JP6738641B2 - Simulation control device and simulation control program - Google Patents

Description

The present invention relates to a simulation control device and a simulation control program using a wearable image display device such as a head mounted display.

A head mounted display (hereinafter referred to as "HMD") is known as a head-mounted image display device that displays an image in front of the user's eyes. For example, the game system disclosed in Patent Document 1 uses a motion sensor (acceleration sensor, gyro sensor) provided in the HMD and a camera for externally capturing the HMD to display an image of the movement of the player's head. Link to give the player a virtual reality feeling as if they entered the game space. This system causes the player to experience that he or she is in eye contact with the game character by changing the high sensitivity parameter of the game character to the player in accordance with the line of sight of the player detected from the movement of the player's head. You can also

JP, 2005-231443, A

In recent years, as in the system of Patent Document 1, the number of games developed by not only the operation of the controller existing in the real space but also the movement of the head is increasing, and when a game in which the player moves in the real space is assumed, It is desirable for the player to maintain a hands-free state for safety in the event of a fall.

Therefore, an object of the present invention is to provide a simulation control device and a simulation control program that can operate as a user interface with high operability by using a wearable image display device.

(1) In order to solve the above problems, the simulation control device of the present invention is
A display processing unit for displaying a virtual space on the wearable image display device;
A measuring unit that determines whether or not the user is visually observing the object arranged in the virtual space, and measures the time when the user visually observes the object,
A receiving unit that accepts the selection of the object when the measurement value obtained by the measurement reaches a first threshold value, and accepts the confirmation of the selection when the measurement value reaches a second threshold value that is larger than the first threshold value. ,
The receiving part is
When a predetermined confirmation action involving the line-of-sight turn-back movement starting from the selected object is detected, the confirmation of the selection is accepted even if the measured value has not reached the second threshold value.

Here, the “line of sight” refers to an area in the virtual space that is considered to be focused by the user's line of sight, and the size and shape of the area can be set appropriately. The movement of the line of sight in the virtual space can be made to follow at least one of the movement of the head of the user in the real space, the movement of the pupil of the user in the real space, and the movement of the visual axis of the user in the real space.

Further, the “folding movement” refers to moving from one position to another position (folding point) and then moving again toward the starting point. The "turnback movement" includes movement that does not completely return from the turning point to the vicinity of the starting point, movement that returns from the turning point to the starting point and passes through the vicinity, and movement that does not completely overlap the forward path and the return path.

The “starting point” is the starting point of movement.

Further, the "outward path" is a portion of the movement path of the turn-back movement, which is located before the turn-back point.

Further, the “return path” is a portion of the movement path of the turn-back movement after the turn-back point.

The "movement starting from the object" is a movement starting from an area where the object is considered to exist.

Therefore, the user can select the object by visually observing until the measured value exceeds the first threshold value. On the contrary, when the user visually checks (glances at) the object within the range not exceeding the first threshold, it is possible to maintain the non-selected state of the object. Further, after the selection of the object, the user can input the confirmation instruction to the simulation control device only by visually observing the object until the measured value reaches the second threshold value. That is, the user can change the state of the object among the three states of “non-selected”, “selected”, and “confirmed” by the action of visually observing the object. Moreover, when the user performs a predetermined confirmation action involving the line-of-sight turn-back movement after selecting an object, the user does not continue to visually check the object until the measured value increases to the second threshold value, but the object is selected. Can be determined. That is, the simulation control device of the present invention can shorten the waiting time of the user from selection to confirmation as necessary.

(2) In the simulation control device of the present invention,
The receiving part is
The reciprocating movement in which at least the time required for the outward trip is within a predetermined time may be detected as the confirmation action.

Therefore, even if the line-of-sight turn-back movement is performed, if the time required for at least the outward path of the turn-back movement is too long, the turn-back movement is not regarded as a confirmation action. Therefore, erroneous detection of the confirmation action can be prevented.

(3) In the simulation control device of the present invention,
The receiving part is
The turn-back movement in which at least the distance required for the outward trip is within a predetermined distance may be detected as the confirmation action.

Therefore, even if the line of sight is turned back, the movement is not considered to be a confirmation action at least when the moving distance before turning back is too long. Therefore, erroneous detection of the confirmation action can be prevented.

(4) In the simulation control device of the present invention,
The receiving part is
The turn-back movement in which the turn-back angle from the forward path to the return path is within a predetermined angle may be detected as the confirmation action.

The "folding angle" is an angle formed by the outward path and the returning path of the folding movement.

Therefore, even if the line-of-sight turn-back movement is performed, if the turn-back angle of the movement path is too large, the turn-back movement is not regarded as the confirmation action. Therefore, erroneous detection of the confirmation action can be prevented.

(5) In the simulation control device of the present invention,
The receiving part is
The turning movement in which at least the shape of the outward path satisfies the straight line condition or the circular arc condition may be detected as the confirmation action.

It should be noted that "movement satisfying a straight line condition" is a move that can be regarded as a straight line, and not only a move in which the move route is a perfect straight line, but also a move route that can be approximated to a straight line with a certain accuracy. It also includes easy movement.

In addition, "movement that satisfies the arc condition" means movement that can be regarded as an arc, and not only the movement of the movement path as a complete arc, but also the movement path with a certain degree of accuracy or less The movement that can be approximated to the curve of is also included.

Therefore, even if the line of sight is turned back, if the shape of the movement path before the turning point cannot be regarded as a straight line or a circular arc, the turning back movement is not regarded as a confirmation action. Therefore, erroneous detection of the confirmation action can be prevented.

(6) The simulation control device of the present invention is
If a turning point of the turning movement is detected, a notification unit may be further provided for notifying the user of the possibility that the fixing action is detected.

Therefore, the user can recognize the possibility that the confirmation action will be detected (that is, the selected object will be confirmed early) by the notice. In addition, the user who receives the notice must timely make a decision to continue the committing action if he/she wants to secure the object lock early and to suspend the committing action if he/she wants to keep the object lock. You can

(7) In the simulation control device of the present invention,
The notification unit further includes
When the confirmation action is detected, the fact may be notified to the user.

Therefore, the user can recognize that the confirmation action is detected (that is, the selected object is confirmed) by the notification.

(8) In the simulation control device of the present invention,
It may further include an execution unit that executes a predetermined process associated with the object when the selection of the object is confirmed.

Therefore, when the selection is confirmed, the predetermined process is automatically executed (however, the timing to be executed may be immediately after the confirmation or after a predetermined time has elapsed from the confirmation). Further, the predetermined processing is, for example, simulation parameter setting processing, object attack processing, object movement processing, processing for other objects, processing for executing a predetermined program, and the like.

(9) The simulation control program of the present invention is
A display processing unit for displaying a virtual space on the wearable image display device;
A measuring unit that determines whether or not the user is visually observing the object arranged in the virtual space, and measures the time when the user visually observes the object,
A receiving unit that receives the selection of the object when the measurement value obtained by the measurement reaches a first threshold value, and accepts the confirmation of the selection when the measurement value reaches a second threshold value that is larger than the first threshold value; Make the computer work,
The receiving part is
When a predetermined confirmation action involving the line-of-sight turn-back movement starting from the selected object is detected, the confirmation of the selection is accepted even if the measured value has not reached the second threshold value.

It should be noted that some or all of the functions of the simulation control device of the present invention can be realized by the server device and the terminal device. It is also possible to record a part or all of the program of the present invention in an information storage medium.

It is a block diagram which shows the schematic structure in one Embodiment of the game system which concerns on this invention. It is a figure for demonstrating the virtual three-dimensional space (simulation space) which can be experienced by the game system of one Embodiment. It is a top view showing the structure of the structure in one embodiment. It is sectional drawing which shows the structure of the structure in one embodiment. It is a perspective view and a side view showing composition of HMD used for a game system of one embodiment. It is a block diagram which shows the block configuration of the simulation control apparatus in one embodiment. It is a figure which shows an example of the movement object which is an effect object and effect device of one embodiment. It is a flowchart (the 1) which shows operation|movement of the game system in one Embodiment. It is a flowchart (the 2) which shows operation|movement of the game system in one Embodiment. The figure explaining the relationship between virtual three-dimensional space, the visual recognition area of player P, and the space seen by player P (example where a visual recognition area is located in the center of virtual three-dimensional space). The figure explaining the relationship between a virtual three-dimensional space, the visual recognition area of the player P, and the space seen by the player P (the visual recognition area is located in the upper left of the virtual three-dimensional space). The figure explaining the relationship between a hit area and a visual recognition area. The figure explaining the relationship between the elapsed time from the start of visual observation and the charge amount of visual observation time. The figure explaining the example of the visual effect of an object. The figure explaining another example of the visual effect of an object. The figure explaining the control processing of lock strength. The figure explaining the relationship between hit area OBHA, visual recognition area LSA, and viewpoint LSA'. The figure which shows the example of the movement pattern of viewpoint LSA' by the action for determination. The figure which shows the example of the movement pattern of viewpoint LSA' which does not satisfy a distance condition. The figure which shows the example of the movement pattern of viewpoint LSA' which does not satisfy an angle condition. The figure which shows the example of the movement pattern of viewpoint LSA' which does not satisfy|fill a linear condition or a circular arc condition. The figure which shows the example of the movement pattern of viewpoint LSA' which does not satisfy a return condition. An example of a case where the advance notice to the player P is given by the state of the arrow mark and the neon mark row. The flowchart of an eye input acceptance process. The flowchart of control processing of lock strength. The flowchart of speed-up processing. The figure explaining the example of application of eye input (the 1). The figure explaining the example of application of eye input (the 2). The figure explaining another example which emphasizes an object. The figure explaining another example of the visual effect of an object.

Hereinafter, embodiments will be described. It should be noted that the embodiments described below do not unduly limit the content of the invention described in the claims. Moreover, not all of the configurations described in the present embodiment are indispensable components of the invention. Further, in the following embodiments, a virtual three-dimensional space is associated with a user's movement in a space (that is, a real space) in a structure that is predetermined by using an HMD (head mounted display) as a wearable image display device. It is an embodiment in which the simulation control device according to the present invention is applied to a game system that provides a game by simulating.

1. Outline of Game System First, an outline of the game system 1 of the present embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a configuration diagram showing an outline configuration of the game system 1 of the present embodiment, FIG. 2 is a diagram for explaining a virtual three-dimensional space (hereinafter, also referred to as “simulation space”) that can be experienced by the game system 1 of the present embodiment.

The game system 1 of the present embodiment has, as its main components, a structure 10 in which a real space (hereinafter, simply referred to as “real space”) in which a player P (an example of a user) can move is formed, and the player P. And an HMD 20 that displays a simulation image of a virtual three-dimensional space (that is, a simulation space) that is attached to a real space.

Specifically, the game system 1 of the present embodiment generates a simulation image seen by the player P in the simulation space corresponding to the real space in the real space, and shows the player P the various environments and situations in the pseudo space. It is a simulator that makes you experience.

In particular, the game system 1 of this embodiment is
(1) Detecting a player state indicating the state of the player P in the real space (specifically, the position and posture of the player in the real space),
(2) According to the detected player state, for example, a simulation that has a virtual travel route associated with the travel route R as shown in FIG. 2 and that can be seen by the player P in the simulation space corresponding to the real space. Perform the image generation process to generate the image,
(3) Display the generated simulation image on the HMD 20,
(4) When the player state on the movement route R satisfies a given condition, it is determined that the player P is a specific state in the simulation space,
(5) When it is determined that the particular state is present, a simulation image for executing an effect based on the particular state is generated.
Have a configuration.

Then, the game system 1 of the present embodiment includes the suspension unit 30 that suspends the HMD 20 from the structure 10, and suspends the HMD 20 independently of the player P, so that the player P moves in the real space. When the HMD 20 follows the movement of the player P while moving or when a predetermined part (for example, the head) of the player P moves, the HMD 20 falls down against the intention of the player P. Also has a configuration capable of maintaining attachment of the HMD 20 to the player P or preventing the HMD 20 from dropping due to attachment/detachment.

In addition to the structure 10, the HMD 20, and the suspension unit 30, the game system according to the present embodiment, as shown in FIG.
(1) A fall prevention unit 40 for preventing a player P moving in the real space from falling over,
(2) The suspension position of the HMD 20 in the suspension unit 30 is changed according to the movement of the player P in the real space, and the suspension position of the player P is changed according to the movement of the player P in the real space. Control unit 50 to change the
(3) The marker unit 60 attached to a predetermined part (for example, the head, both hands and both feet) of the player P, and the real space while detecting the direction and position of each part by detecting the marker unit 60. An image pickup camera 70 for detecting the state of the player P in the inside as a player state;
(4) Various production devices 90 to 93 and a production object 80 which are arranged in the real space and allow the player P to experience a given production by interlocking with the simulation image.
(5) A simulation image of a simulation space, which is a virtual three-dimensional space associated with the real space and is viewed from the player P, is generated, and the corresponding rendering device is linked with the simulation image according to the detected player state. A simulation control device 100 for controlling 90 to 93;
Equipped with.

With such a configuration, the game system 1 of the present embodiment can cause the player P to experience the specific state as a simulation when the player P is in the specific state while interlocking with the state of the player P. Precisely understand the environment or situation that the player P should experience, especially the environment or situation where it is difficult to actually experience, such as the environment to move to a high place or the moving situation including the situation of falling when the player P deviates from the movement route R. It can be reproduced.

For example, not only in a high place, but also in a closed place, a special space, a dangerous place such as a hot place or a cold place, or an environment or situation in a space that is difficult to experience in reality, a specific state or a specific state according to the state of the player P. It can be reproduced as an environment that creates a state.

Therefore, the game system 1 of the present embodiment can improve the reproducibility of any place or space including a dangerous place or a space that is difficult to experience in reality. The player P can be made to experience a realistic feeling.

Further, since the game system 1 of the present embodiment can suspend the HMD 20 independently of the player P, the player P moves in the real space or a predetermined part of the player P ( For example, when the HMD 20 moves in the front-back direction, the left-right direction, and the up-down direction due to movement of the head), even if the player P loses balance and falls against the intention of the player P, The player P can be kept attached or can be prevented from falling due to attachment/detachment.

Therefore, in the game system 1 of the present embodiment, an injury caused by a fall of the player P while the HMD 20 is mounted, or a floor surface or a wall surface when the HMD 20 is detached against the player P's intention. It is possible to prevent an unforeseen situation such as a collision with the vehicle and a resulting damage or failure of a part of the HMD 20.

As a result, in the game system 1 of the present embodiment, if the suspension position of the HMD 20 can be changed with the movement of the player P by the rails, arms, or the like, for example, the HMD 20 is always in a suitable position such as suspended from above. Since it is possible to suspend the robot and respond to movements and movements in all directions, while ensuring the safety of the player P who wears the HMD 20 and moves in the real space, other damages during the simulation of the player P can be achieved. In addition, it is possible to prevent an unexpected situation including damage or failure of the HMD 20.

For example, when the image is supplied to the HMD 20 and its control is performed by wire, such as when it is provided with high resolution, wiring for connecting to the control device that controls the HMD 20 via the suspension unit 30 is arranged. Since the wiring can be provided, it is possible to eliminate the restriction of movement of the player P and the discomfort caused by the wiring being present beside or under the player P.

That is, by having the above-described configuration, the game system 1 of the present embodiment ensures smooth movement and safety in the real space of the player P on which the HMD 20 is mounted, and prevents unexpected damage such as injury to the player P. The situation can be avoided.

In addition, in the present embodiment, the following description will be given by using a game that simulates a fear experience in a high place (hereinafter, referred to as “a height fear experience game”).

2. Game system configuration 2-1. Structure Next, the structure 10 in the game system 1 of the present embodiment will be described with reference to FIGS. 3 and 4 together with FIG. 1 described above. 3 is a plan view showing the structure of the structure 10 in the present embodiment, and FIG. 4 is a sectional view showing the structure of the structure 10 in the present embodiment.

The structure 10 is a casing in which a real space in which the player P is movable and in which the game is executed is formed, and, for example, as shown in FIG. 1 and FIGS. Also, it has a rectangular parallelepiped box-shaped structure formed by the floor 16 and walls 17 covering the four sides thereof.

The structure 10 has a waiting area 11 in which the player P, who is the player P, waits for the start of an experiential game, and a play area 12 in which the experiential game is executed. In particular, the play area 12 is a start zone 13 in which the player P exists at the start of the game, and a zone where the player P actually moves to experience a predetermined environment and situation. And a travel experience zone 14 in which a travel route R in which the existence of the above is permitted is formed.

On the ceiling 15, from the standby area 11 to the play area 12, and along the movement route R in the movement experience zone 14, the suspension unit 30 that suspends the HMD 20 and the fall prevention that prevents the player P from overturning. A plurality of suspension control units 50 to which the unit 40 is slidably attached are formed.

Then, each suspension control unit 50 is provided with the simulation control device 100 in the corresponding movement route.

Further, on the ceiling 15, a plurality of imaging cameras 70 used for detecting the player state of the player P and the state of the effect object 80 are arranged at predetermined positions. The player state of the player P includes, for example, the position and orientation (posture) of the head of the player P.

The floor 16 has a different structure for each of the standby area 11 and the play area 12, and for each of the start zone 13 and the movement experience zone 14.

Specifically, in the start zone 13 of the play area 12, a panel (that is, a spring floor panel) 92 that incorporates a spring that creates an environment in which the elevator moves up and down is provided as one of the production means.

In the movement experience zone 14 of the play area 12, the movement of the player P is prohibited, along with the movement route R formed of a metal or other predetermined member (the movement route member 93 described later) for the player P to walk. And a non-moving route NR including a mat that protects the player P when the player P falls over.

Further, the start zone 13 of the present embodiment has a structure for providing it as a virtual three-dimensional space of the indoor space of the elevator, and at the boundary between the start zone 13 and the movement experience zone 14, a simulation is performed as a production device. An automatic door 91 that functions as an elevator door whose opening and closing is controlled by the control of the control device 100 is provided.

In particular, the effect object 80 is arranged on the movement route R (specifically, the end point of the movement route member 93). Further, on the non-moving route NR, an effect device such as the blower 90 may be formed as necessary, and a sensor unit such as a contact sensor may be formed as necessary.

The wall 17 is formed of a predetermined wall panel or a mat that protects the player P from injury due to a collision by the player P.

2-2. HMD and Suspending Unit Next, the HMD 20 used in the game system of the present embodiment and the suspending unit 30 suspending the HMD 20 will be described with reference to FIG.

Note that FIG. 5 is an example of a perspective view and a side view showing the configuration of the HMD 20 used in the game system of the present embodiment. Further, for example, the HMD 20 of the present embodiment constitutes the wearable image display device of the present invention.

The HMD 20 is a wearable display device that displays an image of a non-transparent virtual three-dimensional space attached to the head of the player P under the control of the simulation control device 100, and shows the appearance of the outside world outside the display device. It is a display device that allows the player P to experience visually the augmented reality by visually recognizing only the image that is made unrecognizable and displayed on the player P.

For example, as shown in FIGS. 4 and 5, the HMD 20 has a structure that completely covers (that is, masks) both eyes of the player P, and is linked to the detected player state while It has a configuration for visually recognizing a simulation image of a simulation space that is seen from P and is associated with the real space in the structure 10.

A marker unit (hereinafter, referred to as “head detecting marker unit”) 60a for detecting the direction and position of the head of the player P is formed on the upper part of the HMD 20. The HMD 20 has, for example, a display size of 200×1080 pixels and a refresh rate of 90 fPS.

The HMD 20 has a headphone jack (not shown), and the headphone 61 is connected to the headphone jack. Then, the headphones 61 are attached to the player P together with the HMD 20. Further, to the headphones 61, the environmental sound that forms the stereophonic sound in the simulation space generated by the simulation control device 100 is output.

The suspension unit 30 is suspended above the HMD 20 and the player P, for example, the suspension control unit 50 disposed on the ceiling 15 of the structure 10 to suspend the HMD 20 while being suspended from the structure 10. It has a configuration of hanging.

In particular, the suspension unit 30 of the present embodiment suspends the HMD 20 above the structure 10 (that is, the ceiling 15) in order to suspend the play area 12 in response to movements and movements of the player P in all directions. Therefore, it is formed above the player P's head.

The suspension unit 30 has wiring (hereinafter, referred to as “cable”) for connecting the HMD 20 and the simulation control device 100 by wire.

Specifically, the suspension unit 30 has, for example, as shown in FIGS. 4 and 5, a connection member 31 used for connection with the suspension control unit 50 and a shape for attaching to the connection member 31. A cord-shaped member (that is, a cable) 32 having a formed end (hereinafter, referred to as “first end”), a second end different from the first end of the cord-shaped member 32, and the HMD 20 are connected. And a connecting member 33 for connecting.

In particular, the string-shaped member 32 prevents the HMD 20 from being grounded on the floor surface of the structure 10 when the HMD 20 is attached to or detached from the player P due to the player P moving largely such as when the player P tends to fall. It has a structure that enables

Specifically, the string-shaped member 32 is expandable and contractable, and is configured by a cable that transfers a predetermined signal or data transmitted from the simulation control device to the HMD 20.

For example, when the HMD 20 is attached to or detached from the player P, the string-like member 32 has a structure that prevents the HMD 20 from grounding to the floor surface of the structure 10 when the HMD 20 is attached to or detached from the player P. The floor of the structure 10 has a length that does not touch the ground, that the cord-shaped member has a spiral shape that can expand and contract, or that the cable is used to adjust the length of the cord-shaped member. It has a structure for winding up.

Note that the HMD 20 of the present embodiment is not limited to these, and may be any one that is attached to the player P and displays an image that can be visually recognized by the player P. If the simulation can be accurately performed, the transmissive HMD 20 can be used. May be

Further, when the HMD 20 and the simulation control device 100 transfer signals or data by wireless communication, the string-shaped member 32 does not need to be a cable, and may be the string itself of a predetermined material, It may be a wide band-shaped member such as a band.

Further, in a part of the suspension unit 30, specifically, the connecting member 31 and the string-shaped member 32 are members common to the fall prevention unit 40 as described later.

2-3. Fall Prevention Unit Next, the fall prevention unit 40 in the game system of this embodiment will be described with reference to FIG.
Will be described.

When the player P loses the balance due to the wearing of the HMD 20, the walkable movement route R being narrow, or both, the fall prevention unit 40 loses the balance and the player P intends. It is used to support the player P and prevent the player P from falling when the player P falls over.

That is, the fall prevention unit 40 not only prevents the damage of the HMD 20 and the injury of the player P due to the damage of the player P when the player P loses the balance, but also the player P caused by the HMD 20 being worn during the playing of the game. It also has a configuration capable of preventing a fall (such as a fall due to loss of balance during movement).

Specifically, the overturn prevention unit 40 has, for example, as shown in FIG. 4 above, a holder member 41 for holding the player P and a suspending member for suspending the player P from the structure 10. The suspension member is composed of the members of the suspension unit 30, that is, the connecting member 31 and the string-shaped member 32.

The holder member is made of, for example, a vest type outerwear having no sleeve portion, and holds the state of the player P by being worn by the player P during play. The holder member 41 is connected to one end of the string-shaped member 32, and has a configuration of supporting the body of the player P via the connecting member 31 formed on the ceiling 15 of the structure 10.

2-4. Suspension Control Unit Next, the suspension control unit 50 in the game system of this embodiment will be described with reference to FIGS. 1, 3, and 4 described above.

The suspension control unit 50 of the present embodiment is a unit for changing the suspension position of the player P itself and the HMD 20 according to the movement of the player P in the real space in the structure 10, and is always upward (that is, It has a configuration in which the HMD 20 and the player P are suspended from the ceiling of the structure 10.

Then, the suspension control unit 50 has a configuration capable of suspending the HMD 20 and the player P at a suitable position in the real space, and responding to the movement and movement of the player P in the movement direction. It is possible to prevent the unexpected situation including the injury during the simulation of the player P, the damage and the failure of the HMD 20 while ensuring the safety of.

Therefore, in the suspension control unit 50, even when the player P freely moves in the real space, the cable that supplies signals and data to the HMD 20 and the member that holds the player P are placed on the side and the feet of the player P. It is possible to appropriately eliminate the restriction and discomfort of the movement of the player P due to the existence thereof, and to hang the HMD 20 and the player P at all times even with respect to the movement and movement of the player P. It has become.

Specifically, the suspension control unit 50 is integrally configured from the standby area 11 to the play area 12, and prevents the player P moving in the real space or the player P whose posture changes from the HMD 20 and the fall prevention. The unit 40 is configured to follow.

For example, as shown in FIGS. 1, 3 and 4, the suspension control unit 50 of the present embodiment is provided for each player P moving in the real space, and the waiting area 11 (more specifically, the HMD 20 and the fall) From the position where the prevention unit 40 is attached) to the play area 12, the player P
Is formed by a rail 51 formed along the moving direction of the movement, and a sliding member 52 that is connected to the connecting member 31 of the suspension unit 30 and slides on the rail 51.

In particular, each rail 51 is on the moving route R in the moving experience zone 14 in which the player P moves along the moving route R (that is, the zone in which the player P moves linearly back and forth). It is formed on the ceiling.

In addition, in each of the other areas in the real space, each rail 51 is a path guided by the player P after the HMD 20 and the fall prevention unit 40 are prepared to be mounted or when performing a simulation such as guidance to the start position (hereinafter, referred to as a guide path). , "Guide path") is formed by a rail 51 formed along S.

The rail 51 is not limited in shape and material as long as the position of the suspension unit 30 can be changed according to the movement of the player P.

The sliding member 52 slides on the rail 51 according to the tension generated according to the state of the player P such as the movement and the posture change of the player P, and the hanging position of the HMD 20 and the player P via the hanging unit 30. To change.

In addition, as shown in FIGS. 1, 3 and 4, the sliding member 52 shortens the length of the cable that electrically connects the HMD 20 and the simulation control device 100 to accurately transfer signals and data. In order to carry out the present invention, the simulation control device 100 has a fixed structure, and the simulation control device 100 is configured to slide integrally.

The sliding member 52 is a member for sliding on the rail 51 and changing the positions of the HMD 20 and the HMD 20 via the suspension unit 30 according to the state of the player P such as the movement and the change of the posture of the player P. If it is, it will not be specifically limited.

2-5. Simulation Control Device Next, the simulation control device 100 in the game system of the present embodiment will be described with reference to FIG.

6. FIG. 6 is a block diagram showing the block configuration of the simulation control device 100 in this embodiment. Furthermore, the simulation control device 100 of the present embodiment is not limited to the configuration of FIG. 8, and various modifications such as omission of some of the components and addition of other components are possible.

The simulation control device 100 is composed of, for example, a device capable of controlling a computer such as a personal computer, and an operation unit (not shown) such as a keyboard operated by an administrator is detachably configured.

In addition, since the simulation control device 100 provides the player P with a simulation space, when the game is started, the image is displayed in accordance with the progress state of the game while the game is being progressed in accordance with the player state and the elapsed time. And controlling the effect devices 90 to 93 in conjunction with the effect control device.

In particular, the simulation control device 100 acquires the image output from the imaging camera 70, detects the marker in the marker unit 60 from the acquired image, and detects the area to which the marker belongs and the positional relationship with other markers and the marker. The player state is detected based on the stay time in the area to which the player belongs.

Specifically, the simulation control device 100 includes a storage unit 170 that stores various data, an information storage medium 180 that stores data such as an application for executing a simulation, a game execution, and a simulation by the game. The communication unit 196 includes a processing unit 101 (an example of a computer) that executes various types of processing for creating a working environment.

The storage unit 170 serves as a work area for the processing unit 101 and communication, and its function can be realized by a RAM (DRAM, VRAM) or the like. In particular, the storage unit 170 of the present embodiment mainly has a main storage unit 172 in which a game program is recorded, an image buffer 174, and a data buffer 176.

The main storage unit 172 mainly stores a game program (an example of a simulation control program). Further, the data buffer 176 is a storage area for storing game data of its own device, and may be provided, for example, in a part of the main memory and read/write controlled by software.

The game program is software in which instruction codes for executing game processing are written. Further, the game data is data for determining a specific state of the player, data necessary for executing the game program, data of the object for production 80, control programs of various production devices 90 to 93, and the like. Is.

The information storage medium 180 (computer-readable medium) stores programs and data, and its function is an optical disk (CD, DVD), HDD (hard disk drive), memory (ROM, etc.), etc. Can be realized by

The processing unit 101 performs various processes of this embodiment based on a program (data) stored in the information storage medium 180. That is, the information storage medium 180 has a program for causing a computer (a device including an operation unit, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment (a program for causing the computer to execute the process of each unit). ) Is stored.

The communication unit 196 communicates with the HMD 20 via a cable, and also communicates with the imaging camera 70 and the rendering devices 90 to 93 via a wired or wireless network. , Communication ASIC or communication processor, and communication firmware.

A program (data) for causing a computer to function as each unit of this embodiment is stored in an information storage medium 180 (or a storage unit) via an information storage medium included in a host device (server system) (not shown) via the network and the communication unit 196. Part 170). The use of the information storage medium by such a host device can also be included in the scope of the present invention.

The processing unit 101 (processor), based on the timing from the start of the game, the image data output from the imaging camera 70 (hereinafter referred to as “image data”), the program, and the like, the game calculation process, the image generation process, and the sound. The generation process and the effect control process are performed.

The processing unit 101 performs various processes using the storage unit 170 as a work area. The function of the processing unit 101 can be realized by hardware such as various processors (CPU, GPU, etc.), ASIC (gate array, etc.) and programs.

The processing unit 101 includes a game calculation unit 110, an object space setting unit 111, a state detection processing unit 112, a movement/motion processing unit 113, an effect control processing unit 114, a communication control unit 120, an image generation unit 130, and a sound generation unit 140. Including. A part of these may be omitted.

The game calculation unit 110 starts the game when the game start condition is satisfied, advances the game, and arranges objects (including the effect object 80) necessary for forming the simulation space. , A process of displaying an object, a process of ending the game when a game end condition is satisfied, and a process of determining whether or not the player state is a specific state (specifically, a state corresponding to the advance of the game). There is a determination process and the like.

In particular, the game calculation unit 110 according to the present embodiment, the viewing direction and the viewing area of the player P according to the detected player state (specifically, the position of the player P in the real space and the posture of the player P). (Hereinafter, referred to as “visual recognition area”) is detected, and a space viewed from the player P in the three-dimensional space is set according to the detected visual recognition direction, visual recognition area, current game environment and progress status of the game.

Further, the game calculation unit 110 determines whether or not the game ending condition is satisfied according to the detected player state or based on a predetermined elapsed time from the game start, and the game ending condition is determined. If it is determined that is satisfied, the game ends.

On the other hand, the game calculation section 110 determines, based on the data stored in advance in the data buffer 176, whether or not the player P has reached a specific state corresponding to the progress of the game in accordance with the detected player state, According to the result, the game is advanced, and the effect control processing unit 114, the image generation unit 130, and the sound generation unit 140 are instructed to perform the corresponding effects.

The object space setting unit 111 includes various objects (polygon, free-form surface, subdivision surface, or the like) for constructing a predetermined simulation space such as the rendering object 80, building, moving route R, pillar, wall, map (terrain). Processing for arranging and setting an object composed of primitives) in an object space (that is, a virtual three-dimensional space) is performed.

That is, the position and rotation angle (synonymous with direction and direction) of the object in the world coordinate system are determined, and the rotation angle (rotation angle around the X, Y, and Z axes) is determined at that position (X, Y, Z). Place the object with.

In particular, in the present embodiment, as the effect object 80, a movable object that appears in the simulation space such as an animal (hereinafter, referred to as “effect moving object”) and an object fixed in the simulation space. The object space setting unit 111 includes these objects for realization in the real space for the player P to recognize (hereinafter, referred to as “fixed object for effect”), and these object 80 for effect are set in the simulation space. Deploy.

In the present embodiment, the rendering moving object is an object that is imaged as an object that actually moves in the real space and also moves in the simulation space (hereinafter referred to as “intrinsic moving object”). In addition, an object that does not move in the real space but moves only in the simulation space when imaged (hereinafter, referred to as “pseudo moving object”) is also included.

The state detection processing unit 112 has both hands and both feet of the player P at the same timing in the image of the player P (hereinafter, referred to as “player image”) output from each of the plurality of imaging cameras 70 that image the player P. The position of the marker unit 60 arranged on the upper part of the HMD 20 is specified.

Then, the state detection processing unit 112 determines the position of each marker unit 60 in each identified image, the positional relationship between each marker unit 60 and another marker unit 60, and the stay at each position of each marker unit 60. The player state indicating the position and orientation of the player P in the real space is detected based on each time information.

In particular, a plurality of areas within a predetermined real space are set for the image output for each imaging camera 70, and the state detection processing unit 112 determines to which area each marker unit 60 belongs. By detecting the position of the marker unit 60 included in each player P image at the same timing, the position of each marker unit 60 in the real space is detected for each image frame.

Further, the state detection processing unit 112 detects the position of each marker unit 60 in the real space for each frame, compares it with the position of each marker unit 60 of the previous frame, and determines the same position in a plurality of frames. The staying time at the same position of each marker unit 60 is detected based on the number of frames in each marker unit 60 detected as existing.

Then, the state detection processing unit 112 detects the posture of the player P in the real space based on the positions of the respective marker units 60 in the real space at the same timing and the stay time of the respective marker units 60 until then. ..

For example, the state detection processing unit 112 of the present embodiment is
(1) Based on the information of at least one part of the position, height and time of a given part of the player P such as the head, both hands or both feet (hereinafter referred to as “part information”), the actual result of the player P. The position in the space (that is, the coordinates of the center position (center of gravity position) of the player P in the real space) is specified,
(2) Based on the part information of the player P, specify the posture of the player P constructed from the positional relationship of each part of the player P such as the head, torso, and limbs, or
(3) Identify both (1) and (2),
The player state is detected based on the position, the posture, or both of the player P.

Then, the state detection processing unit 112
(A) Detecting the viewpoint position and the direction of the player P in the real space based on the position of the head of the player P,
(B) Detecting the standing position and posture of the player P in the real space based on the position of the hand or foot of the player P, and
(C) Modeling the player P based on the detected standing position and posture of the player P (formation of bones)
Execute.

Note that, for example, the part of the user includes the head, hand, or foot of the user, and the part information includes the position (position coordinates in the user movement space), direction, and shape (planar shape or three-dimensional shape) of each part. ) Or color (including gray scale).

On the other hand, as with the player P, the state detection processing unit 112 specifies the position of the marker unit 60 arranged in the effect moving object in the real space as in the player P, and determines the position of the marker unit 60. Based on the position in the real space, the position (the position of the center or the center of gravity) of the effect moving object in the real space and, if necessary, its state are detected.

The movement/motion processing unit 113 calculates the positional relationship between the player P and the effect object 80 based on the detected player state, the current game environment, the game progress state, or two or more of these pieces of information, and A movement/motion calculation (movement/motion simulation) of the effect object 80 is performed based on the calculated positional relationship between the player P and the effect object 80.

That is, the movement/motion processing unit 113 performs various processes of moving various objects in the object space and moving the objects (motion, animation) based on the detected player state and the like.

Specifically, the movement/motion processing unit 113 stores movement information (position, rotation angle, speed, or acceleration) and movement information (position or rotation angle of each part forming the object) of various objects. A simulation process is sequentially performed for each frame (1/60 seconds).

The frame is a unit of time for performing object movement/motion processing (simulation processing) and image generation processing.

Further, the movement/motion processing unit 113, for the effect moving object, the position in the real space, the positional relationship with the player P in the actual space, the state of the effect moving object (the moving direction of the effect moving object). (Or its posture), the current game environment and the progress of the game, and movement information and motion information in the simulation space are calculated.

In particular, the movement/motion processing unit 113 interlocks with the position or state of the real space or seamlessly moves with respect to the position or state of the real space, for the pseudo moving object of the staging moving object, depending on the user state. Then, the movement information and the movement information in the simulation space are calculated based on the position, the state, or both of the pseudo moving object in the real space so that the pseudo moving object can be imaged.

For example, when the pseudo moving object is an animal object such as a cat, the movement/motion processing unit 113 moves at a position different from the position where the pseudo moving object is arranged in the real space, or , Moving around in different areas, returning to the position where the pseudo moving object is arranged in the real space at a predetermined timing, and calculating movement information and motion information to be in a state similar to the state in which it is arranged in the real space. I do.

Further, in such a case, although the movement/motion processing unit 113 images the pseudo-moving object at a position where the pseudo-moving object is arranged in the real space, the movement/motion processing unit 113 moves to image the movement such as its posture or gesture. Calculates information and motion information.

More specifically, the movement/motion processing unit 113
(1) Even when a cat object as a pseudo moving object is placed at the end of the movement route R in the real space at the start of the game, the cat object moves around the player P in a pseudo motion. ,
(2) When the player P travels a certain distance toward the end point of the movement route R, the cat object moves to the position arranged in the real space, and the state in the real space becomes Pseudo-motion from the same pseudo-motion to real-state (3) Pseudo-motion that does not change in real space such as various gestures when the player P holds a cat object
(4) When the player P releases the cat object from the held state, when the cat object falls, the operation is linked to the movement in the real space,
The movement information and motion information for imaging the image are calculated.

The effect control processing unit 114 executes processing for controlling various effect devices 90 to 93 according to the player state (including a specific state), the state of the effect moving object, the current game environment, and the progress status of the game. To do. Specifically, the effect control processing unit 114 executes control based on ON/OFF of the power sources of the effect devices 90 to 93, change of the ability, or a preset program.

For example, the effect control processing unit 114, when the effect devices 90 to 93 are the blowers 90, drive control and stop control including the intensity of the air blowing, and when the effect devices 90 to 93 are temperature adjusting devices, adjust the temperature, When the rendering devices 90 to 93 are the moving route R, the rendering devices 90 to which the swing unit installed in the moving route R or the control of the vibrating unit needs to be changed according to the state of the player P. Control 93.

The communication control unit 120 performs a process of generating data to be transmitted to the HMD 20 (mainly image data for showing the simulation space to the player P). Moreover, the communication control part 120 transmits/receives the control signal for controlling each rendering device 90-93.

The image generation unit 130 performs drawing processing based on various types of information such as a result of various processing (game processing) performed by the processing unit 101 and a player state (including a specific state), and thereby an image (especially a simulation). An image for showing the space to the player P) is generated and output to the HMD 20 via the communication control unit 120.

In particular, the image generation unit 130 first acquires object data (model data) including vertex data (vertex position coordinates, texture coordinates, color data, normal vector or α value) of each vertex of the object (model). The vertex processing (shading by the vertex shader) is executed based on the vertex data included in the acquired object data (model data).

Note that the image generation unit 130 may perform vertex generation processing (tessellation, curved surface division, polygon division) for redistributing the polygon as necessary when performing the vertex processing.

Further, the image generation unit 130 performs vertex movement processing, coordinate conversion (world coordinate conversion, camera coordinate conversion), clipping processing, according to the vertex processing program (vertex shader program, first shader program) as the vertex processing. Alternatively, geometry processing such as perspective transformation is executed, and based on the processing result, the vertex data given for the vertex group forming the object is changed (updated, adjusted).

Then, the image generation unit 130 performs rasterization (scan conversion) based on the vertex data after the vertex processing, and associates the surface of the polygon (primitive) with the pixel.

On the other hand, after the rasterization, the image generation unit 130 executes pixel processing (shading by a pixel shader, fragment processing) that draws pixels that form an image (fragments that form a display screen).

In particular, in pixel processing, the image generation unit 130 performs texture reading (texture mapping), color data setting/change, semi-transparent composition, anti-aliasing, etc. according to a pixel processing program (pixel shader program, second shader program). Various processes are performed to determine the final drawing color of the pixels forming the image, and the drawing color of the perspective-transformed object is stored in the storage unit 170 (a buffer that can store image information in pixel units, VRAM, rendering target). Output (draw).

Further, in the pixel processing, the image generation unit 130 performs the per-pixel processing of setting or changing the image information (color, normal line, brightness, α value, etc.) in pixel units. As a result, an image seen by the player P in the object space is generated.

Further, the image generation unit 130 performs hardware such as a programmable shader (vertex shader or pixel shader) that makes polygon (primitive) drawing processing programmable by a shader program described in a shading language for vertex processing and pixel processing. Realized by.

In addition, the programmable shader has a high degree of freedom in the drawing processing contents by allowing the processing for each vertex and the processing for each pixel to be programmable, greatly improving the expressive power compared to the conventional fixed drawing processing by hardware. Can be made.

On the other hand, the image generation unit 130 performs geometry processing, texture mapping, hidden surface removal processing, α blending, etc. when drawing an object.

In particular, as the geometry processing, the image generation unit 130 executes processing such as coordinate conversion, clipping processing, perspective projection conversion, or light source calculation on the object.

Then, the image generation unit 130 stores the object data (positional coordinates of object vertices, texture coordinates, color data (luminance data), normal vector, or α value) after the geometry processing (after perspective projection conversion). It is stored in the unit 170.

Further, the image generation unit 130 executes texture mapping, which is a process for mapping the texture (texel value) stored in the storage unit 170 onto the object. Specifically, the image generation unit 130 reads the texture (surface properties such as color (RGB) and α value) from the storage unit 170 using the texture coordinates set (applied) to the vertices of the object.

Then, the image generation unit 130 maps the texture, which is a two-dimensional image, on the object. In this case, the image generation unit 130 performs processing for associating pixels with texels and bilinear interpolation as interpolation of texels.

Further, the image generation unit 130 performs the hidden surface removal processing by the hidden Z-buffer method (depth comparison method, Z test) using the Z buffer (depth buffer) to which the Z value (depth information) of the drawing pixel is input. Perform surface erasing processing.

That is, the image generation unit 130 refers to the Z value input to the Z buffer when drawing the drawing pixel corresponding to the primitive of the object. Then, the Z value of the referenced Z buffer is compared with the Z value of the drawing pixel of the primitive, and the Z value of the drawing pixel is the Z value on the front side from the player P (for example, a small Z value). In some cases, the drawing process of the drawing pixel is performed and the Z value of the Z buffer is updated to a new Z value.

Then, the image generating unit 130 executes the α blending (α blending) of the translucent synthesizing process (normal α blending, addition α blending, subtraction α blending, etc.) based on the α value (A value).

The α value is information that can be stored in association with each pixel (texel, dot), and is, for example, positive alpha information other than color information. The α value can be output as mask information, semi-transparency (equivalent to transparency and opacity), bump information, and the like.

The sound generation unit 140 performs sound processing based on the results of various processes performed by the processing unit 101 such as the player state (including a specific state), and game sounds such as BGM, sound effects, and voice (in the simulation space). Environmental sound as stereophonic sound) is generated and output to the headphones 61 via the HMD 20.

2-6. Player Marker Unit and Imaging Camera Next, the player marker unit 60 and the imaging camera 70 in the game system according to the present embodiment will be described with reference to FIGS. 1 and 4.

In the present embodiment, as described above, in order to detect the player state, each player P is provided with the marker unit 60 at a plurality of parts. Specifically, the marker unit 60 of the present embodiment is arranged at a plurality of parts of the head, both hands, and both feet, as shown in FIGS. 1 and 4 above.

In particular, each marker unit 60 is formed of a material such as a reflection sheet whose surface is reflected, and is also formed of a ball field marker. For example, each marker unit 60 has a configuration in which, when irradiated with light, the marker unit 60 reflects the light and shines white or shines in a specific color.

Specifically, each marker unit 60 includes a head detecting marker unit 60a, a right hand or left hand detecting marker unit 60b, and a right foot or left foot detecting marker unit 60c.

A light source unit (not shown) that irradiates each marker unit 60 with light is provided in the movement experience area in the structure 10 of the present embodiment.

The color of the marker unit 60 glowing is not particularly limited, but when a plurality of players P are simultaneously present in the moving experience area, the color may be changed for each player P, or the marker unit 60 is attached. The glowing color of the marker unit 60 may be changed for each part.

For example, as shown in FIG. 1, each of the imaging cameras 70 is fixedly arranged at a preset position in the structure 10, and an imaged area within the angle of view is imaged to simulate its image data. The data is sequentially output to the control device 100.

In particular, each imaging camera 70 of the present embodiment is formed outside the moving range (specifically, the moving route R) in which the player P moves in the real space.

Then, each imaging camera 70 is arranged so as to image the play area 12, move into the play area 12, change the posture, or image all the players P who carry out both of them. There is.

Further, each of the image pickup cameras 70 of the present embodiment includes a predetermined image pickup device such as a CCD and a lens having a predetermined focal length, and defines an area within the view angle according to a predetermined angle of view and focal length. It is imaged and the imaged image data is sequentially output to the simulation control device 100.

If the player P can move freely within the play area 12, it is necessary to image the entire play area 12, and the respective imaging cameras 70 are arranged so that there is no omission in the play area 12. Is set up.

Further, each imaging camera 70 is required to use a color camera in order to detect the colored marker unit 60.

Further, the number and the arrangement position of the marker units 60 are not limited to the above. Basically, the number arrangement position is not limited as long as it can be picked up by the image pickup camera 70.

2-7. Rendering Object and Rendering Device Next, the rendering object 80 and rendering devices 90 to 93 in the game system according to the present embodiment will be described with reference to FIGS. 1, 3, 4 and 7 described above. FIG. 7 is a diagram showing an example of the movement path member 93 which is the effect device of the present embodiment.

The rendering object 80 and the rendering devices 90 to 93 of the present embodiment are arranged in the real space formed in the structure 10 and are linked to the simulation image under the control of the simulation controller 100. The player P is configured to experience a given effect.

In particular, the performance object 80 and the performance devices 90 to 93 are not only outdoor spaces or indoor spaces, but also high space, closed spaces, dangerous spaces, special spaces, simulation spaces such as hot or cold spaces. It is an object for use or a rendering device, and is used for providing a realistic simulation by creating a realistic situation in which the player P is looking through the simulation in conjunction with the simulation image.

Specifically, the effect object 80 of the present embodiment includes the effect moving object and the effect fixed object as described above, and the effect moving object includes the true moving object and the pseudo moving object. ..

Then, the pseudo moving object is imaged in a state different from the state of the effect object 80 in the real space.

The effect moving object is a marker unit for detecting the position in the real space, the positional relationship with the player P in the actual space, and the state of the effect moving object (the moving direction of the effect moving object and its posture). It has 60d.

Then, the moving object for effect causes the simulation control device 100 to recognize the position and the state of the real space and both of them, similarly to each part of the player P, by imaging the marker unit 60d by the imaging camera 70.

For example, as the marker unit 60d of the effect object 80, the same ones as the marker units 60a, 60b, 60c provided in the respective parts of the player P are used. However, it is preferable that the color of the marker units 60a, 60b, 60c of the player P or various kinds of stored information be differentiated to be different for each of the plurality of players P or the effect objects 80 appearing in the game.

A vibrating unit is arranged inside the effect object 80, and the vibration control of the vibrating unit is performed in the simulation control device 100, thereby performing an effect that surprises the player P in conjunction with the simulation image or alone. You may.

The rendering devices 90 to 93 are devices for surely creating a simulated space as a more realistic space in a pseudo manner, and are devices that directly provide the player P with a given rendering effect.

In particular, the rendering devices 90 to 93 are simply arranged in the real space while being interlocked with the simulation image, and the structural rendering device that provides the player P with a given rendering effect based on the layout and its structure, and the detected player. It includes an interlocking type effect device that provides a given effect according to the state, the game environment and the progress of the game.

And the interlocking-type production|generation apparatus contains the production|generation apparatus for forming the environment of simulation space, such as the air blower 90 shown in FIG. 1, and a temperature adjustment apparatus which is not shown in figure, a lighting apparatus, or a vibration apparatus.

Further, in the structural type production device, a movement path member 93 that constitutes the movement path R, a start block (not shown) for recognizing the start position, a spring floor panel 92 for recognizing the inside of the elevator, a wall surface or a floor. It includes a member such as unevenness of the surface or a material for making the player P feel a touch.

For example, as shown in FIGS. 1 and 4 above, the blower 90 outputs a blown air toward the front surface of the player P when the player P switches the zone from the start zone 13 to the moving experience zone 14, and When moving to the movement route R, the blower air is output from below the player P toward the front of the player P.

As shown in FIGS. 3 and 7, the movement path member 93 is provided below a predetermined movement path R along which the player P moves, and is formed to be vibrable or swingable according to the simulation image. A playable area 93a is configured.

That is, as shown in FIG. 7A, the movement path member 93 in the possible production area 93a has a different height (height in the ceiling direction) from the floor surface of the structure 10 (specifically, the non-movement path NR). ) Is formed by.

The movement path member 93 in the effectable area 93a is driven by a plurality of drive units 95 that vibrate or swing the effectable area based on given conditions such as the player P starts walking on the movement path member 93. It is configured.

In particular, in each drive unit 95, a wheel 96 and a wheel 96 that rotate in a direction in which the movement path member 93 is horizontal to the floor surface and are orthogonal to the movement path direction (the traveling direction of the player P) are provided. It is composed of a support plate 97 for supporting the movement path member 93 having a gap D of a predetermined height (for example, about 5 mm) from the surface to be grounded.

The drive unit 95 is arranged adjacent to another drive unit 95 along the movement route R in the effectable area 93a.

In addition, in the movement path member 93 in the production possible area 93a, all the movement paths R may be configured by the drive unit 95, or all the movement paths R are configured by a combination with the movement path member 93 that is not driven. May be. Then, FIG. 7B shows an example in which the drive unit 95 continuously configures the movement route R.

Further, as shown in FIGS. 7A and 7B, the drive unit may be configured to vibrate or swing independently, or mechanically vibrated by the effect control processing unit 114. The drive and swing drive may be controlled.

On the other hand, the effect device may artificially change its structure or form only in the simulation space. That is, the structure and form of the effect object and the effect device do not change in the real space, but it is also possible to artificially change the structure or form only in the simulation space.

For example, when a predetermined event occurs, the image generating unit 130 artificially narrows the width of the movement path member 93, the wall 17 is artificially approaching, or the ceiling 15 is pseudo. The structure or form may be pseudo-changed only in the simulation space, such as being lowered.

3. Operation of Game System Next, the operation of the game system 1 according to the present embodiment will be described with reference to FIGS. 8 and 9. 8 and 9 are flowcharts showing the operation of the game system 1 according to this embodiment.

This operation will be described by using a high altitude fear experience game that simulates a high altitude fear experience. Particularly, in the high-rise fear experience game, the player P starts from the start zone 13 and moves on the movement path member 93 having a predetermined width, and is present at the end point on the movement path member 93 (a point far from the start zone 13). It is a game that holds (rescues) the effect object 80 (for example, a cat) and returns to the start zone 13 within the time limit.

Further, it is assumed that the player P has already mounted the HMD 20 and the fall prevention unit 40 and is ready for hardware.

First, the game calculation unit 110 is not shown based on the operation of the administrator on the assumption that the game calculation unit 110 exists at a predetermined position (specifically, in the start zone 13) of the player P on which the HMD 20 and the fall prevention unit 40 are mounted. Whether or not the button has been pressed (that is, the game starts) is detected (step S101).

As the processing of step S101, the game calculation section 110 starts the detection of the player state by the state detection processing section 112, and also detects whether or not the player P is at a predetermined position to detect the start of the game. May be.

Next, the game calculation unit 110 starts various calculations related to the afraid experience game, and at the same time, the object space setting unit 111, the state detection processing unit 112, the movement/motion processing unit 113, the effect control processing unit 114, and the image generation unit. The sound generation unit 140 and the sound generation unit 140 respectively start respective processes related to the simulation in the aerial fear experience game (step S102).

In particular,
(1) The state detection processing unit 112 starts detection of the marker unit 60 arranged in each part of the player P and the effect object 80, and at the same time, the player state and effect object 80.
Detection of the state of
(2) The object space setting unit 111 and the movement/motion processing unit 113 start to build a simulation space that can be seen by the player P according to the player state, the state of the effect object 80, the game environment and the progress status of the game,
(3) The effect control processing unit 114 controls the applicable effect devices (the blower 90, the automatic door 91, and the spring floor panel 92) according to the player state, the state of the effect object 80, the game environment, and the progress of the game. Start and
(4) The image generation unit 130 and the sound generation unit 140 start the generation of the simulation image and the generation of the sound associated therewith according to the player state, the state of the effect object 80, the game environment, and the progress status of the game.

In the process transition of step S102, each started process is continuously executed until the end of the game is determined.

Next, the image generation unit 130 displays the image in the elevator on the HMD 20, and the effect control processing unit 114 controls the spring floor panel 92 in the start zone 13 to execute the simulation process in the start zone 13 (step S103). ).

Next, when the effect control processing unit 114 detects a predetermined timing (end of the simulation processing in the start zone 13) (step S104), the effect control processing unit 114 executes the game start processing (step S105) and the game. The arithmetic part 110 starts the countdown of the game start (step S106).

For example, the effect control processing unit 114, as the game start processing,
(1) End of control of the spring floor panel 92,
(2) Control of the automatic door 91 (that is, the elevator door) formed between the start zone 13 and the movement experience zone 14 from the closed state to the open state, and
(3) The control of the corresponding effect device such as the blower control by the blower 90 is executed.

Next, while the game calculation unit 110 detects that the countdown has ended (step S107), the state detection processing unit 112 determines whether or not the player has moved beyond the start zone 13 to the movement experience zone 14 (hereinafter, "Start error determination") is executed (step S108).

At this time, when it is determined that the state detection processing unit 112 has moved to the movement experience zone 14 beyond the start zone 13 before the end of the countdown, the state detection processing unit 112 notifies the HMD 20 of a warning (step S109), Then, the process proceeds to step S107.

In this process, the state detection processing unit 112 may execute an effect associated with it, such as interruption of the step S game start operation, to restart the operation from the process of step S105, or interrupt the game. Good.

Further, when detecting that the countdown has ended, the game calculation section 110 starts various calculations related to the execution of the afraid experience game (step S110). Specifically, the game calculation section 110 starts counting the time limit, and also starts the determination of the game ending process.

Next, the game calculation section 110 determines whether or not a game end condition is satisfied (step S111). Specifically, the game calculation section 110 works in conjunction with the state detection processing section 112 to determine whether or not the player state or the state of the effect object 80 satisfies the ending condition, and whether or not the time limit has reached “0”. Determine whether.

For example, based on the detected player state, the game calculation unit 110 determines whether or not the player P has departed from the movement route R, and drops the effect object 80 to be rescued while moving to the specific state. It is determined whether or not a specific state that satisfies the end condition, such as whether or not it has become.

Next, when the game calculation unit 110 determines that the game end condition is not satisfied, the game calculation unit 110 is linked with the state detection processing unit 112 or whether the event start condition is satisfied according to the progress status of the game. It is determined whether or not (step S112).

Specifically, the game calculation unit 110 determines whether or not it has moved onto the movement path member 93, and the first position on the movement path member 93 (the position where the cat object that is the effect object 80 is initially arranged). Whether or not the player is in a predetermined specific state such as whether or not the player has reached the position where the cat object, which is the staging object 80 in the real space, (the end point of the movement path member 93) is reached. Including this, determine the event start condition.

At this time, when the game calculation unit 110 determines that the event start condition is satisfied, the effect control processing unit 114, the image generation unit 130, and the sound generation unit 140 perform processing according to the detected event. If the game calculation unit 110 determines that the event condition is not satisfied (step S113), the process proceeds to step S111.

In particular,
(1) When it is determined that the player P has moved to the movement path member 93, the effect control processing unit 114 moves the blower 90 disposed below the player P. Perform the effect of sending the wind to the player P from below,
(2) If it is determined that the player P has reached the first position on the movement path member 93 (the position where the cat object, which is the rendering object 80, is initially placed), the image generation is performed. The unit 130 and the sound generation unit 140 execute an effect in which the cat object escapes to the end point of the movement route R,
(3) When it is determined that the player P is in the specific state where the position where the cat object is arranged has been reached, the player P executes an effect to rescue the cat object,
(4) When it is determined that the player P is in the specific state in which the player P holds the cat object and rescues the cat object, the image generation unit 130 and the sound generation unit 140 move in the direction toward the start zone 13. In the case of, the effect of narrowing the width of the movement path member 93 is executed,
(5) When it is determined that the player P has reached the start zone 13 while holding the cat object, the player P executes an effect related to game clear such as escape from the elevator.

On the other hand, when the game calculation unit 110 determines that the ending condition of the game is satisfied, the image generating unit 130 and the sound generating unit 140 generate and output an image and a sound for performing an effect regarding the end of the game. Then, (step S114), this operation is ended. It should be noted that, as the effect regarding the end of the game, different effects are executed depending on the ending condition of the game.

4. Eye input 4-1. Outline of Eye Input The game calculation unit 110 of the simulation control device 100 according to the present embodiment appropriately displays the display processing unit 110A, the measurement unit 110B, and accepts according to the game program (an example of the simulation control program) recorded in the main storage unit 172. It operates as the unit 110C, the notification unit 110D, and the execution unit 110E, and functions as a user interface using eye input. The “eye input” here is to input his/her instruction to the simulation control device 100 by the player P visually observing the object. The outline of the operations of the display processing unit 110A, the measuring unit 110B, the receiving unit 110C, the notifying unit 110D, and the executing unit 110E regarding eye input will be described below.

(1) Display processing unit 110A:
The display processing unit 110A displays a virtual three-dimensional space (reference symbol OBS in FIG. 10) on the HMD 20. For example, the display processing unit 110A controls the object space setting unit 111 and the image generation unit 130, and arranges various objects for constructing the simulation space in the virtual three-dimensional space (reference symbol OBS in FIG. 10). The objects include icons (push button objects OB1 to OB4 described later), virtual controllers, virtual mechanical switches, characters, items, and the like. Further, the display processing unit 110A controls the image generation unit 130, sets a virtual camera in the virtual three-dimensional space OBS, and outputs image data for showing the visual field range (reference numeral DA in FIG. 10) of the virtual camera to the player P. Execute the process to generate. Further, the display processing unit 110A controls the communication control unit 120 and the communication unit 196 to execute a process of outputting the image data to the HMD 20. Further, the display processing unit 110A changes the position and orientation of the virtual camera in the virtual three-dimensional space (reference numeral OBS in FIG. 10) according to the change in the position and orientation of the head of the player P detected by the state detection processing unit 112. Execute the changing process.

(2) Measuring unit 110B:
The measuring unit 110B measures (charges) the visual time of the player P with respect to an object (for example, reference numeral OB1 in FIG. 11) arranged in the virtual three-dimensional space (reference numeral OB1 in FIG. 11), and the object (reference numeral OB1 in FIG. 11). When the line of sight (symbol LSA of FIG. 10) of the player P is deviated from, the measured value (hereinafter referred to as “charge amount”) obtained by measurement according to the time when the line of sight (symbol LSA of FIG. 10) is deviated. Reduce. The measurement unit 110B, for example, the hit area OBHA of the push button object OB1 located in the display area DA (an example of an area where the object is considered to exist) and the visual recognition area LSA set in the display area DA (in which the line of sight is Based on the positional relationship with an example of an area that is considered to exist, a process (visual determination process) for determining whether or not the player P is visually checking the push button object OB1 is executed.

(3) Receiving unit 110C:
When the charge amount reaches the first threshold Th1 (for example, 2 seconds), the accepting unit 110C accepts an instruction for selecting an object (reference numeral OB1 in FIG. 11) (hereinafter, referred to as “lock”), and the charge amount is the first. When the second threshold Th2 (for example, 5 seconds) that is larger than the first threshold Th1 is reached, an instruction to confirm the lock of the object (reference numeral OB1 in FIG. 11) is received, and the charge amount before the confirmation is the third threshold Th3 (for example, zero). When it has decreased to the second, the unlocking of the object (reference numeral OB1 in FIG. 11) is accepted. However, even if the charge amount does not reach the second threshold value Th2 (for example, 5 seconds), the receiving unit 110C determines that the charge amount exceeds the first threshold value Th1 and the player P takes a predetermined action. In this case, the lock may be forcibly confirmed. The predetermined action may be “pushing down a button arranged in the real space” or “visually checking the confirmation object”. However, in the following description, a case will be described in which buttons and confirmation objects arranged in the real space are not used.

(4) Notification unit 110D:
The notification unit 110D notifies the player P of the magnitude of the charge amount. The notification unit 110D notifies the player P by, for example, controlling the object space setting unit 111 and attaching a visual effect (FIG. 14) that changes according to the magnitude of the charge amount to the object (reference numeral OB1 in FIG. 11). I do. The notification unit 110D notifies the player P by causing the sound generation unit 140 to generate a sound effect and outputting the sound effect to the headphones 61 of the HMD 20 via the communication control unit 120 and the communication unit 196. May be. In addition, the notification unit 110D can notify the player P by at least one of the visual, auditory, tactile, and olfactory senses of the player P (however, the visual notification will be mainly described below).

(5) Execution unit 110E:
The game calculation section 110 as the execution section 110E executes a predetermined process associated with the object (reference numeral OB1 in FIG. 11) when the lock of the object (reference numeral OB1 in FIG. 11) is confirmed. The predetermined processing associated with the object (reference numeral OB1 in FIG. 11) executes, for example, game parameter setting processing, attack processing on the object, movement processing of the object, processing for other objects, and predetermined program. Processing etc. The timing at which the execution unit 110E executes the predetermined process may be immediately after the confirmation or after a predetermined time has elapsed from the confirmation (hereinafter, it is assumed to be immediately after the confirmation).

Hereinafter, the operation of the game calculation section 110 as the display processing section 110A, the operation of the game calculation section 110 as the measurement section 110B, the operation of the game calculation section 110 as the acceptance section 110C, and the operation of the game calculation section 110 as the notification section 110D. The operation of the game calculation section 110 as the execution section 110E will be described as the operation of the game calculation section 110.

4-2. Visual Area FIG. 10 shows the relationship between the virtual three-dimensional space OBS, the space seen by the player P wearing the HMD 20 (hereinafter referred to as “display area DA”), and the visual area LSA of the player P wearing the HMD 20. It is a figure explaining.

The display area DA corresponds to the visual field range of the virtual camera arranged in the virtual three-dimensional space OS as described above, and is an area displayed in front of the player P via the HMD 20. Since the game calculation unit 110 causes the position and orientation of the virtual camera to follow the position and orientation of the head of the player P as described above, the position and orientation of the display area DA in the virtual three-dimensional space OBS is also the head of the player P. Follow the position and posture of.

The visual recognition area LSA is an area of a predetermined size set by the game calculation unit 110 at the center of the display area DA. The visual recognition area LS corresponds to a range (also referred to as a gaze range or a line-of-sight range) that is considered to be visually observed by the player P in a visual determination described later. The size ratio of the visible area LSA based on the size of the display area DA is basically fixed, and the position of the display area DA in the display area DA is also basically fixed. Here, as shown in FIG. 10, it is assumed that the position of the visible area LSA in the display area DA is the center of the display area DA and the shape of the visible area LSA is circular.

The ratio of the size of the visual recognition area LSA based on the size of the display area DA may be variable. It is also possible to change the position of the visual recognition area LSA in the display area DA. Furthermore, when the position of the visual recognition area LSA in the display area DA is variable, for example, the position of the visual recognition area LSA can be made to follow the direction of the line of sight of the player P (see line-of-sight input described later). Further, in FIG. 10, the outline of the visible area LSA and the center coordinates of the visible area LSA are visualized for the sake of description, but each of the outline and the central coordinates may actually be hidden.

Now, FIG. 10 shows an example in which the selection screen is displayed as the virtual three-dimensional space OBS at the start of the aerial fear experience game (step S101). The select screen is a screen for the player P to make some settings regarding game processing.

Here, it is assumed that the push button objects OB1 and OB2 for selecting the number of people and the push button objects OB3 and OB4 for selecting the difficulty level are arranged on the selection screen with a certain interval. Each of these push button objects OB1, OB2, OB3, and OB4 is a virtual operation button, and is an object which is generally called an “icon”. Although not shown in FIG. 10, behind the push button objects OB1, OB2, OB3, and OB4 seen from the player P, other objects existing in the virtual three-dimensional space OBS (for example, in the aerial fear experience game). It does not matter if the scenery seen from the starting point) is included.

First, the push button object OB1 is assigned a function of processing for setting the mode of the game processing to be executed by the processing unit 101 (mainly the game calculation unit 110) to the “single player play mode”. The “single player mode” is a mode suitable for a single player P wearing the HMD 20 to move the structure 10.

Further, the push button object OB2 is assigned a function of processing for setting the mode of the game processing to be executed by the processing unit 101 (mainly the game calculation unit 110) to the “two-player play mode”. The “two-player play mode” is a mode suitable for two players P individually wearing the HMD 20 to move the same structure 10 (a mode in which the two players P share a fear experience). For example, the game calculation unit 110 in the “two-player play mode” sets two virtual cameras individually corresponding to the two players P in the virtual three-dimensional space OBS, and also individually corresponds to the two players P. Two characters (avatars) are placed in the virtual three-dimensional space OBS. Then, the game calculation unit 110 causes the two virtual cameras to interlock with the heads of the two players P, and interlocks each part of the two avatars with each part of the two players P.

In addition, the push button object OB3 is assigned a function of processing for setting the mode of the game processing to be executed by the processing unit 101 (mainly the game calculation unit 110) to the “beginner mode”. The “beginner mode” is a mode in which the difficulty level of the game processing (for example, the probability that the player P falls) is set lower than in the “advanced mode” described later. The adjustment of the difficulty level of the game processing is performed, for example, by adjusting the parameters of the game processing.

Further, the push button object OB4 is assigned a function of processing for setting the mode of the game processing to be executed by the processing unit 101 (mainly the game calculation unit 110) to the “advanced mode”. The “advanced mode” is a mode in which the difficulty level of the game processing (for example, the probability that the player P falls) is set higher than in the above-mentioned “beginner mode”. The adjustment of the difficulty level of the game processing is performed, for example, by adjusting the parameters of the game processing.

Hereinafter, it is assumed that the player P plays in the “single player mode” and the “beginner mode”, that is, the player P locks the push button objects OB1 and OB3 by an eye input and confirms the lock by the eye input. ..

As shown in FIG. 10, at the beginning of displaying the select screen, the push button objects OB1, OB2, OB3, and OB4 are arranged in a 2×2 matrix, and the display area DA and the viewing area LSA are located in the center of the matrix. Suppose that

Then, when the player P turns his/her head to the upper left, as shown in FIG. 11, the display area DA and the visual recognition area LSA move toward the upper left of the select screen (upper left as viewed from the player P).

In FIG. 11, the visual recognition area LSA is located at the center of the push button object OB1, and
The display area DA shows a state in which the entire push button object OB1 is covered. In this state, the game calculation section 110 determines that the player P is viewing the push button object OB1 (details of the visual determination will be described later).

Although not shown in FIGS. 10 and 11, when the player P retreats behind himself/herself, the sizes of the display area DA and the visual recognition area LSA in the virtual three-dimensional space OBS become large, and for example, four pushes are performed. It is also possible to fit the whole picture of the button objects OB1, OB2, OB3, OB4 in the display area DA.

4-3. The visual determination game calculation unit 110 individually sets a hit area for each of the push button objects OB1, OB2, OB3, and OB4 arranged on the select screen. FIG. 12A representatively shows an example of the hit area OBHA set in the push button object OB1.

As shown in FIG. 12A, the hit area OBHA of the push button object OB1 is an area of a predetermined shape and a predetermined size centered on the same coordinates as the center coordinates of the push button object OB1. The contour shape of the hit area OBHA is, for example, a similar figure to the contour of the push button object OB1, and the size of the hit area OBHA of the push button object OB1 is, for example, the same as the size of the push button object OB1.

However, the size of the hit area OBHA may be larger or smaller than the size of the push button object OB1. Further, the size of the hit area OBHA may be adjustable if necessary.

Now, the game calculation section 110 determines whether or not the player P is visually watching the push button object OB1 (visual judgment) based on the positional relationship between the hit area OBHA of the push button object OB1 and the visual recognition area LSA.

For example, when at least a part of the hit area OBHA and at least a part of the visual recognition area LSA overlap, the game calculation section 110 determines that the player P is “visually observing” the push button object OB1 and does not so. In this case, the player P determines that the push button object OB1 is “not in sight” (that is, the line of sight of the player P is out of the push button object OB1). FIG. 12B shows a state in which at least part of the hit area OBHA and at least part of the visual recognition area LSA overlap. The state of FIG. 12B is one of the states that the game calculation section 110 determines to be “visually watching”.

Note that here, the condition that the game calculation unit 110 determines that the player P is visually watching the push button object OB1 is “when at least a part of the hit area OBHA and at least a part of the visual recognition area LSA overlap”. However, “when one of the hit area OBHA and the visual recognition area LSA includes the other”, “when the distance between the hit area OBHA and the visual recognition area LSA is less than a threshold”, or the like can be used. ..

In addition, in FIGS. 12A and 12B, the case where the visual recognition area LSA is smaller than the hit area OBHA is shown as an example, but the visual recognition area LSA is naturally larger than the hit area OBHA. Can be.

As a result, the player P changes the position of the visual recognition area LSA in the virtual three-dimensional space OBS and the like by changing the combination of the posture of the head wearing the HMD 20 and the position of the head, and pushbutton object OB1. And push button object OB
It is possible to remove the line of sight from 1.

In the following, the state that is determined to be "visible" by visual determination is simply referred to as "visual", and the state that is determined to be "not visible" by visual determination is "to remove the line of sight", "I'm out of sight." In addition, the “line of sight” here does not refer to the actual line of sight of the player P (visual axis of the eyeball) in the real space, but refers to the visual recognition area LSA in the virtual three-dimensional space OBS.

Further, in the HMD 20 of the present embodiment, the visual recognition area LSA and the hit area OBHA may be basically hidden. This is because the game calculation unit 110 of the present embodiment emphasizes the visually-observed object when the player P visually sees any object in the virtual three-dimensional space OBS (see FIG. 14 and the like described later). Even if the visual recognition area LSA and the hit area OBHA are not displayed, it is considered that the player P will not lose sight of where his or her line of sight is in the virtual three-dimensional space OBS.

4-4. Basically, the game calculation unit 110 of the present embodiment basically measures (charges) the visual time of the player P for each object arranged in the virtual three-dimensional space OBS, and measures the amount of charge (charge) for each object. The state of the object is controlled between three states of "locked", "unlocked (unlocked)", and "confirmed" according to the amount. Note that the game calculation unit 110 manages the charge amount of the visual time for each object in, for example, a readable/writable memory (data buffer 176 or the like).

13(a), 13(b), 13(c), and 13(d) are diagrams (graphs) illustrating the relationship between the elapsed time from the start of visual observation and the charge amount of a certain object. is there. The horizontal axis of the graph represents time, and the vertical axis of the graph represents the charge amount.

FIG. 13A shows a change pattern of the charge amount when the player P visually checks the object for a short period of time (when the line of sight deviates before the charge amount reaches the first threshold Th1 after the start of the visual check).

FIG. 13B shows the amount of charge when the player P looks at the object for a certain period of time and then removes the line of sight (when the line of sight deviates after the amount of charge reaches the first threshold Th1 after the start of visual observation). Shows the change pattern of.

FIG. 13C shows a change pattern of the charge amount when the player P continuously views the object for a sufficient time (when the charge amount reaches the second threshold Th2 after the start of the visual check). ..

FIG. 13D shows a case where the player P visually removes the line of sight of the object for a certain period of time, and then re-visualizes the object (the charge amount exceeds the first threshold Th1 after the start of the visual observation. A change pattern of the charge amount in the case where the line of sight is deviated before reaching the threshold Th2 and then re-visualized before the charge amount becomes zero) is shown.

First, when the player P starts to visually check the object (see the charge start time ts in FIGS. 13A to 13D), the game calculation unit 110 starts charging the object for the viewing time. .. Here, it is assumed that the game calculation unit 110 increases the charge amount by “1” every time the visual observation time increases by 1 second.

When the line of sight of the player P deviates from the object (see the line-of-sight release time tO in FIGS. 13B and 13D), the game calculation unit 110 visually checks the time depending on the time when the line of sight is off. Decrease the amount of charge in time. Here, it is assumed that the game calculation unit 110 increases the charge amount by "0.5" each time the visual observation time increases by 1 second.

Then, the game calculation unit 110 locks the object when the charge amount reaches the first threshold Th1 (here, Th1=2) after the start of charging (FIGS. 13B, 13C, and 13C). See the lock start time tL in d).).

Therefore, the player P can lock the object by continuously visually observing the object for a certain amount or more (here, for 2 seconds).

Further, when the charge amount reaches the second threshold Th2 (here, Th2=5) which is larger than the first threshold Th1 after the start of charging (FIG. 13(c), (d)). , The lock time of the object is fixed, and the charge amount is reset to zero.

Therefore, the player P can confirm the lock of the locked object by continuously (or intermittently) visually observing the locked object for a certain amount or more.

In addition, the game calculation unit 110 accepts the unlocking of the object when the charge amount has decreased to the third threshold value Th3 (here, Th3=0) after being locked and before being fixed (FIG. 13(b). ) Refer to unlock time tU).

Therefore, the player P can unlock the object by removing the line of sight from the locked object for a certain amount of time or more, and the earlier the viewing time of the object is, the earlier the unlocking timing is. can do. On the contrary, the player P can secure a long time until the lock is maintained after removing the line of sight by keeping the locked object visible for a long time. In other words, the strength of the player P's intention to view the object is reflected in the lock strength of the object (hardness of unlocking).

Further, the game calculation unit 110, if the line of sight deviates from the object before the charge amount reaches the first threshold Th1 after the start of charging (see the line-of-sight release time tO in FIG. 13A), the charge amount. To (immediately) reset to zero.

Therefore, when the player P is wondering what kind of object should be locked, the object is not locked when the line of sight is merely on the object, and the object which the player P intentionally locked is visually checked. The object is locked only in the case (long view).

Further, the game calculation unit 110 makes the speed at which the charge amount approaches the third threshold Th3 after locking slower than the speed at which the charge amount approaches the second threshold Th2. For example, the game calculation unit 110 increases the charge amount by “1” each time the visual observation time increases by 1 second, whereas the game calculation unit 110 increases the charge amount by “1” each time the visual line deviates after locking for 1 second. It is decreased by 0.5" (in fact, the decrease curve in FIGS. 13B and 13D has a gentler slope than the rising curve).

Therefore, after the object P is locked, the player P can easily keep the object locked even if the position and the posture of the head are not completely fixed (even if the neck is slightly wobbled). ..

In addition, the player P can determine the lock of the object in a short time if he/she continues to visually check the object without hesitation (see FIG. 13C), and hesitates whether or not to confirm the lock. In this case, by removing or returning the line of sight from the object, it is possible to increase the remaining time until confirmation while keeping the lock of the object (FIG. 13(d)).

As a result of the above, the player P can freely switch the state of the object among “locked”, “unlocked (unlocked)”, and “confirmed”.

In the above description, the game calculation unit 110 adjusts the speed at which the charge amount is increased or decreased in order to adjust the speed at which the charge amount approaches the threshold, but instead of adjusting the speed at which the charge amount is increased or decreased (or In addition to adjusting the rate of increasing or decreasing the charge amount), the magnitude of the threshold may be adjusted. That is, since the charge amount and the threshold value are relative to each other, “adjusting the increase/decrease speed of the charge amount” and “adjusting the charge amount threshold value” can be regarded as equivalent to each other. Yes (and so on).

Further, in the above description, the game calculation unit 110 confirms the lock of the object at the timing when the charge amount of the object reaches the threshold Th2, but even if the player P does not reach the threshold Th2, When the confirmation action is performed, the lock may be forcibly confirmed. The predetermined confirming action may be “pressing a predetermined button arranged in the real space”, “visualizing the confirming object”, or “moving the line of sight of a predetermined pattern”. May be. Hereinafter, it is assumed that the confirmation action is adopted. Details of the confirmation action will be described later.

4-5. Visual Effects of Objects FIG. 14 is a diagram illustrating an example of visual effects of objects.

As shown in FIG. 14, the game calculation unit 110 gives a visual effect to an object and changes the visual effect according to the charge amount of the object, thereby changing the charge amount of the object with time ( Visualize the state where the charge amount increases/decreases.

If the charge amount for each object is visualized, the player P can specify the object that he or she is viewing, and can distinguish whether or not he or she is viewing the object. Further, the player P can also grasp the remaining time until the object being viewed by the player P is locked, the remaining time until the object is unlocked, and the viewing time required until the lock is confirmed. It is possible.

Now, the visual effect is implemented by animation, for example. This is because the animation allows the player P to be notified of the time change of the charge amount in real time (sequentially). In the example shown in FIG. 14, this animation is an animation in which a mark row (neon mark row) is arranged at the outer edge of an object and the number of mark rows arranged is changed according to the charge amount.

In this way, if the charge amount is reflected in the number of arranged mark rows, the player P can intuitively determine the amount of charge amount, whether the charge amount is increased or decreased, the charge amount increasing speed, the charge amount decreasing speed, and the like. It is possible to grasp.

FIG. 14A shows a mark row when the charge amount becomes “0.5” after the start of visual observation (immediately after the start of visual observation or immediately before unlocking).

FIG. 14B shows the mark row when the charge amount becomes “1” after the start of visual inspection.

FIG. 14C shows the mark row when the charge amount becomes “1.5” after the start of visual observation.

FIG. 14D shows the mark row when the charge amount becomes “2” (locked) after the start of visual observation.

FIG. 14E shows the mark row when the charge amount becomes “2.5” after locking.

FIG. 14F shows the mark row when the charge amount becomes “3” after locking.

FIG. 14G shows the mark row when the charge amount becomes “3.5” after locking.

FIG. 14(h) shows the mark row when the charge amount becomes “4” after locking.

FIG. 14I shows the mark row when the charge amount becomes “4.5” after locking.

FIG. 14J shows a mark row when the charge amount becomes “5” after locking (when locking is confirmed).

That is, in the animation shown in FIG. 14, the degree of the charge amount is represented by the number of mark rows arranged. The white arrows in FIG. 14 indicate the order of changes in the mark row when the player P continuously views the object for 5 seconds, but when the line of sight deviates from the object as described above, As the charge amount decreases, the animation changes in the direction opposite to the white arrow. Further, as described above, in the present embodiment, the speed at which the charge amount decreases is slower than the speed at which the charge amount increases, so that the speed at which the animation changes in the direction of the white arrow in FIG. The speed at which the animation changes in the direction opposite to the white arrow is slower.

Here, the game calculation section 110 distinguishes between the locked object and the unlocked object. For example, the game calculation unit 110 sets the emphasis degree of the locked object (FIGS. 14D to 14I) higher than that of the unlocked object (FIGS. 14A to 14C). Set. In the example shown in FIG. 14, the density of the locked object (FIGS. 14D to 14I) is set higher than the density of the unlocked object (FIGS. 14A to 14C). ..

Therefore, the player P can distinguish whether or not the object is locked by the degree of emphasis (here, density) of the object.

The degree of emphasis of the object can be adjusted by, for example, at least one of the following parameters (1) to (14).

(1) Mark row density,
(2) Brightness of mark row,
(3) Mark row color,
(4) Opacity of mark row,
(5) Saturation of mark row,
(6) Mark row shape,
(7) At least one change pattern of density, brightness, color, opacity, saturation, and shape of the mark string,
(8) Object density,
(9) brightness of the object,
(10) Object color,
(11) Object opacity,
(12) Saturation of the object,
(13) Object shape,
(14) At least one change pattern of the density, brightness, color, opacity, saturation, and shape of the object.

Further, here, as the animation for notifying the player P of the charge amount, “animation in which the mark row is arranged at the outer edge of the object and the arrangement number of the mark row is changed according to the charge amount” is used. , "Animation in which a ring-shaped or partially ring-shaped gauge (tube-shaped gauge) is placed on the outer edge of the object and the length of the gauge (corresponding to the position of the gauge pointer) is changed according to the charge amount" Good (see Figure 30).

In this way, by reflecting the charge amount on the length of the gauge, the player P intuitively grasps the size of the charge amount, whether the charge amount is increased or decreased, the charge amount increasing speed, the charge amount decreasing speed, etc. It is possible to

The animation for notifying the player P of the charge amount may be an animation in which the degree of emphasis of the object itself is changed according to the charge amount, instead of the animation using the mark row or the gauge. The emphasis degree of the object itself can be adjusted by, for example, at least one of the parameters (7) to (12) described above. Note that FIG. 15 shows an example in which the density of the object itself changes according to the charge amount.

In this way, by notifying the player P of the charge amount based on the change in the degree of emphasis of the object itself, a wide space around the object can be secured, so that the degree of freedom in layout of the object is increased. Therefore, for example, it is effective when a large number of objects are densely arranged.

Further, regarding the relationship between the charge amount and the emphasis degree of the visual effect, it is desirable that the emphasis degree increases as the charge amount increases. Here, “high emphasis” means, for example, that the density is high, the saturation is high, the opacity is high, and the change cycle of colors and the like is fast.

4-6. Control of Lock Strength The game calculation section 110 uses a determination criterion for determining that the player P is visually checking the locked object (a determination criterion for visually checking the locked object), and the unlocked object is the player. It is set more gradually than the judgment standard for judging that P is visually inspected (the judgment standard for the visual judgment of the unlocked object). If the criterion is loosened, the lock strength of the object can be increased. The “lock strength” here means a low possibility that the lock is released.

Therefore, the player P cannot lock the object unless he or she intentionally looks at the unlocked object, but if the object is locked, it is easy to maintain the lock without consciously watching it. ..

Here, as shown in FIG. 12, the push button object OB1 will be described as an example, but the same applies to other objects.

As described above, the game calculation section 110 performs the visual determination of the push button object OB1 based on whether at least a part of the hit area OBHA of the push button object OB1 and at least a part of the visual recognition area LSA overlap. .. Then, the game calculation section 110 determines that “they are visually observed” when at least a part of the hit area OBHA of the push button object OB1 and at least a part of the visual recognition area LSA overlap, and when they do not overlap, It is judged as "not visually observed".

Therefore, the game calculation unit 110 increases the size of at least one of the hit area OBHA and the visual recognition area LSA of the push button object OB1 in order to loosen the criterion for the visual determination of the push button object OB1.

Here, in consideration of performing control of the determination standard for each object, a case where the size of the hit area OBHA is variable and the size of the visual recognition area LSA is fixed is described for simplicity. Further, the size adjustment may be continuous, but a case where the size adjustment is stepwise is taken as an example.

Furthermore, the game calculation unit 110 sets the determination standard of the visual determination of the push button object OB1 more gently as the charge amount of the push button object OB1 is larger. That is, the game calculation unit 110 increases the size of the hit area OBHA of the push button object OB1 as the charge amount of the push button object OB1 increases.

For example, when the push button object OB1 is not locked, the game calculation unit 110 sets the size of the hit area OBHA of the push button object OB1 to, for example, the “standard” size shown in FIG. When the charge amount of OB1 is less than a predetermined value (for example, “3”) between the threshold values Th1 and Th2, the size of the hit area OBHA of the push button object OB1 is set to the “medium” size shown in FIG. 16(b). When the charge amount of the push button object OB1 is equal to or larger than the predetermined value (“3”), the size of the hit area OBHA of the push button object OB1 is set to the “large” size shown in FIG. 16C. To do.

In this case, the longer the player P views the push button object OB1, the higher the lock strength of the push button object OB1.

Moreover, as shown in FIGS. 16(a), (b), and (c), the game calculation section 110 determines the hit area in the left and right direction of the player P rather than the enlargement ratio of the size of the hit area OBHA in the up and down direction of the player P. OBHA size enlargement ratio is set high.

According to this setting, the lock strength in the horizontal direction is relatively higher than the lock strength in the vertical direction of the push button object OB1.

Generally, the direction of the line of sight of the player P (which is determined by the posture of the neck in this embodiment) is more unstable in the left-right direction than in the up-down direction. Therefore, the lock strength in the left-right direction is set relatively high. If this is done, it is considered that an eye input error (unintentional unlocking of the player P in the present embodiment) can be reduced without impairing operability.

4-6-1. Supplement on Lock Strength Control Note that the game calculation unit 110 of the present embodiment controls the lock strength by adjusting the size (spatial adjustment) of at least one of the visual recognition areas LSA. Adjustment (temporal adjustment), or spatial adjustment and temporal adjustment may be combined.

For example, the game calculation unit 110 of the present embodiment may make the speed at which the charge amount approaches the third threshold Th3 slower as the charge amount of the push button object OB1 increases. The speed can be adjusted by adjusting the threshold value or adjusting the charge amount increasing/decreasing speed as described above.

In this case, for example, when the player P is wondering whether to lock an object, the object cannot be locked unless the object is visually observed for a certain time or longer. On the contrary, after the object is locked, the object remains locked unless the line of sight is removed from the object for a long time.

Further, although the game calculation unit 110 of the present embodiment adjusts the size of the hit area OBHA in the virtual three-dimensional space OBS in order to perform the spatial adjustment, it adjusts the size of the visual recognition area LSA in the virtual three-dimensional space OBS. Alternatively, both the hit area OBHA and the size of the visual recognition area LSA may be adjusted. In that case, for example, the game calculation unit 110 of the present embodiment may control the size of the visual recognition area LSA according to the charge amount of the object closest to the visual recognition area LSA.

4-7. Speed-up processing 4-7-1. Overview of Speed-Up Process When the game calculation unit 110 of the present embodiment detects a predetermined confirmation action involving the line-of-sight turn-back movement starting from the locked object, the charge amount reaches the second threshold Th2. Even if the lock has not been set, the processing for accepting the lock confirmation (speed-up processing) is executed. Therefore, when the player P wants to immediately confirm the lock after locking the object, the player P may perform a predetermined action for confirming the line of sight of the locked object as a starting point. In this case, since the player P does not need to continue to visually check the object until the charge amount of the object increases to the second threshold Th2, the waiting time from the lock to the confirmation can be significantly reduced. That is, the player P may take different actions depending on whether the object P should be locked immediately after locking the object or not. The confirming action and the speed-up process will be described below.

In the present embodiment, not all the actions for confirming the turn-back movement of the line of sight from the locked object as the starting point are determined, and the turn-back movement of the line-of-sight satisfying one or more additional conditions (described later) is used for the decision. It is regarded as an action, and the turn-back movement of the line of sight that does not satisfy the additional condition is not regarded as a confirmation action.

4-7-2. Explanation of wording Here, the “line of sight” refers to a region of the virtual three-dimensional space OBS in which the line of sight of the player P is considered to be focused, and the size and shape of the region can be appropriately set. It is possible. For example, the visual recognition area LSA shown in FIG. 17 can be set as the “line of sight”, or the center point LSA′ of the visual recognition area LSA can be set as the “line of sight”. Hereinafter, the center point LSA′ of the visual recognition area LSA will be referred to as a “viewpoint LSA′” and the viewpoint LSA′ will be regarded as a line of sight for description. Incidentally, the movement (position and posture) of the viewpoint LSA′ in the virtual three-dimensional space OBS is the movement (position and posture) of the head of the player P in the real space, and the movement (position and posture) of the pupil of the player P in the real space. , At least one of the movements (position and posture) of the visual axis of the player P in the real space can be followed. However, in the present embodiment, the movement (position and posture) of the viewpoint LSA′ in the virtual three-dimensional space OBS follows the movement (position and posture) of the head of the player P.

In addition, "folding movement" refers to moving from one position to another position (a folding point described later) and then moving toward the starting point again. The "turnback movement" includes movement that does not completely return from the turning point to the vicinity of the starting point, movement that returns from the turning point to the starting point and passes through the vicinity, and movement that does not completely overlap the forward path and the return path.

The “starting point” is the starting point of movement.

Further, the "outward path" is a portion of the movement path of the turn-back movement, which is located before the turn-back point.

Further, the “return path” is a portion of the movement path of the turn-back movement after the turn-back point.

The "movement starting from the object" is a movement starting from an area where the object is considered to exist. This area may be the object itself or the hit area OBHA provided near the object. However, in this embodiment, this area will be described as a hit area OBHA.

4-7-3. The game calculation unit 110 as the confirming action accepting unit 110C, for example, the viewpoint LSA′ that satisfies the seven conditions of the start condition, the turn-back condition, the time condition, the distance condition, the angle condition, the straight line condition or the arc condition, and the return condition. The movement of is detected as an action for confirmation. Note that it is possible to remove at least a part of the five conditions other than the start condition and the turn-back condition (for example, remove at least one of the distance condition and the time condition) out of the seven conditions. The case where only the movement satisfying all of the two conditions is set as the confirmation action will be described.

(1) Starting Point Condition The game calculation section 110 as the acceptance section 110C sets a condition (starting point condition) that “the viewpoint LSA′ belongs to the hit area OBHA of the object at the timing when the object is locked”. , Is one of the conditions for the action for confirmation.

For example, when the object is locked, the game calculation unit 110 refers to the positional relationship between the hit area OBHA and the viewpoint LSA′ of the object as shown in FIG. 17, and the viewpoint LSA′ belongs to the hit area OBHA. If so, it is determined that the starting condition is satisfied, and if not, it is determined that the starting condition is not satisfied. Note that FIG. 17 shows an example of a state where the starting condition is satisfied.

Note that the game calculation section 110 may adjust the accuracy (severity) of the starting point condition according to the progress of the game, preset settings, and the like. For example, if the starting point condition is that the distance from the viewpoint LSA′ to the center of the hit area OBHA is within a predetermined range, the starting point condition can be relaxed. Further, here, the hit area OBH and the viewpoint LSA′ are used to define the starting point condition, but the contour of the object may be used instead of the hit area OBH, and the visual recognition area may be used instead of the viewpoint LSA′. LSA can also be used.

(2) Returning Condition The game calculation unit 110 as the receiving unit 110C sets, for example, the condition that “the returning point exists on the moving route of the viewpoint LSA′” (the returning condition) as one of the conditions for the confirmation action. .. FIG. 18 shows an example of the moving route in which the direction of the moving route is reversed and the turning point P3 is generated.

For example, when the object is locked, the game calculation section 110 causes the velocity vectors V1, V2, and V3 of the viewpoint LSA′ at each of the first timing, the second timing, the third timing, and so on after the object is locked. , And the position of the viewpoint LSA' at the i-th timing when the inverse vector component of the (i-1)-th speed vector V(i-1) occurs in the i-th speed vector Vi. Pi is detected as a turning point. Then, when the turning point is detected, the game calculation section 110 determines that the movement of the viewpoint LSA′ satisfies the turning condition. The example of FIG. 18 is an example in which the position P3 of the viewpoint LSA' at the third timing is determined to be the turning point. The number “i” of the velocity vector V and the position P shown in FIG. 18 represents each number of the frame output from the imaging camera 70 after the object is locked.

Here, the velocity vector V is a vector representing the moving direction and moving speed of the viewpoint LSA' in the virtual three-dimensional space OBS. However, this velocity vector does not need to have a component in the depth direction viewed from the player P, and thus may be a two-dimensional vector. The game calculation section 110 can calculate the velocity vector V based on, for example, the inter-frame difference (such as the inter-frame difference at the marker position) sequentially output from the imaging camera 70. The calculation of the velocity vector V is repeated in the frame cycle of the imaging camera 70.

Further, the frame period of the imaging camera 70 is sufficiently shorter than the time required for the charge amount to reach the second threshold Th2 from the first threshold Th1. Therefore, the game calculation section 110 can calculate a sufficient number of velocity vectors V within a time equivalent to the required time. In this case, the game calculation section 110 can detect the shape of the movement path of the viewpoint LSA' after the object is locked with sufficient accuracy.

In the moving path of the viewpoint LSA′ detected by the game calculation unit 110, a portion (positions P1 to P3 in FIG. 18) before the turning point (position P3 in FIG. 18) is the “outward path” described above, and the game The portion (positions P1 to P3 in FIG. 18) after the turning point (position P3 in FIG. 18) on the movement path of the viewpoint LSA′ detected by the calculation unit 110 is the above-mentioned “return path”.

(3) Time Condition The game calculation unit 110 as the acceptance unit 110C sets, for example, the condition (time condition) that “at least the time required for the outward trip is within the predetermined time” to the condition of the confirmation action. Let's do it.

For example, the game calculation unit 110 measures the moving time of the viewpoint LSA′ from the starting point P1, and when the moving time of the viewpoint LSA′ reaches a predetermined time before the turning point is detected, the viewpoint is concerned. It is determined that the movement of LSA' does not satisfy the time condition. For example, when the game calculation unit 110 does not detect the turning point before the number i (frame number) of the velocity vector Vi after locking reaches a predetermined value, the movement of the viewpoint LSA′ satisfies the time condition. It is determined not to.

Here, the predetermined time (or the predetermined value) is set to a time shorter than the time required for the charge amount to increase from the first threshold Th1 to the second threshold Th2.

Therefore, even if the return movement of the viewpoint LSA′ is performed on a route similar to the movement route shown in FIG. 18, if the time required for the outward trip of the return movement is too long, the movement of the viewpoint LSA′ is determined. It is not considered an action. That is, by imposing a time condition on the condition of the committing action, it is possible to prevent erroneous detection of the committing action.

The game calculation section 110 may adjust the accuracy (severity) of the time condition according to the progress of the game, preset settings, and the like. If the predetermined time is lengthened, the time condition can be relaxed, and if the predetermined time is shortened, the time condition can be tightened.

(4) Distance Condition The game calculation unit 110 as the acceptance unit 110C sets, for example, the condition (distance condition) that “at least the distance required for the outward trip is within a predetermined distance” to the confirmation action condition 1 Let's go.

For example, the game calculation unit 110 measures the moving distance of the viewpoint LSA′ from the starting point P1, and when the moving distance of the viewpoint LSA′ reaches a predetermined distance before the turning point is detected, the viewpoint is moved. It is determined that the movement of LSA' does not satisfy the distance condition. For example, when the game calculation unit 110 does not detect the turning point before the sum of the magnitudes of the velocity vectors Vi after the lock reaches a predetermined value, the movement of the viewpoint LSA′ must satisfy the distance condition. judge.

Therefore, even if the viewpoint LSA' is turned back, if the moving distance before turning back is too long (see FIG. 19), the movement of the viewpoint LSA' is not regarded as a confirmation action. That is, by imposing the distance condition on the condition of the confirmation action, it is possible to prevent erroneous detection of the confirmation action.

Note that the game calculation section 110 may adjust the accuracy (severity) of the distance condition according to the progress of the game, preset settings, and the like. If the predetermined distance is lengthened, the distance condition can be relaxed, and if the predetermined distance is shortened, the distance condition can be tightened. Further, the predetermined distance can be set according to the size of the object.

(5) Angle condition The game calculation unit 110 as the acceptance unit 110C sets, for example, the condition (angle condition) that "the turn-back angle from the outward path to the return path is within a predetermined angle" to the determination action condition. And one of them.

For example, when the game calculation unit 110 detects a turning point (position P3 in FIG. 20) as shown in FIG. 20, the speed vector (speed in FIG. 20) calculated before and after the turning point (position P3 in FIG. 20). Based on the vectors V2 and V3), the turning angle θ of the moving path of the viewpoint LSA′ is calculated, and when the turning angle θ exceeds a predetermined angle, it is determined that the movement of the viewpoint LSA′ does not satisfy the angle condition. To do.

Here, the “folding back angle” is an angle θ formed by the forward path and the backward path of the folding back movement. Further, the predetermined angle is set to a predetermined value smaller than 90°, for example, 45°.

Therefore, even if the return movement of the viewpoint LSA′ is performed, as shown in FIG. 20, when the return angle θ of the return movement is too large, the movement of the viewpoint LSA′ is regarded as a confirmation action. There is no. Therefore, by imposing an angle condition on the condition of the confirmation action, it is possible to prevent erroneous detection of the confirmation action.

The game calculation section 110 may adjust the accuracy (severity) of the angle condition according to the progress of the game, preset settings, and the like. The angle condition can be made gentle by increasing the predetermined angle, and the angle condition can be made strict by making the predetermined angle small.

(6) Straight line condition or circular arc condition The game calculation unit 110 as the acceptance unit 110C determines, for example, that the condition "at least the shape of the outward path is a straight line or a circular arc" (a straight line condition or a circular arc condition) is a confirmation action. This is one of the conditions.

For example, the game calculation unit 110 fits a polygonal line connecting the velocity vectors V1, V2, V3,... After the object is locked and before the turning point is detected to a quadratic curve, and the fitting error is predetermined. When it exceeds the value, it is determined that the movement of the viewpoint LSA′ does not satisfy the straight line condition or the circular arc condition.

For example, the game calculation unit 110 monitors the time differentiation of the velocity vectors V1, V2, V3,... And the shape of the outward path is a linear condition or an arc condition at the timing when a jump of a threshold value or more occurs in the time differentiation being monitored. It is determined that is no longer satisfied. The example of FIG. 21 is an example of the case where the shape of the movement path does not satisfy the linear condition or the circular arc condition at the fourth timing (i=4). Further, in the example of FIG. 21, since the velocity vectors V3 and V4 before and after the fourth timing do not satisfy the above-described turnaround condition (that is, the fourth position P4 is not a turnaround point), the viewpoint LSA' Movement is never detected as a confirming action.

Therefore, even if the viewpoint LSA′ is turned back and forth, as shown in FIG. 21, if the moving route bends in a direction different from the original direction before the turning point is detected, the point of view is changed. The movement of LSA' is not considered as a confirming action. Therefore, by imposing a straight-line condition or a circular arc condition on the condition for the confirming action, it is possible to prevent erroneous detection of the confirming action.

It should be noted that "movement that satisfies the straight line condition" here is movement that allows the movement route to be regarded as a straight line. Not only movement that makes the movement route a perfect straight line, but also a movement route that has a certain accuracy It also includes movements that can be approximated.

In addition, "movement that satisfies the arc condition" here means movement that can be regarded as a circular arc, and not only the movement that the moving path is a perfect circular arc, but also the moving path with a certain accuracy. A movement that can approximate a curve of a predetermined order or less is also included.

In addition, the game calculation unit 110 may adjust the accuracy (severity) of the straight line condition or the circular arc condition according to the progress of the game, preset settings, and the like. For example, if the threshold value for time differentiation is increased, the linear condition or arc condition can be made gentle, and if the threshold value for time differentiation is decreased, the linear condition or arc condition can be made strict.

(7) Return Condition The game calculation section 110 as the acceptance section 110C sets, for example, a condition (return condition) that “the return path is along the outward path” as one of the conditions for the finalizing action.

For example, the game calculation unit 110, after detecting the turnaround point, shifts the movement path (return path) from the turnaround point to the current point and the portion of the movement path (outward path) from the start point to the turnaround point corresponding to the return path. If the magnitude of the deviation is calculated and exceeds a predetermined value, it is determined that the outbound path deviates from the inbound path. Further, the game calculation unit 110 keeps the return path in a state where it does not deviate from the outward path, and within a predetermined time (for example, within 0.5 seconds), the length of the return path reaches a predetermined distance (for example, about half the distance of the outward path). If so, it is determined that the return condition is satisfied. The predetermined time is set to an appropriate value within a range that does not deviate from the purpose of the speed-up processing (that is, the purpose of shortening the time from lock to confirmation).

For example, as illustrated in FIG. 22, the game calculation unit 110 calculates a polygonal line formed by connecting the velocity vectors V1 and V2 from the starting point P1 to the turning point P3 as the outward path, and calculates the current position of the viewpoint LSA′ from the turning point P3. A polygonal line formed by connecting the velocity vectors V3 and V5 up to P5 is calculated as the outward path. In the example of FIG. 22, the length of the return path is secured to be at least half the length of the outward path, and the angular difference between the latter half of the outward path (speed vector V2) and the first half of the return path (speed vector V3) is small. However, since the angle difference between the first half of the forward path (speed vector V1) and the second half of the backward path (speed vector V4) is large, the amount of deviation between the forward path and the return path exceeds a predetermined value, and the viewpoint LSA′ moves. Is determined not to satisfy the return condition.

Therefore, even if the return movement of the viewpoint LSA′ is performed, as shown in FIG. 22, when the return trip is largely deviated from the outward movement of the return movement, the movement of the viewpoint LSA′ is regarded as the confirmation action. There is no such thing. That is, by imposing a return condition on the condition of the committing action, it is possible to prevent erroneous detection of the committing action.

In addition, the player P turns the viewpoint LSA′ so as to deviate from the return route when the player P turns back the movement route of the viewpoint LSA′ in an attempt to perform the determination action but loses the determination intention immediately after the return. (See FIG. 22) By making the viewpoint LSA' stagnant for a certain period or more, it is possible to avoid immediate confirmation.

The game calculation section 110 may adjust the precision (severity) of the return condition in accordance with the progress of the game, preset settings, and the like. For example, if the predetermined value is increased, the return condition can be made gentle, and if the predetermined value is decreased, the return condition can be made strict.

4-7-4. When the game calculation unit 110 as the confirmation notice notifying unit 110D detects the turning point of the turning movement of the viewpoint LSA′, the game calculation unit 110 gives the player P a notice (confirmation notice) of the possibility of the determination action being detected.

For example, when the movement pattern of the turn-back movement of the viewpoint LSA′ is as shown in FIG. 18, the game calculation section 110 gives the player P a confirmation notice immediately after detecting the turn-back point P3.

Like the other notifications to the player P, the confirmation notice to the player P can be given by, for example, controlling the object space setting unit 111 and emphasizing the object. As a method of emphasizing an object, at least one of the various emphasizing methods described above can be adopted. It is also possible to add a visual effect to the object in order to emphasize the object. Examples of this visual effect include display of an arrow mark from the viewpoint LSA' to the starting point (FIG. 23(f')).

If such an arrow mark (FIG. 23(f′)) is displayed at the timing when the game calculation unit 110 detects the turning point, not only the player P can recognize the possibility that the lock of the object is confirmed but also the confirmation is performed. The player P can also recognize the moving direction of the viewpoint LSA′ necessary to complete the action (to satisfy the return condition described above).

Further, the confirmation notice to the player P can also be given by causing the sound generation unit 140 to generate a sound effect and outputting the sound effect to the headphones 61 of the HMD 20 via the communication control unit 120 and the communication unit 196.

That is, the confirmation notice to the player P can be given through at least one of the visual sense, the auditory sense, the tactile sense, and the sense of smell of the player P.

FIG. 23 shows an example of a case where the player P is given a confirmation notice by the state of the arrow mark and the neon mark row.

23(d)→23(e)→23(f)→23(g)→23(h)→23(i)→23(j) is a confirmation action after the object is locked. 23D shows the state transition of the object when nothing is done, and FIG. 23(d)→FIG. 23(e)→FIG. 23(f)→FIG. 23(f′)→FIG. 23(g′) The state transition of the object when the confirming action is performed after the object is locked is shown. Note that in FIG. 23, the timing at which the turning point of the confirming action is detected is the timing in FIG.

In the example shown in FIG. 23, when the confirmation action is started and the turning point is detected (FIG. 23(f)), an arrow mark is displayed on the object, and the number of neon mark rows of the object rapidly increases. Also, the neon mark row starts blinking (FIG. 23(f')).

In this case, the player P determines that an arrow mark is displayed on the locked object (FIG. 23(f)→FIG. 23(f′)), and that the number of neon mark rows of the locked object is rapidly increased. (FIG. 23(f)→FIG. 23(f′)), or because the neon mark row of the locked object starts to blink (FIG. 23(f)→FIG. 23(f′)), the confirmation action is performed. Can be detected (that is, the locked object can be immediately determined).

Therefore, the player P receiving this confirmation notice continues the confirmation action when he/she wants to immediately confirm the lock of the object, and suspends the confirmation action when he/she wants to keep the lock of the object (from the viewpoint as the starting point). It is possible to make a decision of "turning off or stopping in the direction away" in a timely manner.

Although not particularly shown in FIG. 23, the game calculation unit 110 indicates the remaining moving distance of the viewpoint LSA′ required until the return condition is satisfied by the length of the arrow mark displayed (FIG. 23(f′). ) May be reflected in).

4-7-5. Detection notification When the game calculation section 110 as the notification section 110D further detects a confirmation action, the game calculation section 110 notifies the player P to that effect (detection notification).

For example, when the movement pattern of the turn-back movement is as shown in FIG. 18, the game calculation unit 110 detects the turn-back point P3 and the length of the return pass along the forward pass is within a predetermined time. The detection notification is sent to the player P at the timing when the predetermined length is reached (for example, the timing when the viewpoint LSA′ reaches the position P5).

The detection notification to the player P can be performed by, for example, controlling the object space setting unit 111 and emphasizing the object, like other notifications to the player P.
As a method of emphasizing an object, at least one of the various emphasizing methods described above can be adopted. It is also possible to add a visual effect to the object in order to emphasize the object.

FIG. 23 shows an example in which the detection notification to the player P is given by the state of the arrow mark and the neon mark row.

FIG. 23(f′)→FIG. 23(g′) shows the state transition of the object when the confirmation action is continued after the confirmation notice.

FIG. 23(f′)→FIG. 23(g) shows the state transition of the object when the confirmation action is interrupted after the confirmation notice.

In the example shown in FIG. 23, if the confirmation action is continued after the confirmation notice (FIG. 23(f′)), the arrow mark of the object disappears, the number of neon mark rows of the object becomes maximum, and The neon mark row blinks rapidly (FIG. 23(g')).

On the other hand, in the example shown in FIG. 23, when the confirmation action is interrupted after the confirmation notice (FIG. 23(f′)), the arrow mark of the object disappears and the number of neon mark rows of the object becomes the charge amount. Then, the blinking of the neon mark row ends (FIG. 23(g)). That is, the object returns to its original state.

In this case, the player P has disappeared the arrow mark after the confirmation notice (FIG. 23(f′)→FIG. 23(g′)), and has the maximum number of neon mark rows after the confirmation notice (FIG. 23( f') → Fig. 23(g')), or the confirmation action is completed due to the fact that the neon mark row starts blinking at high speed after confirmation is announced (Fig. 23(f') → Fig. 23(g')). It is possible to recognize what has been done (that is, the locked object has been confirmed).

Further, the player P has returned the number of neon mark rows to the original number after the announcement of confirmation (FIG. 23(f′)→FIG. 23(g)), or has finished blinking the neon mark row after the announcement of confirmation (FIG. 23(f′)→FIG. 23(g), it is possible to recognize that the committing action has been interrupted (that is, the locked object has not been committed).

4-8. Flow of Eye Input Accepting Process Next, the flow of the eye input accepting process performed by the game calculation unit 110 will be described with reference to FIG.

The flow of the eye input acceptance process is, for example, that the game system 1 needs to accept one or more instructions from the player P during, before, or after the execution of the aerial fear experience game (FIGS. 8 and 9). If it occurs, it is executed appropriately. The flow of the eye input acceptance processing is executed for each object (object that can be designated by the player P) that is the target of the eye input acceptance processing. Here, the selection screen (FIG. 10) is taken as an example.

For example, when the game processing mode has already been set to the "single player mode" or the "two player mode", each of the push button objects OB1 and OB2 in the select screen (FIG. 10) has a reception process. , And the push button objects OB3 and OB4 are subject to the eye input acceptance processing.

If the game processing mode has already been set to the “beginner mode” or the “advanced mode”, the push button objects OB3 and OB4 in the selection screen (FIG. 10) are not the target of the acceptance processing, Each of the button objects OB1 and OB2 is a target of the eye input acceptance process.

The flow of FIG. 24 will be described below.

First, the game calculation section 110 starts displaying an object that is a target of the acceptance process (step S11). The display of the object is performed by arranging the object in the virtual three-dimensional space.

Next, the game calculation section 110 executes visual determination processing of the object (step S13), and when the object is visually observed (step S13Y), starts charging of the visual time of the object (step S15). If not (step S13N), the visual determination (step S13) is repeated. It should be noted that “charging of visual time” is measurement of visual time, and the amount of charge is increased according to the time when the object is visually observed, and the object is charged according to the time when the line of sight of the object is off. It is the process of reducing the amount. It should be noted that, when the charge is started (S15), the game calculation unit 110 performs a process of performing visual determination and increasing/decreasing the charge amount according to the result of the visual determination during a period until the charge amount is reset. For example, it is repeated periodically. The repetition cycle is set to the same cycle as the frame cycle, for example.

Next, the game calculation unit 110 does not exceed the first threshold value Th1 (=2) (step S17N) and unless the line of sight of the object is off (step S19N), the charge amount is the first threshold value Th1( =2) has been reached (step S17) and the line of sight from the object has been removed (step S19).

Then, the game calculation unit 110 resets the charge amount of the object to zero when the line of sight of the object deviates before the charge amount exceeds the first threshold Th1 (=2) (step S17N) (step S19Y). After that (step S20), the process returns to the visual determination process (step S13).

When the charge amount exceeds the first threshold Th1 (=2) (step S17Y), the game calculation section 110 accepts the lock of the object (step S21). This locks the object.

When the object is locked (step S21), the game calculation unit 110 does not reach the second threshold value Th2 (=5) (step S23N), and the charge amount until the third threshold value Th3 (=zero). Unless it decreases (step S25N), it is determined whether the charge amount has reached the second threshold Th2 (=5) (step S23) and whether the charge amount has decreased to the third threshold Th3 (=zero). The determination process (step S25) is repeated.

After that, when the charge amount drops to the third threshold value Th3 (=zero) (step S25Y), the game calculation section 110 accepts the unlocking of the object (step S29), and the initial visual determination process (step S29). Return to S13).

When the charge amount reaches the second threshold Th2 (=5) (step S23Y), the game calculation unit 110 receives the lock confirmation (step S27), and resets the charge amount to zero ((S27)). Step S30), and the flow ends. This establishes the lock of the object.

Although not shown in the above flow, when the charge amount of the object exceeds the first threshold Th1 (step S17Y), the game calculation unit 110 waits until the charge amount of the object reaches the second threshold Th2. If the line of sight deviates from (step S19Y), the charge amount of the object reaches the second threshold Th2 (step S23Y), and the charge amount of the object decreases to the third threshold Th3 (step S25Y), The process for changing the mode of the visual effect (the mode of the visual effect of the object itself) is executed (see FIG. 14 and the like).

4-9. Flow of Lock Strength Control Processing Next, a flow of lock strength control processing will be described with reference to FIG.

The flow of the lock strength control process is executed in parallel with the flow of the eye input acceptance process (FIG. 24). Further, the flow of the lock strength control processing is repeatedly executed for each object that is the target of the eye input reception processing.

First, the game calculation section 110 determines whether or not the object is locked (step S51).

Then, when the object is not locked (step S51N), the game calculation section 110 sets the size of the hit area to "standard" (step S53), and determines the reduction rate of the charge amount when the line of sight is off. It is set to "high" (step S55), and the flow ends. However, the rate of decrease of the charge amount is slower than the rate of increase of the charge amount.

On the other hand, when the object is locked (step S51Y), the game calculation section 110 determines whether or not the charge amount of the object is “3” or more (step S57).

If the charge amount is not equal to or greater than "3" (step S57N), the game calculation unit 110 sets the size of the hit area to "medium" (step S59), and the charge amount is reduced when the line of sight is off. The speed is set to "medium", which is slower than "high" (step S61), and the flow ends.

On the other hand, when the charge amount is equal to or larger than “3” (step S57Y), the game calculation unit 110 sets the size of the hit area to “large” (step S65), and the charge amount when the line of sight is off The decrease speed is set to a speed "low" that is slower than "medium" (step S67), and the flow ends.

Although not shown in the above flow, the game calculation section 110 makes the size expansion ratio of the player P in the left-right direction larger than the size expansion ratio of the player P in the vertical direction (see FIG. 16). .. Further, in the above flow, the order of steps can be changed within a possible range.

4-10. Flow of Speed-Up Processing Next, the flow of speed-up processing by the game calculation unit 110 will be described with reference to FIG.

The speed-up processing flow is executed in parallel with the eye input acceptance processing flow (FIG. 24). In addition, the flow of the speed-up process is repeatedly executed for each object that is the target of the eye input acceptance process.

First, the game calculation section 110 determines whether or not the object is locked (step S71).

When the object is not locked (step S71N), the game calculation section 110 repeats the determination of step S71.

When the object is locked (step S71Y), the game calculation section 110 determines whether or not the viewpoint LSA' satisfies the starting point condition (step S73).

If the viewpoint LSA' satisfies the starting point condition (step S73Y), the game calculation section 110 proceeds to the next step, and if not (step S73N), the game calculation section 110 returns to the initial determination process (step S71). ..

Next, the game calculation section 110 determines whether or not the movement of the viewpoint LSA' satisfies a straight line condition or a circular arc condition (step S75).

If the movement of the viewpoint LSA' does not satisfy the straight line condition or the circular arc condition (step S75N), the process returns to the initial determination process (step S71), and if not (step S75Y), the process proceeds to the next process (step S77). ..

Next, the game calculation section 110 determines whether or not the movement of the viewpoint LSA' satisfies the time condition (step S77).

If the movement of the viewpoint LSA' does not satisfy the time condition (step S77N), the process returns to the initial determination process (step S71), and if not (step S77Y), the process proceeds to the next process (step S79).

Next, the game calculation section 110 determines whether or not the movement of the viewpoint LSA' satisfies the distance condition (step S79).

If the movement of the viewpoint LSA' does not satisfy the distance condition (step S79N), the process returns to the initial determination process (step S71), and if not (step S79Y), the process proceeds to the next process (step S81).

Next, the game calculation section 110 determines whether or not the movement of the viewpoint LSA' satisfies the turning back condition (step S81).

If the movement of the viewpoint LSA' does not satisfy the turn-back condition (step S81N), the process returns to the determination process for the straight-line condition (step S75), and if not (step S81Y), the process proceeds to the next process (step S83).

Next, the game calculation section 110 determines whether or not the movement of the viewpoint LSA' satisfies the angle condition (step S83).

If the movement of the viewpoint LSA' does not satisfy the angle condition (step S83N), the process returns to the initial determination process (step S71), and if not (step S83Y), the process proceeds to the next process (step S85).

Next, the game calculation section 110 gives an advance notice (confirmation notice) to the player P about the possibility of detecting the confirmation action (step S85), and proceeds to the next process (step S87).

Next, the game calculation section 110 determines whether or not the movement of the viewpoint LSA' satisfies the return condition (step S87).

If the movement of the viewpoint LSA' does not satisfy the return condition (step S87N), the advance notice (confirmation notice) is canceled and then the process returns to the initial determination process (step S71), and the return condition is satisfied (step S87Y). Proceeds to the next process (step S88).

Next, the game calculation section 110 notifies the player P that the confirmation action has been detected (detection notification) (step S88), and proceeds to the next process (step S89).

Next, the game calculation unit 110 receives confirmation of lock of the object regardless of the detected charge amount of the object (step S89), resets the charge amount to zero (step S91), and then ends the flow. .. This establishes the lock of the object.

4-11. Example of application of eye input For example, in the high-rise fear experience game of the present embodiment, a mode in which the task is to capture (rescue) the cat effect object 80 and the cat effect object 80 is captured (rescue). There are modes that do not require you to do anything.

In this case, at the start of the game, the game calculation unit 110, for example, as shown in FIG. 27, the character image “Do you want to capture a cat?”, the cat object, and the push button objects OB5 and OB6 in a virtual three-dimensional manner. Place in space OBS.

Among them, the push button object OB5 is a push button object for the player P to input the intention of “YES” to the simulation control device 100, and the push button object OB6 is the player P that controls the intention of “NO” by the simulation control. A push button object for inputting to the device 100.

For example, when the player P locks and confirms the push button object OB6 corresponding to “NO” as shown in FIG. 28 by the eye input, the game calculation unit 110, for example, displays an animation in which the cat object is retracted from the virtual movement path. It is displayed in the virtual three-dimensional space OBS via the object space setting unit 111. In addition, the game calculation unit 110 causes the effect object for cat 80 to be retracted from the end point of the actual movement route R via the effect control processing unit 114.

Further, for example, when the player P locks and confirms the push button object OB5 corresponding to “YES” by the eye input, the game calculation unit 110, for example, the animation in which the cat object escapes toward the end point of the virtual movement route. Is displayed in the virtual three-dimensional space OBS via the object space setting unit 111. Further, the game calculation section 110 arranges the cat effect object 80 at the end point of the actual movement route R via the effect control processing section 114.

In the above embodiment, the object that the player P can specify by the eye input is the push button object (icon), but the character (enemy character, ally character, animal character, own avatar), item (treasure box, It may be a card) or a part of a character or item.

5. As described above, in the simulation control device 100 according to the present embodiment, the player P visually recognizes the display processing unit 110A that displays a virtual three-dimensional space on the HMD 20 and the objects arranged in the virtual three-dimensional space. When the player P's line-of-sight is deviated from the object, the amount of charge is reduced according to the time when the line of sight of the player P deviates from the object. When the charge amount reaches the first threshold Th1, the instruction to lock the object is accepted, and when the charge amount reaches the second threshold Th2 which is larger than the first threshold Th1, the instruction to lock the object is accepted and confirmed. Before, the accepting unit 110C that accepts the unlocking of the object when the charge amount drops to the third threshold Th3, the notifying unit 110D that notifies the player P of the magnitude of the charge amount, and the lock of the object is confirmed. And a receiving unit 110C (the game calculation unit 110 as the receiving unit 110C) is provided with an executing unit 110E that executes a predetermined process associated with the object. When a predetermined confirmation action accompanied by is detected, lock confirmation is accepted even if the charge amount has not reached the second threshold Th2.

Therefore, the player P can lock the object by visually checking until the charge amount of the object reaches the first threshold Th1. On the other hand, when the player P looks at the object within a range not exceeding the first threshold Th1 (at a glance), the unlocked state of the object can be maintained.

Further, when the object is locked, even if the line of sight of the player P deviates from the object, the lock is maintained until the charge amount drops to the third threshold Th3. Therefore, in order to maintain the lock, the player P Is not forced to fix his line of sight. On the contrary, if the player P removes the line of sight from the object until the charge amount drops to the third threshold value Th3, the object can be unlocked.

In addition, after the object is locked, the player P can visually input the object until the charge amount reaches the second threshold value Th2 to input the confirmation instruction to the simulation control device 100. On the contrary, after the object is locked, if the player P visually or removes the line of sight of the object so that the charge amount falls between the second threshold value Th2 and the third threshold value Th3, the locked state is continued. Can also

Therefore, the player P can freely control the state of the object among the three states of “locked”, “unlocked (unlocked)”, and “confirmed” by the eye input. The “eye input” is to input his/her instruction to the simulation control device 100 by the player P visually observing the object.

Furthermore, when the player P performs a predetermined confirmation action involving the line-of-sight turn-back movement after the object is locked, the player P does not continue to visually check the object until the charge amount increases to the second threshold Th2. You can lock the object. That is, the simulation control device 100 of the present embodiment can shorten the waiting time of the player P (time from lock to confirmation) as necessary.

Further, the game calculation section 110 serving as the receiving section 110C detects a turn-back movement in which at least the time required for the outward trip is within a predetermined time, as an action for confirmation. In other words, the game calculation section 110 as the acceptance section 110C uses the turn-back movement as a final action if at least the time required for the outward trip is not within the predetermined time even if the turn-back movement is performed. Not detected.

Therefore, even if the line-of-sight turn-back movement is performed, if the time required for the outward path of the turn-back movement is too long, the turn-back movement is not regarded as a confirmation action. Therefore, erroneous detection of the confirmation action can be prevented.

Further, the game calculation section 110 serving as the receiving section 110C detects, as a confirmation action, a turn-back movement in which at least the distance required for the outward path is within a predetermined distance. In other words, the game calculation section 110 as the receiving section 110C determines that the return movement is the final action if at least the distance required for the outward trip is not within the predetermined distance even if the return movement is performed. Not detected.

Therefore, even if the line of sight is turned back, if the moving distance before turning back is too long, the turning back movement is not regarded as a confirmation action. Therefore, erroneous detection of the confirmation action can be prevented.

Further, the game calculation section 110 serving as the receiving section 110C detects a turn-back movement in which the turn-back angle from the outward path to the return path is within a predetermined angle, as an action for confirmation. In other words, the game calculation unit 110 as the receiving unit 110C confirms the return movement if the return movement from the outward path to the return path is not within the predetermined angle even if the return operation is performed. Not detected as an action.

Therefore, even if the line-of-sight turn-back movement is performed, if the turn-back angle of the movement path is too large, the turn-back movement is not regarded as the confirmation action. Therefore, erroneous detection of the confirmation action can be prevented.

Further, the game calculation section 110 serving as the acceptance section 110C detects, as the action for confirmation, a turn-back movement in which at least the shape of the outward path satisfies the linear condition or the arc condition. In other words, the game calculation section 110 as the receiving section 110C determines that the return movement is the final action if at least the outward shape does not satisfy the straight line condition or the arc condition even if the return movement is performed. Not detected.

Therefore, even if the line of sight is turned back, if the movement path bends in a direction different from the original direction before the turning point, the turn back movement is not regarded as a confirmation action. Therefore, erroneous detection of the confirmation action can be prevented.

Further, when the game calculation unit 110 serving as the notification unit 110D detects the turnaround point of the turnaround movement, the game calculation unit 110 notifies the player P of the possibility that the confirmation action is detected.

Therefore, the player P can recognize the possibility that the confirmation action will be detected (the possibility that the locked object will be confirmed immediately) from the notice. In addition, the player P, who has received the notice, timely decides to continue the committing action if he/she wants to instantly secure the lock of the object, or interrupt the committing action if he/she wants to keep the lock of the object. It can be carried out.

Further, when the game calculation section 110 as the notification section 110D detects a confirmation action, the game calculation section 110 notifies the player P to that effect.

Therefore, the player P can recognize that the confirmation action is detected (that is, the locked object is confirmed) from the notification. Further, the player P can recognize that the confirmation action has not been detected (that is, the locked object has not been confirmed) because the notification has not been given.

6. Modification 6-1. Regarding the Motion Sensor In the game system of the above embodiment, the image pickup camera 70 is used to detect the position and orientation of the head of the player P, but a motion sensor mounted on the HMD 20 may be used, or an image pickup camera. A combination of 70 and a motion sensor may be used. An acceleration sensor, an angular velocity sensor (gyro sensor), or the like can be used as the motion sensor. The motion sensor is suitable for highly accurately detecting the movement of a moving object (here, the head of the player P) accompanied by a change in posture.

6-2. Regarding Line-of-sight Detection In the above embodiment, the game calculation unit 110 uses the movement (position and posture) of the display area DS and the visual recognition area LSA in the virtual three-dimensional space OBS as the movement (position and posture) of the player P's head. Although it is made to follow, the movement (position and posture) of the eyeball of the player P may be made to follow.

Alternatively, in the above-described embodiment, the game calculation unit 110 determines movements (positions and postures) of the display area DS and the visual recognition area LSA in the virtual three-dimensional space OBS, both of the movement of the head of the player P and the movement of the eyeball. May be followed.

In that case, for example, the game calculation unit 110 causes the movement of the display area DS in the virtual three-dimensional space OBS to follow the movement of the head of the player P, and the movement of the visual recognition area LSA in the display area DS as the player P. The movement of the eyeball may be made to follow.

In order to detect the movement of the eyeball of the player P, for example, a line-of-sight sensor that detects the line-of-sight direction of the player P is mounted on the HMD 20, and the output of the line-of-sight sensor is output via the communication unit 196 and the communication control unit 120. It may be received by the processing unit 101 (game calculation unit 110).

As the line-of-sight sensor, at least one of the following line-of-sight sensors (1) and (2) can be adopted.

(1) A line-of-sight sensor including a camera that captures at least one eye of the player P and a processing unit that detects the position of the pupil of the player P (information indicating the direction of the visual axis) based on the image captured by the camera.

(2) A projection unit that projects detection light such as infrared rays onto at least one eyeball of the player P, a detection unit that detects the amount of reflected light of the detection light on the retina of the eyeball, and an eyeball based on the output of the detection unit. A line-of-sight sensor including a processing unit that detects the direction of the visual axis.

When using the line-of-sight sensor, it is desirable to calibrate the line-of-sight sensor for each player P. The calibration of the line-of-sight sensor is a process for correctly detecting the line-of-sight direction of the player P regardless of variations in the position of the eyeballs, variations in the size of the pupils, variations in the mounting posture of the HMD 20, etc. for each player P. For example, it is a process of causing the player P wearing the HMD 20 to view some known directions and adjusting the parameters of the processing unit based on the output of the line-of-sight sensor at that time.

6-3. Virtual Mechanic Switch In the above embodiment, the game calculation unit 110 notifies the player P of the status of the object (charge amount, presence/absence of lock, presence/absence of detection of turning point, etc.) (including confirmation notice and detection notice). Although some examples of changing the emphasis level of an object have been described (see FIGS. 14, 15, 23, etc.), other methods can be adopted to change the emphasis level. For example, a method of changing the appearance of the object.

For example, the game calculation unit 110 may adopt a virtual push button (virtual mechanical switch) as an object that can be designated by the player P, and change the amount of pressing the virtual mechanical switch according to the status of the object. For example, the game calculation unit 110 can give the player P the sensation of pressing down the virtual mechanical switch by injecting the line of sight by increasing the pressing amount of the virtual mechanical switch as the charge amount of the object increases. This virtual mechanical switch is a virtual mechanical switch that is locked by long-pressing (here, long-sightedness) and is determined by further long-pressing (here, long-sightedness). In addition, for example, the game calculation unit 110 makes the player feel as if the virtual mechanical switch is pushed down by the turn-back movement of the line of sight by deepening the pushing amount of the virtual mechanical switch as the probability of the confirmation action being detected is higher. Can be given to P.

6-4. Notification Based on Presence or Absence of Object Highlighting In the above-described embodiment, some examples have been described in which the game calculation unit 110 changes the degree of highlighting of an object in order to notify the player P of the status of the object (including confirmation notice and detection notification). (See FIGS. 14, 15, 23, etc.), the presence/absence of emphasis of an object (for example, presence/absence of display of a mark) may be switched.

For example, the game calculation unit 110 may hide the neon mark row while the object is not locked, and may start displaying the neon mark row when the object is locked.

In addition, for example, the game calculation unit 110 hides the neon mark row when the turning point is detected after the object is locked, and continues displaying the neon mark row when the turning point is not detected after the object is locked. Good. FIG. 29(f)→FIG. 29(f′) shows an example in which the neon mark row is hidden after the turning point is detected. In FIG. 29(f)→FIG. 29(g), the turning point is detected. This shows an example in which the neon mark row is continuously displayed without being displayed.

Further, for example, the game calculation unit 110 continues to hide the neon mark row when the confirming action is continued after the turning point is detected, and the neon mark is stopped when the confirming action is interrupted after the turning point is detected. You may restart the display of columns. FIG. 29(f′)→FIG. 29(g′) shows an example in which the non-display of the neon mark row is continued after the turning point is detected. An example in which the display of the neon mark row is restarted after the turning point is detected is shown.

That is, the game calculation unit 110 hides the neon mark row at the time when the lock is confirmed regardless of the charge amount (FIG. 29(f′), FIG. 29(g′)) and changes the charge amount according to the charge amount. At the time when the lock is confirmed by the lock (FIGS. 29D to 29I), whether or not to emphasize the object may be switched in a pattern of displaying the neon mark row. Note that the patterns given here are examples and can be variously modified. Further, as a visual effect, a gauge can be used instead of the neon mark row (see FIG. 30).

6-5. Regarding the wording “selection” In the above-described embodiment, the game calculation unit 110 accepts the start of measurement (charge) at the timing when the visual observation of a certain object is started, and the “selection” is performed at the timing when the charge amount exceeds the first threshold Th1. (Lock)", and when the charge amount reaches the second threshold Th2, "selection (lock) confirmation" is received, and when the charge amount drops to the third threshold Th3, "selection (lock) release". Accepted. However, the name of the instruction accepted by the game calculation unit 110 at each timing is merely for convenience, and can be replaced with another name.

For example, in the above embodiment, the following can be read as follows. That is, the game calculation unit 110 receives “selection” at the timing when the visual observation of a certain object is started, and receives “maintain selection (lock)” at the timing when the charge amount exceeds the first threshold value Th1 to receive the charge amount. May accept “confirmation of selection” at the timing when the second threshold Th2 is reached, and may accept “release of selection” or “release of maintenance (lock)” at the timing when the charge amount is reduced to the third threshold Th3.

6-6. Regarding Function Sharing The functions of the elements in the game system 1 of the present embodiment can be appropriately modified within a range in which the effects are not impaired.

For example, some of the functions of the HMD 20 described above may be mounted on the simulation control device 100 side, or some or all of the functions of the simulation control device 100 may be mounted on the HMD 20 side. Further, the functional assignment of each element included in the processing unit 101 of the simulation control device 100 can be changed as appropriate.

For example, some or all of the processing of the display processing unit 110A may be executed by the object space setting unit 111, and some or all of the processing of the object space setting unit 111 may be executed by the display processing unit 110A. Good.

Further, a part or all of the processing of the measurement unit 110B may be executed by the state detection processing unit 112, and a part or all of the processing of the state detection processing unit 112 may be executed by the measurement unit 110B. ..

Further, the simulation control device 100 may be equipped with a dedicated circuit (hardware) that realizes a part or all of the functions of the processing unit 101. That is, part or all of the processing in the processing unit 101 may be executed by software or hardware.

6-7. Regarding the game machine In the above embodiment, the game system 1 (simulation control device 100 of the game system 1) including the structure in which the real space in which the player P can move (hereinafter, simply referred to as “real space”) is formed, Although the example in which the eye input by the HMD 20 is applied has been described, the eye input by the HMD 20 can also be applied to another game system.

For example, the eye input by the HMD 20 can be applied to a system in which a game is provided from a server device to a terminal device via a network such as the Internet. In that case, the execution of the game program in the system may be performed on the terminal device side or the server device side. In that case, the terminal device may realize the above-mentioned game by executing an operation input and an image display by streaming.

Further, the eye input by the HMD 20 can be applied to a stand-alone game device that is not connected to a network, and is not limited to a game device, but a smartphone, a tablet information terminal device, a personal computer, a monitor, or a television. It is also possible to apply to a terminal device capable of executing operation input using a touch panel such as.

6-8. Regarding Eye Input Device In the above embodiment, the non-transmissive HMD 20 is used for eye input, but other types of wearable image display devices such as a transmissive HMD and a monocular HMD may be used for eye input. Also, as a method of mounting the HMD on the player P, various mounting methods such as a hat type, an eyeglass type, a helmet type, a sun visor type, and a hair band type can be adopted.

7. Others The present invention is not limited to the one described in the above embodiment, and various modifications can be made. For example, terms referred to as broad or synonymous terms in the description or drawings can be replaced with broad or synonymous terms in other descriptions in the specification or drawings.

The present invention includes configurations that are substantially the same as the configurations described in the embodiments (for example, configurations having the same function, method, and result, or configurations having the same purpose and effect). Further, the invention includes configurations in which non-essential parts of the configurations described in the embodiments are replaced. Further, the invention includes a configuration that achieves the same effect as the configuration described in the embodiment or a configuration that can achieve the same object. Further, the invention includes configurations in which known techniques are added to the configurations described in the embodiments.

Although the embodiments of the present invention have been described in detail as above, it will be easily understood by those skilled in the art that many modifications can be made without materially departing from the novel matters and effects of the present invention. .. Therefore, all such modifications are included in the scope of the present invention.

1... Game system 10... Structure 20... HMD
30... Suspension unit 40... Fall prevention unit 50... Suspension control unit 60... Marker unit 70... Imaging camera 80... Rendering object 90... Rendering device (blower, spring plate panel and movement guide path)
100... Simulation control device

Claims (9)

A display processing unit for displaying a virtual space on the wearable image display device;
A measuring unit that determines whether or not the user is visually observing the object arranged in the virtual space, and measures the time when the user visually observes the object,
A receiving unit that accepts the selection of the object when the measurement value obtained by the measurement reaches a first threshold value, and accepts the confirmation of the selection when the measurement value reaches a second threshold value that is larger than the first threshold value. ,
The receiving part is
In the case of detecting a predetermined confirmation action accompanied by the turning movement of the line of sight with the object being selected as a starting point, the confirmation of the selection is accepted even if the measured value has not reached the second threshold value ,
Further comprising a notification unit for notifying the user that it is in the return movement state,
A simulation control device characterized by the above. The simulation control device according to claim 1,
The receiving part is
At least the turn-back movement in which the time required for the outward trip is within a predetermined time is detected by the confirming action.
A simulation control device characterized by the above. The simulation control device according to claim 1 or 2,
The receiving part is
At least the return movement in which the distance required for the outward trip is within a predetermined distance is detected as the confirmation action,
A simulation control device characterized by the above. The simulation control device according to any one of claims 1 to 3,
The receiving part is
The turn-back movement in which the turn-back angle from the forward path to the return path is within a predetermined angle is detected as the confirmation action.
A simulation control device characterized by the above. The simulation control device according to any one of claims 1 to 4,
The receiving part is
At least the return movement in which the shape of the outward path satisfies a linear condition or an arc condition is detected as the confirming action,
A simulation control device characterized by the above. The simulation control device according to any one of claims 1 to 5,
The notification unit,
When the turning point of the turning movement is detected, the user is notified of the possibility that the action for confirmation is detected .
A simulation control device characterized by the above. The simulation control device according to claim 6,
The notification unit further includes
When the confirmation action is detected, the fact is notified to the user,
A simulation control device characterized by the above. The simulation control device according to any one of claims 1 to 7,
Further comprising an execution unit that executes a predetermined process associated with the object when the selection of the object is confirmed,
A simulation control device characterized by the above. A display processing unit for displaying a virtual space on the wearable image display device;
A measuring unit that determines whether or not the user is visually observing the object arranged in the virtual space, and measures the time when the user visually observes the object,
A receiving unit that receives the selection of the object when the measurement value obtained by the measurement reaches a first threshold value, and accepts the confirmation of the selection when the measurement value reaches a second threshold value that is larger than the first threshold value; Make the computer work,
The receiving part is
In the case of detecting a predetermined confirmation action accompanied by the turning movement of the line of sight with the object being selected as a starting point, the confirmation of the selection is accepted even if the measured value has not reached the second threshold value ,
Causing the computer to further function as a notification unit for notifying the user that it is in the return movement state,
A simulation control program characterized in that

Images