JP2017182217A - Simulation controller and simulation control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a simulation controller and a simulation control program which operate as a highly operable user interface using a wearable image display device.SOLUTION: The simulation controller comprises: a display processing unit for displaying a virtual space on a wearable image display device; a measurement unit for measuring the visual observation time of a user on an object arranged in the virtual space, and when the line of sight comes off the object, reducing the measured value in accordance with a time during which the line of sight is off; and an acceptance unit for accepting selection of an object when the measured value reaches a first threshold, accepting confirmation of selection when the measured value reaches a second threshold larger than the first threshold, and accepting cancellation of object selection when the measured value drops to a third threshold before confirmation. When a prescribed condition is satisfied while two or more objects are selected the same time, the acceptance unit accepts confirmation on the basis of a measured value that is common to all of the selected objects.SELECTED DRAWING: Figure 6

Description

  The present invention relates to a simulation system using a wearable image display device such as a head mounted display.

  A head-mounted display (hereinafter referred to as “HMD”) is known as a head-mounted image display device that displays an image in front of a user's eyes. For example, the game system disclosed in Patent Document 1 uses an motion sensor (acceleration sensor, gyro sensor) provided in the HMD and a camera that captures the HMD from the outside to capture an image of the movement of the player's head. The player is linked to give the player a virtual reality feeling as if he has entered the game space. This system changes the high sensitivity parameter of the game character to the player according to the player's line of sight detected from the movement of the player's head, thereby causing the player to experience an eye contact with the game character. You can also.

Japanese Patent Laying-Open No. 2015-231443

  In recent years, as in the system of Patent Document 1, there is an increasing number of games that are developed not only by the operation of the controller existing in the real space but also by the movement of the head, and a game in which the player moves in the real space is assumed. It is desirable for the player to maintain a hands-free state as much as possible for safety in the event of a fall.

  Accordingly, an object of the present invention is to provide a simulation control device and a simulation control program that can operate as a user interface with high operability by using a wearable image display device.

(1) In order to solve the above problem, a simulation control apparatus of the present invention provides:
A display processing unit for displaying the virtual space on the wearable image display device;
Measurement that measures a user's viewing time for an object arranged in the virtual space, and decreases the measurement value according to the time when the user's line of sight deviates from the object according to the time when the line of sight is deviated And
The selection of the object is accepted when the measurement value reaches a first threshold value, and the selection is accepted when the measurement value reaches a second threshold value that is greater than the first threshold value. A receiving unit that receives the cancellation of the selection of the object when the value drops to a third threshold,
The receiving part is
If a predetermined condition is satisfied when two or more objects are simultaneously selected, at least the confirmation is accepted based on the measurement value common to all of the two or more objects being simultaneously selected. .

The “common measurement value” is, for example, a measurement value obtained by integrating individual measurement values of two or more objects (measurement value after integration), a measurement value of an object representing two or more objects (representative) Measurement values) new measurement values (separate measurement values) set separately from the individual measurement values of two or more objects. The “measurement value after integration” is, for example, an average of individual measurement values, a weighted average of individual measurement values, a sum of individual measurement values, a product of individual measurement values, or the like.

  Therefore, the user can select the object by viewing until the measured value exceeds the first threshold. On the other hand, when the user visually observes an object within a range not exceeding the first threshold (when the user glances), it is possible to maintain the non-selected state of the object. In addition, after the object is selected, the user can input a confirmation instruction to the simulation control device only by visually observing the object until the measurement value reaches the second threshold value, and the measurement value decreases to the third threshold value. Just by removing the line of sight from the object, the user can input a release instruction to the simulation apparatus. That is, the user can control the state of the object among three states of “non-selected (cancel)”, “selected”, and “confirmed” by an operation of visually observing the object.

  In addition, when a predetermined condition is satisfied when two or more objects are selected at the same time, the accepting unit determines a final value based on the common measurement values for all the two or more selected objects. Accept. Therefore, since the user can confirm the selection of two or more objects being selected by one operation (movement of the viewing target), than when performing an operation on each of two or more objects, The number of operations can be reduced.

(2) In the simulation control apparatus of the present invention,
The receiving part is
If the predetermined condition is satisfied when the two or more objects are simultaneously selected, the release is accepted based on the measurement value common to all the two or more objects being simultaneously selected. You may go.

  Therefore, since the user can cancel the selection of two or more objects being selected by one operation (movement of the viewing target), than when performing an operation on each of two or more objects, The number of operations can be reduced.

(3) Moreover, in the simulation control apparatus of the present invention,
The predetermined condition is:
The user may re-view a first selected object among the two or more objects being simultaneously selected.

  Therefore, the user activates the simulation control device in a mode in which the selection of two or more objects can be confirmed by one operation by performing an operation of re-viewing the object selected first. be able to.

(4) In the simulation control apparatus of the present invention,
The receiving part is
When the predetermined condition is satisfied, the measurement values for all of the two or more objects being simultaneously selected may be integrated.

  In this case, since the measurement value before the predetermined condition is satisfied can be taken over by the integrated measurement value, the visual operation of the user performed before the predetermined condition is satisfied is not wasted.

(5) Moreover, in the simulation control apparatus of the present invention,
The measuring unit is
When the predetermined condition is satisfied, the integrated measurement value may be increased or decreased according to the viewing time for the first selected object.

  Therefore, the user can control the states of two or more objects only by controlling the viewing time of the first selected object after the predetermined condition is satisfied.

(6) In the simulation control apparatus of the present invention,
The measuring unit is
The speed at which the measured value of the non-selected object approaches the first threshold value may be made slower as the measured value of the selected object is larger.

  In this case, since the non-selected object is less likely to be selected as the user looks at the selected object for a long time, for example, the user increases the number of objects selected when the user does not want to activate the mode or at the same time. If you don't want to, look at the object to be selected for a long time, and if you want to activate the mode or increase the number of objects to be selected at the same time, adjust the not to look at the object to be selected for too long. You can decide whether or not to activate the mode and whether or not to select the mode at your own will.

(7) In the simulation control apparatus of the present invention,
The receiving part is
When the user performs the following operations (a) to (c) for a specific object that is any one of the two or more objects being simultaneously selected, the specific object of the two or more objects The cancellation of the selection may be accepted.

(A) observing the specific object;
(B) removing the line of sight from the specific object;
(C) The specific object is visually observed.

  Therefore, the user can cancel the selection of the object only by performing an operation (so-called twice) of visually observing the object to be deselected from two or more objects, removing the line of sight from the object, and re-observing the object. Can do.

(8) In the simulation control apparatus of the present invention,
You may further provide the notification part which notifies the said magnitude | size of the measured value to the said user.

  Therefore, the user can specify the object he / she is viewing, and can distinguish whether he / she is viewing the object. Furthermore, the user can grasp the remaining time until the object is selected, the viewing time required until the selection is confirmed, based on the notified charge amount. Therefore, according to the simulation control apparatus, the user can comfortably input information by the visual operation.

(9) In the simulation control apparatus of the present invention,
The notification unit
A visual effect corresponding to the measured value may be given to the selected object.

In this way, if the measurement value is visualized, the user can specify the object that he / she is viewing, or can distinguish whether he / she is viewing the object. The user can also visually grasp the remaining time until the object being viewed, the viewing time necessary until the selection is confirmed, and the like.

(10) In the simulation control apparatus of the present invention,
The notification unit
The selected object and the non-selected object may be distinguished.

  Therefore, the user can distinguish whether or not each of the one or more objects is selected.

(11) In the simulation control apparatus of the present invention,
The notification unit
The aspect of the visual effect of the two or more objects being simultaneously selected may be changed between when the predetermined condition is satisfied and when the predetermined condition is not satisfied.

  Therefore, the user can recognize whether or not the mode is activated for the selected object based on the visual effect applied to the selected object.

(12) In the simulation control apparatus of the present invention,
The visual effect is
It may be an animation.

  According to the animation, it is possible to notify the user of changes in the measured value over time in real time (or sequentially).

(13) In the simulation control apparatus of the present invention,
The animation
An animation in which an annular or partial annular gauge is arranged on the outer edge of the object and the length of the gauge is changed according to the measurement value may be used.

  In this way, if the measurement value is reflected in the length of the gauge, the user can intuitively determine, for example, the size of the measurement value, whether the measurement value increases or decreases, the increase rate of the measurement value, the decrease rate of the measurement value, etc. It is possible to grasp.

(14) In the simulation control apparatus of the present invention,
The animation
An animation in which a mark row is arranged at an outer edge portion of the object and the number of mark rows is changed according to the measurement value may be used.

  In this way, if the measurement value is reflected in the number of arrangements of the mark rows, the user can intuitively know, for example, the size of the measurement value, the increase / decrease of the measurement value, the increase rate of the measurement value, the decrease rate of the measurement value, etc. It is possible to grasp it.

(15) In the simulation control apparatus of the present invention,
The animation
An animation that changes the degree of emphasis of the object according to the measurement value may be used.

As described above, if the measurement value is notified to the user by the change in the emphasis degree of the object itself, a wide space around the object can be secured, so that the degree of freedom of layout of the object increases. Therefore, it is effective, for example, when a large number of objects are densely arranged. Note that the degree of enhancement of an object can be adjusted by at least one of the following parameters, for example.

Object density,
Object brightness,
Object color,
Object opacity,
・ Saturation of the object,
Object shape,
A change pattern of at least one of the density, brightness, color, opacity, saturation, and shape of the object.

(16) In the simulation control apparatus of the present invention,
You may further provide the execution part which performs the predetermined | prescribed process matched with the said object, when the said selection of the said object is decided.

  Therefore, when the selection is confirmed, a predetermined process is automatically executed (however, the execution timing may be immediately after the confirmation or after a lapse of a predetermined time from the confirmation). The predetermined processing includes, for example, simulation parameter setting processing, object attack processing, object movement processing, processing for other objects, processing for executing a predetermined program, and the like.

(17) Further, the simulation control program of the present invention includes:
A display processing unit for displaying the virtual space on the wearable image display device;
Measurement that measures a user's viewing time for an object arranged in the virtual space, and decreases the measurement value according to the time when the user's line of sight deviates from the object according to the time when the line of sight is deviated And
The selection of the object is accepted when the measurement value reaches a first threshold value, and the selection is accepted when the measurement value reaches a second threshold value that is greater than the first threshold value. When the value drops to the third threshold value, the computer functions as an accepting unit that accepts the cancellation of the selection of the object,
The receiving part is
If a predetermined condition is satisfied when two or more objects are simultaneously selected, at least the confirmation is accepted based on the measurement value common to all of the two or more objects being simultaneously selected. .

  Note that part or all of the functions of the simulation control device of the present invention can be realized by a server device and a terminal device. It is also possible to record part or all of the program of the present invention on an information storage medium.

It is a block diagram which shows the general | schematic structure in one Embodiment of the game system which concerns on this invention. It is a figure for demonstrating the virtual three-dimensional space (simulation space) which can be experienced with the game system of one Embodiment. It is a top view which shows the structure of the structure in one Embodiment. It is sectional drawing which shows the structure of the structure in one Embodiment. It is the perspective view and side view which show the structure of HMD used for the game system of one Embodiment. It is a block diagram which shows the block configuration of the simulation control apparatus in one Embodiment. It is a figure which shows an example of the movement path | route member which is a production object and presentation apparatus of one Embodiment. It is a flowchart (the 1) which shows operation | movement of the game system in one Embodiment. It is a flowchart (the 2) which shows operation | movement of the game system in one Embodiment. The figure explaining the relationship between the virtual three-dimensional space, the viewing area of the player P, and the space visible to the player P (example in which the viewing area is located at the center of the virtual three-dimensional space). The figure explaining the relationship between the virtual three-dimensional space, the viewing area of the player P, and the space visible to the player P (example in which the viewing area is located at the upper left of the virtual three-dimensional space). The figure explaining the relationship between a hit area and a visual recognition area. The figure explaining the relationship between the elapsed time from the visual start, and the charge amount of visual time. The figure explaining the example of the visual effect of an object. The figure explaining the change of the visual effect before and after the combo process is activated. The figure explaining integration of charge amount. The figure explaining a partial cancellation | release process. The figure explaining separation of the charge amount. The figure explaining another example of the visual effect of an object. The figure explaining the control processing of lock strength. The flowchart of the acceptance process of eye input. The flowchart of the process which concerns on a combo process. 10 is a flowchart of lock strength control processing. FIG. 6 illustrates an application example of eye input (part 1); FIG. 6 illustrates an application example of eye input (part 2); The figure explaining another example of the visual effect of an object.

  Hereinafter, embodiments will be described. The embodiments described below do not unduly limit the contents of the present invention described in the claims. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention. Furthermore, in the following embodiments, a virtual three-dimensional space is associated with the movement of a user in a space (that is, a real space) determined in advance using a HMD (head mounted display) as a wearable image display device. It is an embodiment when the simulation control device according to the present invention is applied to a game system that provides a game by being simulated.

1. Outline of Game System First, an outline of the game system 1 of the present embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a configuration diagram showing a schematic configuration of the game system 1 of the present embodiment. FIG. 2 is a diagram for explaining a virtual three-dimensional space (hereinafter also referred to as “simulation space”) that can be experienced by the game system 1 of the present embodiment.

  The game system 1 according to the present embodiment mainly includes a structure 10 in which a real space (hereinafter simply referred to as “real space”) in which a player P (an example of a user) can move is formed, and the player P. And an HMD 20 that displays a simulation image of a virtual three-dimensional space (that is, a simulation space) associated with the real space.

Specifically, the game system 1 of the present embodiment generates a simulation image that can be seen by the player P in the simulation space corresponding to the real space in the real space, and displays various environments and situations in the pseudo space as the player P. It is a simulator to let you experience.

In particular, the game system 1 of the present embodiment is
(1) Detecting a player state (specifically, the position and posture of the player in the real space) indicating the state of the player P in the real space;
(2) According to the detected player state, for example, a simulation that has a virtual movement path associated with the movement path R as shown in FIG. 2 and that can be seen from the player P in the simulation space corresponding to the real space Execute the image generation process to generate the image,
(3) Display the generated simulation image on the HMD 20;
(4) When the player state has a given condition on the movement route R, the player P determines that the specific state is a specific state on the simulation space;
(5) When it determines with the said specific state, the simulation image for performing the production | presentation based on the said specific state is produced | generated,
It has a configuration.

  The game system 1 according to the present embodiment includes a suspension unit 30 that suspends the HMD 20 from the structural body 10, and the player P moves in the real space by suspending the HMD 20 independently of the player P. When moving or when a predetermined part (for example, the head) of the player P moves, the HMD 20 falls down against the intention of the player P while following the movement of the player P. In addition, the HMD 20 has a configuration capable of maintaining the mounting of the HMD 20 on the player P or preventing the HMD 20 from dropping due to the attachment / detachment.

In addition to the structure 10, the HMD 20, and the suspension unit 30, the game system of the present embodiment, as shown in FIG.
(1) A fall prevention unit 40 that prevents the player P moving in real space from falling.
(2) The suspension position of the HMD 20 in the suspension unit 30 is changed according to the movement of the player P in the real space, and the suspension position of the player P is changed according to the movement of the player P in the real space. Suspension control unit 50 for changing
(3) The real space while detecting the marker unit 60 attached to a predetermined part (for example, the head, both hands and both feet) of the player P, and detecting the direction and position of each part by detecting the marker unit 60 An imaging camera 70 for detecting the state of the player P as a player state,
(4) Various rendering devices 90 to 93 and a rendering object 80 that are arranged in the real space and that allow the player P to experience a given rendering by interlocking with the simulation image;
(5) Generate a simulation image of a simulation space, which is a virtual three-dimensional space associated with the real space, visible to the player P, and in conjunction with the simulation image according to the detected player state, the corresponding effect device A simulation control apparatus 100 for controlling 90 to 93;
It has.

  With such a configuration, the game system 1 of the present embodiment can cause the player P to experience the specific state as a simulation when the player P is in the specific state while interlocking with the state of the player P. Accurately identify the environment and situation that the player P should experience, especially the environment and situation that is difficult to actually experience, such as the environment where the player P falls when moving out of the travel route R, and the situation where the player P moves. Can be reproduced.

For example, not only high places but also closed places, special spaces, dangerous places such as hot places or cold places, and environments and situations that are difficult to experience in reality, depending on the state of the player P It can be reproduced as an environment that creates a state.

  Therefore, the game system 1 of the present embodiment can improve the reproducibility of any place or space including a dangerous place or a space that is difficult to experience in reality. It is possible to let the player P experience a natural feeling.

  In addition, since the game system 1 according to the present embodiment can suspend the HMD 20 independently of the player P, the player P moves in the real space or a predetermined part of the player P ( For example, when the HMD 20 moves in the front-rear direction, the left-right direction, and the up-down direction by moving the head), even if the player P loses balance and falls down against the intention of the player P, the HMD 20 It is possible to maintain the mounting on the player P or to prevent the player P from dropping due to the attachment / detachment.

  Therefore, the game system 1 according to the present embodiment is injured when the player P falls while the HMD 20 is mounted, or the HMD 20 is attached or detached against the player P's intention. It is possible to prevent unforeseen situations such as the occurrence of a collision or a breakage of a part of the HMD 20 and the occurrence of a failure.

  As a result, in the game system 1 of the present embodiment, if the suspension position of the HMD 20 can be changed with the movement of the player P by a rail, an arm, or the like, for example, the HMD 20 is always suspended at an appropriate position, for example, from above. Since the player P can move in the real space with the HMD 20 attached, the player P can be injured during the simulation of the player P. In addition, it is possible to prevent unforeseen circumstances including breakage or failure of the HMD 20.

  For example, when image supply to the HMD 20 and its control are executed by wire, such as when the image is provided with high resolution, wiring for connecting to a control device that controls the HMD 20 is arranged via the suspension unit 30. Therefore, the movement limitation and discomfort of the player P due to the presence of the wiring on the side or under the foot of the player P can be solved.

  In other words, by having the above-described configuration, the game system 1 of the present embodiment ensures smooth movement and safety in the real space of the player P to which the HMD 20 is attached, and unforeseen such as an injury of the player P. The situation can be avoided.

  In the present embodiment, the following description will be given using a game that simulates a fear experience at a high place (hereinafter referred to as a “high place fear experience game”).

2. Configuration of game system 2-1. Structure Next, the structure 10 in the game system 1 of the present embodiment will be described with reference to FIGS. 3 and 4 together with FIG. 3 is a plan view showing the structure of the structure 10 in the present embodiment, and FIG. 4 is a cross-sectional view showing the structure of the structure 10 in the present embodiment.

  The structure 10 is a housing in which a real space in which the player P can move and the game is executed is formed. For example, as shown in FIGS. 1, 3, and 4, the ceiling 15 And it has the box-shaped structure of the rectangular parallelepiped formed by the floor 16 and the wall 17 which covers the four sides.

  The structure 10 includes a standby area 11 where the player P, who is the player P, waits for the start of the experience-type game, and a play area 12 where the experience-type game is executed. In particular, the play area 12 includes a start zone 13 in which the player P exists at the start of the game, and a zone in which the player P actually moves to experience a predetermined environment and situation. The movement experience zone 14 in which the movement route R in which the existence of the movement is permitted is formed is included.

  On the ceiling 15, the suspension unit 30 that suspends the HMD 20 and the player P from the standby area 11 to the play area 12 and along the movement path R in the movement experience zone 14 prevents the player P from falling. A plurality of suspension control units 50 to which the unit 40 is slidably attached are formed.

  Each suspension control unit 50 is provided with a simulation control device 100 in the corresponding movement path.

  A plurality of imaging cameras 70 used for detecting the player state of the player P and the state of the effect object 80 are disposed on the ceiling 15 at predetermined positions. The player state of the player P includes, for example, the position and orientation (posture) of the head of the player P.

  The floor 16 has a different configuration for each of the standby area 11 and the play area 12, and for each of the start zone 13 and the movement experience zone 14.

  Specifically, the start zone 13 of the play area 12 is configured by a panel (that is, a spring floor panel) 92 in which a spring that creates an environment that moves up and down by an elevator is provided as one of the production means.

  In addition, the movement experience zone 14 of the play area 12 is prohibited from moving by the movement path R constituted by a metal or other predetermined member (movement path member 93 described later) for the player P to walk, and the movement of the player P. The non-moving route NR is configured by a mat or the like that protects the player P when the player P falls down.

  Furthermore, the start zone 13 of this embodiment has a structure for providing as a virtual three-dimensional space of the elevator interior space, and a simulation is performed as an effect device at the boundary between the start zone 13 and the moving experience zone 14. An automatic door 91 that functions as an elevator door whose opening and closing is controlled by the control of the control device 100 is provided.

  In particular, an effect object 80 is arranged on the movement path R (specifically, the end point of the movement path member 93). On the non-moving route NR, an effect device such as a blower 90 may be formed as necessary, and a sensor unit such as a contact sensor may be formed as necessary.

  The wall 17 is formed of a mat that protects against a predetermined wall panel or an injury caused by a collision by the player P.

2-2. HMD and Suspension Unit Next, the HMD 20 used in the game system of the present embodiment and the suspension unit 30 for suspending the HMD 20 will be described with reference to FIG.

FIG. 5 is an example of a perspective view and a side view showing the configuration of the HMD 20 used in the game system of the present embodiment. Further, for example, the HMD 20 of the present embodiment constitutes a wearable image display device of the present invention.

  The HMD 20 is a wearable display device that displays an image of a non-transparent virtual three-dimensional space mounted on the head of the player P under the control of the simulation control device 100, and shows the external environment outside the display device. This is a display device for visually recognizing only the image displayed on the player P in an unrecognizable state and allowing the player P to experience augmented reality visually.

  For example, as shown in FIG. 4 and FIG. 5 described above, the HMD 20 has a structure that completely covers (that is, masks) both eyes of the player P, and is linked to the detected player state. It has a configuration for visually recognizing a simulation image of a simulation space associated with a real space in the structure 10 that can be seen from P.

  In addition, a marker unit (hereinafter referred to as a “head detection marker unit”) 60 a for detecting the orientation and position of the head of the player P is formed on the top of the HMD 20. The HMD 20 has, for example, a display size of 200 × 1080 pixels and a refresh rate of 90 fPS.

  The HMD 20 has a headphone jack (not shown), and a headphone 61 is connected to the headphone jack. The headphones 61 are attached to the player P together with the HMD 20. In addition, the headphone 61 outputs the environmental sound that constitutes the three-dimensional sound in the simulation space generated by the simulation control apparatus 100.

  The suspension unit 30 is connected to the suspension control unit 50 disposed above the HMD 20 and the player P, for example, the ceiling 15 of the structure 10, so that the suspension unit 30 is suspended by the structure 10 and the HMD 20 is It has a configuration to be suspended.

  In particular, the suspension unit 30 of the present embodiment suspends the HMD 20 above the structure 10 (that is, the ceiling 15) in order to suspend the play area 12 in accordance with movement or movement in any direction in the player P. Therefore, it is formed above the player P.

  The suspension unit 30 has wiring (hereinafter referred to as “cable”) for connecting the HMD 20 and the simulation control apparatus 100 by wire.

  Specifically, for example, as shown in FIGS. 4 and 5, the suspension unit 30 has a connection member 31 used for connection to the suspension control unit 50 and a shape to be attached to the connection member 31. The HMD 20 is connected to a string-like member (that is, a cable) 32 having a formed end (hereinafter referred to as “first end”), and a second end different from the first end of the string-like member 32. Connecting member 33 to be configured.

  In particular, the string-shaped member 32 prevents the HMD 20 from being grounded to the floor surface of the structure 10 when the player P moves greatly, for example, when the player P is about to fall down. It has a possible structure.

  Specifically, the string-like member 32 is extendable and configured by a cable that transfers predetermined signals and data transmitted from the simulation control device to the HMD 20.

For example, the string-like member 32 has a structure that prevents the HMD 20 from coming into contact with the floor surface of the structure 10 when the HMD 20 is detached from the player P. The cable has a length that does not contact the floor of the structure 10, the string-like member has a spiral shape that can be expanded or contracted, or the cable to adjust the length of the string-like member It has a winding structure.

  Note that the HMD 20 of the present embodiment is not limited to these, and any HMD 20 that is attached to the player P and can display an image so as to be visually recognized by the player P may be used. It may be.

  In addition, when the HMD 20 and the simulation control apparatus 100 transfer signals or data by wireless communication, the string-like member 32 does not have to be a cable, and may be a string of a predetermined material, A band-shaped member having a width such as a band may be used.

  Furthermore, in a part of the suspension unit 30, specifically, the connecting member 31 and the string-like member 32 are members that are common to the fall prevention unit 40, as will be described later.

2-3. Fall Prevention Unit Next, the fall prevention unit 40 in the game system of this embodiment will be described with reference to FIG.

  The fall prevention unit 40 loses the balance due to the wearing of the HMD 20, the walking movement path R is narrow, or both, or the balance is lost and the player P intends. On the contrary, it is used to support the player P and to prevent the player P from falling when it falls.

  That is, when the player P loses balance, the fall prevention unit 40 not only prevents damage to the HMD 20 and injury to the player P based on the damage, but also causes the player P to be generated when the HMD 20 is attached during game play. It is possible to prevent a fall (such as a fall due to a loss of balance during movement).

  Specifically, the fall prevention unit 40 includes, for example, a holder member 41 that holds the player P and a suspension member that suspends the player P from the structure 10, as shown in FIG. The suspension member is constituted by the members of the suspension unit 30, that is, the connecting member 31 and the string-like member 32 described above.

  The holder member is constituted by, for example, a vest type outer garment having no sleeve portion, and holds the state of the player P by causing the player P to wear it during play. The holder member 41 is connected to one end of the string-like member 32 and has a configuration for supporting the body of the player P through the connecting member 31 formed on the ceiling 15 of the structure 10.

2-4. Suspension control unit Next, the suspension control unit 50 in the game system of the present embodiment will be described with reference to FIGS. 1, 3, and 4.

  The suspension control unit 50 of the present embodiment is a unit for changing the suspension position of the player P itself and the HMD 20 according to the movement of the player P in the real space in the structure 10, and is always upward (ie, The HMD 20 and the player P are suspended from the ceiling of the structural body 10).

The suspension control unit 50 has a configuration capable of suspending the HMD 20 and the player P at a suitable position in the real space so as to correspond to the movement and movement of the player P in the moving direction, and the player P. It is possible to prevent unforeseen situations including injury during the simulation of the player P, breakage or failure of the HMD 20, while ensuring safety of the player.

  Therefore, even if the player P moves freely in the real space, the suspension control unit 50 has a cable for supplying signals and data to the HMD 20 and a member for holding the player P on the side or under the player P. The restriction and discomfort of the movement of the player P based on the existence can be eliminated accurately, and the HMD 20 and the player P can always be suspended accurately with respect to the movement and movement of the player P. It has become.

  Specifically, the suspension control unit 50 is integrally formed from the standby area 11 to the play area 12, and the HMD 20 and fall prevention are performed for the player P that moves in the real space or the player P whose posture changes. The unit 40 is configured to follow.

  For example, as shown in FIGS. 1, 3 and 4, the suspension control unit 50 of the present embodiment is provided for each player P moving in the real space, and the waiting area 11 (more specifically, the HMD 20 and the overturn) The rail 51 and the connecting member 31 of the suspension unit 30 are formed along the moving direction of the movement of the player P from the point where the prevention unit 40 is mounted to the play area 12, and slide on the rail 51. And a sliding member 52.

  In particular, each rail 51 is located on the movement path R in the movement experience zone 14 in which the player P moves along the movement path R (that is, a zone in which the player P moves linearly back and forth). It is formed on the ceiling.

  In addition, each rail 51 is routed in other areas in the real space when the player P performs a simulation such as preparation for mounting the HMD 20 and the fall prevention unit 40 or guiding to the start position (hereinafter, referred to as the rail 51). , Referred to as “guidance path”.) It is constituted by rails 51 formed along S.

  Note that the shape and material of the rail 51 are not limited as long as the position of the suspension unit 30 can be changed according to the movement of the player P.

  The sliding member 52 slides on the rail 51 according to the tension generated according to the state of the player P, such as the movement of the player P or the change of the posture, and the suspension position of the HMD 20 and the player P via the suspension unit 30. To change.

  In addition, as shown in FIGS. 1, 3, and 4, the sliding member 52 shortens the length of the cable that electrically connects the HMD 20 and the simulation control device 100 to accurately transfer signals and data. In order to implement, it has the structure where the simulation control apparatus 100 is fixed, and has the structure which slides the said simulation control apparatus 100 integrally.

  The sliding member 52 slides on the rail 51 and changes the position of the HMD 20 and the HMD 20 via the suspension unit 30 according to the state of the player P such as movement of the player P or change of posture. If it is, it will not be specifically limited.

2-5. Simulation Control Device Next, the simulation control device 100 in the game system of this embodiment will be described using FIG.

FIG. 6 is a configuration diagram showing a block configuration of the simulation control apparatus 100 in the present embodiment. Furthermore, the simulation control apparatus 100 according to the present embodiment is not limited to the configuration shown in FIG. 8, and various modifications such as omitting some of the components and adding other components are possible.

  The simulation control device 100 is configured by a device capable of performing computer control such as a personal computer, for example, and is configured such that an operation unit (not shown) such as a keyboard operated by an administrator is detachable.

  In addition, since the simulation control apparatus 100 provides a simulation space to the player P, when the game is started, the game progresses according to the player state and the elapsed time, and the image according to the progress state of the game. And the production devices 90 to 93 are controlled in conjunction with the production control device.

  In particular, the simulation control apparatus 100 acquires an image output from the imaging camera 70, detects a marker in the marker unit 60 from the acquired image, the positional relationship between the area to which the marker belongs and other markers, the marker The player state is detected based on the stay time in the area to which the player belongs.

  Specifically, the simulation control apparatus 100 includes a storage unit 170 in which various data are stored, an information storage medium 180 in which data such as an application for executing the simulation is stored, execution of the game, and simulation by the execution thereof. A processing unit 101 that executes various processes for creating an environment for communication, and a communication unit 196.

  The storage unit 170 serves as a work area for the processing unit 101 and communication, and its function can be realized by a RAM (DRAM, VRAM) or the like. In particular, the storage unit 170 of this embodiment mainly includes a main storage unit 172 in which a game program is recorded, an image buffer 174, and a data buffer 176.

  The main storage unit 172 mainly stores game programs. The data buffer 176 is a storage area for storing game data of its own device, and may be configured to be provided in a part of the main memory and read / write controlled by software.

  The game program is software in which instruction codes for executing game processing are described. Further, the game data is data for determining a specific state of the player, data necessary for executing the game program, data of the object for rendering 80, control programs for various rendering devices 90 to 93, and the like. It is.

  The information storage medium 180 (a computer-readable medium) stores programs, data, and the like, and functions as an optical disk (CD, DVD), HDD (hard disk drive), memory (ROM, etc.), and the like. Can be realized.

  Note that the processing unit 101 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, in the information storage medium 180, a program for causing a computer (an apparatus including an operation unit, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment (a program for causing the computer to execute processing of each unit). ) Is stored.

  The communication unit 196 communicates with the HMD 20 via a cable and communicates with the imaging camera 70 and the rendering devices 90 to 93 via a wired or wireless network. It can be realized by hardware such as a communication ASIC or a communication processor, and communication firmware.

  Note that a program (data) for causing a computer to function as each unit of the present embodiment is stored in an information storage medium 180 (or storage medium) via a network and communication unit 196 from an information storage medium included in a host device (server system) (not shown). Part 170). Use of an information storage medium by such a host device can also be included within the scope of the present invention.

  The processing unit 101 (processor) performs game calculation processing, image generation processing, sound generation based on timing from the start of the game, image data output from the imaging camera 70 (hereinafter referred to as “image data”), a program, and the like. Generation processing, production control processing, and the like are performed.

  The processing unit 101 performs various processes using the storage unit 170 as a work area. The function of the processing unit 101 can be realized by hardware such as various processors (CPU, GPU, etc.), ASIC (gate array, etc.), and a program.

  The processing unit 101 includes a game calculation unit 110, an object space setting unit 111, a state detection processing unit 112, a movement / motion processing unit 113, an effect control processing unit 114, a communication control unit 120, an image generation unit 130, and a sound generation unit 140. Including. Note that some of these may be omitted.

  The game calculation unit 110 starts the game when the game start condition is satisfied, the process for proceeding with the game, and the process for arranging objects (including the effect object 80) necessary for forming the simulation space. A process for displaying an object, a process for ending a game when a game end condition is satisfied, and whether or not the player state is a specific state (specifically, a state in advance corresponding to the progress of the game). There is a determination process to determine.

  In particular, the game calculation unit 110 according to the present embodiment determines the viewing direction and the viewing area of the player P according to the detected player state (specifically, the position in the real space of the player P and the posture of the player P). (Hereinafter referred to as “viewing area”) is detected, and a space that is visible to the player P in the three-dimensional space is set according to the detected viewing direction, the viewing area, the current game environment, and the progress of the game.

  In addition, the game calculation unit 110 determines whether or not a game end condition is satisfied according to the detected player state or based on a predetermined elapsed time from the start of the game, and the game end condition When it is determined that is satisfied, the game is terminated.

  On the other hand, based on the data stored in the data buffer 176 in advance, the game calculation unit 110 determines whether or not the player P has entered a specific state corresponding to the progress of the game in accordance with the detected player state. The game is progressed according to the result, and an instruction for performing an effect corresponding to the effect control processing unit 114, the image generation unit 130, and the sound generation unit 140 is given.

  The object space setting unit 111 includes various objects (polygons, free-form surfaces, subdivision surfaces, etc.) for constructing a predetermined simulation space such as a production object 80, a building, a movement route R, a pillar, a wall, and a map (terrain). A process of placing and setting an object composed of primitives) in an object space (ie, a virtual three-dimensional space) is performed.

That is, the position and rotation angle (synonymous with direction and direction) of the object in the world coordinate system are determined, and the rotation angle (rotation angle about the X, Y, and Z axes) is determined at that position (X, Y, Z). Place the object with.

  In particular, in the present embodiment, as the production object 80, a movable object appearing in a simulation space such as an animal (hereinafter referred to as “production movement object”) and an object fixed in the simulation space are used. The object space setting unit 111 includes objects to be actually present in the real space for the player P to recognize (hereinafter referred to as “production fixed objects”), and the object space setting unit 111 places these effect objects 80 in the simulation space. Deploy.

  In the present embodiment, the effect moving object is an object that is actually moved in the real space and imaged as an object that also moves in the simulation space (hereinafter referred to as “true moving object”). In addition, an object that does not move in the real space but moves only in the simulation space when imaged (hereinafter referred to as “pseudo moving object”) is also included.

  The state detection processing unit 112 includes both hands and both feet of the player P at the same timing in the images of the player P (hereinafter referred to as “player images”) output from the plurality of imaging cameras 70 that image the player P, respectively. The position of the marker unit 60 disposed on the top of the HMD 20 is specified.

  And the state detection process part 112 is the position of each marker unit 60 in each specified image, the positional relationship with each other marker unit 60 in each marker unit 60, and the stay at each position of each marker unit 60. Based on each piece of time information, the player state indicating the position and posture of the player P in the real space is detected.

  In particular, a plurality of predetermined areas in real space are set for the image output for each imaging camera 70, and the state detection processing unit 112 determines which area each marker unit 60 belongs to. By detecting the position of the marker unit 60 included in each player P image at the same timing, the position of each marker unit 60 in the real space is detected for each image frame.

  In addition, the state detection processing unit 112 detects the position of each marker unit 60 in the real space for each frame, compares it with the position of each marker unit 60 in the previous frame, and sets the same position in a plurality of frames. Based on the number of frames in each marker unit 60 detected as being present, the staying time at the same position of each marker unit 60 is detected.

  And the state detection process part 112 detects the attitude | position in the real space of the player P based on the position in the real space in each marker unit 60 in the same timing, and the stay time until the said marker unit 60 until then. .

For example, the state detection processing unit 112 of the present embodiment
(1) Based on information on the position, height and time of a given part of the player P such as the head, both hands or both feet (hereinafter referred to as “part information”), Specify the position in space (that is, the coordinates of the center position (center of gravity position) of the player P in the real space),
(2) Based on the part information of the player P, specify the posture of the player P constructed from the positional relationship of each part such as the head, torso, and limbs of the player P, or
(3) Identify both (1) and (2)
The player state is detected based on the position, posture or both of the player P.

Then, the state detection processing unit 112
(A) detecting the viewpoint position and direction of the player P in the real space based on the position of the head of the player P;
(B) detecting the standing position and posture of the player P in the real space based on the position of the hand or the foot of the player P;
(C) Modeling the player P based on the detected standing position and posture of the player P (formation of bone),
Execute.

  For example, the user's part includes the user's head, hand, or foot, and the part information includes the position of each part (positional coordinates in the user movement space), direction, and shape (planar shape or three-dimensional shape). ) Or color (including gray scale).

  On the other hand, similarly to the player P, the state detection processing unit 112 specifies the position of the marker unit 60 disposed in the effect moving object in the real space, as in the player P. Based on the position in the real space, the position (the center or the position of the center of gravity) of the effect moving object in the real space and, if necessary, the state thereof are detected.

  The movement / motion processing unit 113 calculates the positional relationship between the player P and the effect object 80 based on the detected player state, the current game environment, the progress of the game, or two or more information thereof, Based on the calculated positional relationship between the player P and the effect object 80, movement / motion calculation (movement / motion simulation) of the effect object 80 is performed.

  That is, the movement / motion processing unit 113 performs each process of moving various objects in the object space and moving (motion, animation) the objects based on the detected player state and the like.

  Specifically, the movement / motion processing unit 113 receives movement information (position, rotation angle, speed, or acceleration) and motion information (position or rotation angle of each part constituting the object) of various objects. A simulation process is sequentially performed every frame (1/60 second).

  A frame is a unit of time for performing object movement / motion processing (simulation processing) and image generation processing.

  In addition, the movement / motion processing unit 113, with respect to the production moving object, the position in the real space, the positional relationship with the player P in the real space, the state of the production moving object (the moving direction of the production moving object) Movement information and motion information in the simulation space are calculated based on the current game environment and the progress of the game.

  In particular, the movement / motion processing unit 113, with respect to the pseudo moving object of the production moving object, is linked with the position and state of the real space or seamlessly with the position and state of the real space according to the user state. The movement information and the movement information in the simulation space are calculated based on the position and / or the state of the pseudo moving object in the real space so that it can be imaged.

For example, when the pseudo moving object is an animal object such as a cat, the movement / motion processing unit 113 operates at a position different from the position where the pseudo moving object is arranged in the real space, or Calculating movement information and motion information to move around different areas, return to the position where the pseudo moving object is arranged in the real space at a predetermined timing, and to be in a state similar to the state where the pseudo moving object is arranged in the real space I do.

  In such a case, the movement / motion processing unit 113 images the pseudo moving object at a position where it is arranged in the real space, but moves to image the motion such as the posture and gesture. Information and operation information are calculated.

More specifically, the movement / motion processing unit 113
(1) Even when a cat object as a pseudo moving object is arranged at the end point of the moving path R in the real space at the start of the game, the pseudo operation of moving the cat object around the player P ,
(2) When the player P advances a certain distance toward the end point of the movement path R, the cat object moves toward the position arranged in the real space, and the state in the real space is determined at the arrangement position. (3) Pseudo actions that do not change in the real space, such as various gestures when the player P holds a cat object,
(4) When the player P releases the cat object from the holding state, when the cat object falls, an operation linked to movement in the real space;
The movement information and the motion information for imaging are calculated.

  The effect control processing unit 114 executes processing for controlling various effect devices 90 to 93 in accordance with the player state (including the specific state), the state of the effect moving object, the current game environment, and the progress of the game. To do. Specifically, the effect control processing unit 114 executes control based on power ON / OFF, capability change, or a preset program in each of the effect devices 90 to 93.

  For example, when the effect devices 90 to 93 are the blower 90, the effect control processing unit 114 includes drive control and stop control including the intensity of the air blowing, and when the effect devices 90 to 93 are temperature adjusting devices, When the production devices 90 to 93 are the movement path R, the production devices 90 to 93 that need to be changed in accordance with the state of the player P, such as control of the swing unit or the vibration unit prepared in the movement route R. 93 is controlled.

  The communication control unit 120 performs processing for generating data to be transmitted to the HMD 20 (mainly image data for showing the simulation space to the player P). Moreover, the communication control part 120 transmits / receives the control signal for controlling each production | presentation apparatuses 90-93.

  The image generation unit 130 performs drawing processing based on various types of information such as the results of various processing (game processing) performed by the processing unit 101 and the player state (including a specific state). Image for showing the space to the player P) is generated and output to the HMD 20 via the communication control unit 120.

  In particular, the image generation unit 130 first acquires object data (model data) including vertex data (vertex position coordinates, texture coordinates, color data, normal vector, α value, etc.) of each vertex of the object (model). Based on the vertex data included in the acquired object data (model data), vertex processing (shading by a vertex shader) is executed.

Note that when performing the vertex processing, the image generation unit 130 may perform vertex generation processing (tessellation, curved surface division, polygon division) for subdividing the polygon as necessary.

  The image generation unit 130 performs vertex processing, vertex conversion processing, coordinate conversion (world coordinate conversion, camera coordinate conversion), clipping processing in accordance with a vertex processing program (vertex shader program, first shader program). Alternatively, geometry processing such as perspective transformation is executed, and based on the processing result, vertex data given to the vertex group constituting the object is changed (updated or adjusted).

  Then, the image generation unit 130 performs rasterization (scan conversion) based on the vertex data after the vertex processing, and associates the surface of the polygon (primitive) with the pixel.

  On the other hand, following rasterization, the image generation unit 130 executes pixel processing (shading or fragment processing by a pixel shader) for drawing pixels constituting an image (fragments constituting a display screen).

  In particular, in pixel processing, the image generation unit 130 reads out textures (texture mapping), sets / changes color data, translucent synthesis, anti-aliasing, and the like according to a pixel processing program (pixel shader program, second shader program). Various processes are performed to determine the final drawing color of the pixels constituting the image, and the drawing color of the perspective-converted object is stored in the storage unit 170 (a buffer capable of storing image information in units of pixels; VRAM, rendering target). Output (draw).

  In the pixel processing, the image generation unit 130 performs per-pixel processing for setting or changing image information (color, normal, luminance, α value, etc.) in units of pixels. Thereby, an image that can be seen by the player P in the object space is generated.

  Further, the image generation unit 130 is a hardware that enables a polygon (primitive) drawing process to be programmed by a shader program written in a shading language for vertex processing and pixel processing, so-called programmable shaders (vertex shaders and pixel shaders). To achieve.

  Programmable shaders can be programmed with vertex-level processing and pixel-level processing, so the degree of freedom in drawing processing is high, and the power of expression is greatly improved compared to conventional hardware-based fixed drawing processing. Can be made.

  On the other hand, the image generation unit 130 performs geometry processing, texture mapping, hidden surface removal processing, α blending, and the like when drawing an object.

  In particular, as the geometry processing, the image generation unit 130 performs processing such as coordinate conversion, clipping processing, perspective projection conversion, or light source calculation on the object.

  Then, the image generation unit 130 stores the object data (positional coordinates of object vertices, texture coordinates, color data (luminance data), normal vector, α value, etc.) after geometry processing (after perspective projection conversion). Store in the unit 170.

  Further, the image generation unit 130 executes texture mapping, which is a process for mapping the texture (texel value) stored in the storage unit 170 to the object. Specifically, the image generation unit 130 reads textures (surface properties such as color (RGB) and α value) from the storage unit 170 using texture coordinates or the like set (given) at the vertices of the object.

  Then, the image generation unit 130 maps a texture that is a two-dimensional image to an object. In this case, the image generation unit 130 performs processing for associating pixels with texels and bilinear interpolation as texel interpolation.

  Furthermore, the image generation unit 130 performs the hidden surface removal processing by the Z buffer method (depth comparison method, Z test) using the Z buffer (depth buffer) to which the Z value (depth information) of the drawing pixel is input. Perform surface erasing.

  That is, the image generation unit 130 refers to the Z value input to the Z buffer when drawing the drawing pixel corresponding to the primitive of the object. Then, the Z value of the referenced Z buffer is compared with the Z value at the drawing pixel of the primitive, and the Z value at the drawing pixel is a Z value (for example, a small Z value) on the near side as viewed from the player P. In some cases, the drawing process of the drawing pixel is performed and the Z value of the Z buffer is updated to a new Z value.

  Then, the image generation unit 130 performs α blending (α composition) of translucent composition processing (normal α blending, addition α blending, subtraction α blending, or the like) based on the α value (A value).

  The α value is information that can be stored in association with each pixel (texel, dot), for example, plus alpha information other than color information. The α value can be output as mask information, translucency (equivalent to transparency and opacity), bump information, and the like.

  The sound generation unit 140 performs sound processing based on the results of various processes performed by the processing unit 101 such as a player state (including a specific state), and game sounds such as BGM, sound effects, and sounds (in the simulation space). Environmental sound as stereophonic sound) is generated and output to the headphones 61 via the HMD 20.

2-6. Next, the player marker unit 60 and the imaging camera 70 in the game system of the present embodiment will be described with reference to FIGS. 1 and 4 described above.

  In the present embodiment, as described above, in order to detect the player state, each player P is provided with the marker units 60 at a plurality of portions. Specifically, as shown in FIGS. 1 and 4 above, the marker unit 60 of the present embodiment is disposed at a plurality of sites on the head, both hands, and both feet.

  In particular, each marker unit 60 is formed of a material that reflects on the surface thereof, such as a reflective sheet, and is formed of a marker of a ball field. For example, when each marker unit 60 is irradiated with light, the marker unit 60 reflects the light and shines in white or shines with a specific color.

  Specifically, each marker unit 60 includes a head detection marker unit 60a, a right or left hand detection marker unit 60b, and a right or left foot detection marker unit 60c.

  Note that a light source unit (not shown) that irradiates each marker unit 60 with light is provided in the movement experience area in the structure 10 of the present embodiment.

Further, the color that the marker unit 60 shines is not particularly limited. However, when a plurality of players P are simultaneously present in the movement experience area, the color may be changed for each player P, or the marker unit 60 is attached. You may change the color which the marker unit 60 shines for every site | part.

  For example, as shown in FIG. 1, each imaging camera 70 is fixedly disposed at a preset position in the structure 10, and images an area captured within the angle of view to simulate the image data. The data is sequentially output to the control device 100.

  In particular, each imaging camera 70 of the present embodiment is formed outside the movement range (specifically, the movement route R) in which the player P moves in real space.

  Each imaging camera 70 is arranged so as to image the play area 12, move into the play area 12, change the posture, or image all the players P that perform both. Yes.

  In addition, each imaging camera 70 according to the present embodiment includes a predetermined imaging element such as a CCD and a lens having a predetermined focal length, and an area within the angle of view is defined by a predetermined angle of view and focal length. The imaged image data is sequentially output to the simulation control apparatus 100.

  If the player P can freely move within the play area 12, it is necessary to image the entire play area 12, and each imaging camera 70 is arranged so that there is no omission in imaging of the play area 12. Established.

  Each imaging camera 70 is required to use a color camera in order to detect the colored marker unit 60.

  Further, the number and arrangement positions of the marker units 60 are not limited to the above. Basically, the arrangement positions are not limited as long as the positions can be captured by the imaging camera 70.

2-7. Effect Object and Effect Device Next, the effect object 80 and effect devices 90 to 93 in the game system of the present embodiment will be described with reference to FIGS. 1, 3, 4, and 7. FIG. 7 is a diagram illustrating an example of the movement path member 93 that is the effect device of the present embodiment.

  The effect object 80 and the effect devices 90 to 93 according to the present embodiment are disposed in a real space formed in the structure 10 and are linked with a simulation image under the control of the simulation control device 100. The player P is configured to experience a given effect.

  In particular, the effect object 80 and the effect devices 90 to 93 are not only an outdoor space and an indoor space, but also an effect for experiencing a simulation space such as a high place, a closed place, a dangerous place, a special space, a hot place, or a cold place. This is an object or presentation device that is used to create a realistic simulation of the situation that the player P can see through simulation in conjunction with a simulation image.

  Specifically, the production object 80 according to the present embodiment includes the production moving object and the production fixed object as described above, and the production moving object includes the intrinsic movement object and the pseudo movement object. .

The pseudo moving object is a production object 8 in the real space.
The image is formed in a state different from the zero state.

  The effect moving object is a marker unit for detecting the position in the real space, the positional relationship with the player P in the real space, and the state of the effect moving object (the moving direction and the posture of the effect moving object). 60d.

  Then, the effect moving object causes the simulation control device 100 to recognize the position, state, and both of the real space, as with each part of the player P, by causing the imaging unit 70 to image the marker unit 60d.

  For example, as the marker unit 60d of the effect object 80, the same one as the marker units 60a, b, and c disposed at each part of the player P is used. However, it is preferable that the color of the marker units 60a, b, and c of the player P or various information stored therein is different for each of the plurality of players P or the effect objects 80 appearing in the game.

  It should be noted that by providing a vibration unit inside the effect object 80 and performing vibration control of the vibration unit in the simulation control device 100, an effect that surprises the player P in conjunction with the simulation image or alone is executed. May be.

  The rendering devices 90 to 93 are devices for reliably creating a simulation space as a more realistic space, and directly providing a given rendering effect to the player P.

  In particular, the effect devices 90 to 93 are simply arranged in the real space while being linked to the simulation image, and the structured effect device that provides the player P with a given effect by the arrangement and its structure, and the detected player It includes a linked production device that provides a given production effect according to the state, game environment, and game progress.

  The interlocking effect device includes, for example, a fan 90 shown in FIG. 1 and an effect device for forming an environment of a simulation space such as a temperature adjusting device, an illumination device, or a vibration device (not shown).

  In addition, the structural rendering device includes a wall or floor such as a movement path member 93 constituting the movement path R, a start block (not shown) for recognizing the start position, or a spring floor panel 92 for recognizing the inside of the elevator. It includes a member for causing the player P to feel a touch such as surface irregularities or materials.

  For example, as shown in FIGS. 1 and 4, the blower 90 outputs a blow toward the front of the player P when the player P switches from the start zone 13 to the movement experience zone 14. When moving to the movement route R, the air flow is output from below the player P toward the front of the player P.

  As shown in FIGS. 3 and 7, the movement path member 93 is provided below the predetermined movement path R along which the player P moves, and is configured to be able to vibrate or swing according to the simulation image. An effectable area 93a is configured.

  That is, as shown in FIG. 7A, the movement path member 93 in the effectable area 93a has a height (height in the ceiling direction) that differs from the floor surface of the structure 10 (specifically, the non-movement path NR). ).

  The moving path member 93 in the effectable region 93a is driven by a plurality of drive units 95 that vibrate or drive the effectable region based on a given condition such that the player P starts walking on the moving path member 93. It is configured.

  In particular, each drive unit 95 includes a wheel 96 that rotates in a direction in which the moving path member 93 is parallel to the floor surface and perpendicular to the moving path direction (advancing direction of the player P). And a support plate 97 that supports a moving path member 93 having a gap D having a predetermined height (for example, about 5 mm) from the surface to be grounded.

  And the drive unit 95 is arrange | positioned adjacent to the other drive unit 95 along the movement path | route R in the production possible area | region 93a.

  Note that, in the movement path member 93 in the effectable area 93a, the entire movement path R may be configured by the drive unit 95, or the entire movement path R is configured by a combination with the movement path member 93 that is not driven. It may be. FIG. 7B shows an example in which the drive unit 95 continuously forms the movement path R.

  Further, as shown in FIGS. 7A and 7B, the drive unit may be configured to be driven to vibrate or swing independently, or mechanically vibrated by the effect control processing unit 114. Drive and swing drive may be controlled.

  On the other hand, the rendering device may change the structure or form of the simulation space only in a pseudo manner. In other words, the structure or form of the production object and the production apparatus do not change in the real space, but it is also possible to change the structure or form of the simulation space only in a pseudo manner.

  For example, when a predetermined event occurs, the image generation unit 130 artificially narrows the width of the movement path member 93, the wall 17 approaches, or the ceiling 15 artificially Only the simulation space may be changed in a pseudo manner, such as being lowered.

2-7-1. Operation of Game System Next, the operation of the game system 1 in this embodiment will be described with reference to FIGS. 8 and 9. 8 and 9 are flowcharts showing the operation of the game system 1 in the present embodiment.

  This operation will be described using a height fear experience game that simulates a fear experience at height. In particular, in the height fear experience game, the player P starts from the start zone 13 and moves on the movement path member 93 having a predetermined width, and exists at an end point (a point far from the start zone 13) on the movement path member 93. This is a game that holds (rescues) a production object 80 (for example, a cat) to return to the start zone 13 within the time limit.

  In addition, it is assumed that the player P has already mounted the HMD 20 and the fall prevention unit 40 and is ready for hardware.

  First, the game calculation unit 110 is not illustrated based on the operation of the administrator on the assumption that the game calculation unit 110 exists in a predetermined position (specifically, in the start zone 13) of the player P to which the HMD 20 and the fall prevention unit 40 are attached. It is detected whether or not the button is pressed (that is, the start of the game) (step S101).

  The game calculation unit 110 detects the start of the game by detecting whether or not the player P exists at a predetermined position while starting the detection of the player state by the state detection processing unit 112 as the process of step S101. May be.

  Next, the game calculation unit 110 starts various calculations related to the height fear experience game, and also includes an object space setting unit 111, a state detection processing unit 112, a movement / motion processing unit 113, an effect control processing unit 114, and an image generation unit. 130 and the sound generation unit 140 start each process related to the simulation in the height fear experience game (step S102).

In particular,
(1) The state detection processing unit 112 starts detection of the player unit and the state of the effect object 80 while starting detection of the marker unit 60 disposed in each part of the player P and the effect object 80,
(2) The object space setting unit 111 and the movement / motion processing unit 113 start building a simulation space that can be seen from the player P according to the player state, the state of the effect object 80, the game environment, and the progress of the game,
(3) The effect control processing unit 114 controls the corresponding effect devices (the blower 90, the automatic door 91, and the spring floor panel 92) according to the player state, the state of the effect object 80, the game environment, and the progress of the game. Start,
(4) The image generation unit 130 and the sound generation unit 140 start generating a simulation image and accompanying sound according to the player state, the state of the effect object 80, the game environment, and the progress of the game.

  Note that the process transition in step S102 is continuously executed until the end of the game is determined.

  Next, the image generation unit 130 displays an image in the elevator on the HMD 20, and the effect control processing unit 114 controls the spring floor panel 92 in the start zone 13 and executes a simulation process in the start zone 13 (step S103). ).

  Next, when the effect control processing unit 114 detects a predetermined timing (end of the simulation process in the start zone 13) (step S104), the effect control processing unit 114 executes the game start process (step S105), and the game The calculation unit 110 starts a countdown for starting the game (step S106).

For example, the production control processing unit 114 includes, as game start processing,
(1) End of control of the spring floor panel 92,
(2) control of the automatic door 91 (ie, the elevator door) formed between the start zone 13 and the movement experience zone 14 from the closed state to the open state; and
(3) Blower control by the blower 90,
The control of the corresponding production device such as is executed.

  Next, the game calculation unit 110 detects that the countdown has been completed (step S107), and the state detection processing unit 112 determines whether or not the movement experience zone 14 has been moved beyond the start zone 13 (hereinafter, referred to as “the movement experience zone 14”). "Start error determination" is executed (step S108).

At this time, when it is determined that the state detection processing unit 112 has moved to the movement experience zone 14 beyond the start zone 13 before the countdown ends, the state detection processing unit 112 notifies the HMD 20 of a warning (step S109). The process proceeds to step S107.

  Note that in this process, the state detection processing unit 112 may perform the accompanying effects such as interruption of the step S game start operation and restart the operation from the process of step S105, or may interrupt the game. Good.

  Moreover, when the game calculation part 110 detects that countdown was complete | finished, it will start the various calculation regarding execution of a height fear experience game (step S110). Specifically, the game calculation unit 110 starts counting the time limit and starts determining the game end process.

  Next, the game calculation unit 110 determines whether or not a game end condition is satisfied (step S111). Specifically, the game calculation unit 110 interlocks with the state detection processing unit 112 to determine whether the player state or the state of the effect object 80 satisfies the end condition, and whether the time limit has become “0”. Determine whether.

  For example, based on the detected player state, the game calculation unit 110 determines whether the player P has entered a specific state that is off the movement path R, and drops the effect object 80 to be rescued during the movement. It is determined whether or not a specific state satisfying the end condition such as has been satisfied.

  Next, if the game calculation unit 110 determines that the game end condition is not satisfied, whether the event calculation condition is satisfied in conjunction with the state detection processing unit 112 or according to the progress of the game It is determined whether or not (step S112).

  Specifically, the game calculation unit 110 determines whether or not it has moved onto the movement path member 93, and the first position on the movement path member 93 (the position where the cat object that is the effect object 80 is first arranged). Whether or not the player is in a predetermined specific state, such as whether the cat object that is the effect object 80 in real space has been reached (the end point of the moving path member 93). Including the event start condition.

  At this time, if the game calculation unit 110 determines that the event start condition is satisfied, the effect control processing unit 114, the image generation unit 130, and the sound generation unit 140 execute processing according to the detected event. However, if it is determined by the game calculation unit 110 that the event condition is not satisfied (YES in step S113), the process proceeds to step S111.

In particular,
(1) When it is determined that the player P has moved to the moving path member 93 in the specific state, the effect control processing unit 114 moves the blower 90 disposed below the player P. Performing an effect of sending wind from below to player P,
(2) When it is determined that the player P has reached the first position on the movement path member 93 (the position where the cat object that is the effect object 80 is first placed), it is determined that the image is generated. The unit 130 and the sound generation unit 140 execute an effect in which the cat object escapes to the end point of the movement path R,
(3) When it is determined that the player P is in a specific state that the position has reached the position where the cat object is arranged, an effect of rescuing the cat object is executed,
(4) When it is determined that the player P is in the specific state that the cat object is rescued, the image generation unit 130 and the sound generation unit 140 move in the direction toward the start zone 13. In the case of the production, the effect of narrowing the width of the movement path member 93 is executed,
(5) When it is determined that the player P is in a specific state where the player has reached the start zone 13 while holding the cat object, an effect relating to clearing the game, such as escaping from the elevator, is executed.

  On the other hand, when the game calculation unit 110 determines that the game end condition is satisfied, the image generation unit 130 and the sound generation unit 140 generate and output an image and sound for performing an effect related to the game end. (Step S114), and this operation is terminated. It should be noted that as the effects related to the end of the game, different effects are executed according to the game end conditions.

2-8. Eye input 2-8-1. Outline of Eye Input The game calculation unit 110 of the simulation control apparatus 100 according to the present embodiment appropriately includes a display processing unit 110A, a measurement unit 110B, and an acceptance according to a game program (an example of a simulation control program) recorded in the main storage unit 172. It operates as a unit 110C, a notification unit 110D, and an execution unit 110E, and functions as a user interface using eye input. Here, “eye input” means that the player P inputs his / her instruction to the simulation control apparatus 100 through an operation of visually observing the object. Hereinafter, an outline of operations of the display processing unit 110A, the measurement unit 110B, the reception unit 110C, the notification unit 110D, and the execution unit 110E related to the eye input will be described.

(1) Display processing unit 110A:
The display processing unit 110A displays a virtual three-dimensional space (reference OBS in FIG. 10) on the HMD 20. For example, the display processing unit 110A controls the object space setting unit 111 and the image generation unit 130, and arranges various objects for constructing the simulation space in the virtual three-dimensional space (reference OBS in FIG. 10). This object includes icons (push button objects OB1 to OB4 described later), a virtual controller, a virtual mechanical switch, a character, an item, and the like. In addition, the display processing unit 110A controls the image generation unit 130, sets a virtual camera in the virtual three-dimensional space OBS, and displays image data for showing the player P the field-of-view range (DA in FIG. 10) of the virtual camera. Execute the process to generate. In addition, the display processing unit 110 </ b> A controls the communication control unit 120 and the communication unit 196 to execute processing for outputting the image data to the HMD 20. Further, the display processing unit 110A determines the position and orientation of the virtual camera in the virtual three-dimensional space (reference OBS in FIG. 10) according to changes in the position and orientation of the head of the player P detected by the state detection processing unit 112. Execute the changing process.

(2) Measuring unit 110B:
The measurement unit 110B measures (charges) the viewing time of the player P with respect to the object (for example, the symbol OB1 in FIG. 11) arranged in the virtual three-dimensional space (the symbol OB1 in FIG. 11), and the object (the symbol OB1 in FIG. 11). When the player's line of sight (LSA in FIG. 10) deviates, the measured value (hereinafter referred to as “charge amount”) is measured according to the time when the line of sight (LSA in FIG. 10) is deviated. Decrease. The measurement unit 110B, for example, includes a hit area OBHA (an example of an area in which an object is present) of the push button object OB1 located in the display area DA, and a visual recognition area LSA (line of sight) set in the display area DA. Based on the positional relationship with an example of an area regarded as existing), a process of determining whether or not the player P is viewing the push button object OB1 (visual determination process) is executed.

(3) Receiving part 110C:
When the charge amount reaches a first threshold Th1 (for example, 2 seconds), the receiving unit 110C receives an instruction for selecting an object (reference numeral OB1 in FIG. 11) (hereinafter referred to as “lock”),
When the charge amount reaches a second threshold value Th2 (for example, 5 seconds) that is greater than the first threshold value Th1, an instruction to confirm the lock of the object (reference numeral OB1 in FIG. 11) is received, and the charge amount is set to the third threshold value before the confirmation. Release of the lock of the object (reference numeral OB1 in FIG. 11) is accepted when the time drops to Th3 (for example, zero seconds). However, even if the charge amount does not reach the second threshold Th2 (for example, 5 seconds), the receiving unit 110C has exceeded the first threshold Th1 and the player P has performed a predetermined action. In some cases, the lock may be forcibly confirmed. The predetermined action may be “depressing a button arranged in the real space” or “viewing a confirmation object”. However, in the following description, a case will be described in which buttons and confirmation objects arranged in the real space are not used.

(4) Notification unit 110D:
The notification unit 110D notifies the player P of the magnitude of the charge amount. For example, the notification unit 110D controls the object space setting unit 111 to notify the player P by attaching a visual effect (FIG. 14) that changes according to the amount of charge to the object (reference numeral OB1 in FIG. 11). I do. Note that the notification unit 110D notifies the player P by causing the sound generation unit 140 to generate a sound effect and outputting the sound effect to the headphones 61 of the HMD 20 via the communication control unit 120 and the communication unit 196. May be. Further, the notification unit 110D can notify the player P by at least one of the visual, auditory, tactile, and olfactory senses of the player P (however, the visual notification will be mainly described below).

(5) Execution unit 110E:
The game operation unit 110 as the execution unit 110E executes a predetermined process associated with the object (reference numeral OB1 in FIG. 11) when the lock of the object (reference numeral OB1 in FIG. 11) is confirmed. The predetermined process associated with the object (symbol OB1 in FIG. 11) includes, for example, a game parameter setting process, an attack process for the object, a movement process for the object, a process for another object, and a predetermined program. Processing. The timing at which the execution unit 110E executes the predetermined process may be immediately after the determination or after a predetermined time has elapsed from the determination (hereinafter, assumed to be immediately after the determination).

  Hereinafter, the operation of the game calculation unit 110 as the display processing unit 110A, the operation of the game calculation unit 110 as the measurement unit 110B, the operation of the game calculation unit 110 as the receiving unit 110C, and the operation of the game calculation unit 110 as the notification unit 110D The operation of the game calculation unit 110 as the execution unit 110E will be described as the operation of the game calculation unit 110.

2-8-2. Viewing Area FIG. 10 shows the relationship between the virtual three-dimensional space OBS, the space that can be seen by the player P wearing the HMD 20 (hereinafter referred to as “display area DA”), and the viewing area LSA of the player P wearing the HMD 20. It is a figure explaining.

  The display area DA corresponds to the visual field range of the virtual camera arranged in the virtual three-dimensional space OS as described above, and is an area displayed in front of the player P via the HMD 20. Since the game calculation unit 110 causes the position and posture of the virtual camera to follow the position and posture of the head of the player P as described above, the position and posture of the display area DA in the virtual three-dimensional space OBS is also the head of the player P. Follow the position and posture of

The viewing area LSA is an area of a predetermined size set by the game calculation unit 110 in the center of the display area DA. The visual recognition area LS corresponds to a range (also referred to as a gaze range or a line-of-sight range) that is considered to be viewed by the player P in visual determination described later. The ratio of the size of the viewing area LSA based on the size of the display area DA is basically fixed, and the position of the display area DA in the display area DA is also basically fixed. Here, as shown in FIG. 10, it is assumed that the position of the viewing area LSA in the display area DA is the center of the display area DA, and the shape of the viewing area LSA is circular.

  Note that the ratio of the size of the viewing area LSA based on the size of the display area DA may be variable. Further, the position of the visual recognition area LSA in the display area DA can be made variable. Further, when the position of the viewing area LSA in the display area DA is variable, for example, the position of the viewing area LSA can be made to follow the direction of the line of sight of the player P (see line of sight input described later). In FIG. 10, the outline of the visual recognition area LSA and the center coordinates of the visual recognition area LSA are visualized for the sake of explanation, but each of the outline and the central coordinates may actually be hidden.

  FIG. 10 shows an example in which the select screen is displayed as the virtual three-dimensional space OBS at the start of the height fear experience game (step S101). The select screen is a screen for the player P to make some settings relating to game processing.

  Here, it is assumed that the push button objects OB1 and OB2 for selecting the number of people and the push button objects OB3 and OB4 for selecting the difficulty level are arranged on the select screen at a predetermined interval. Each of these push button objects OB1, OB2, OB3, and OB4 is a virtual operation button, and is generally an object sometimes called an “icon”. Although not shown in FIG. 10, when viewed from the player P, behind the push button objects OB1, OB2, OB3, and OB4, other objects existing in the virtual three-dimensional space OBS (for example, in the height fear experience game) It doesn't matter if there is a scene that can be seen from the starting point).

  First, the push button object OB1 is assigned a function of processing for setting the game processing mode to be executed by the processing unit 101 (mainly the game calculation unit 110) to the “single-player mode”. The “single player mode” is a mode suitable for a single player P wearing the HMD 20 to move the structure 10.

  The push button object OB2 is assigned a function of processing for setting the game processing mode to be executed by the processing unit 101 (mainly the game calculation unit 110) to “two-player mode”. The “two-player mode” is a mode suitable for two players P individually wearing the HMD 20 to move the same structure 10 (a mode in which two players P share a fear experience). The game calculation unit 110 in the “two-player mode” sets, for example, two virtual cameras individually corresponding to the two players P in the virtual three-dimensional space OBS and individually corresponds to the two players P. Two characters (avatars) are arranged in the virtual three-dimensional space OBS. Then, the game calculation unit 110 links the two virtual cameras to the heads of the two players P, and links the parts of the two avatars to the parts of the two players P.

  The push button object OB3 is assigned a function of processing for setting the mode of game processing to be executed by the processing unit 101 (mainly the game calculation unit 110) to “beginning mode”. The “beginner level mode” is a mode in which the difficulty level of the game process (for example, the probability that the player P falls) is set lower than the “advanced mode” described later. The adjustment of the difficulty level of the game process is performed, for example, by adjusting game process parameters.

The push button object OB4 is assigned a function of processing for setting the mode of game processing to be executed by the processing unit 101 (mainly the game calculation unit 110) to “advanced mode”. The “advanced mode” is a mode in which the difficulty level of the game process (for example, the probability that the player P falls) is set higher than the “beginner level mode” described above. The adjustment of the difficulty level of the game process is performed, for example, by adjusting game process parameters.

  Hereinafter, it is assumed that the player P plays in the “single player mode” and the “beginner mode”, that is, the player P locks the push button objects OB1 and OB3 by eye input and confirms the lock by eye input. .

  As shown in FIG. 10, when the select screen is initially displayed, the push button objects OB1, OB2, OB3, and OB4 are arranged in a 2 × 2 matrix, and the display area DA and the viewing area LSA are located at the center of the matrix. Assuming that

  Thereafter, when the player P turns his head to the upper left, the display area DA and the viewing area LSA move toward the upper left (upper left as viewed from the player P) of the select screen as shown in FIG.

  FIG. 11 shows a state in which the visual recognition area LSA is located at the center of the push button object OB1, and the display area DA covers the entire push button object OB1. In this state, the game calculation unit 110 determines that the player P is viewing the push button object OB1 (details of the visual determination will be described later).

  Although not shown in FIGS. 10 and 11, when the player P moves backward behind him, the sizes of the display area DA and the visual recognition area LSA in the virtual three-dimensional space OBS are increased. It is also possible to fit the entire picture of the button objects OB1, OB2, OB3, and OB4 in the display area DA.

2-8-3. Visual Determination The game calculation unit 110 sets a hit area individually for each of the push button objects OB1, OB2, OB3, and OB4 arranged on the select screen. FIG. 12A shows an example of the hit area OBHA set in the push button object OB1.

  As shown in FIG. 12A, the hit area OBHA of the push button object OB1 is an area having a predetermined shape and a predetermined size centered on the same coordinates as the center coordinates of the push button object OB1. The outline shape of the hit area OBHA is, for example, similar to the outline of the push button object OB1, and the size of the hit area OBHA of the push button object OB1 is equal to, for example, the size of the push button object OB1.

  However, the size of the hit area OBHA may be larger or smaller than the size of the push button object OB1. Further, the size of the hit area OBHA may be adjustable as necessary.

  The game calculation unit 110 determines whether or not the player P is viewing the push button object OB1 (visual determination) based on the positional relationship between the hit area OBHA of the push button object OB1 and the visual recognition area LSA.

  For example, when at least a part of the hit area OBHA and at least a part of the visual recognition area LSA overlap, the game calculation unit 110 determines that the player P is “seeing” the push button object OB1, and is not so. In this case, it is determined that the player P is “not viewing” the push button object OB1 (that is, the line of sight of the player P is out of the push button object OB1). FIG. 12B shows a state where at least a part of the hit area OBHA and at least a part of the visual recognition area LSA overlap. The state shown in FIG. 12B is one of the states that the game calculation unit 110 determines to be “viewing”.

  Here, the condition that the game calculation unit 110 determines that the player P is viewing the push button object OB1 is “when at least a part of the hit area OBHA and at least a part of the viewing area LSA overlap”. However, “when one of the hit area OBHA and the visual recognition area LSA is included”, “when the interval between the hit area OBHA and the visual recognition area LSA is less than a threshold”, or the like can be used. .

  12A and 12B show an example in which the viewing area LSA is smaller than the hit area OBHA, but the viewing area LSA is naturally larger than the hit area OBHA. Can be.

  As a result, the player P changes the position of the visual recognition area LSA in the virtual three-dimensional space OBS by changing the combination of the posture of the head wearing the HMD 20 and the position of the head, and push button object OB1. Can be visually observed, or the line of sight can be removed from the push button object OB1.

  In the following, the state that is determined to be “visually” by visual determination is simply referred to as “visual”, and the state that is determined to be “not visual” by visual determination is “take off line of sight”, “Looks out of sight”. In addition, the “line of sight” here refers not to the actual line of sight of the player P in the real space (the visual axis of the eyeball) but to the visual recognition area LSA in the virtual three-dimensional space OBS.

  Further, in the HMD 20 of the present embodiment, the viewing area LSA and the hit area OBHA may be basically non-displayed. This is because, when the player P views any object in the virtual three-dimensional space OBS, the game calculation unit 110 according to the present embodiment emphasizes the viewed object (see FIG. 14 and the like described later). Even if the viewing area LSA and the hit area OBHA are not displayed, it is considered that the player P will not lose sight of where the line of sight exists in the virtual three-dimensional space OBS.

2-9. The amount of visual time charge The game calculation unit 110 of this embodiment basically measures (charges) the visual time of the player P for each object arranged in the virtual three-dimensional space OBS, and measures the amount of measurement (charge) for each object. The state of the object is controlled between three states of “locked”, “unlocked (unlocked)”, and “confirmed” according to the amount. Note that the game calculation unit 110 manages the charge amount of the viewing time for each object, for example, in a readable / writable memory (such as the data buffer 176).

  FIG. 13A, FIG. 13B, FIG. 13C, and FIG. 13D are diagrams (graphs) for explaining the relationship between the elapsed time from the visual start and the charge amount for a certain object. is there. The horizontal axis of the graph indicates time, and the vertical axis of the graph indicates the charge amount.

  FIG. 13A shows a change pattern of the charge amount when the player P looks at the object for a short time (when the line of sight deviates before the charge amount reaches the first threshold value Th1 after the visual start).

  FIG. 13B shows the charge amount when the player P looks away from the object for a certain period of time and then removes his line of sight (when the line of sight departs after the charge amount reaches the first threshold Th1 after the visual start). The change pattern is shown.

  FIG. 13C shows a change pattern of the charge amount when the player P continuously views the object for a sufficient time (when the charge amount reaches the second threshold value Th2 after the visual start). .

  FIG. 13D shows a case in which the player P visually removes the line of sight after observing the object for a certain period of time and re-views (the charge amount exceeds the first threshold value Th1 after the visual start and is second The change pattern of the charge amount when the line of sight is lost before reaching the threshold value Th2 and then re-viewed before the charge amount becomes zero is shown.

  First, when the player P starts viewing the object (see the charging start time ts in FIGS. 13A to 13D), the game calculation unit 110 starts charging the object for the viewing time. . Here, it is assumed that the game calculation unit 110 increases the charge amount by “1” every time the viewing time increases by 1 second.

  Further, when the line of sight of the player P deviates from the object (see the line-of-sight release time tO in FIGS. 13B and 13D), the game calculation unit 110 visually checks according to the time when the line of sight is deviated. Decrease the amount of time charge. Here, it is assumed that the game calculation unit 110 increases the charge amount by “0.5” every time the viewing time increases by 1 second.

  Then, when the charge amount reaches the first threshold Th1 (here, Th1 = 2) after the start of charging, the game calculation unit 110 locks the object (FIGS. 13B, 13C, and 13C). (See the lock start time tL in d).)

  Therefore, the player P can lock the object by observing the object continuously for a certain period or longer (here, for 2 seconds).

  When the charge amount reaches the second threshold Th2 (here, Th2 = 5) larger than the first threshold Th1 after the start of charging (see FIGS. 13C and 13D). ), The lock of the object is confirmed, and the charge amount is reset to zero.

  Therefore, the player P can determine the lock of the object by observing the locked object continuously (or intermittently) over a certain level.

  Further, when the charge amount is reduced to the third threshold value Th3 (here, Th3 = zero) after the lock and before the confirmation, the game calculation unit 110 accepts the unlocking of the object (FIG. 13B). (See the unlocking time tU).

  Therefore, the player P can release the lock of the object by removing the line of sight from the locked object for a certain amount of time, and the release timing is earlier as the time when the object is viewed is shorter. can do. On the other hand, the player P can ensure a long time until the lock is maintained after removing the line of sight by viewing the locked object for a long time. In other words, the strength of the player P's intention to view the object is reflected in the lock strength (difficulty of unlocking) of the object.

  In addition, when the line of sight deviates from the object before the charge amount reaches the first threshold Th1 after the start of charging (see the line-of-sight release time tO in FIG. 13A), the game calculation unit 110 starts to charge. To (instantly) reset to zero.

  Therefore, when the player P is at a loss as to what object to lock, the object is not locked as long as the line of sight is simply put on the object, and the player P intentionally looks at the object to be locked. The object is locked only in the case (in the long view).

  Furthermore, the game calculation unit 110 makes the speed at which the charge amount approaches the third threshold Th3 after the lock becomes slower than the speed at which the charge amount approaches the second threshold Th2. For example, the game calculation unit 110 increases the charge amount by “1” every time the visual time increases by 1 second, whereas the game operation unit 110 increases the charge amount by “1” every time the time when the line of sight is off after the lock increases by 1 second. Decrease by 0.5 ”(in fact, the decrease curves in FIGS. 13B and 13D are more gradual than the rise curve).

  Therefore, after the object is locked, the player P can easily maintain the lock of the object without continuing the state in which the position and posture of the head are completely fixed (even if the neck slightly fluctuates). .

  In addition, if the player P keeps observing a certain object without hesitation, the player P can determine the lock of the object in a short time (see FIG. 13C) and he / she was wondering whether or not to confirm the lock. In this case, by removing the line of sight from the object or returning it, the remaining time until the determination can be increased while maintaining the lock of the object (FIG. 13D).

  As a result, the player P can freely switch the state of the object between “locked”, “unlocked (unlocked)”, and “confirmed”.

  In the above description, the game calculation unit 110 adjusts the speed of increasing / decreasing the charge amount in order to adjust the speed at which the charge amount approaches the threshold value, but instead of adjusting the speed of increasing / decreasing the charge amount (or In addition to adjusting the rate at which the charge amount is increased or decreased, the threshold size may be adjusted. In other words, since the charge amount and the threshold value are relative, “adjusting the charge amount increase / decrease speed” and “adjusting the charge amount threshold value” can be regarded as equivalent to each other. Yes (and so on).

  In the above description, the game calculation unit 110 unlocks the object at the timing when the charge amount of the object decreases to the threshold value Th3. However, even if the player P has not yet decreased to the threshold value Th3, If a predetermined action is taken, the lock may be forcibly confirmed. The predetermined action may be “depressing a button arranged in the real space”, “viewing a release object”, or “double-view” action on an object ( The action of “Twice” will be described later.) However, in the following description, a case will be described in which a button, a confirmation object, and a “double view” that are arranged in real space for unlocking are not used.

2-10. Visual Effect of Object FIG. 14 is a diagram illustrating an example of the visual effect of an object.

  As shown in FIG. 14, the game calculation unit 110 gives a visual effect to an object and changes the visual effect according to the charge amount of the object, thereby changing the charge amount of the object with time ( The state where the charge amount increases or decreases) is visualized.

If the charge amount for each object is visualized, the player P can identify the object he / she is viewing, and can distinguish whether he / she is viewing the object. In addition, the player P can grasp the remaining time until the object being viewed is locked, the remaining time until the lock is released, and the viewing time required until the lock is confirmed. Is possible.

  Now, the visual effect is implemented by animation, for example. This is because the animation can notify the player P of the change in the charge amount with time in real time (sequentially). In the example shown in FIG. 14, this animation is an animation in which a mark row (neon mark row) is arranged at the outer edge of the object and the number of mark rows is changed according to the charge amount.

  In this way, if the charge amount is reflected in the number of arrangements of mark rows, the player P can intuitively determine the amount of charge, whether the charge amount increases or decreases, the charge amount increase rate, the charge amount decrease rate, etc. It is possible to grasp.

  FIG. 14A shows a mark row when the charge amount becomes “0.5” after the start of visual inspection (immediately after the visual start or immediately before unlocking).

  FIG. 14B shows a mark row when the charge amount becomes “1” after the start of visual inspection.

  FIG. 14C shows a mark row when the charge amount becomes “1.5” after the visual start.

  FIG. 14D shows a mark row when the charge amount becomes “2” (when locked) after the visual start.

  FIG. 14E shows a mark row when the charge amount becomes “2.5” after locking.

  FIG. 14F shows a mark row when the charge amount becomes “3” after locking.

  FIG. 14G shows a mark row when the charge amount becomes “3.5” after locking.

  FIG. 14 (h) shows a mark row when the charge amount becomes “4” after locking.

  FIG. 14I shows a mark row when the charge amount becomes “4.5” after locking.

  FIG. 14J shows a mark row when the charge amount becomes “5” after lock (when lock is confirmed).

That is, the animation shown in FIG. 14 represents the degree of charge by the number of mark rows arranged. The white arrows in FIG. 14 indicate the order of change in the mark row when the player P continuously views the object for 5 seconds. As described above, when the line of sight deviates from the object, Since the charge amount decreases, the animation changes in the direction opposite to the white arrow. Further, as described above, in the present embodiment, the speed at which the charge amount decreases is slower than the speed at which the charge amount increases, so that the speed at which the animation changes in the direction of the white arrow in FIG. The speed at which the animation changes in the direction opposite to the white arrow is more gradual.

  Here, the game calculation unit 110 distinguishes between a locked object and an unlocked object. For example, the game calculation unit 110 increases the emphasis level of the locked object (FIGS. 14D to 14I) higher than the emphasis level of the unlocked object (FIGS. 14A to 14C). Set. In the example shown in FIG. 14, the density of the locked object (FIGS. 14D to 14I) is set higher than the density of the unlocked object (FIGS. 14A to 14C). .

  Accordingly, the player P can distinguish whether or not the object is locked based on the degree of emphasis (here, density) of the object.

  Note that the degree of object enhancement can be adjusted by at least one of the following parameters (1) to (14), for example.

(1) Mark row density,
(2) The brightness of the mark row,
(3) Mark row color,
(4) Opacity of mark row,
(5) Mark row saturation,
(6) Shape of mark row,
(7) At least one change pattern among the density, brightness, color, opacity, saturation, and shape of the mark row,
(8) Object density,
(9) Object brightness,
(10) Object color,
(11) Object opacity,
(12) Object saturation,
(13) Object shape,
(14) At least one change pattern among the density, brightness, color, opacity, saturation, and shape of the object.

  Here, the animation for notifying the player P of the charge amount is “an animation in which a mark row is arranged at the outer edge of the object and the number of mark rows is changed according to the charge amount”. , "Animation in which an annular or partial annular gauge (tubular gauge) is placed on the outer edge of the object and the length of the gauge (corresponding to the position of the gauge pointer) is changed according to the amount of charge" Good (see FIG. 26).

  In this way, if the charge amount is reflected in the gauge length, the player P intuitively grasps the charge amount, whether the charge amount increases or decreases, the charge amount increase rate, the charge amount decrease rate, etc. Is possible.

  Further, the animation for notifying the player P of the charge amount may be an animation in which the degree of emphasis of the object itself is changed according to the charge amount, instead of the animation using the mark row or the gauge. The degree of enhancement of the object itself can be adjusted by at least one of the parameters (7) to (12) described above, for example. FIG. 19 shows an example in which the density of the object itself changes according to the charge amount.

Thus, if the charge amount is notified to the player P by the change in the emphasis degree of the object itself, a wide space around the object can be secured, and the degree of freedom of layout of the object is increased. Therefore, it is effective, for example, when a large number of objects are densely arranged.

  In addition, as for the relationship between the charge amount and the enhancement degree of the visual effect, it is desirable that the enhancement degree increases as the charge amount increases. Here, “high enhancement degree” refers to, for example, an increase in density, an increase in saturation, an increase in opacity, and an early change period of color or the like.

2-11. Combo processing 2-11-1. Outline of Combo Process The game calculation unit 110 executes (invokes) the combo process when a predetermined condition is satisfied when two or more objects are locked at the same time. The “combo process” here is a process of accepting eye input (confirmation of lock and release of lock) based on a common charge amount for all of two or more locked objects.

  The “common charge amount” means, for example, a charge amount obtained by integrating individual charge amounts of two or more objects (integrated charge amount), a charge amount of an object representing two or more objects (representative charge amount) ) A new charge amount (separate charge amount) set separately from the individual charge amounts of two or more objects. The “integrated charge amount” is, for example, an average of individual charge amounts, a weighted average of individual charge amounts, a sum of individual charge amounts, a product of individual charge amounts, or the like. In the following, a case where the sum of individual charge amounts is mainly used as the integrated charge amount will be described as an example (details will be described later).

  In order to activate the combo process, the player P locks an object and locks another object before the lock is released, so that two or more objects are locked at the same time. A predetermined condition (hereinafter, referred to as “combo activation condition”) may be satisfied. Details of the combo activation condition will be described later.

  When the combo process is activated, the player P can determine two or more locked objects with a single eye input, so that the eye can be used more than when the eye input is performed for each of the two or more objects. It is possible to reduce the number of times of input (in this embodiment, the number of times that the player P mainly swings his / her head).

  For example, when the combo process is activated when the push button objects OB1 and OB2 in FIG. 10 are locked at the same time, the player P can perform both of the push button objects OB1 and OB2 only by eye input to one of the push button objects OB1 and OB2. Can be input to the simulation control apparatus 100 (instructions for setting the one-player mode and the beginner mode).

2-11-2. Combo triggering conditions The combo triggering conditions will be specifically described below.

  The game calculation unit 110 of the present embodiment sets the combo activation condition “the player P re-views an object that is locked first among two or more objects that are simultaneously locked”.

  Here, it is assumed that the combo process is activated for the two push button objects OB1 and OB3 shown in FIG. In the description here, the number of objects to be subjected to the combo process is “2”, but “3 or more” is also possible.

  First, the player P locks the push button object OB1 by visually observing one of the two push button objects OB1 and OB3 (hereinafter referred to as push button object OB1) for a sufficient time of 2 seconds or more. To do. The sufficient time is, for example, a time longer than 2 seconds and shorter than 5 seconds.

  Next, the player P removes his / her line of sight from the locked push button object OB1 and visually checks the other push button object OB3 for 2 seconds or more before unlocking the push button object OB1. The button object OB3 is locked. As a result, the push button objects OB1 and OB3 are simultaneously locked.

  Next, the player P removes the line of sight from the push button object OB3, and takes an action of re-viewing the push button object OB1 that is locked first before the lock of any of the push button objects OB1 and OB3 is released. To do. A curve indicated by a thick dotted arrow in FIG. 15A is an example of the movement locus of the line of sight of the player P. This action satisfies the combo activation condition for the push button objects OB1 and OB3, so the combo process is activated.

  Here, if a certain bo object is locked, even if the player P's line of sight deviates from the push button object, the lock is not released immediately. It is also possible to lock. Therefore, the player P can easily satisfy the combo activation condition.

  Note that the game calculation unit 110 according to the present embodiment makes the speed at which the charge amount of the unlocked object approaches the first threshold value Th1 becomes slower as the charge amount (or total charge amount) of the locked object is larger. Also good.

  In this case, since the unlocked object is less likely to be locked as the player P looks at the locked object for a long time, for example, the player P does not want to activate the combo process or the number of objects locked at the same time. If you do not want to increase the number of objects, look at the object to be locked for a long time, and if you want to activate the combo process or increase the number of objects that are locked at the same time, adjust the lock so that the object to be locked is not viewed too long. The presence or absence of the combo process or the simultaneous lock state can be determined by one's own intention.

2-11-3. Visual effects before and after the combo process is activated The visual effects before and after the combo process is activated will be described below.

  The game calculation unit 110 changes the visual effect mode of the two or more objects OB1 and OB3 that are simultaneously locked before and after the combo process is activated.

  FIG. 15A shows an example of a visual effect before the combo process is activated, and FIG. 15B shows an example of a visual effect after the combo process is activated. FIGS. 15A and 15B show an example in which a mark row is adopted as a visual effect. Among marks belonging to the mark row, a mark being displayed is indicated by a solid line, and a mark not being displayed is indicated. It is represented by a dotted line (however, the dotted line image may not actually be displayed). Further, the curve indicated by the thick dotted arrow in FIG. 15A is an example of the movement trajectory of the line of sight of the player P.

For example, before the combo process is activated, the game calculation unit 110 displays two mark rows OB11 and OB13 that individually surround each of the locked push button objects OB1 and OB3, as shown in FIG. After the combo process is activated, one integrated mark row OB20 formed by integrating the two mark rows OB11 and OB13 is displayed as shown in FIG.

  Here, the integrated mark row OB20 is a mark row that surrounds the entire two push button objects OB1 and OB3 that are targets of the combo process, and the number of marks being displayed in the integrated mark row OB20 is the combo process. This represents the amount of charge used (hereinafter referred to as “integrated charge amount”, an example of a measurement value after integration). Details of the integrated charge amount will be described later.

  Therefore, the player P is locked based on the aspect of the visual effect imparted to the locked push button objects OB1 and OB3 (in FIG. 15, whether or not the mark rows OB11 and OB13 are integrated into the mark row OB20). Whether or not the combo process is activated for the push button objects OB1 and OB3 can be recognized.

2-11-4. Integration of Charge Amount in Combo Processing Hereinafter, the combo processing (charge amount integration) by the game calculation unit 110 will be described.

  When the game calculation unit 110 activates the combo process, the game calculation unit 110 integrates the charge amounts of two or more objects (here, two push button objects OB1 and OB3) that are targets of the combo process. At this time, the remaining charge amount is also integrated. The “remaining charge amount” referred to here is a charge amount necessary to be finalized (threshold value Th2), and the remaining charge amount decreases as the charge amount increases and increases as the charge amount decreases. Hereinafter, the integrated charge amount is referred to as “integrated charge amount”, and the remaining charge amount after integration is referred to as “integrated remaining charge amount”.

  FIG. 16A is a conceptual diagram showing the charge amount immediately before the integration, and FIG. 16B is a conceptual diagram of the integrated charge amount. In FIGS. 16A and 16B, the charge amount is represented by a solid block, and the remaining charge amount is represented by a dotted block.

  For example, before the combo process is activated, the game calculation unit 110 calculates the charge amount (and the remaining charge amount) of each of the locked push button objects OB1 and OB3 as shown in FIG. Apply to OB1 and OB3 individually. On the other hand, after the combo process is activated, the game calculation unit 110 integrates the charge amount (and the remaining charge amount) of the objects OB1 and OB3 as shown in FIG. Amount) is applied to the entire push button objects OB1 and OB3.

  Here, “application of charge amount” means that the state (“locked”, “unlocked”, “confirmed”) is controlled by the charge amount (and the remaining charge amount).

  Further, the ratio of the total charge amount immediately before the integration and the total remaining charge amount immediately before the integration (FIG. 16A) is inherited by the ratio between the integrated charge amount and the integrated remaining charge amount (FIG. 16B). It is.

  Thereafter, the game calculation unit 110 increases or decreases the integrated charge amount according to the viewing time of the player P with respect to the push button object OB1 that is locked first among the push button objects OB1 and OB3 that are the targets of the combo process.

On the other hand, the game operation unit 110 sets the integrated charge amount for the viewing time of the player P with respect to the push button object OB3 locked second or later among the push button objects OB1 and OB3 subjected to the combo process. Do not reflect.

  Therefore, after the combo process is activated, the player P only controls the viewing time of the push button object OB1 that is locked first, and changes the state of all the push button objects OB1 and OB3 that are the targets of the combo process. Control can be performed between “lock”, “unlock”, and “confirm”. Moreover, since the charge amount before the combo process is activated is taken over by the charge amount after the combo process is activated, the visual operation of the player P performed before the activation is not wasted.

  In the present embodiment, as shown in FIG. 16B, the overall scale of the integrated charge amount and the integrated remaining charge amount is set to a size according to the number of objects that are targets of the combo process. To do. According to this setting, the larger the number of objects subjected to combo processing, the longer the viewing time required until confirmation, and the longer the remaining viewing time until release. For example, the scale increase of the charge amount can be realized by, for example, increasing the second threshold value Th2, but instead of increasing the second threshold value Th2, the same increase can be made by slowing the increase rate and decrease rate of the charge amount. An effect can also be obtained.

  In addition, the game calculation unit 110 of the present embodiment converts only the viewing time of the push button object OB1 that is locked first among the two or more objects subjected to the combo process into the integrated charge amount (and the remaining charge amount). Although reflected, the total viewing time of two or more objects that are targets of the combo process may be reflected in the integrated charge amount (and the remaining charge amount). That is, the game calculation unit 110 increases the integrated charge amount when at least one of the two or more objects that are targets of the combo process is viewed, and from all of the two or more objects that are targets of the combo process. The integrated charge amount may be decreased when the line of sight is lost. In this case, the player P can increase the integrated charge amount by simply looking at any one of the two or more objects subjected to the combo process, and the line of sight from all of the two or more objects. By removing, the integrated charge amount can be reduced.

2-11-5. Partial release processing in combo processing The game operation unit 110 performs the following operation (a) for a specific object that is one of two or more objects subjected to combo processing during the combo processing. When the steps (c) to (c) are performed within a sufficiently short predetermined time, the specific object is removed from the combo processing target. The sufficiently short predetermined time is, for example, within 2 seconds.

(A) observing a specific object;
(B) remove the line of sight from the specific object;
(C) A specific object is visually observed.

  Hereinafter, the process of removing one of the two or more objects that are the target of the combo process from the target of the combo process is referred to as a “partial release process”. It is assumed that removing is equivalent to unlocking a part of the object.

  Here, as shown in FIG. 17A, it is assumed that the combo process is activated for the two push button objects OB1 and OB3, and the player P releases only the lock of the push button object OB3. To do. Here, the number of objects subjected to combo processing is “2”, but the same applies to “3 or more”.

Accordingly, the player P looks at the push button object OB3 to be unlocked out of the two push button objects OB1 and OB3, removes the line of sight from the push button object OB3, and re-views the push button object OB3 (so-called so-called). It is possible to release the lock of the push button object OB3 while maintaining the lock of the push button object OB1 only by performing the second view) within a sufficiently short predetermined time.

2-11-6. Visual effects before and after partial release processing The visual effects before and after partial release processing will be described below.

  The game calculation unit 110 changes the visual effect of the objects OB1 and OB3 that are the targets of the combo process before and after the partial release process.

  FIG. 17A shows an example of a visual effect before partial release processing, and FIG. 17B shows an example of a visual effect after partial release. FIGS. 17A and 17B show an example in which a mark row is adopted as a visual effect. Among marks belonging to the mark row, a mark being displayed is indicated by a solid line, and a mark not being displayed is shown. It is represented by a dotted line (however, the dotted line image may not actually be displayed). Further, the curve indicated by the thick dotted arrow in FIG. 17A is an example of the movement trajectory of the line of sight of the player P.

  For example, before the partial release process, the game calculation unit 110 sets an integrated mark row OB20 that surrounds the entire two push button objects OB1 and OB3 that are targets of the combo process, as shown in FIG. After the partial release processing, as shown in FIG. 17B, a part of the integrated mark row OB20 is separated and two mark rows OB11 and OB12 are displayed.

  Here, the mark row OB11 is a mark row surrounding the push button object OB1 in which the lock is maintained, and the number of marks being displayed in the mark row OB11 is applied to the push button object OB1 in which the lock is maintained. Represents the charge amount.

  On the other hand, the mark row OB13 is a mark row surrounding the unlocked push button object OB3, and the number of marks being displayed in the mark row OB13 is a charge applied to the unlocked push button object OB3. Represents quantity.

  Therefore, the player P determines the target of the combo process based on the visual effect applied to the push button objects OB1 and OB3 (in FIG. 17, whether or not the integrated mark row OB20 is separated into the mark rows OB11 and OB13). It is possible to recognize the presence / absence of partial release processing for the push button objects OB1 and OB3.

2-11-7. Separation of Charge Amount in Partial Release Processing Hereinafter, partial release processing (charge amount separation) by the game calculation unit 110 will be described.

  When starting the partial release process, the game calculation unit 110 separates the charge amount of the unlocked object from the integrated charge amount. At this time, the remaining charge amount is also separated. The “remaining charge amount” referred to here is a charge amount necessary to be finalized (threshold value Th2), and the remaining charge amount decreases as the charge amount increases and increases as the charge amount decreases.

  FIG. 18A is a conceptual diagram showing the integrated charge amount immediately before separation, and FIG. 18B is a conceptual diagram of the charge amount immediately after separation. 18A and 18B, the charge amount is represented by a solid line block, and the remaining charge amount is represented by a dotted line block.

For example, before starting the partial release processing, the game calculation unit 110 applies the integrated charge amount (and the integrated remaining charge amount) to the entire push button objects OB1 and OB3 as shown in FIG. On the other hand, after the start of the partial release process, the game calculation unit 110 applies the integrated charge amount (and the integrated remaining charge amount) as it is to the push button object OB1 in which the lock is maintained, as shown in FIG. 18B. Then, the individual charge amount (and the individual remaining charge amount) is applied to the push button object OB3 that is unlocked.

  Here, “application of charge amount” means that the state (“locked”, “unlocked”, “confirmed”) is controlled by the charge amount (and the remaining charge amount).

  Further, the integrated charge amount and the integrated remaining charge amount (FIG. 18A) immediately before the partial release processing are set to the charge amount and the remaining charge amount (upper part of FIG. 18B) of the push button object OB1 in which the lock is maintained. (In the example shown in FIG. 18B, the number of objects whose lock is maintained is “1”, so the combo process automatically ends, but the number of objects whose lock is maintained. When the value is “2” or more, the combo process is continued, so that the integrated charge amount and the integrated remaining charge amount are continued in the combo process.)

  On the other hand, the integrated charge amount and the integrated remaining charge amount (FIG. 18 (a)) immediately before the partial release processing are set to the charge amount and the remaining charge amount (lower stage of FIG. 18 (b)) of the unlocked push button object OB3. Is not carried over, and the charge amount of the push button object OB3 whose lock is released (the lower part of FIG. 18B) is set to zero at the release timing.

  Thereafter, the game calculation unit 110 increases or decreases the charge amount of the push button object OB1 in accordance with the viewing time of the player P with respect to the push button object OB1 that is locked (however, the number of objects that are locked is “ If it is 2 ”or more, the combo process is continued, so that the integrated charge amount is increased or decreased according to the viewing time of the object locked earliest.)

  Further, the game calculation unit 110 increases or decreases the charge amount of the push button object OB3 according to the viewing time of the player P with respect to the unlocked push button object OB3.

  Therefore, after the combo process is activated, the player P only releases the specific push button object OB3 and releases only the lock of the push button object OB3 while maintaining the lock of the other push button object OB1. Can do. In addition, since the charge amount before the release is taken over by the charge amount after the release, the visual operation of the player P performed before the release is not wasted.

  In the present embodiment, as shown in FIG. 18B, the overall scale of the charge amount and the remaining charge amount is set to a size according to the number of objects to which the charge amount is applied. According to this setting, the smaller the number of objects to which the charge amount is applied, the shorter the viewing time required until confirmation, and the shorter the remaining viewing time until release. Incidentally, the size reduction of the charge amount scale can be realized, for example, by reducing the second threshold value Th2, but instead of reducing the second threshold value Th2, the charge amount increase rate and the decrease rate are made similar by making them steep. An effect can also be obtained.

In addition, here, the partial release process has been described as a process executed while the combo process is activated, but it may be performed while the combo process is not activated. That is, when the player P performs the above operations (1) to (3) for a certain object within a sufficiently short predetermined time during the period in which the certain object is locked, The unlocking of the object may be accepted and the charge amount of the object may be reset to zero.

2-12. Control of Lock Strength The game calculation unit 110 uses a criterion for determining that the player P is viewing an object that is locked (a criterion for determining a visual determination of an object that is locked). It is set more gently than a criterion for determining that P is visually inspected (a criterion for visually determining an object that is not locked). When the criterion is relaxed, the lock strength of the object can be increased. Here, “lock strength” refers to the low possibility of unlocking.

  Therefore, the player P cannot lock the object without intentionally viewing the unlocked object. However, if the object is locked, the player P can easily maintain the lock without consciously viewing it. .

  Here, as shown in FIG. 12, the push button object OB1 will be described as an example, but the same applies to other objects.

  As described above, the game calculation unit 110 performs the visual determination of the push button object OB1 based on whether at least a part of the hit area OBHA of the push button object OB1 overlaps at least a part of the visual recognition area LSA. . Then, the game calculation unit 110 determines “looking” when at least a part of the hit area OBHA of the push button object OB1 overlaps with at least a part of the visual recognition area LSA. Judged as "not visually observed".

  Therefore, the game calculation unit 110 increases the size of at least one of the hit area OBHA and the visual recognition area LSA of the push button object OB1 in order to loosen the criterion for visual judgment of the push button object OB1.

  Here, for the sake of simplicity, considering that the determination criteria are controlled for each object, a case where the size of the hit area OBHA is variable and the size of the visual recognition area LSA is fixed will be described. The size adjustment may be continuous, but a case where the size is stepwise will be described as an example.

  Furthermore, the game calculation unit 110 sets the determination criterion of the visual determination of the push button object OB1 more gradually as the charge amount of the push button object OB1 is larger. That is, the game calculation unit 110 increases the size of the hit area OBHA of the push button object OB1 as the charge amount of the push button object OB1 is larger.

  For example, when the push button object OB1 is not locked, the game calculation unit 110 sets the size of the hit area OBHA of the push button object OB1 to, for example, the size of “standard” shown in FIG. When the charge amount of OB1 is less than a predetermined value (for example, “3”) between threshold values Th1 and Th2, the size of the hit area OBHA of the push button object OB1 is set to the “medium” size shown in FIG. When the charge amount of the push button object OB1 is greater than or equal to the predetermined value (“3”), the size of the hit area OBHA of the push button object OB1 is set to the “large” size shown in FIG. To do.

  In this case, the longer the player P views the push button object OB1, the higher the lock strength of the push button object OB1.

  Moreover, as shown in FIGS. 20A, 20 </ b> B, and 20 </ b> C, the game calculation unit 110 determines the hit area in the left-right direction of the player P rather than the enlargement ratio of the size of the hit area OBHA in the vertical direction of the player P. OBHA size enlargement ratio is set high.

  According to this setting, the lock strength in the left-right direction is relatively higher than the lock strength in the up-down direction of the push button object OB1.

  In general, the direction of the line of sight of the player P (determined by the posture of the neck in this embodiment) is more unstable in the horizontal direction than in the vertical direction, so the lock strength in the horizontal direction is set relatively strong. In this case, it is considered that eye input mistakes (in this embodiment, unlocking unintended by the player P) can be reduced without impairing operability.

2-13. Supplementary information on the control of the lock strength Note that the game computing unit 110 of the present embodiment controls the lock strength by adjusting the size (spatial adjustment) of at least one of the viewing areas LSA. Adjustment (temporal adjustment) may be performed, or spatial adjustment and temporal adjustment may be combined.

  For example, the game calculation unit 110 according to the present embodiment may decrease the speed at which the charge amount approaches the third threshold Th3 as the charge amount of the push button object OB1 increases. Note that the speed can be adjusted by adjusting the threshold or adjusting the rate of increase / decrease of the charge amount as described above.

  In this case, for example, when the player P is wondering whether or not to lock an object, the object cannot be locked unless the object is visually observed for a certain period of time. On the other hand, after the object is locked, the object is locked unless the line of sight is removed from the object for a long time.

  In addition, the game calculation unit 110 of the present embodiment adjusts the size of the hit area OBHA in the virtual three-dimensional space OBS in order to perform spatial adjustment, but adjusts the size of the viewing area LSA in the virtual three-dimensional space OBS. Alternatively, both the hit area OBHA and the size of the visual recognition area LSA may be adjusted. In that case, for example, the game calculation unit 110 of the present embodiment may control the size of the visual recognition area LSA according to the charge amount of the object closest to the visual recognition area LSA.

2-14. Eye Input Acceptance Processing Flow Next, a flow of eye input acceptance processing by the game calculation unit 110 will be described with reference to FIG.

  The flow of the eye input acceptance process is, for example, that the game system 1 needs to accept one or a plurality of instructions from the player P during, before or after execution of the height fear experience game (FIGS. 8 and 9). This is executed as appropriate when the error occurs. The flow of the eye input acceptance process is executed for each object (object that can be designated by the player P) that is the target of the eye input acceptance process. Here, a select screen (FIG. 10) is taken as an example.

  For example, when the game process mode has been set to “one-player mode” or “two-player mode”, each of the push button objects OB1 and OB2 in the select screen (FIG. 10) Each of the push button objects OB3 and OB4 is a target of the eye input receiving process.

  If the game process mode is already set to “beginner mode” or “advanced mode”, the push button objects OB3 and OB4 in the select screen (FIG. 10) are not subjected to the accepting process, and Each of the button objects OB1 and OB2 is an eye input receiving process.

  Hereinafter, the flow of FIG. 21 will be described.

  First, the game calculation unit 110 starts displaying an object to be accepted (step S11). The display of the object is performed by arranging the object in the virtual three-dimensional space.

  Next, the game calculation unit 110 executes an object visual determination process (step S13). When the object is visually observed (step S13Y), charging of the object for the visual time is started (step S15). If not (step S13N), the visual determination (step S13) is repeated. “Viewing time charge” is the measurement of the viewing time, and the charge amount is increased according to the time when the object is being viewed, and the object is charged according to the time when the line of sight is off the object. It is a process that reduces the amount. When the game calculation unit 110 starts charging (S15), the game calculation unit 110 performs a visual determination, and performs a process of increasing or decreasing the charge amount according to the result of the visual determination during the period until the charge amount is reset. For example, it repeats periodically. The repetition cycle is set to the same cycle as the frame cycle, for example.

  Next, the game calculation unit 110 does not exceed the first threshold Th1 (= 2) (step S17N), and unless the line of sight deviates from the object (step S19N), the charge amount is equal to the first threshold Th1 ( = 2) is repeated (step S17) and whether or not the line of sight has deviated from the object (step S19) is repeated.

  Then, before the charge amount exceeds the first threshold Th1 (= 2) (step S17N), the game calculation unit 110 resets the charge amount of the object to zero when the line of sight deviates from the object (step S19Y). After that (step S20), the process returns to the visual determination process (step S13).

  In addition, when the charge amount exceeds the first threshold Th1 (= 2) (step S17Y), the game calculation unit 110 receives the object lock (step S21). This locks the object.

  When the object is locked (step S21), the game calculation unit 110 does not reach the second threshold value Th2 (= 5) (step S23N) and the charge amount reaches the third threshold value Th3 (= zero). As long as it does not decrease (step S25N), it is determined whether or not the charge amount has reached the second threshold Th2 (= 5) (step S23), and whether or not the charge amount has decreased to the third threshold Th3 (= zero). The determination process (step S25) is repeated.

  Thereafter, when the charge amount decreases to the third threshold Th3 (= zero) (step S25Y), the game calculation unit 110 accepts the unlocking of the object (step S29), and performs the initial visual determination process (step S29). Return to S13).

When the charge amount reaches the second threshold Th2 (= 5) (step S23Y), the game calculation unit 110 accepts the confirmation of the lock (step S27) and resets the charge amount to zero (step S27). Step S30), the flow ends. Thereby, the lock of the object is confirmed.

  Although not shown in the above flow, the game calculation unit 110 determines that the object charge amount reaches the second threshold value Th2 when the charge amount of the object exceeds the first threshold value Th1 (step S17Y). When the line of sight is deviated from (step S19Y), when the charge amount of the object reaches the second threshold Th2 (step S23Y), when the charge amount of the object decreases to the third threshold Th3 (step S25Y), the object The process of changing the aspect of the visual effect (the aspect of the visual effect of the object itself) is executed (see FIG. 14 and the like).

2-15. Combo Processing Flow Next, a processing flow related to the combo processing will be described with reference to FIG.

  The flow of the process related to the combo process is executed in parallel with the flow of the eye input receiving process (FIG. 21). The process flow related to the combo process is not executed for each object, but is executed for all of a plurality of objects that can be designated by the player P.

  First, unless two or more objects are locked (step S31N), the game calculation unit 110 repeats the determination process (step S31) for determining whether two or more objects are locked.

  Thereafter, when two or more objects are locked (step S31Y), the game calculation unit 110 proceeds to the next process (step S33).

  Next, the game calculation unit 110 determines whether or not the object that was locked first among the two or more locked objects has been re-viewed (that is, whether or not the combo activation condition is satisfied) (step When the combo activation condition is not satisfied (step S33N), the process returns to the lock determination process (step S31). When the combo activation condition is satisfied (step S33Y), the combo process (step S35) is executed. To S43).

  In the combo process (steps S35 to S43), first, the game calculation unit 110 executes an integration process (step S35) for integrating charge amounts for two or more locked objects. Thereby, the charge amounts of two or more objects are integrated into the integrated charge amount.

  Next, before the integrated charge amount returns to zero (step S37N), the game calculation unit 110 does not satisfy the partial release processing start condition (reviewing any one of two or more locked objects). As long as it is (step S41N), the determination process of whether or not the integrated charge amount has become zero (step S37) and the start condition determination process (step S41) are repeated.

  Thereafter, when the start condition is satisfied (step S41Y), the game calculation unit 110 executes a partial release process (step S43) for separating the recharged object charge amount from the integrated charge amount. Note that according to the partial release processing (step S43), the lock of the re-viewed object is released, and the charge amount of the re-viewed object is set to zero.

When the integrated charge amount becomes zero (step S37Y), the game calculation unit 110 executes a separation process (step S39) for separating the charge amounts of all locked objects. The separation process (step S39) is a process for setting the charge amount of all locked objects as an individual charge amount and setting the individual charge amount to zero. After executing the separation process (step S39), the game calculation unit 110 ends the flow.

  Although not shown in the above flow, the game calculation unit 110 has a visual attached to the object when the combo process is activated (step S53) or when the partial release process is executed (step S43). A process of changing the effect mode is executed (see FIGS. 15 and 17).

2-16. Lock Strength Control Processing Flow Next, the lock strength control processing flow will be described with reference to FIG.

  The lock strength control processing flow is executed in parallel with the eye input acceptance processing flow (FIG. 21). The flow of the lock strength control process is repeatedly executed for each object subjected to the eye input acceptance process.

  First, the game calculation unit 110 determines whether or not the object is locked (step S51).

  If the object is not locked (step S51N), the game calculation unit 110 sets the size of the hit area to “standard” (step S53) and sets the rate of decrease in the charge amount when the line of sight is off. “High” is set (step S55), and the flow ends. However, the decrease rate of the charge amount is slower than the increase rate of the charge amount.

  On the other hand, when the object is locked (step S51Y), the game calculation unit 110 determines whether or not the charge amount of the object is “3” or more (step S57).

  If the charge amount is not “3” or more (step S57N), the game calculation unit 110 sets the size of the hit area to “medium” (step S59) and the charge amount decreases when the line of sight is off. The speed is set to “medium”, which is slower than “high” (step S61), and the flow ends.

  On the other hand, when the charge amount is “3” or more (step S57Y), the game calculation unit 110 sets the size of the hit area to “large” (step S65) and the charge amount when the line of sight is off. The decreasing speed is set to a lower speed “low” than “medium” (step S67), and the flow ends.

  Although not shown in the above flow, the game calculation unit 110 increases the size expansion rate of the player P in the left-right direction rather than the size expansion rate of the player P in the vertical direction (see FIG. 20). . In the above flow, the order of steps can be changed within a possible range.

2-17. Application example of eye input For example, in the height fear experience game of the present embodiment, a mode in which the task is to capture (rescue) the cat staging object 80 and the cat staging object 80 (rescue). There is a mode that does not assume the duty to do.

  In this case, at the start of the game, for example, as shown in FIG. 24, the game calculation unit 110 converts a character image “Do you want to capture a cat?”, A cat object, and push button objects OB5 and OB6 into a virtual three-dimensional form. Place in the space OBS.

  Among these, the push button object OB5 is a push button object for the player P to input the intention of “YES” to the simulation control apparatus 100, and the push button object OB6 is the simulation control of the intention of “NO” by the player P. A push button object for inputting to the device 100.

  For example, when the player P locks and determines the push button object OB6 corresponding to “NO” by eye input as shown in FIG. 25, the game calculation unit 110, for example, displays an animation in which the cat object retreats from the virtual movement path. The image is displayed on the virtual three-dimensional space OBS via the object space setting unit 111. In addition, the game calculation unit 110 retracts the cat effect object 80 from the end point of the actual movement route R via the effect control processing unit 114.

  For example, when the player P locks and determines the push button object OB5 corresponding to “YES” by eye input, the game calculation unit 110, for example, an animation in which the cat object escapes toward the end point of the virtual movement path. Are displayed in the virtual three-dimensional space OBS via the object space setting unit 111. In addition, the game calculation unit 110 places the cat effect object 80 at the end point of the actual movement route R via the effect control processing unit 114.

  In the above embodiment, the object that can be specified by the player P by the eye input is the push button object (icon), but the character (enemy character, friend character, animal character, own avatar), item (treasure box, Card), or a part of a character or item.

2-18. Effect 1 of embodiment
As described above, the simulation control apparatus 100 according to the present embodiment charges the display processing unit 110A that displays the virtual three-dimensional space on the HMD 20 and the viewing time of the player P with respect to the object arranged in the virtual three-dimensional space. When the player P's line of sight is off, the measurement unit 110B that reduces the charge amount according to the time when the line of sight is off, and an instruction to lock the object when the charge amount reaches the first threshold Th1. When the charge amount reaches a second threshold value Th2 that is larger than the first threshold value Th1, an instruction to confirm the lock of the object is accepted, and when the charge amount decreases to the third threshold value Th3 before the confirmation, the lock of the object is released. 110C for accepting and a notification unit for notifying the player P of the magnitude of the charge amount Comprising 10D and, the execution unit 110E for executing a predetermined processing corresponding to the object if the lock object has been determined.

  Therefore, the player P can lock the object by viewing until the charge amount of the object reaches the first threshold Th1. On the other hand, when the player P views the object within a range that does not exceed the first threshold Th1, it is possible to maintain the unlocked state of the object.

  When the object is locked, even if the player's line of sight deviates from the object, the lock is maintained until the charge amount decreases to the third threshold value Th3. Will not be forced to fix his gaze. Conversely, if the player P removes his / her line of sight from the object until the charge amount drops to the third threshold Th3, the object can be unlocked.

In addition, after the object is locked, the player P can input a confirmation instruction to the simulation control device 100 only by visually observing the object until the charge amount reaches the second threshold Th2. On the other hand, after the object is locked, if the player P visually or deviates the object so that the charge amount falls between the second threshold Th2 and the third threshold Th3, the locked state is continued. You can also.

  Accordingly, the player P can freely control the state of the object among the three states of “locked”, “unlocked (unlocked)”, and “confirmed” by eye input. “Eye input” means that the player P inputs his / her instruction to the simulation control apparatus 100 by an operation of visually observing the object.

  Moreover, since the game calculation unit 110 as the notification unit 110D notifies the player P of the charge amount, the player P specifies whether or not he / she is viewing the object. Can be distinguished. Furthermore, the player P grasps the remaining time until the object is locked, the remaining time until the lock is released, and the visual time required until the lock is determined based on the notified charge amount. It is also possible.

  Therefore, according to the simulation control apparatus 100 of the present embodiment, the player P can comfortably perform eye input.

2-19. Effect 2 of embodiment 2
In addition, the game calculation unit 110 as the reception unit 110C receives at least confirmation and release of the two or more selected items when the combo activation condition is satisfied when two or more objects are simultaneously selected. A combo process is performed for all the objects based on the common charge amount.

  When the combo process is activated, the player P can input the two or more locked objects with a common eye input, so that the eye input of the two or more objects can be performed more than when the eye input is performed individually. It is possible to reduce labor (in this embodiment, the number of times that the player P mainly swings his / her head).

2-20. Effects of embodiment 3
In addition, the game calculation unit 110 as the measurement unit 110B according to the present embodiment allows the player P to visually determine a criterion for determining that the player P is viewing the locked object. It is set more gently than the criterion for determining that it is present.

  Therefore, the player P cannot lock the object without intentionally viewing the unlocked object. However, if the object is locked, the player P can easily maintain the lock without consciously viewing it. .

  For example, when the adjustment of the determination criterion is performed by spatial adjustment (described above), if the player P is wondering whether to lock a certain object or the like, the object must be viewed without looking at the position near the center of the object. I can't lock it. On the other hand, if the object is locked, the lock of the object is maintained unless the line of sight is moved to a position away from the center of the object.

  For example, when the adjustment of the criterion is performed by temporal adjustment (described above), when the player P is wondering whether to lock a certain object, the object must be visually checked for a certain time or more. Cannot be locked. On the other hand, after the object is locked, the object is locked unless the line of sight is removed from the object for a long time.

  Therefore, according to the simulation control apparatus 100 of the present embodiment, it is possible to reduce eye input mistakes after locking (such as unlocking due to swinging unintended by the player P).

3. Modification 3-1. Regarding the motion sensor In the game system of the above-described embodiment, the imaging camera 70 is used to detect the position and orientation of the head of the player P. However, a motion sensor mounted on the HMD 20 may be used. A combination of 70 and a motion sensor may be used. As the motion sensor, an acceleration sensor, an angular velocity sensor (gyro sensor), or the like can be used. The motion sensor is suitable for detecting a movement of a moving object (here, the head of the player P) with a change in posture with high accuracy.

3-2. Regarding Gaze Detection In the above embodiment, the game calculation unit 110 converts the movement (position and posture) of the display area DS and the visual recognition area LSA in the virtual three-dimensional space OBS to the movement (position and posture) of the head of the player P. However, the movement (position and posture) of the eyeball of the player P may be followed.

  Alternatively, in the above-described embodiment, the game calculation unit 110 determines the movement (position and posture) of the display area DS and the visual recognition area LSA in the virtual three-dimensional space OBS as both the head movement and the eyeball movement of the player P. May be followed.

  In this case, for example, the game calculation unit 110 causes the player P's head to follow the movement of the display area DS in the virtual three-dimensional space OBS, and the movement of the visual recognition area LSA in the display area DS is changed to the player P. You may make it follow the movement of the eyeball.

  In order to detect the movement of the eyeball of the player P, for example, a line-of-sight sensor that detects the direction of the line of sight of the player P is mounted on the HMD 20, and the output of the line-of-sight sensor is transmitted via the communication unit 196 and the communication control unit 120. What is necessary is just to receive the process part 101 (game calculating part 110).

  As the line-of-sight sensor, at least one of the following line-of-sight sensors (1) and (2) can be employed.

  (1) A line-of-sight sensor including a camera that captures at least one eye of the player P, and a processing unit that detects the position of the pupil of the player P (information indicating the direction of the visual axis) based on an image captured by the camera.

  (2) a light projecting unit that projects detection light such as infrared rays onto at least one eyeball of the player P, a detection unit that detects a reflected light amount of the detection light on the retina of the eyeball, and an output of the eyeball based on the output of the detection unit A line-of-sight sensor including a processing unit that detects a direction of a visual axis.

  Note that when using a line-of-sight sensor, it is desirable to calibrate the line-of-sight sensor for each player P. The calibration of the gaze sensor is a process for correctly detecting the gaze direction of the player P regardless of the variation in the position of the eyeball for each player P, the variation in the size of the pupil, the variation in the mounting posture of the HMD 20, and the like. For example, this is a process of causing the player P wearing the HMD 20 to visually observe some known directions and adjusting the parameters of the processing unit based on the output of the visual line sensor at that time.

3-3. Regarding the virtual mechanical switch In the above embodiment, several examples have been described in which the game calculation unit 110 changes the degree of enhancement of the object in order to notify the player P of the charge amount (see FIGS. 14, 19, etc.). Other methods can be employed to change the degree of emphasis. For example, a method of changing the appearance of an object.

  For example, the game calculation unit 110 may employ a virtual push button (virtual mechanical switch) as an object that can be designated by the player P, and change the amount of depression of the virtual mechanical switch in accordance with the amount of charge. In this case, the game calculation unit 110 can give the player P the feeling of pushing down the virtual mechanical switch by injecting the line of sight by deepening the amount of depression of the virtual mechanical switch as the charge amount increases. This virtual mechanical switch is a virtual mechanical switch that is locked by a long press (here, long viewing) and is confirmed by a further long press (here, long viewing).

3-4. Regarding the word “selection” In the above embodiment, the game calculation unit 110 accepts the start of measurement (charge) at the timing when visual observation of a certain object is started, and “selects” when the charge amount exceeds the first threshold Th1. (Lock) "is received," Selection (lock) is confirmed "when the charge amount reaches the second threshold value Th1, and" Selection (lock) is released "when the charge amount is reduced to the third threshold value Th3. Was accepted. However, the name of the instruction received by the game calculation unit 110 at each timing is for convenience only and can be replaced with another name.

  For example, in the above embodiment, it can be read as follows. In other words, the game calculation unit 110 accepts “selection” at the timing when visual inspection of a certain object is started, and accepts “maintain selection (lock)” when the charge amount exceeds the first threshold Th1. “Selection confirmation” may be received at the timing when the second threshold Th1 is reached, and “selection release” or “maintenance (lock) release” may be received when the charge amount decreases to the third threshold Th3.

3-5. Regarding the function sharing The functions of the elements in the game system 1 of the present embodiment can be appropriately modified within a range where the effects are not impaired.

  For example, some of the functions of the HMD 20 described above may be mounted on the simulation control apparatus 100 side, and some or all of the functions of the simulation control apparatus 100 may be mounted on the HMD 20 side. Further, the function sharing of each element included in the processing unit 101 of the simulation control apparatus 100 can be changed as appropriate.

  For example, part or all of the processing of the display processing unit 110A may be executed by the object space setting unit 111, and part or all of the processing of the object space setting unit 111 is executed by the display processing unit 110A. Also good.

  In addition, part or all of the processing of the measurement unit 110B may be executed by the state detection processing unit 112, and part or all of the processing of the state detection processing unit 112 may be executed by the measurement unit 110B. .

The simulation control apparatus 100 may be equipped with a dedicated circuit (hardware) that realizes part or all of the functions of the processing unit 101. That is, part or all of the processing in the processing unit 101 may be executed by software or may be executed by hardware.

3-6. Regarding the Game Machine In the above embodiment, the game system 1 (simulation control device 100 of the game system 1) including a structure in which a real space in which the player P can move (hereinafter simply referred to as “real space”) is formed. Although an example in which the eye input by the HMD 20 is applied has been described, the eye input by the HMD 20 can also be applied to other game systems.

  For example, the eye input by the HMD 20 can be applied to a system in which a game is provided from a server device to a terminal device via a network such as the Internet. In that case, the game program in the system may be executed on the terminal device side or on the server device side. In that case, the terminal device may realize the above-described game by executing operation display and image display by streaming.

  Further, the eye input by the HMD 20 can be applied to a stand-alone game device that is not connected to a network. It is also possible to apply to a terminal device that can execute an operation input using a touch panel such as.

3-7. Eye Input Device In the above embodiment, the non-transmissive HMD 20 is used for eye input. However, other types of wearable image display devices such as a transmissive HMD and a monocular HMD may be used for eye input. As for the HMD mounting method for the player P, various mounting methods such as a hat type, an eyeglass type, a helmet type, a sun visor type, and a hair band type can be employed.

4). Others The present invention is not limited to that described in the above embodiment, and various modifications can be made. For example, terms cited as broad or synonymous terms in the description in the specification or drawings can be replaced with broad or synonymous terms in other descriptions in the specification or drawings.

  The present invention includes configurations that are substantially the same as the configurations described in the embodiments (for example, configurations that have the same functions, methods, and results, or configurations that have the same objects and effects). In addition, the invention includes a configuration in which a non-essential part of the configuration described in the embodiment is replaced. In addition, the present invention includes a configuration that exhibits the same operational effects as the configuration described in the embodiment or a configuration that can achieve the same object. In addition, the invention includes a configuration in which a known technique is added to the configuration described in the embodiment.

  As described above, the embodiments of the present invention have been described in detail. However, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. . Accordingly, all such modifications are intended to be included in the scope of the present invention.

1 ... Game system 10 ... Structure 20 ... HMD
DESCRIPTION OF SYMBOLS 30 ... Suspension unit 40 ... Fall prevention unit 50 ... Suspension control unit 60 ... Marker unit 70 ... Imaging camera 80 ... Production object 90 ... Production device (blower, spring board panel, and movement guide path)
100 ... Simulation control device

Claims (17)

A display processing unit for displaying the virtual space on the wearable image display device;
Measurement that measures a user's viewing time for an object arranged in the virtual space, and decreases the measurement value according to the time when the user's line of sight deviates from the object according to the time when the line of sight is deviated And
When the measured value reaches a first threshold, the selection of the object is accepted, and when the measured value reaches a second threshold value larger than the first threshold, the selection of the object is accepted, and before the confirmation A receiving unit that receives the cancellation of the selection of the object when the measured value falls to a third threshold value,
The receiving part is
If a predetermined condition is satisfied when two or more objects are simultaneously selected, at least the confirmation is accepted based on the measurement value common to all of the two or more objects being simultaneously selected. ,
A simulation control apparatus characterized by that. The simulation control device according to claim 1,
The receiving part is
If the predetermined condition is satisfied when the two or more objects are simultaneously selected, the release is accepted based on the measurement value common to all the two or more objects being simultaneously selected. Do,
A simulation control apparatus characterized by that. In the simulation control device according to claim 1 or 2,
The predetermined condition is:
The user re-views an object selected first among the two or more objects being simultaneously selected.
A simulation control apparatus characterized by that. In the simulation control apparatus according to claim 3,
The receiving part is
Integrating the measurement values for all of the two or more objects being simultaneously selected when the predetermined condition is satisfied;
A simulation control apparatus characterized by that. In the simulation control apparatus according to claim 4,
The measuring unit is
When the predetermined condition is satisfied, the measured value after integration is increased or decreased according to the viewing time for the object selected first.
A simulation control apparatus characterized by that. In the simulation control device according to any one of claims 1 to 5,
The measuring unit is
The speed at which the measurement value of the non-selected object approaches the first threshold value becomes gentler as the measurement value of the selected object is larger.
A simulation control apparatus characterized by that. In the simulation control device according to any one of claims 1 to 6,
The receiving part is
When the user performs the following operations (1) to (3) for a specific object that is any one of the two or more objects being simultaneously selected, the specific object of the two or more objects Accept the deselection of
(1) observing the specific object;
(2) Remove the line of sight from the specific object;
(3) viewing the specific object;
A simulation control apparatus characterized by that. In the simulation control device according to any one of claims 1 to 7,
A notification unit for notifying the user of the magnitude of the measurement value;
A simulation control apparatus characterized by that. The simulation control apparatus according to claim 8, wherein
The notification unit
A visual effect corresponding to the measurement value is given to the selected object.
A simulation control apparatus characterized by that. The simulation control apparatus according to claim 9, wherein
The notification unit
Distinguishing the selected object from the non-selected object;
A simulation control apparatus characterized by that. The simulation control apparatus according to claim 9, wherein
The notification unit
The aspect of the visual effect of the two or more objects being simultaneously selected is changed between when the predetermined condition is satisfied and when the predetermined condition is not satisfied.
A simulation control apparatus characterized by that. In the simulation control device according to any one of claims 9 to 11,
The visual effect is
An animation,
A simulation control apparatus characterized by that. The simulation control apparatus according to claim 12, wherein
The animation
An animation in which an annular or partial annular gauge is arranged at the outer edge of the object, and the length of the gauge is changed according to the measurement value.
A simulation control apparatus characterized by that. The simulation control apparatus according to claim 12, wherein
The animation
It is an animation that arranges a mark row on the outer edge of the object and changes the number of arrangement of the mark row according to the measurement value.
A simulation control apparatus characterized by that. The simulation control apparatus according to claim 12, wherein
The animation
An animation that changes the degree of emphasis of the object according to the measurement value.
A simulation control apparatus characterized by that. In the simulation control device according to any one of claims 1 to 15,
An execution unit that executes a predetermined process associated with the object when the selection of the object is confirmed;
A simulation control apparatus characterized by that. A display processing unit for displaying the virtual space on the wearable image display device;
Measurement that measures a user's viewing time for an object arranged in the virtual space, and decreases the measurement value according to the time when the user's line of sight deviates from the object according to the time when the line of sight is deviated And
When the measured value reaches a first threshold, the selection of the object is accepted, and when the measured value reaches a second threshold value larger than the first threshold, the selection of the object is accepted, and before the confirmation When the measured value decreases to a third threshold value, the computer functions as a receiving unit that receives the cancellation of the selection of the object,
The receiving part is
If a predetermined condition is satisfied when two or more objects are simultaneously selected, at least the confirmation is accepted based on the measurement value common to all of the two or more objects being simultaneously selected. ,
A simulation control program characterized by that.

Images