JP6643783B2 - Simulation control device and simulation control program - Google Patents

Description

  The present invention, such as simulation systems for using mounted image display apparatus such as a head-mounted display.

Head-mounted display (hereinafter, referred to as "HMD".) Is known as a head-mounted image display apparatus for displaying an image in front of the eyes of the user. For example, the game system disclosed in Patent Literature 1 uses a motion sensor (acceleration sensor, gyro sensor) provided in the HMD and a camera that captures the HMD from the outside, and uses the camera to move the image of the head of the player. link to, give a virtual reality as if entered the game space to the player. The system in accordance with the line of sight of the player is detected from the movement of the player's head, by changing the sensitivity parameter for the player of the game character, to the experience as a game character and eye contact to the player You can also.

JP-A-2015-231443

  In recent years, as in the system of Patent Document 1, games that are developed not only by the operation of the controller existing in the real space but also by the movement of the head are increasing, and a game in which a player moves in the real space is assumed. , possible player also for the time of fall safety is desired to maintain the state of the hands-free.

  Accordingly, an object of the present invention is to provide a simulation control device and a simulation control program that can operate as a user interface with high operability by using a wearable image display device.

(1) In order to solve the above problems, a simulation control device of the present invention
A display processing unit that displays a virtual space on the wearable image display device,
A measuring unit for measuring a visual time of the user for the arranged in the virtual space object,
A receiving unit that receives selection of the object when the measurement value obtained by the measurement reaches a first threshold, and receives confirmation of the selection when the measurement value reaches a second threshold larger than the first threshold;
A notification unit for notifying the order of magnitude of the measurement value to said user,
Is provided.

Therefore, the user, the measurement value by visually to over the first threshold value, it is possible to select the object. Further, on the contrary, if the user visually objects without exceeding the first threshold value (when glance), it is possible to maintain the non-selected state of the object. Further, after selecting the object, only the user to the measurement value reaches the second threshold value is visually an object, it is possible to input an instruction of confirmation to the simulation control unit. That is, the user by operation of viewing the object, "non-selected" the state of the object, "select" can transition between three states of "definite".

  The notification unit, so notifies the measured value to the user, the user can or identify objects that they are visually he or distinguish whether that visually objects. Further, the user can grasp the remaining time until the object is selected, the viewing time required until the selection is determined, and the like, based on the notified charge amount. Therefore, according to the simulation control unit, an input by operation of visual user can perform comfortably.

(2) In the simulation control device of the present invention,
The measurement unit,
If the line of sight of the user from the object goes out reduces the measured values according to the time the line of sight is out,
The receiving unit is,
If the measured value has decreased to a third threshold value before the determination, cancellation of the selection may be accepted.

  Therefore, the user can remove the line of sight over a certain level or more from the selected object, it is possible to deselect the object, moreover, the time of visual the object early timing of the release smaller the shorter be able to. Further, on the contrary, the user can keep visually longer the selected object, it is possible to ensure a long time until the selection after removing the line of sight is maintained.

(3) In the simulation control device of the present invention,
The measurement unit is
After the selection, the speed at which the measured value approaches the third threshold may be slower than the speed at which the measured value approaches the second threshold.

  Therefore, after selecting the object, the user can easily maintain the selection of the object without continuing to fix his / her eyes completely (even if it fluctuates somewhat).

(4) Further, in the simulation control system of the present invention,
The notifying unit,
A visual effect according to the measurement value may be provided to the object.

  When the measurement values are visualized in this way, the user can specify the object that he or she is looking at, and can distinguish whether or not he or she is looking at the object. In addition, the user can visually grasp the remaining time until the object being viewed by the user is selected, the viewing time required until the selection is confirmed, and the like.

(5) In the simulation control device of the present invention,
The notifying unit,
It may distinguish between the objects of the object and the non-selected in the selection.

  Therefore, the user can distinguish whether or not each of the one or more objects is selected.

(6) In the simulation control device of the present invention,
The visual effects,
It may be an animation.

  According to the animation, it is possible to notify the time variation of the measured values in real-time to (or sequentially) user.

(7) Further, in the simulation control system of the present invention,
The animation,
The animation may be such that an annular or partial annular gauge is arranged at the outer edge of the object, and the length of the gauge is changed according to the measured value.

  Thus, if the reflected measurement to the length of the gauge, for example, the magnitude of the measured values, different increase and decrease of the measured values, the rate of increase in the measured value, and the rate of decrease in the measured value, the user intuitively It is possible to grasp.

(8) Further, in the simulation control system of the present invention,
The animation is
Place a mark row to an outer edge portion of the object, and may be an animation of changing the sequence number of the mark array in response to the measured value.

  In this way, if the measured value is reflected in the number of arrangements of the mark row, the user can intuitively understand, for example, the magnitude of the measured value, whether the measured value is increasing or decreasing, the increasing speed of the measured value, or the decreasing speed of the measured value. It is possible to grasp it.

(9) Further, in the simulation control system of the present invention,
The animation,
Or it may be animated to change the degree of emphasis of said object in response to the measured value.

  Thus, if the notification to the user of the measured value by a change in emphasis of the object itself, since the space around the object can be widely secured, enhances the degree of freedom in the layout of the object. Therefore, for example, it is effective when many objects are densely arranged. The degree of emphasis of the object can be adjusted by, for example, at least one of the following parameters.

And density of objects,
Object brightness,
Of object color,
Object opacity,
Object saturation,
・ Object shape,
A change pattern of at least one of the density, brightness, color, opacity, saturation, and shape of the object;

(10) In the simulation control device of the present invention,
The information processing apparatus may further include an execution unit configured to execute a predetermined process associated with the object when the selection of the object is determined.

Therefore, when the selection is determined, the predetermined process is automatically executed (however, the timing of execution may be immediately after the determination or after a lapse of a predetermined time from the determination). Also,
Predetermined processing, for example, setting processing of the simulation parameters, attack process to an object, the moving process of the object, processing for other objects, and the like processing for executing a predetermined program.

(11) Further, the simulation control program of the present invention provides:
A display processing unit that displays a virtual space on the wearable image display device,
A measurement unit that measures the user's viewing time for the object placed in the virtual space,
The measuring accepts the selection of the object when the measurement value reaches the first threshold value by the receiving unit receives a confirmation of the selection when the measured value reaches a larger first threshold second threshold value,
A notification unit that notifies the user of the magnitude of the measurement value by the measurement,
And let the computer function.

  Note that some or all of the functions of the simulation control device of the present invention can be realized by a server device or a terminal device. Further, a part or all of the program of the present invention can be recorded on an information storage medium.

Is a block diagram showing an outline configuration of an embodiment of a game system according to the present invention. It is a figure for explaining a virtual three-dimensional space (simulation space) which can be experienced by the game system of one embodiment. Is a plan view showing a structure of a structure in an embodiment. It is sectional drawing which shows the structure of the structure in one Embodiment. FIG. 2 is a perspective view and a side view illustrating a configuration of an HMD used in the game system according to the embodiment. 1 is a configuration diagram illustrating a block configuration of a simulation control device according to one embodiment. It is a figure showing an example of an object for production of one embodiment, and a movement course member which is a production device. It is a flowchart (the 1) which shows operation | movement of the game system in one Embodiment. It is a flowchart (the 2) which shows operation | movement of the game system in one Embodiment. Diagram for explaining a virtual three-dimensional space, visible area of the player P, and the relationship of the space seen from the player P (example visible area is located at the center of the virtual three-dimensional space). The figure explaining the relationship of the virtual three-dimensional space, the visual recognition area of the player P, and the space seen from the player P (an example in which the visual recognition area is located at the upper left of the virtual three-dimensional space). The figure explaining the relationship between a hit area and a visual recognition area. The figure explaining the relationship between the elapsed time from the start of visual observation, and the charge amount of visual time. FIG. 4 is a diagram illustrating an example of a visual effect of an object. The figure explaining the change of the visual effect before and after the activation of the combo process. Diagram illustrating the integration of the charge amount. Diagram for explaining the partial release processing. FIG. 4 is a diagram illustrating separation of charge amounts. Diagram illustrating another example of a visual effect of an object. The figure explaining the control processing of lock strength. Flowchart of reception processing of eye input. Flowchart of processing according to the combo treatment. Flowchart of a control process for locking strength. Diagram describing an application example of the eye input (Part 1). FIG. 9 is a diagram (part 2) illustrating an application example of eye input. The figure explaining another example of the visual effect of an object.

  Hereinafter, embodiments will be described. The embodiments described below do not unreasonably limit the content of the present invention described in the appended claims. In addition, all of the configurations described in the present embodiment are not necessarily essential components of the invention. In addition, the following embodiments are mounted image display apparatus as HMD (head mounted display) predetermined structure space with (i.e., real space) of the virtual three-dimensional space in association with the movement of the user in the This is an embodiment in which the simulation control device according to the present invention is applied to a game system that provides a game by performing simulation.

1. Summary of Game System First, an outline of a game system 1 of the present embodiment with reference to FIGS. 1 and 2, FIG. 1 is a block diagram showing a general configuration of a game system 1 of this embodiment, 2, experience available virtual three-dimensional space by the game system 1 of the present embodiment (hereinafter, also referred to as "simulation space".) is a diagram for explaining the.

  The game system 1 of the present embodiment includes, as main configuration, the player P (an example of the user) the real movable space (hereinafter, simply referred to as "real space".) And the structure 10 is formed, the player P And an HMD 20 that displays a simulation image in a virtual three-dimensional space (that is, a simulation space) associated with the real space.

  Specifically, the game system 1 of the present embodiment generates a simulation image viewed from the player P in the simulation space corresponding to the real space in the real space, and displays various environments and situations in the pseudo space by the player P. is a simulator to experience.

In particular, the game system 1 of this embodiment,
(1) (specifically, the position and orientation of the player in the real space) player status indicating the status of the player P in the real space is detected and
(2) According to the detected player state, for example, a simulation having a virtual moving path associated with the moving path R as shown in FIG. 2 and visible from the player P in the simulation space corresponding to the real space Perform image generation processing to generate an image,
(3) Display the generated simulation image on the HMD 20;
(4) When the player state satisfies given conditions on the movement route R, the player P determines that the player P is a specific state in the simulation space,
(5) when it is determined that the specific state, to generate a simulation image for performing an effect based on the specific state,
It has a configuration.
The game system 1 of this embodiment includes a lifting unit 30 which Tsutoki the HMD 20 from the structure 10, by independently be suspended from the player P to HMD 20, the player P is within the real space when moving, or, when a predetermined portion of the player P (e.g. head) moves, while following the HMD20 the movement of the player P, a case of a fall against the intention of the player P This also has a configuration in which the HMD 20 can be kept attached to the player P or can be prevented from falling due to attachment and detachment.

The game system of this embodiment, as shown in FIG. 1, the other structures 10, HMD 20 and the lifting unit 30,
(1) A fall prevention unit 40 for preventing the player P moving in the real space from falling,
(2) in response to movement in the real space of the player P, HMD in hanging unit 30
Change the suspended position of 20, and, according to the movement in the real space of the player P, the lifting control unit 50 for changing the suspended position of the player P
(3) a predetermined portion of the player P (e.g., head, hands and feet) marker unit 60 mounted on, and, while detecting the orientation and position of each part by detecting the marker unit 60, the real space An imaging camera 70 that detects the state of the player P within the player as a player state;
(4) together are arranged in the real space, the various effects device 90-93 and effect for objects 80 to experience a given effect to the player P by interlocking with the simulation images,
(5) Generates a simulation image of a simulation space, which is a virtual three-dimensional space associated with a real space, which can be seen from the player P, and, in accordance with the detected player state, associates the simulation device with the simulation image and produces a corresponding effect device. a simulation control unit 100 for controlling the 90 to 93,
It has.

  With such a configuration, the game system 1 of the present embodiment can cause the player P to experience the specific state as a simulation when the player P is in the specific state while being linked to the state of the player P. The environment and the situation that should be experienced by the player P, especially the environment and the situation where it is difficult to actually experience the environment such as the environment where the player P moves, including the situation where the player P falls when the vehicle deviates from the movement route R, and the moving situation, are accurately determined. thereby making it possible to reproduce in.

  For example, depending on the state of the player P, an environment or a situation in a dangerous place such as a closed place, a special space, a hot place or a cold place, or a space that is difficult to be experienced in reality, as well as a high place, is determined in a specific state or the specific state. so that the it can be reproduced as the environment to create a state.

  Therefore, since the game system 1 of this embodiment, in hazardous locations and reality can be enhanced reproducibility of any place and space including the space it is difficult to experience, even pseudo space, more realistic This allows the player P to experience a realistic feeling.

  The game system 1 of this embodiment, it is possible to independently be suspended from the player P to HMD 20, by the player P moves in the real space, or a predetermined portion of the player P ( for example by the head) moves, HMD 20 is the front-rear direction, when moved in the horizontal direction and the vertical direction, even when a fall against the intention of the player P player P is unbalanced, the HMD 20 maintaining the attachment to the player P, or, so that it is possible to prevent the falling by detachable.

  Therefore, the game system 1 of this embodiment, injuries caused by falls in a state where HMD20 in the player P is attached, or, floor or wall by the HMD20 is detachably against the intention of the player P and it is capable of preventing contingencies such as occurrence of a collision and some breakage or malfunction of the HMD20 associated therewith to.

As a result, if the hanging position of the HMD 20 can be changed along with the movement of the player P by the rail, the arm, or the like, the game system 1 of the present embodiment can, for example, always hold the HMD 20 at a suitable position such as by hanging from above. the hanging hanged, since it is possible to correspond to the movement and movement in all directions, while ensuring the safety of the player P to move the real space by mounting the HMD 20, other injuries during simulation of the player P to, and is capable of preventing the eventuality, including damage or failure of the HMD 20.

  For example, when provided by a high resolution, when the image supply and its control to HMD20 is performed via wired communication, distribution wiring for connecting the control device for controlling the HMD20 through the lifting unit 30 Since the wiring can be provided next to or below the player P, restrictions on movement of the player P and uncomfortable feeling can be eliminated.

  That is, by having the above-described configuration, the game system 1 of the present embodiment ensures smooth movement and safety of the player P to which the HMD 20 is mounted in the real space, and prevents an unexpected accident such as injury to the player P. The situation can be avoided.

  In the present embodiment, a game that simulates a fear experience in high altitude (hereinafter referred to. "Altitude fear experience game") the following description with reference to.

2. Configuration of game system 2-1. Structure Next, the structure 10 of the game system 1 of the present embodiment will be described with reference to FIGS. 3 and 4 in conjunction with Figure 1 above. FIG. 3 is a plan view illustrating the structure of the structure 10 according to the present embodiment, and FIG. 4 is a cross-sectional view illustrating the structure of the structure 10 according to the present embodiment.

  Structure 10, a casing real space is formed by the player P is executing a game be moveable, for example, above 1, and, as shown in FIG. 3 and FIG. 4, the ceiling 15 And a floor 16 and a wall 17 covering the four sides thereof, and has a rectangular parallelepiped box-shaped structure.

  The structure 10 has a standby area 11 in which the player P, which is the player P, waits for the start of an experiential game, and a play area 12 in which the experiential game is executed. In particular, the play area 12 includes a start zone 13 where the player P is present at the start of the game and a zone where the player P actually moves and experiences a predetermined environment and situation. a moving experience zone 14 moving path R presence of is permitted are formed include.

  The ceiling 15, across from the waiting area 11 to the playing area 12, and, in the mobile experience zone 14 along the travel path R, fall prevention for preventing tipping of the lifting unit 30 and the player P to suspended the HMD20 A plurality of suspension control units 50 to which the unit 40 is slidably attached are formed.

  Each of the suspension control units 50 is provided with the simulation control device 100 on the corresponding movement route.

  Further, on the ceiling 15, a plurality of imaging cameras 70 used for detecting the player state of the player P and the state of the effect object 80 are arranged at predetermined positions. The player state of the player P includes, for example, the position and orientation (posture) of the head of the player P.

  The floor 16 has a different configuration for each of the standby area 11 and the play area 12, and for each of the start zone 13 and the movement experience zone 14.

Specifically, the start zone 13 of the play area 12 is configured as a panel (in other words, a spring floor panel) 92 in which a spring for creating an environment that is raised and lowered by an elevator is incorporated as one of the effect means.

  In addition, the movement experience zone 14 of the play area 12 includes a movement path R formed of metal or other predetermined members (a movement path member 93 described later) for the player P to walk, and movement of the player P is prohibited. And a non-moving route NR configured by a mat or the like that protects the player P when the player P falls.

  Furthermore, the start zone 13 of the present embodiment has a structure for providing as a virtual three-dimensional space of the interior space of the elevator, and the boundary between the start zone 13 and the movement experience zone 14 is a simulation device as an effect device. An automatic door 91 that functions as an elevator door whose opening and closing are controlled by the control of the control device 100 is provided.

  In particular, on the movement route R (specifically, at the end point of the movement route member 93), the effect object 80 is arranged. Further, on the non-moving route NR, an effect device such as the blower 90 may be formed as necessary, and a sensor unit such as a contact sensor may be formed as necessary.

  Wall 17 is composed of a mat protected from injury based on collision with a predetermined wall panel or the player P.

2-2. HMD and Suspended Unit Next, the HMD 20 used in the game system of the present embodiment and the suspended unit 30 that suspends the HMD 20 will be described with reference to FIGS.

  FIG. 5 is an example of a perspective view and a side view showing a configuration of the HMD 20 used in the game system of the present embodiment. Further, for example, HMD 20 of the present embodiment constitutes a mounted image display apparatus of the present invention.

  The HMD 20 is a wearable display device that displays an image of a non-transparent virtual three-dimensional space mounted on the head of the player P under the control of the simulation control device 100, and displays an external environment outside the display device. Unknown to to visually recognize only the image displayed on the player P and a display device for experienced player P augmented reality visually.

  For example, as shown in FIGS. 4 and 5, the HMD 20 has a structure that completely covers (that is, masks) both eyes of the player P, and, while being linked to the detected player state, It has a configuration for visually recognizing a simulation image in the simulation space associated with the real space in the structure 10 that is visible from P.

  Also, the top of the HMD 20, a marker unit for detecting the orientation and position of the head of the player P (hereinafter, referred to as "head detection mark unit".) 60a is formed. Then, HMD 20 is, for example, the display size of 200 × 1080 pixels, and has a refresh rate of 90 fps.

  Incidentally, HMD 20 has a headphone jack (not shown), a headphone 61 to the headphone jack is connected. Then, the headphones 61 are attached to the player P together with the HMD 20. Further, the headphone 61, the environmental sound constituting the stereophonic in the simulation space generated by the simulation control unit 100 is output.

Hanging unit 30, the upper HMD20 and the player P, for example, the ceiling of the structure 10 1
By connecting the suspended control unit 50 disposed 5, while being suspended in the structure 10, and has a configuration that suspended the HMD 20.

  In particular, lifting unit 30 of the present embodiment, in order to hanging in correspondence to the movement and movement in all directions in the player P of the playing area 12, above the structure 10 the HMD 20 (i.e., the ceiling 15) It is formed above the player P.

  The hanging unit 30 has wiring (hereinafter, referred to as “cable”) for connecting the HMD 20 and the simulation control device 100 by wire.

  Specifically, hanging unit 30 is, for example, as shown in FIGS. 4 and 5, the connecting member 31 used to couple the suspended control unit 50, the shape for attachment to the connecting member 31 A string-shaped member (that is, a cable) 32 having a formed end (hereinafter, referred to as a “first end”), and a second end different from the first end of the string-shaped member 32 connected to the HMD 20. And a connecting member 33 to be connected.

  In particular, the cord-like member 32 prevents the player P from coming into contact with the floor surface of the structure 10 when the HMD 20 is detached from the player P due to a large movement of the player P such as the player P being likely to fall. It has a structure that can be used.

  Specifically, the string member 32 is a flexible, constituted by a cable for transferring a predetermined signal and data transmitted from the simulation controller to HMD 20.

  For example, when the HMD 20 is attached to and detached from the player P, the string-shaped member 32 has a structure that prevents the HMD 20 from being grounded to the floor of the structure 10 even when the HMD 20 is attached to and detached from the player P. that has a length that does not contact with the floor surface of the structure 10, that the string-like member is in retractable spiral, or the cable to adjust the length of the string-shaped member It has a structure that takes up.

  Note that the HMD 20 of the present embodiment is not limited to these, and any HMD that is mounted on the player P and displays an image so that the player P can visually recognize the HMD 20 may be used. It may be.

  Further, when the HMD20 and simulation controller 100 performs the transfer of signals or data by wireless communication, the string member 32 need not be a cable, it may be a string itself predetermined material, A wide band-like member such as a band may be used.

  Furthermore, some of the lifting unit 30, specifically, the connecting member 31 and the string-shaped member 32, as described below, has a member common to the fall prevention unit 40.

2-3. Fall prevention unit Next, the fall prevention unit 40 will be described in the game system of this embodiment with reference to FIG. 4 above.

  When the player P loses his or her balance due to the fact that the HMD 20 is worn, the walking path R that can walk is narrow, or both, It is used to support the player P when falling down, and to prevent the player P from falling down.

That is, when the player P loses balance, the fall prevention unit 40
In addition to preventing the player P from being damaged and the player P from being injured, the player P can also be prevented from falling (eg, falling due to loss of balance during movement) caused by the HMD 20 being mounted during game play. it has a configuration capable.

  Specifically, the fall prevention unit 40 includes, for example, as shown in FIG. 4 described above, a holder member 41 that holds the player P, and a suspending member that suspends the player P from the structure 10. , hanging member, member of hanging unit 30, i.e., constituted by the connecting member 31 and the string-shaped member 32 described above.

  The holder member, for example, is constituted by a jacket best type having no sleeves, during play, to hold the state of the player P by wearing the player P. The holder member 41 is connected to one end of the string-shaped member 32, and has a configuration in which the body of the player P is supported via the connection member 31 formed on the ceiling 15 of the structure 10.

2-4. Hanging Control Unit Next, the hanging control unit 50 in the game system of the present embodiment will be described with reference to FIGS. 1, 3, and 4 described above.

  The suspension control unit 50 of the present embodiment is a unit for changing the suspension position of the player P itself and the HMD 20 in accordance with the movement of the player P in the real space in the structure 10, and is always upward (ie, It has a configuration which suspended the HMD20 and the player P from the ceiling direction) of the structure 10.

  The hanging control unit 50, hanged in a position suitable in HMD20 and within the player P real space, and having a movement or motion that can be made to correspond structure of the moving direction of the player P, the player P The safety of the player P can be ensured, and unexpected situations including injury during the simulation of the player P and damage or failure of the HMD 20 can be prevented.

  Therefore, even when the player P freely moves in the real space, the suspension control unit 50 can move the cable that supplies signals and data to the HMD 20 and the member that holds the player P to the side or below the player P. The restriction and the discomfort of the movement of the player P based on the existence can be properly solved, and the HMD 20 and the player P can always be properly hung with respect to the movement and movement of the player P. It has become.

  Specifically, suspending control unit 50 is constructed integrally toward playing area 12 from the standby area 11, HMD 20 and fall prevention to the player P player P or the posture is changed to move the real space It has a structure to follow the unit 40.

  For example, hanging the control unit 50 of the present embodiment, as shown in FIGS. 1, 3 and 4, provided for each player P to move the real space, the waiting area 11 (more specifically, HMD 20 and fall a rail 51 is formed along the moving direction of the movement of the player P toward prevention unit 40 points equipped with) Karakara playing area 12, and connected to the connection member 31 of the lifting unit 30, slides on the rails 51 And the sliding member 52.

  In particular, each of the rails 51 is located on the movement route R in the movement experience zone 14 where the player P moves along the movement route R (that is, the zone where the player P moves linearly back and forth linearly). It is formed on the ceiling.

Further, in each area in the real space other than the rails 51, the player P
The rails 51 are formed along a route (hereinafter, referred to as a “guide route”) S that is guided in performing a simulation, such as after the preparation of the mounting of the fall protection unit 20 and the fall prevention unit 40 and the guidance to the start position. .

  Note that, in the rail 51, as long as it can change the position of the lifting unit 30 in accordance with movement of the player P, such as its shape and material are not limited.

  The sliding member 52 slides on the rail 51 according to the tension generated according to the state of the player P, such as the movement of the player P or a change in the posture, and the suspension position of the HMD 20 and the player P via the suspension unit 30. To change.

  Also, as shown in FIGS. 1, 3 and 4, the sliding member 52 shortens the length of a cable for electrically connecting the HMD 20 and the simulation control device 100 to accurately transfer signals and data. In order to implement, the simulation control device 100 has a structure to be fixed, and has a configuration in which the simulation control device 100 slides integrally.

  Incidentally, the sliding member 52, the upper rail 51 slides, member for changing the HMD20 and position through the lifting unit 30 according to the state of the player P, such as changing the movement and posture of the player P If so, there is no particular limitation.

2-5. Simulation Control Apparatus Next, the simulation control apparatus 100 in the game system according to the present embodiment will be described with reference to FIG.

  Incidentally, FIG. 6 is a block diagram showing a block configuration of the simulation control unit 100 in this embodiment. Furthermore, the simulation control device 100 of the present embodiment is not limited to the configuration of FIG. 8, and various modifications can be made such as omitting some components and adding other components.

  The simulation control device 100 is configured by, for example, a device capable of performing computer control such as a personal computer, and is configured such that an operation unit (not shown) such as a keyboard operated by an administrator is detachable.

  Further, in order to provide the simulation space to the player P, the simulation control device 100, when the game is started, advances the game according to the player state and the elapsed time, while displaying an image corresponding to the progress state of the game. It generates, and has a configuration of controlling the effect device 90 to 93 in conjunction with the effect control device.

  In particular, the simulation control device 100 acquires an image output from the imaging camera 70, detects a marker in the marker unit 60 from the acquired image, and determines the area to which the marker belongs and the positional relationship between the marker and the other markers. And the stay time in the area to which the player belongs.

  Specifically, the simulation control device 100 includes a storage unit 170 in which various data is stored, an information storage medium 180 in which data such as an application for executing a simulation is stored, a game execution and a simulation The communication unit 196 includes a processing unit 101 that executes various types of processing for creating an environment for communication.

The storage unit 170 serves as a work area for the processing unit 101 and communication, and its function can be realized by a RAM (DRAM, VRAM) or the like. In particular, the storage unit 170 of the present embodiment mainly includes a main storage unit 172 in which a game program is recorded, an image buffer 174, and a data buffer 176.

  The main storage unit 172, mainly, the game program is recorded. The data buffer 176 is a storage area in which game data of the game device is stored. For example, the data buffer 176 may be provided in a part of the main storage and control reading and writing by software.

  The game program is a software instruction code for executing the game processing is described. The game data is data for determining a specific state of a player, data necessary for executing a game program, such as data of an effect object 80 or a control program of various effect devices 90 to 93. it is.

  The information storage medium 180 (computer-readable medium) stores programs, data, and the like, and functions as an optical disk (CD, DVD), HDD (hard disk drive), or memory (ROM, etc.). It can be realized by.

  The processing unit 101 performs various processes according to this embodiment based on a program (data) stored in the information storage medium 180. That is, the information storage medium 180 has a program for causing a computer (a device including an operation unit, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment (a program for causing a computer to execute processing of each unit). ) it is stored.

  The communication unit 196 performs communication with the HMD20 through the cable, which communicates with the image pickup camera 70 and the effect producing device 90 to 93 via a wired or wireless network, its function , hardware such as a communication ASIC or communication processor, and may be implemented by communication firmware.

  A program for causing a computer to function as each section according to this embodiment (the data), the information from the information storage medium a host device (not shown) which (server system) has over a network and the communication unit 196 storage medium 180 (or the storage it may be delivered to the section 170). Use of the information storage medium by the host device is also included within the scope of the present invention.

  Processing unit 101 (processor), the data of the image output from the timing and the imaging camera 70 from the start of the game (hereinafter, referred to as. "Image data") based, and the like on the program, a game calculation process, an image generation process, a sound It performs generation processing and effect control processing.

  The processing unit 101 performs various processes using the storage unit 170 as a work area. The function of the processing unit 101 can be realized by hardware and programs such as various processors (CPU, GPU, etc.), ASIC (gate array, etc.).

  Processing unit 101, a game calculation section 110, an object space setting section 111, the state detection processing unit 112, the moving-operation processing section 113, the effect control process unit 114, the communication control unit 120, the image generation unit 130 and a sound generation section 140 Including. Note that a configuration in which some of these are omitted may be adopted.

The game calculation section 110 performs a process of starting the game when game start conditions have been satisfied, proceeding with a game, disposing an object necessary for forming a simulation space (effect for the object 80 including.) , A process of displaying an object, a process of ending the game when a game ending condition is satisfied, and a determination whether the player state is a specific state (specifically, a state corresponding to the progress of the game in advance). There is a determination process to determine.

  In particular, the game calculation section 110 of the present embodiment (specifically, the actual attitude of the space definitive position and the player P of the player P) detected player status area of the viewing direction and the viewing of the player P in accordance with the (hereinafter. referred to as "viewing area") detects a, the detected viewing direction, viewing area, to set the space viewed from the player P in the three-dimensional space in accordance with the progress of the current game environment and the game.

  Further, the game calculation unit 110 determines whether or not the game termination condition is satisfied, based on the detected player state or based on a predetermined elapsed time from the start of the game, and When it is determined that is satisfied, the game is ended.

  On the other hand, based on the data stored in the data buffer 176 in advance, the game calculation unit 110 determines whether or not the player P has entered a specific state corresponding to the progress of the game in advance according to the detected player state, performs progression of the game in accordance with the result, the performance control unit 114, the image generation unit 130, and an instruction for performing an effect corresponding to the sound generation section 140 performs.

  The object space setting section 111, an effect for the object 80, the building, the movement path R, pillar, wall, map various objects to build a given simulation space, such as (terrain) (polygons, such as free-form surface, or subdivision surface A process of arranging and setting a primitive (object composed of primitives) in an object space (that is, a virtual three-dimensional space) is performed.

  That is, the position and rotation angle of the object in the world coordinate system (synonymous with orientation or direction) is determined and its position (X, Y, Z) to the rotational angle (X, Y, the rotation angle of the Z axis) in placing the object.

  In particular, in the present embodiment, as the effect object 80, a movable object (hereinafter, referred to as “effect moving object”) appearing in the simulation space such as an animal and an object fixed in the simulation space are used. The object space setting unit 111 includes objects for causing the player P to actually exist in a real space for recognition (hereinafter, referred to as “effect fixed objects”). Deploy.

  In the present embodiment, the effect for the moving object, actually with moving in the real space, the object to be imaged as an object also move in the simulation space (hereinafter, referred to as "intrinsic moving object".) In addition, an object that does not move in the real space but moves only in the simulation space when being imaged (hereinafter, referred to as a “pseudo moving object”) is also included.

  The state detection processing unit 112 includes both hands and both feet of the player P at the same timing in images of the player P (hereinafter, referred to as “player images”) output from the plurality of imaging cameras 70 that image the player P, and an upper HMD 20, the position of the marker unit 60 which is arranged to identify.

  Then, the state detection processing unit 112, the position of each marker units 60 in each image identified, positional relationship with other markers units 60 at each marker unit 60, and stay at each location of each marker units 60 based on the information of the time to detect the player status indicating the position and orientation in the real space of the player P.

  In particular, a plurality of areas in a predetermined real space are set for an image output for each imaging camera 70, and the state detection processing unit 112 determines which area each marker unit 60 belongs to. the by detecting the position of the marker unit 60 included in each player P picture in the same time, to detect the position in the real space of each marker unit 60 for each image frame.

  The state detection processing unit 112, while detecting the position in the real space of the each marker unit 60 for each frame is compared with the position of each marker unit 60 of the previous frame, the same position in a plurality of frames Based on the number of frames in each marker unit 60 detected as being present, the stay time of each marker unit 60 at the same position is detected.

  Then, the state detection processing unit 112, the position in the real space in each marker unit 60 in the same timing, and, based on the residence time up to that of each of the markers unit 60 detects the posture of the real space of the player P .

For example, the state detection processing unit 112 of the present embodiment
(1) a head, the position of a given site of the player P, such as hands or feet, at least one part of information of height and time (hereinafter, referred to as. "Site information") based on the real player P to locate in the space (i.e., the coordinates of the center position of the player P in the real space (the centroid position)),
(2) Based on the part information of the player P, the posture of the player P constructed from the positional relationship of each part such as the head, the torso, and the limbs of the player P is specified, or
(3) Specify both (1) and (2),
The player state is detected based on the position, posture, or both of the player P.

Then, the state detection processing unit 112
(A) detecting the viewpoint position and the direction of the player P in the real space based on the position of the head of the player P;
(B) detecting the standing position and posture of the player P in the real space based on the position of the hand or the position of the foot of the player P;
(C) Modeling the player P based on the detected standing position and posture of the player P (formation of a bone)
Execute.

  Incidentally, for example, at the site of the user comprises the head, the hands or feet of the user, the site information, (positional coordinates on the user moving space) position of each part, orientation, shape (planar shape or three-dimensional shape ) or color (. including grayscale) including various kinds of information such as.

  On the other hand, the state detection processing unit 112, in effect for the moving object, similar to the player P, identifies the location in the real space of the marker unit 60 disposed in the effect for the moving object, the marker unit 60 and the Based on the position in the real space, the position (the position of the center or the center of gravity) of the performance moving object in the real space and, if necessary, its state are detected.

  The movement / motion processing unit 113 calculates the positional relationship between the player P and the rendering object 80 based on the detected player state, the current game environment, the progress of the game, or two or more pieces of these information. calculated as the player P based on the positional relationship between the effect for the object 80 to move-operation calculation of the effect for the object 80 (moving-motion simulation).

  That is, the movement / motion processing unit 113 performs various processes of moving various objects in the object space and moving (motion, animation) the objects based on the detected player state or the like.

  More specifically, the movement / motion processing unit 113 stores movement information (position, rotation angle, speed, or acceleration) of various objects and motion information (position or rotation angle of each part constituting the object). performs found sequentially simulation processing for each frame (1/60 seconds).

  Note that the frame is a unit of time for performing the object movement / motion processing (simulation processing) and the image generation processing.

  The moving-operation processing unit 113, for presentation for a mobile object, the position in the real space, the positional relation in the real space of the player P, the moving direction of the effect for the moving object state (for effect moving object or its orientation), based on the progress of the current game environment or game, calculates the movement information and the operation information in the simulation space.

  In particular, the movement / motion processing unit 113 determines whether the pseudo-moving object of the rendering moving object is linked to the position or state of the real space or seamless with the position or state of the real space according to the user state. The movement information and the movement information in the simulation space are calculated based on the position, the state, or both of the pseudo moving object in the real space so that the image can be imaged.

  For example, if the pseudo moving object is an animal of an object, such as cats, movement and operation processing unit 113, and an operation at a position different from the position where the pseudo moving object is located in the real space, or Move around different areas, return to a position where the pseudo moving object is arranged in the real space at a predetermined timing, and calculate movement information and motion information to be in a state similar to a state arranged in the real space. I do.

  In such a case, the movement / motion processing unit 113 images the motion at the position where the pseudo moving object is arranged in the real space, but performs the movement for imaging the motion of the posture, the gesture, and the like. performing the calculation of the information and operation information.

More specifically, the movement / motion processing unit 113
(1) At the start of the game, even if a cat object as a pseudo moving object is arranged at the end point of the moving path R in the real space, the pseudo operation in which the cat object moves around the player P ,
(2) the player P is when advanced a certain distance towards the end of the travel path R, cats object moves toward the position that is located in the real space, the state of the real space in the position (3) A pseudo operation that does not change in the real space, such as various gestures when the player P holds a cat object,
(4) When the player P is let go from the state holding a cat object, operation in which the cat object to work with the movement of the real space in them to fall,
The calculation of the movement information and the operation information for imaging the image is performed.

Effect control process unit 114, the player status (including specific state.), The state of the effect for the moving object, the processing for controlling various effect device 90 to 93 in accordance with the progress of the current game environment and game execution I do. Specifically, the performance control unit 114, the rendering device 90
In step 93, the power supply is turned on and off, the capability is changed, or control based on a preset program is executed.

  For example, effect control process unit 114, if the performance apparatus 90 to 93 of the blower 90, strength comprises driving control and stop control of the blower, when the performance apparatus 90 to 93 are the temperature regulating device adjusts the temperature, If effect device 90 to 93 is moving path R is the moving path R rocking units charged in, or effect device 90 that needs to be changed in accordance with the state of the control, such as the player P of the vibrating unit to control the 93.

  The communication control unit 120 performs processing for generating the (image data to show the main simulation space player P) data to be transmitted to the HMD 20. In addition, the communication control unit 120 transmits and receives a control signal for controlling each of the effect devices 90 to 93.

  Image generating unit 130 (including the specific condition.) Results and player status of various processes performed by the processing section 101 (game process) performs a drawing process based on various information such as, thereby image (especially Simulation It generates an image) to show a space player P, and outputs the HMD20 via the communication control unit 120.

  In particular, the image generation unit 130 first acquires object data (model data) including vertex data (position coordinates of the vertices, texture coordinates, color data, normal vector, α value, etc.) of each vertex of the object (model). , based on the vertex data included in the object data the acquired (model data), it executes the vertex process (shading using a vertex shader).

  The image generation unit 130, in performing the vertex process, optionally subdivided vertex generation process for the polygons (tessellation, curved surface division, polygon division) may be performed.

  In addition, the image generation unit 130 performs vertex movement processing, coordinate conversion (world coordinate conversion, camera coordinate conversion), clipping processing, and the like in accordance with a vertex processing program (vertex shader program, first shader program). Alternatively, geometry processing such as perspective transformation is performed, and vertex data given for a vertex group forming the object is changed (updated or adjusted) based on the processing result.

  Then, the image generating unit 130 performs rasterization (scan conversion) based on the vertex data after the vertex process, associating the plane and the pixel of the polygon (primitive).

  On the other hand, the image generating unit 130, following the rasterization performs pixel processing for drawing the pixels that form the image (fragments that form the display screen) the (shading using a pixel shader or a fragment process).

  In particular, in the pixel processing, the image generating unit 130 performs reading of a texture (texture mapping), setting / changing of color data, translucent composition, anti-aliasing, and the like according to a pixel processing program (pixel shader program, second shader program). Various processes are performed to determine the final drawing color of the pixels constituting the image, and the drawing color of the perspective-transformed object is stored in the storage unit 170 (buffer capable of storing image information in pixel units; VRAM, rendering target). output (drawing) to.

In the pixel processing, the image generating unit 130 performs a per-pixel processing of setting or changing image information (color, normal, luminance, α value, and the like) in pixel units. Thus, an image that can be seen from the player P in the object space is generated.

  Further, the image generating unit 130, the vertex process and the pixel process, the shader program written in shading language, polygons hardware that allows programs drawing process (primitives), a so-called programmable shader (vertex shader and pixel shader) It is realized by.

  The programmable shader allows for a high degree of freedom in rendering processing by allowing the processing of vertices and processing of pixels to be programmable, greatly improving the expressive power compared to fixed rendering processing using conventional hardware. it can be.

  On the other hand, when drawing an object, the image generation unit 130 performs geometry processing, texture mapping, hidden surface removal processing, α blending, and the like.

  In particular, the image generator 130, as geometry processing, subjects the object to coordinate transformation, clipping, execute perspective transformation, or light source calculation and the like.

  Then, the image generation unit 130 stores the object data (position coordinates of the vertices of the object, texture coordinates, color data (luminance data), normal vector, α value, etc.) after the geometry processing (after the perspective projection transformation). stored in the section 170.

  Further, the image generation unit 130 executes texture mapping, which is a process for mapping a texture (texel value) stored in the storage unit 170 to an object. Specifically, the image generation unit 130 reads a texture (color (RGB), surface properties such as α value) from the storage unit 170 using the texture coordinates set to the vertices of the object (grant).

  Then, the image generation unit 130 maps the texture (two-dimensional image) onto the object. In this case, the image generation unit 130 performs a process of associating pixels with texels, and performs bilinear interpolation or the like as texel interpolation.

  Further, the image generating unit 130, the hidden surface removal, hidden by Z buffer Z value of the drawing (depth) is input Z buffer method was used (depth buffer) value (depth, Z test) Perform a surface erasing process.

  That is, the image generating unit 130 refers to the Z value input to the Z buffer when drawing the drawing pixel corresponding to the primitive of the object. Then, the Z value of the referenced Z buffer is compared with the Z value of the primitive drawing pixel, and the Z value of the drawing pixel is a Z value (for example, a small Z value) on the near side as viewed from the player P. In some cases, the drawing process of the drawing pixel is performed, and the Z value of the Z buffer is updated to a new Z value.

  Then, the image generation unit 130 performs α blending (α synthesis) of the translucent composition processing (normal α blending, addition α blending, subtraction α blending, etc.) based on the α value (A value).

  The α value is information that can be stored in association with each pixel (texel, dot), for example, plus alpha information other than color information. α value, mask information, translucency (transparency, opacity equivalent), can be output as bump information, or the like.

The sound generation section 140 (including the specific condition.) Player state performs a sound process based on the results of various processes performed by the processing unit 101 such as, BGM, sound effects, or the game sound such as voice in (simulation space An environmental sound as three-dimensional sound is generated and output to the headphones 61 via the HMD 20.

2-6. Then the marker unit and an imaging camera for players, the marker unit 60 and the imaging camera 70 of the player is described in the game system of this embodiment with reference to FIGS. 1 and 4 above.

  In the present embodiment, as described above, in order to detect the player state, each player P, and disposed the marker unit 60 at multiple sites. Specifically, the marker units 60 of the present embodiment are provided at a plurality of parts of the head, both hands, and both feet, as shown in FIGS.

  In particular, each marker unit 60 is formed of a material whose surface reflects such as a reflection sheet, and is formed of a stadium marker. For example, each marker unit 60, when light is irradiated, and a glowing by white shining or specific color configuration to reflect the light.

  Specifically, each marker unit 60 includes a head detection marker unit 60a, a right hand or left hand detection marker unit 60b, and a right foot or left foot detection marker unit 60c.

  Incidentally, the mobile experience area within the structure 10 of the present embodiment, the light source unit is provided (not shown) for irradiating light to each marker unit 60.

  The color of the marker unit 60 that emits light is not particularly limited. However, when a plurality of players P are simultaneously present in the movement experience area, the color may be changed for each player P, or the marker unit 60 may be mounted. The shining color of the marker unit 60 may be changed for each part.

  For example, as shown in FIG. 1, each imaging camera 70 is fixedly disposed at a preset position in the structure 10, and images an area imaged within an angle of view to simulate the image data. and sequentially outputs to the controller 100.

  In particular, each imaging camera 70 of the present embodiment is formed outside the moving range (specifically, moving path R) in which the player P moves in the real space.

  Each imaging camera 70 is arranged so as to be able to image the play area 12, move into the play area 12, change the posture, or image all the players P performing both of them. I have.

  Further, each imaging camera 70 of the present embodiment includes a predetermined imaging element such as a CCD and a lens having a predetermined focal length, and an area within the angle of view is determined by a predetermined angle of view and focal length. imaged, and outputs the image data obtained by the imaging sequential simulation controller 100.

  If the player P can move freely within the play area 12, it is necessary to image the entire play area 12, and the imaging cameras 70 are arranged so that the play area 12 is not missed. It is set.

Further, the imaging camera 70, in order to detect the marker unit 60 a colored, is required to use a color format of the camera.

  The number and arrangement positions of the marker units 60 are not limited to the above. As long as the position can be imaged by the imaging camera 70, basically, the number of arrangement positions is not limited.

2-7. Production Object and Production Device Next, the production object 80 and the production devices 90 to 93 in the game system of the present embodiment will be described with reference to FIGS. 1, 3, 4 and 7 described above. FIG. 7 is a diagram illustrating an example of the movement route member 93 that is the rendering device of the present embodiment.

  The rendering object 80 and the rendering devices 90 to 93 according to the present embodiment are arranged in a real space formed in the structure 10 and are linked with a simulation image under the control of the simulation control device 100. It has a structure to experience a given effect to the player P.

  In particular, the effect object 80 and the effect devices 90 to 93 are effects for experiencing not only an outdoor space and an indoor space but also a simulation space such as a high place, a closed place, a dangerous place, a special space, a hot place or a cold place. a use object or effect device, a situation in which in conjunction with the simulation image player P is seen by the simulation creates even perceived, used to provide a simulation realistic.

  Specifically, the effect object 80 of the present embodiment includes the effect moving object and the effect stationary object as described above, and the effect moving object includes the intrinsic moving object and the pseudo moving object. .

  And, for the pseudo moving object, the state of the effect for the object 80 in the real space is imaged in different states.

  Effect for the moving object, the position in the real space, the positional relation in the real space of the player P, and the marker unit for detecting the state of the effect for the moving object (moving direction and the posture of the effect for the moving object) 60d.

  Then, by causing the marker unit 60d to be imaged by the imaging camera 70, the effect moving object causes the simulation control device 100 to recognize the position, state, and both of the real space, similarly to each part of the player P.

  For example, as the marker unit 60d of the rendering object 80, the same one as the marker units 60a, 60b, 60c arranged in each part of the player P is used. However, it is preferable that the color is different for each of the plurality of players P or the staging objects 80 appearing in the game by discriminating the colors of the marker units 60a, 60b, 60c of the player P or various kinds of stored information.

  Incidentally, the vibrating unit is disposed in the interior of the effect for the object 80, by performing the vibration control of the vibration unit in the simulation control unit 100, simulator - execute an effect of surprise player P in conjunction with Deployment image or alone it may be.

  The rendering devices 90 to 93 are devices for surely creating a simulation space as a more realistic space in a pseudo manner, and are devices that directly provide a given rendering effect to the player P.

  In particular, effect device 90 to 93, while in conjunction with the simulation image, simply arranged in the real space, and structure type effect device that provides a given production effect to the player P the arrangement and by its structure, was detected player state, in accordance with the progress status of the game environment and game including linked effect device that provides a given production effect.

  The interlocking effect device includes, for example, a fan 90 shown in FIG. 1 and an effect device for forming an environment of a simulation space such as a temperature adjusting device, a lighting device, or a vibration device (not shown).

  Further, the structure-type effect device includes a moving path member 93 constituting the moving path R, a start block (not shown) for recognizing the start position, or a wall or floor such as a spring floor panel 92 for recognizing the inside of the elevator. Includes a member such as surface irregularities or a material for causing the player P to feel a touch.

  For example, as shown in FIGS. 1 and 4 described above, when the player P switches the zone from the start zone 13 to the movement experience zone 14, the blower 90 outputs a blower toward the front of the player P, has a structure of outputting the blowing toward the bottom of the player P in front of the player P when moving the moving path R.

  As shown in FIGS. 3 and 7, the moving path member 93 is provided below a predetermined moving path R in which the player P moves, and is formed so as to be able to vibrate or swing according to a simulation image. production area 93a is configured.

  That is, the moving path member 93 in effect region 93a, as shown in FIG. 7 (A), the floor surface of the structure 10 (specifically, the non-moving path NR) from different heights (the height of the ceiling direction ).

  The moving path member 93 in the effectable area 93a is driven by a plurality of drive units 95 that vibrate or swing the effectable area based on given conditions such as the player P starting walking on the moving path member 93. It is configured.

  In particular, each drive unit 95 includes a wheel 96 that rotates in a direction in which the movement path member 93 is horizontal to the floor surface and is perpendicular to the movement path direction (the traveling direction of the player P). And a support plate 97 that supports a movement path member 93 having a gap D at a predetermined height (for example, about 5 mm) from the grounding surface.

  Then, the drive unit 95 is arranged being adjacent to other drive units 95 along the moving path R in effect region 93a.

  In the movement path member 93 in the effectable area 93a, the entire movement path R may be configured by the drive unit 95, or the entire movement path R may be configured by a combination with the non-driven movement path member 93. May be. FIG. 7B shows an example in which the drive unit 95 continuously forms the movement route R.

  Further, as shown in FIGS. 7A and 7B, the drive unit may be configured to independently perform vibration drive or swing drive, or may be mechanically vibrated by the effect control processing unit 114. The drive and the swing drive may be controlled.

On the other hand, the rendering device may change its structure or form only in the simulation space. In other words, the structure and form of the effect object and the effect device are not changed in the real space, but the structure or shape can be changed only in the simulation space.

  For example, when a predetermined event occurs, the image generation unit 130 is to reduce the width of the movement path member 93 artificially, the wall 17 is approaching artificially, or ceiling 15 artificially For example, the structure or form may be changed only in the simulation space, for example, when the simulation space is lowered.

2-7-1. Operation of Game System Next, the operation of the game system 1 according to the present embodiment will be described with reference to FIGS. 8 and 9 are flowcharts illustrating the operation of the game system 1 according to the present embodiment.

  This operation will be described using a high place fear experience game that simulates a fear experience at a high place. In particular, heights fear experience game, the player P is to start from the start zone 13 moves the movement path member 93 above the predetermined width, present in the end point on the movement path member 93 (the point farthest from the start zone 13) In this game, the player returns to the start zone 13 within the time limit while holding (rescuing) a staging object 80 (for example, a cat).

  Also, it is assumed that the player P has already mounted the HMD 20 and the fall prevention unit 40, and is ready for hardware.

  First, the game calculation unit 110 is not illustrated based on an operation of the administrator, assuming that the HMD 20 and the fall prevention unit 40 are present at a predetermined position of the player P (specifically, within the start zone 13). It is detected whether or not the button has been pressed (that is, the game has started) (step S101).

  Note that the game calculation unit 110 starts the detection of the player state by the state detection processing unit 112 as the process of step S101, and detects whether the player P is present at a predetermined position to detect the start of the game. You may.

  Next, the game calculation unit 110 starts various calculations relating to the high-altitude fear experience game, and sets the object space setting unit 111, the state detection processing unit 112, the movement / motion processing unit 113, the effect control processing unit 114, and the image generation unit. 130 and sound generator 140, respectively, to initiate each processing relating to the simulation of altitude fear experience game (step S102).

In particular,
(1) The state detection processing unit 112 starts detection of the player state and the state of the effect object 80 while starting detection of each unit of the player P and the marker unit 60 disposed on the effect object 80,
(2) The object space setting unit 111 and the movement / motion processing unit 113
State of the effect for the object 80, to start the construction of the simulation space visible from the player P according to the progress of the game environment and game,
(3) The effect control processing unit 114 controls the effect devices (blower 90, automatic door 91, and spring floor panel 92) corresponding to the player state, the state of the effect object 80, the game environment, and the progress of the game. started,
(4) image generation unit 130 and a sound generation section 140, the player status, effect for the object 8
In accordance with the state of 0, the game environment, and the progress of the game, the generation of the simulation image and the generation of the accompanying sound are started.

The processing proceeds in step S102, until the end of the game is determined, the process started is continuously executed.

  Next, the image generation unit 130 displays the image in the elevator on the HMD 20, and the effect control processing unit 114 controls the spring floor panel 92 in the start zone 13 to execute the simulation process in the start zone 13 (step S103). ).

  Next, when the effect control processing unit 114 detects a predetermined timing (end of the simulation process in the start zone 13) (step S104), the effect control processing unit 114 executes a game start process (step S105), and The operation unit 110 starts a countdown for starting the game (step S106).

For example, the effect control processing unit 114 performs, as the game start processing,
(1) End of control of the spring floor panel 92,
(2) Control of the automatic door 91 (that is, the door of the elevator) formed between the start zone 13 and the movement experience zone 14 from the closed state to the open state, and
(3) The control of the corresponding effect device such as the blowing control by the blower 90 is executed.

  Then, the game calculation section 110, while detecting that the countdown is finished (step S107), the state detection processing unit 112, determines whether or not to move the mobile experience zone 14 exceeds the start zone 13 (hereinafter, "Start error determination") is performed (step S108).

  At this time, if the state detection processing unit 112 determines that it has moved to the movement experience zone 14 beyond the start zone 13 before the countdown ends, it notifies the HMD 20 of a warning (step S109). The process moves to step S107.

  In the present process, the state detection processing unit 112 may execute an accompanying effect such as interruption of the step S game start operation, and restart the operation from the process of step S105, or may interrupt the game. Good.

  When detecting that the countdown has ended, the game calculation section 110 starts various calculations relating to the execution of the high-altitude fear experience game (step S110). Specifically, the game calculation section 110 starts counting of the time limit, also starts to determine the game end process.

  Then, the game calculation section 110 determines whether or not equipped with a termination condition for the game (step S111). Specifically, the game calculation unit 110 interlocks with the state detection processing unit 112 to determine whether the player state or the state of the staging object 80 satisfies the termination condition, and whether the time limit has reached “0”. Is determined.

  For example, based on the detected player state, the game calculation unit 110 determines whether the player P has entered a specific state deviating from the movement route R, and drops the effect object 80 to be rescued during the movement to the specific state. It is determined whether or not a specific state that satisfies the end condition such as whether or not the state has been reached.

Next, if it is determined that the game calculation unit 110 does not have the game end condition, the game calculation unit 110 does not have the event start condition in conjunction with the state detection processing unit 112 or according to the progress of the game. It is determined whether or not it is (step S112).

  Specifically, the game calculation section 110 determines whether or not moved on the movement path member 93, a first position on the moving path member 93 (cat object is effect for the object 80 is first placed position) until whether reached, as to whether or not such player who has reached the position where the cat object is placed a presentation for the object 80 in the real space (the end point of the movement path member 93) whether a predetermined specific state including determining the start conditions of the event.

  At this time, when the game calculation section 110 is determined to be equipped with a start condition of the event, the effect control process unit 114, the image generation unit 130 and a sound generation section 140 executes processing corresponding to the detected event Then (step S113), if the game operation unit 110 determines that the event condition is not satisfied, the process proceeds to step S111.

In particular,
(1) When it is determined that the player P has moved to the movement path member 93 in the specific state, the effect control processing unit 114 operates the blower 90 disposed below the player P to move the blower 90. Perform the effect of sending the wind to the player P from below,
(2) the player P is, when the first position on the movement path member 93 is determined with specific conditions which has reached (cat object is effect for the object 80 is first placed position), the image generation The unit 130 and the sound generation unit 140 perform an effect in which the cat object escapes to the end point of the movement route R,
(3) player P is, when it is determined that the specific state that has reached to a position where the cat object is placed performs an effect to rescue the cat object,
(4) player P is, when it is determined that the specific state of the rescued suffer from cat object, the image generating unit 130 and a sound generation section 140, is in the direction in which the moving direction is toward the start zone 13 In this case, an effect of reducing the width of the movement path member 93 is executed,
(5) player P, in the case where but is determined to be a specific state that has reached the start zone 13 in a state that had a cat object, to perform an effect on the game clear, such as to escape from the elevator.

On the other hand, when the game calculation section 110 determines that the end condition of the game is satisfied, the image generation section 130 and the sound generation section 140 generate and output an image and a sound for effecting the end of the game. Then (step S114), the operation ends. It should be noted that, as is the effect on the end of the game, different performance depending on the termination condition of the game is executed.

2-8. Eye input 2-8-1. The game calculation section 110 of the simulation control unit 100 of the Outline of Embodiment of the eye input in accordance with a game program recorded in the main storage unit 172 (an example of a simulation control program), as appropriate, the display processing unit 110A, the measurement unit 110B, accepted parts 110C, the notification unit 110D, operates as an execution unit 110E, functions as a user interface that utilizes an eye input. Here, the "Eye Input" is that the player P is input by the operation of viewing the object to simulation controller 100 to their instructions. Hereinafter, the outline of the operations of the display processing unit 110A, the measurement unit 110B, the reception unit 110C, the notification unit 110D, and the execution unit 110E regarding the eye input will be described.

(1) Display processing unit 110A:
The display processing unit 110A displays the virtual three-dimensional space (the code OBS in FIG. 10) on the HMD 20. For example, the display processing unit 110A includes the object space setting unit 111 and the image generation unit 13
Controls 0, placing various objects to build a simulation space in a virtual three-dimensional space (reference numeral OBS in Figure 10). The objects include icons (push button objects OB1 to OB4 described later), virtual controllers, virtual mechanical switches, characters, items, and the like. Further, the display processing unit 110A controls the image generation unit 130, sets the virtual camera in the virtual three-dimensional space OBS, and displays image data for showing the player P the visual field range (reference numeral DA in FIG. 10) of the virtual camera. Execute the process to generate. Further, the display processing unit 110A controls the communication control unit 120 and the communication unit 196 to execute a process of outputting the image data to the HMD 20. In addition, the display processing unit 110A changes the position and the posture of the virtual camera in the virtual three-dimensional space (the code OBS in FIG. 10) according to the change in the position and the posture of the head of the player P detected by the state detection processing unit 112. Execute the process of changing.

(2) Measurement unit 110B:
Measurement unit 110B, a virtual three-dimensional space by measuring the visual time of the player P with respect to (code OB1 e.g. FIG. 11) objects arranged in a (reference numeral OBS in FIG. 11) (charge), the object (reference numeral OB1 in FIG. 11) When the line of sight of the player P (reference symbol LSA in FIG. 10) deviates from, a measurement value (hereinafter, referred to as “charge amount”) obtained by measurement according to the time during which the player P is out of sight (reference character LSA in FIG. 10). Decrease. The measurement unit 110B includes, for example, a hit area OBHA of the push button object OB1 located in the display area DA (an example of an area where an object is considered to be present) and a visual recognition area LSA (line of sight set in the display area DA). A process (visual determination process) of determining whether or not the player P is looking at the push button object OB1 based on a positional relationship with an example of an area considered to be present) is performed.

(3) Receiving unit 110C:
When the charge amount has reached the first threshold value Th1 (for example, 2 seconds), the receiving unit 110C receives an instruction to select an object (reference numeral OB1 in FIG. 11) (hereinafter, referred to as “lock”), and the charge amount is set to the first. receives an instruction of the lock of the defined object (code OB1 in FIG. 11) when it reaches the first threshold value Th1 is greater than the second threshold value Th2 (e.g., 5 seconds), the charge amount of the third threshold value Th3 (e.g. zero before the confirmation Second), the release of the lock on the object (reference numeral OB1 in FIG. 11) is accepted. However, receiving unit 110C is, if the charge amount even has not reached the second threshold value Th2 (e.g., 5 seconds), the charge amount exceeds the first threshold value Th1, and the player P has a predetermined action case, may be forced to accept the lock. The predetermined action may be “depression of a button arranged in the real space” or “visual confirmation of the object for confirmation”. However, in the following description describes the case of not using the arranged buttons and defined for the object in the real space.

(4) Notification unit 110D:
Notification unit 110D notifies the degree of charge amount of size to the player P. Notification unit 110D, for example, notification to the player P by subjecting to control the object space setting section 111, the charge amount of visual changes according to the size effect (FIG. 14) to the object (reference numeral OB1 in FIG. 11) I do. The notification unit 110D notifies the player P by causing the sound generation unit 140 to generate a sound effect and outputting the sound effect to the headphones 61 of the HMD 20 via the communication control unit 120 and the communication unit 196. You may. The notification unit 110D is notified to the player P, visual player P, hearing, touch, can be carried out by at least one olfactory (However, in the following description is mainly given notification by visual.).

(5) executing section 110E:
The game calculation section 110 as an execution unit 110E executes the predetermined processing corresponding to the object (reference numeral OB1 in Figure 11) if the lock object (code OB1 in FIG. 11) is confirmed. Objects predetermined processing corresponding to the (sign OB1 in FIG. 11),
For example, there are a process of setting a game parameter, a process of attacking the object, a process of moving the object, a process of another object, and a process of executing a predetermined program. Further, the timing at which the execution unit 110E executes the predetermined process may be immediately after the determination or after a predetermined time has elapsed from the determination (hereinafter, it is assumed that it is immediately after the determination).

  Hereinafter, the operation of the game operation unit 110 as the display processing unit 110A, the operation of the game operation unit 110 as the measurement unit 110B, the operation of the game operation unit 110 as the reception unit 110C, and the operation of the game operation unit 110 as the notification unit 110D The operation of the game operation unit 110 as the execution unit 110E will be described as the operation of the game operation unit 110.

2-8-2. Viewing area Figure 10, the virtual 3-dimensional space OBS, space viewed from the player P who wears the HMD 20 (hereinafter. Referred to as "display area DA") and the relationship between the viewing area LSA of the player P who wears the HMD 20 it is a diagram for explaining.

  The display area DA corresponds to the field of view of the virtual camera arranged in the virtual three-dimensional space OS as described above, and is an area displayed in front of the player P via the HMD 20. As described above, the game calculation unit 110 causes the position and orientation of the virtual camera to follow the position and orientation of the head of the player P. Therefore, the position and orientation of the display area DA in the virtual three-dimensional space OBS also change the head of the player P. Follow the position and attitude of.

  The viewing area LSA is an area of a predetermined size set by the game calculation unit 110 in the center of the display area DA. The viewing area LS corresponds to a range in which the player P is considered to be watching in a visual determination described later (it can also be referred to as a gaze range or a line-of-sight range). The ratio of the size of the viewing area LSA relative to the size of the display area DA is basically fixed, the position of the display area DA of the display area DA, which is basically fixed. Here, as shown in FIG. 10, it is assumed that the position of the viewing area LSA in the display area DA is the center of the display area DA, and the shape of the viewing area LSA is circular.

  The ratio of the size of the viewing area LSA relative to the size of the display area DA may also be made variable. Further, the position of the viewing area LSA in the display area DA can be made variable. Further, when the position of the viewing area LSA in the display area DA is variable, for example, the position of the viewing area LSA can be made to follow the direction of the line of sight of the player P (see the line of sight input described later). Further, in FIG. 10, has been visualized and the center coordinates of the contour to the viewing area LSA of the viewing area LSA for explanation, each of the outline and the center coordinates, may be actually hidden.

  Now, FIG. 10 shows an example in which the select screen is displayed as the virtual three-dimensional space OBS at the start of the high-altitude fear experience game (step S101). The select screen is a screen for the player P to make some settings relating to the game processing.

  Here, it is assumed that the push button objects OB1 and OB2 for selecting the number of persons and the push button objects OB3 and OB4 for selecting the degree of difficulty are arranged on the select screen at regular intervals. Each of these push button objects OB1, OB2, OB3, OB4 is a virtual operation button, and is an object that may be generally called an "icon". Although not shown in FIG. 10, other objects existing in the virtual three-dimensional space OBS behind the push button objects OB1, OB2, OB3, and OB4 as viewed from the player P (for example, the The scenery that you can see from the starting point) can be reflected.

  First, the push button object OB1 is assigned a function of a process of setting the mode of the game process to be executed by the processing unit 101 (mainly the game calculation unit 110) to the “single player mode”. The “single player mode” is a mode suitable for a single player P wearing the HMD 20 to move the structure 10.

  Also, the push button object OB2, processor 101 (mainly the game calculation section 110) function of the processing of setting the mode of the game process to be executed "two play mode" is assigned. "Two play mode" is a mode in which two players P who wears the HMD20 individually adapted to move a single structure 10 (mode for sharing two fear experience to the player P in). The game calculation section 110 in the "two play mode", for example, with two virtual camera corresponding individually to the two players P are set in the virtual three-dimensional space OBS, individually corresponding to the two players P Two characters (avatars) are arranged in a virtual three-dimensional space OBS. Then, the game calculation unit 110 links the two virtual cameras to the heads of the two players P, and links the parts of the two avatars to the parts of the two players P.

  Also, the push button object OB3, processor 101 (mainly the game calculation section 110) function of the processing of setting the mode of the game process to be executed "beginner mode" is assigned. "Beginner mode", the difficulty level of the game processing (for example, the probability that the player P is dropped) is that the lower the mode set by comparison with the "advanced modes", which will be described later. Adjustment of difficulty of the game process is performed, for example, by adjusting the parameters of the game process.

  The push button object OB4 is assigned a function of a process of setting the mode of the game process to be executed by the processing unit 101 (mainly the game calculation unit 110) to the “advanced mode”. "Advanced mode", the difficulty level of the game processing (for example, the probability that the player P is dropped) is a mode that is set higher than the "Introductory mode" described above. The adjustment of the difficulty level of the game processing is performed, for example, by adjusting the parameters of the game processing.

  Hereinafter, it is assumed that the player P plays in the “single player mode” and the “elementary mode”, that is, the player P locks the push button objects OB1 and OB3 by eye input and determines the lock by eye input. .

  As shown in FIG. 10, at the beginning of the display of the select screen, the push button objects OB1, OB2, OB3, and OB4 are arranged in a 2 × 2 matrix, and the display area DA and the visual recognition area LSA are located at the center of the matrix. which was assuming.

  Thereafter, when the player P turns his head to the upper left, the display area DA and the visible area LSA move toward the upper left of the select screen (upper left as viewed from the player P) as shown in FIG.

  FIG. 11 shows a state in which the viewing area LSA is located at the center of the push button object OB1, and the display area DA covers the entire push button object OB1. In this state, the game calculation unit 110 determines that the player P is watching the push button object OB1 (the details of the visual determination will be described later).

  Although not shown in FIGS. 10 and 11, when the player P retreats behind him, the size of the display area DA and the visual recognition area LSA in the virtual three-dimensional space OBS increases, and for example, four pushes are performed. The entire image of the button objects OB1, OB2, OB3, and OB4 can be contained in the display area DA.

2-8-3. Visual judgment game calculation section 110 has set the hit area separately for each of the push button object OB1, OB2, OB3, OB4 disposed to the select screen. The FIG. 12 (a), the illustrated as a representative example of the hit area OBHA set in the push button object OB1.

  As shown in FIG. 12A, the hit area OBHA of the push button object OB1 is an area having a predetermined shape and a predetermined size centered on the same coordinates as the center coordinates of the push button object OB1. The shape of the outline of the hit area OBHA, for example, a similar shape of the contour of the push button object OB1, the size of the hit area OBHA pushbutton object OB1, for example, is equal to the size of the push button object OB1.

  However, the size of the hit area OBHA may be larger or smaller than the size of the push button object OB1. The size of the hit area OBHA may be adjustable if desired.

  Now, the game calculation section 110, based on the positional relationship between the hit areas OBHA the viewing area LSA of push button object OB1, performing push button object OB1 determination player P is whether or not visually (visual judgment).

  For example, when at least a part of the hit area OBHA overlaps with at least a part of the viewing area LSA, the game calculation unit 110 determines that the player P is “viewing” the push button object OB1, and is not so. In this case, the player P determines that the push button object OB1 is “not looking” (that is, the player P is out of the line of sight of the push button object OB1). FIG. 12B shows a state where at least a part of the hit area OBHA and at least a part of the visual recognition area LSA overlap. The state in FIG. 12B is one of the states in which the game calculation unit 110 determines that the user is “visually watching”.

  Note that here, the condition that the game calculation unit 110 determines that the player P is looking at the push button object OB1 is set as “a case where at least a part of the hit area OBHA overlaps with at least a part of the visual recognition area LSA”. However, “when one of the hit area OBHA and the visual recognition area LSA is included in the other”, “when the interval between the hit area OBHA and the visual recognition area LSA becomes smaller than the threshold value”, and the like can be used. .

  12 (a) and 12 (b) show an example in which the visible area LSA is smaller than the hit area OBHA, but it is natural that the visible area LSA is larger than the hit area OBHA. Could be.

  As a result, the player P changes the position and the like of the viewing area LSA in the virtual three-dimensional space OBS by changing the combination of the posture of the head wearing the HMD 20 and the position of the head, and changes the push button object OB1. Can be visually checked, and the line of sight can be removed from the push button object OB1.

  In the following, the state that is determined to be "viewing" by visual determination is simply referred to as "visual", and the state that is determined to be "not watching" by visual determination is "remove the line of sight", "Look out of sight." The “line of sight” here does not refer to the actual line of sight of the player P (the visual axis of the eyeball) in the real space, but to the visual recognition area LSA in the virtual three-dimensional space OBS.

In the HMD 20 of the present embodiment, the visible area LSA and the hit area OBHA may be basically not displayed. Because, when the player P views any object in the virtual three-dimensional space OBS, the game calculation unit 110 of the present embodiment emphasizes the viewed object (see FIG. 14 and the like described later). Even if the visual recognition area LSA and the hit area OBHA are not displayed, it is considered that the player P does not lose sight of where in the virtual three-dimensional space OBS the own line of sight exists.

2-9. Amount of Charge for Visual Time The game calculation unit 110 of the present embodiment basically measures (charges) the visual time of the player P for each object arranged in the virtual three-dimensional space OBS, and measures the amount of charge (charge) for each object. the state of the object in accordance with the amount), "locked", "unlocked (unlocked)", it is controlled between the three states of "definite". In addition, the game calculation unit 110 manages the charge amount of the viewing time for each object in, for example, a readable / writable memory (such as the data buffer 176).

  13 (a), 13 (b), 13 (c), and 13 (d) are diagrams (graphs) illustrating the relationship between the elapsed time from the start of visual observation of a certain object and the charge amount. is there. The horizontal axis of the graph represents time and the vertical axis indicates the charge amount of the graph.

  13 (a) shows the player P indicates the charge amount of the change pattern in the case where only visually briefly object (if the charge amount after visually started gaze falls off before reaching the first threshold value Th1).

  FIG. 13 (b), the charge amount when the player P goes off sight from viewing the objects over a certain time (if the charge amount after visually started out line of sight after reaching the first threshold value Th1) 3 shows a change pattern.

  FIG. 13C shows a change pattern of the charge amount when the player P continuously looks at the object for a sufficient time (when the charge amount reaches the second threshold value Th2 after the start of the visual observation). .

  FIG. 13D shows a case where the player P looks at the object for a certain period of time, temporarily removes his / her line of sight, and looks at the object again (the charge amount exceeds the first threshold Th1 after the start of the visual observation and the second time. This shows a change pattern of the charge amount when the line of sight is displaced before reaching the threshold Th2, and thereafter, the user is re-viewed before the charge amount becomes zero.

  First, the game calculation section 110, the visual of the player P on the object is started (see charge starting time ts in FIG. 13 (a) ~ (d).), To start charging of the visual time for the object . Here, it is assumed that the game calculation unit 110 increases the charge amount by “1” each time the viewing time increases by one second.

  Further, when the line of sight of the player P deviates from the object (see the line of sight release time tO in FIGS. 13B and 13D), the game calculation unit 110 performs visual observation according to the time during which the line of sight is deviated. Reduce time charge. Here, the game calculation section 110 is assumed to visual time is increased by "0.5" charge amount every increase of 1 second.

  The game calculation section 110, when the charge amount after charging start has reached the first threshold value Th1 (here, the Th1 = 2.), To lock the object (FIG. 13 (b), (c), ( (See the lock start time tL in d).)

Thus, the player P is over an object above a certain level (here over 2 seconds)
By visually continuously, it is possible to lock the object.

  Further, when the charge amount reaches a second threshold value Th2 (here, Th2 = 5) larger than the first threshold value Th1 after the start of charging (FIGS. 13C and 13D). The lock of the object is determined and the charge amount is reset to zero.

  Therefore, the player P can determine the lock of the locked object by continuously (or intermittently) watching the locked object over a certain amount.

  The game calculation section 110, if and charge amount before confirmation after lock which decreases to a third threshold value Th3 (here, the Th3 = zero.) Receives the unlocking of the object (FIG. 13 (b referring to unlock time tU of).).

  Therefore, the player P can release the lock of the locked object by removing his / her eyes from the locked object for a certain amount or more, and further, the earlier the time of viewing the object is, the earlier the release timing is. can do. Conversely, the player P keeps watching the locked object for a long time, so that it is possible to secure a long time until the lock is maintained after the line of sight is removed. In other words, the strength of intention player P is to visually objects is reflected in the locking strength of the object (release by resistance in the lock).

  The game calculation section 110, when the charge amount after charging start off the line of sight from the object prior to reaching the first threshold Th1 (see sight cancel time tO in FIG. 13 (a).), The charge amount Is reset to (immediately) zero.

  Therefore, such as when the player P is wondering whether to lock any object, the extent to which gaze is simply applied to the object, never the object is locked, the player P may have intentionally visual objects to be locked If only (when viewed long), the object is locked.

  Further, the game calculation section 110 makes the speed at which the charge amount approaches the third threshold value Th3 after locking slower than the speed at which the charge amount approaches the second threshold value Th2. For example, the game calculation section 110, the charge amount each time the viewing time increases 1 second for increase by "1", the charge amount every time that out-of-sight after the lock is increased one second " 0.5 "(in fact, the decreasing curves in FIGS. 13B and 13D have a gentler slope than the ascending curves).

  Thus, the player P after locking of an object, without continued completely fixed state the position and orientation of the head (even unsteady somewhat neck), it is easy to maintain the lock of the object .

  In addition, if the player P keeps looking at an object without hesitation, it can determine the lock of the object in a short time (see FIG. 13C), and hesitates whether to determine the lock. In this case, by removing the line of sight from the object or returning the line of sight, it is possible to increase the remaining time until the object is fixed while maintaining the lock of the object (FIG. 13D).

  As a result, the player P can freely switch the state of the object between “locked”, “unlocked (unlocked)”, and “fixed”.

  In the above description, the game calculation unit 110 adjusts the speed at which the charge amount is increased or decreased in order to adjust the speed at which the charge amount approaches the threshold, but instead of adjusting the speed at which the charge amount is increased or decreased (or In addition to adjusting the rate at which the charge is increased or decreased, the magnitude of the threshold may be adjusted. That is, since the charge amount and the threshold value are relative, "adjusting the rate of increase or decrease of the charge amount" and "adjusting the threshold value of the charge amount" may be regarded as equivalent to each other. Yes (same below).

  Further, in the above description, the game calculation unit 110 unlocks the object at the timing when the charge amount of the object has decreased to the threshold Th3. When a predetermined action is taken, the lock may be forcibly determined. The predetermined action may be a "depressed buttons arranged in the real space" may be a "visually releasing objects", which may be an action of "look twice" for the object ( The action of "twice" will be described later.) However, in the following description, the buttons arranged in the real space for releasing the lock, determined for the object, for the case of not using the "look twice" as described.

2-10. FIG. 14 is a diagram illustrating an example of a visual effect of an object.

  As shown in FIG. 14, the game calculation unit 110 gives a visual effect to the object, and changes the visual effect according to the charge amount of the object, thereby changing the charge amount of the object over time ( visualizing the state) the charge amount is increased or decreased.

  If the amount of charge of each object is visualized, the player P can or identify objects that they are visually he or distinguish whether that visually objects. Further, the player P, for objects in he visual remaining time or until it is locked, the remaining time or until the lock is released, also possible to grasp the visual time required until the lock is established possible it is.

  The visual effect is implemented by, for example, animation. This is because according to the animation, the time change of the charge amount can be notified to the player P in real time (sequentially). In the example shown in FIG. 14, this animation is an animation in which a mark row (neon mark row) is arranged at the outer edge of the object, and the number of arranged mark rows is changed according to the charge amount.

  As described above, if the charge amount is reflected in the number of arrangements of the mark rows, the player P can intuitively determine the magnitude of the charge amount, whether the charge amount is increasing or decreasing, the speed at which the charge amount increases, or the speed at which the charge amount decreases. It is possible to grasp.

  FIG. 14 (a), the amount of charge after the visual start indicates the mark string when (visual start immediately or unlocked just before) became "0.5".

  FIG. 14 (b), the charge amount after viewing start indicates the mark string when it becomes "1".

  FIG. 14 (c), the amount of charge after the visual start indicates the mark string when it becomes "1.5".

FIG. 14D shows a case where the charge amount becomes “2” after the visual observation starts (when the charge amount is locked).
Are shown.

  FIG. 14 (e) the amount of charge after the lock is shown a mark string when it becomes "2.5".

  FIG. 14F shows a mark row when the charge amount becomes “3” after locking.

  Figure 14 (g), the charge amount after the lock indicates a mark string when it becomes "3.5".

  FIG. 14H shows a mark sequence when the charge amount becomes “4” after locking.

  FIG. 14 (i) shows a mark sequence when the charge amount becomes “4.5” after locking.

  FIG. 14 (j) shows a mark sequence when the charge amount becomes “5” after locking (when locking is determined).

  That is, in the animation shown in FIG. 14, the degree of the charge amount is represented by the number of arrangements of the mark rows. The outline arrow in FIG. 14 indicates the order of change of the mark sequence when the player P continuously looks at the object for 5 seconds. As described above, when the player loses his / her gaze from the object, Since the charge amount is reduced, the animation changes in the direction opposite to the white arrow. Further, as described above, in the present embodiment, since the direction of the speed which decreases the amount of charge than the rate at which the charge amount is increased is slow, than the rate at which the animation is changed in the direction of the white arrow in FIG. 14, The speed at which the animation changes in the direction opposite to the white arrow is slower.

  Here, the game calculation unit 110 distinguishes between locked objects and unlocked objects. For example, the game calculation unit 110 sets the degree of emphasis of the locked object (FIGS. 14D to 14I) higher than the degree of emphasis of the unlocked object (FIGS. 14A to 14C). Set. In the example shown in FIG. 14, the density of the locked object (FIGS. 14D to 14I) is set higher than the density of the unlocked object (FIGS. 14A to 14C). .

  Therefore, the player P can determine whether or not the object is locked based on the degree of emphasis (here, the density) of the object.

  Incidentally, enhancement of the object, for example, the following parameters (1) can be adjusted by at least one of - (14).

(1) Mark row density,
(2) the brightness of the mark row,
(3) Mark row color,
(4) Opacity of mark row,
(5) Saturation of mark row,
(6) mark row shape,
(7) concentration of the mark row, brightness, color, opacity, saturation, at least one variation pattern of the shape,
(8) the concentration of the object,
(9) the object of brightness,
(10) Object color,
(11) Opacity of the object,
(12) object of saturation,
(13) Object shape,
(14) At least one change pattern among the density, luminance, color, opacity, saturation, and shape of the object.

  Here, as the animation for notifying the player P of the charge amount, "animation for arranging the mark rows on the outer edge of the object and changing the number of arrangement of the mark rows according to the charge amount" has been described. , "Animation in which an annular or partial annular gauge (tube-shaped gauge) is arranged on the outer edge of an object and the length of the gauge (corresponding to the position of the gauge pointer) according to the charge amount" Good (see FIG. 26).

  In this way, if the charge amount is reflected in the length of the gauge, the player P can intuitively grasp the magnitude of the charge amount, whether the charge amount is increasing or decreasing, the speed at which the charge amount increases, or the speed at which the charge amount decreases. It is possible to

  Further, the animation for notifying the player P of the charge amount may be an animation in which the degree of emphasis of the object itself is changed according to the charge amount, instead of the animation using the mark row or the gauge. The degree of enhancement of the object itself can be adjusted by, for example, at least one of the parameters (7) to (12) described above. FIG. 19 shows an example in which the density of the object itself changes according to the charge amount.

  As described above, if the amount of charge is notified to the player P based on a change in the degree of emphasis of the object itself, a large space around the object can be secured, so that the degree of freedom in layout of the object is increased. Therefore, for example, it is effective when many objects are densely arranged.

  Further, as for the relationship between the charge amount and the degree of enhancement of the visual effect, it is desirable that the greater the charge amount, the higher the degree of enhancement. Here, "high enhancement degree" refers, for example, the concentration becomes higher, the saturation is high, the opacity is high, and that the change period of the color and the like is advanced.

2-11. Combo processing 2-11-1. SUMMARY game calculation section 110 of the combo treatment, when a predetermined condition is satisfied when two or more objects are locked at the same time, executes the combo treatment (activation). The “combo process” here is a process of receiving an eye input (confirmation of lock and release of lock) for all of two or more locked objects based on a common charge amount.

  The “common charge amount” is, for example, a charge amount obtained by integrating individual charge amounts of two or more objects (integrated charge amount), and a charge amount of an object representing two or more objects (representative charge amount). ) A new charge amount (separate charge amount) set separately from the individual charge amounts of two or more objects. The “integrated charge amount” is, for example, an average of individual charge amounts, a weighted average of individual charge amounts, a sum of individual charge amounts, a product of individual charge amounts, and the like. The following mainly describes a case where the sum of individual charge amounts is used as the integrated charge amount (details will be described later).

  In order to activate the combo process, the player P locks an object and locks another object before the lock is released, so that two or more objects are locked at the same time. It suffices if a predetermined condition (hereinafter, referred to as “combo activation condition”) is satisfied. Details of the combo activation condition will be described later.

  When the combo process is activated, the player P can determine two or more locked objects with a single eye input, so that the player P can perform eye input more than when performing eye input for each of the two or more objects. the number of inputs (in this embodiment the number of operations by the player P is mainly shakes his head) can be reduced.

  For example, if the combo process is activated while the push button objects OB1 and OB2 in FIG. 10 are locked at the same time, the player P will perform both the push button objects OB1 and OB2 only by eye input to one of the push button objects OB1 and OB2. (The instruction for setting the single player mode and the elementary mode) can be input to the simulation control device 100.

2-11-2. Combo activating condition Hereinafter, the combo activating condition will be specifically described.

  The game calculation section 110 of this embodiment, a combo transition condition, and "be visually initially locked object the player P re of two or more objects in co lock".

  Here, it is assumed that to trigger the combo treatment for two push button object OB1, OB3 shown in Figure 15 (a). In the description here, the number of objects to be subjected to the combo processing is set to “2”, but it is also possible to set “3 or more”.

  First, the player P locks the push button object OB1 by viewing one of the two push button objects OB1 and OB3 (hereinafter referred to as a push button object OB1) for a sufficient time of 2 seconds or more. to. The sufficient time is, for example, a time longer than 2 seconds and shorter than 5 seconds.

  Next, the player P removes his / her line of sight from the locked push button object OB1, and looks at the other push button object OB3 for 2 seconds or more before the lock of the push button object OB1 is released, thereby pushing the player. Lock the button object OB3. As a result, the push button objects OB1, OB3 are simultaneously locked.

  Next, the player P removes his / her line of sight from the push button object OB3, and performs an action of revisiting the initially locked push button object OB1 before any of the push button objects OB1 and OB3 is unlocked. I do. The curve indicated by the thick dotted arrow in FIG. 15A is an example of the movement trajectory of the line of sight of the player P. This action satisfies the combo activation condition for the push button objects OB1 and OB3, so that the combo process is activated.

  Here, when a certain object is locked, the lock is not immediately released even if the player P loses his / her line of sight from the push button object. it is also quite possible to lock. Therefore, the player P can easily satisfy the combo activation condition.

  The game calculation section 110 of this embodiment, the rate at which charge amount of the object in the unlocked approaches the first threshold value Th1, and gentle enough when the charge amount of the object in the lock (or the total charge amount) is large Is also good.

  In this case, since the player P is as objects in the non-lock is difficult to locked when visually long object locked, for example, the player P, the number of objects Ya being locked at the same time that you do not want to activate the combo treatment the when you do not want to increase the longer viewing the object to be locked, when you want to increase the number of objects Ya that is locked at the same time when you want to activate the combo process, by making the adjustment the objects you want to lock does not visually too long, that , the presence or absence of a state of existence and simultaneous lock of the activation of the combo treatment, can be determined by their own will.

2-11-3. Visual Effects Before and After Activating Combo Processing Hereinafter, visual effects before and after activating the combo processing will be described.

  The game calculation unit 110 changes the aspect of the visual effect of the two or more objects OB1 and OB3 that are simultaneously locked between before and after the activation of the combo process.

  FIG. 15A shows an example of a mode of the visual effect before the activation of the combo process, and FIG. 15B shows an example of a mode of the visual effect after the activation of the combo process. In FIG. 15 (a), (b), shows an example of a case of adopting the mark row as a visual effect, among the mark belonging to the mark train, represents the mark being displayed by a solid line, the marks hidden in It is represented by a dotted line (however, the image of the dotted line does not have to be actually displayed). The curve indicated by a thick dotted arrow in FIG. 15 (a) is an example of a moving locus of the line of sight of the player P.

  For example, before the combo process is activated, the game calculation unit 110 displays two mark rows OB11 and OB13 individually surrounding the locked push button objects OB1 and OB3 as shown in FIG. After the activation of the combo processing, as shown in FIG. 15B, one integrated mark row OB20 obtained by integrating the two mark rows OB11 and OB13 is displayed.

  Here, integration mark train OB20 are mark train surrounding the whole of the two push button object OB1, OB3 a combo treatment of the subject, among the integrated mark row OB20, the number of marks in the display, a combo treatment charge amount used (hereinafter, an example of measurement values after. integration of "integrated charge amount".) it represents. Integrated charge amount of detail will be described later.

  Thus, the player P, based on the aspect of the granted visual effect to the push button object OB1, OB3 in lock (15, whether mark row OB11, OB13 is integrated into the mark column OB20), in the lock It is possible to recognize whether or not the combo processing has been activated for the push button objects OB1 and OB3.

2-11-4. Integration of the charge amount in the combo treatment will be described below combo treatment of the game calculation section 110 (the amount of charge integration).

The game calculation section 110 integrates the Activate the combo treatment, the charge amount of the subject to two or more objects of the combo treatment (here two push button object OB1, OB3). At this time, the remaining charge amount is also integrated. Here, the "remaining charge amount", determined the method comprising the charge amount necessary for up to (threshold Th2), the remaining charge amount decreases the charge amount increases, increasing the charge amount decreases. Hereinafter, the charge amount after integration is referred to as “integrated charge amount”, and the remaining charge amount after integration is referred to as “integrated remaining charge amount”.

  FIG. 16A is a conceptual diagram showing the charge amount immediately before integration, and FIG. 16B is a conceptual diagram of the integrated charge amount. In FIG. 16 (a), (b), it represents the amount of charge by the solid line in the block, representing the remaining charge amount in the dashed block.

  For example, as shown in FIG. 16A, the game calculation unit 110 determines the charge amount (and the remaining charge amount) of each of the locked push button objects OB1 and OB3 before the activation of the combo process. Applied individually to OB1 and OB3. On the other hand, the game calculation section 110, after activation of the combo treatment, as shown in FIG. 16 (b), the object OB1, the charge amount of OB3 (and the remaining charge amount) integrated charge amount that can be integrated (and Integrated remaining charge the amount), to apply to the whole of push-button object OB1, OB3.

  Here, "the application of the charge amount", state quantity the charge (and the remaining charge amount) ( "lock", "unlock", "Enter") refers to the control.

  The ratio between the total charge amount immediately before the integration and the total remaining charge amount immediately before the integration (FIG. 16A) is succeeded to the ratio between the integrated charge amount and the integrated remaining charge amount (FIG. 16B). It is.

  Thereafter, the game calculation section 110, of the push button object OB1, OB3 as the object of the combo treatment, depending on the viewing time of the player P with respect to pushbutton object OB1 which is initially locked, to increase or decrease the integration charge amount.

  On the other hand, the game calculation unit 110 determines that the viewing time of the player P with respect to the second and subsequent locked push button objects OB3 among the push button objects OB1 and OB3 subjected to the combo processing is reduced to the integrated charge amount. Do not reflect.

  Thus, the player P after activation of the combo treatment controls only the first locked visual time push button object OB1 were all push button object as the object of the combo treatment OB1, the state of OB3, Control can be performed between “lock”, “unlock”, and “fix”. Moreover, since the charge amount before activation of the combo treatment is taken over to the charge amount after activation of the combo treatment, it is also no visual motion of the player P made before activation is wasted.

  In the present embodiment, as shown in FIG. 16 (b), the scale of the overall integrated charge amount and the integrated remainder charge amount, and shall be set to the size corresponding to the number of objects as the object of the combo treatment I do. According to this setting, the larger the number of objects subjected to the combo processing, the longer the viewing time required for confirmation, and the longer the remaining viewing time until release. Incidentally, the size expansion of the charge amount of the scale, for example, can be realized by the expansion of the second threshold value Th2, instead of expanding the second threshold value Th2, similar by gradual increase rate and decrease rate of the amount of charge effect can also be obtained.

The game calculation section 110 of the present embodiment, among the two or more objects as the object of the combo treatment, visual time only integration charge amount of the first lock the pushbutton objects OB1 to (and remaining charge amount) Although the reflection time is reflected, the entire viewing time of two or more objects subjected to the combo processing may be reflected on the integrated charge amount (and the remaining charge amount). That is, the game calculation unit 110 increases the integrated charge amount when at least one of the two or more objects subjected to the combo processing is viewed, and increases the integrated charge amount from all of the two or more objects subjected to the combo processing. it may decrease the integrated charge amount when the sight is out. In this case, the player P can increase the integrated charge amount only by visually observing any one of the two or more objects subjected to the combo processing. it is possible to reduce the integrated charge amount by removing the.

2-11-5. Partial release processing in combo processing During the activation of the combo processing, the game operation unit 110 performs the following operation (a) on the specific object that is one of the two or more objects subjected to the combo processing. When (c) is performed within a sufficiently short predetermined time, the specific object is excluded from the target of the combo processing. Well in a short predetermined time, for example less than 2 seconds.

(A) viewing the specific object,
(B) Remove the line of sight from a particular object,
(C) viewing the specific object.

  Below, the process of removing the object of one part of the two or more objects have been the subject of combo treatment from the subject of the combo treatment is referred to as a "partial release processing", here, the object of one part from the target of the combo treatment remove it is assumed to be equivalent to unlock a portion of the object.

  In addition, here, as shown in FIG. 17 (a), 2 single push button object OB1, OB3 and combo treatment with activated about, of, assuming that only the locking of the push button object OB3 is the player P releases I do. Here, the number of objects subjected to the combo processing is “2”, but the same applies to the case of “3 or more”.

  Therefore, the player P has two push-button object OB1, viewing the push-button object OB3 you want to release the lock of the OB3, remove the line-of-sight from the push-button object OB3, re-viewing the push-button object OB3, that action (the so-called By simply performing the second look within a sufficiently short predetermined time, the lock of the push button object OB3 can be released while the lock of the push button object OB1 is maintained.

2-11-6. Visual effects before and after partial release processing The visual effects before and after partial release processing will be described below.

  The game calculation unit 110 changes the visual effect of the objects OB1 and OB3 subjected to the combo processing before and after the partial release processing.

  FIG. 17A shows an example of the form of the visual effect before the partial release processing, and FIG. 17B shows an example of the form of the visual effect after the partial release. FIGS. 17A and 17B show an example in which a mark sequence is employed as a visual effect. Among the marks belonging to the mark sequence, the displayed mark is represented by a solid line, and the non-displayed mark is represented by a solid line. It is represented by a dotted line (however, the image of the dotted line does not have to be actually displayed). The curve indicated by the thick dotted arrow in FIG. 17A is an example of the movement locus of the line of sight of the player P.

  For example, the game calculation section 110, the front part release process, as shown in FIG. 17 (a), the integration mark train OB20 surrounding the whole of the two push button object OB1, OB3 of interest combo treatment After the display and the partial release processing, as shown in FIG. 17B, a part of the integrated mark row OB20 is separated to display two mark rows OB11 and OB12.

Here, the mark column OB11 is a mark column surrounding the push button object OB1 in which the lock is maintained, and the number of displayed marks in the mark column OB11 is applied to the push button object OB1 in which the lock is maintained. Indicates the charge amount.

  On the other hand, the mark row OB13 is a mark row surrounding the unlocked push button object OB3, and the number of displayed marks in the mark row OB13 is the charge applied to the unlocked push button object OB3. It represents the quantity.

  Thus, the player P, based on the aspects of the visual effect applied to the push button object OB1, OB3 (17, whether integrated mark row OB20 is separated mark rows OB11, OB13), and the target combo treatment it is possible to recognize the presence or absence of a partial release processing for the push-button object OB1, OB3 became.

2-11-7. Following separation of the charge amount in the partial cancellation process, partial release processing by the game calculation section 110 (charge amount of separation) will be described.

  When starting the partial release process, the game calculation unit 110 separates the charge amount of the unlocked object from the integrated charge amount. At this time, the remaining amount of charge also separated. Here, the “remaining charge amount” is a charge amount required until the charge amount is determined (threshold Th2). The remaining charge amount decreases as the charge amount increases, and increases as the charge amount decreases.

  FIG. 18A is a conceptual diagram showing an integrated charge amount immediately before separation, and FIG. 18B is a conceptual diagram of a charge amount immediately after separation. In FIG. 18 (a), (b), it represents the amount of charge by the solid line in the block, representing the remaining charge amount in the dashed block.

  For example, before the start of the partial release process, the game calculation unit 110 applies the integrated charge amount (and the integrated remaining charge amount) to the entirety of the push button objects OB1 and OB3 as shown in FIG. On the other hand, after the start of the partial release process, the game calculation unit 110 applies the integrated charge amount (and the integrated remaining charge amount) to the push button object OB1 in which the lock is maintained, as shown in FIG. Then, the individual charge amount (and the individual remaining charge amount) is applied to the unlocked push button object OB3.

  Here, "the application of the charge amount", state quantity the charge (and the remaining charge amount) ( "lock", "unlock", "Enter") refers to the control.

  Further, the integrated charge amount and the integrated remaining charge amount (FIG. 18A) immediately before the partial release processing are equal to the charge amount and the remaining charge amount of the push button object OB1 whose lock is maintained (the upper part of FIG. 18B). In the example shown in FIG. 18B, the number of locked objects is “1”, so the combo processing is automatically terminated, but the number of locked objects is Is greater than or equal to "2", the combo process is continued, so the integrated charge amount and the integrated remaining charge amount continue in the combo process.)

  On the other hand, the integrated charge amount and the integrated remaining charge amount (FIG. 18A) immediately before the partial release processing are equal to the charge amount and the remaining charge amount of the unlocked push button object OB3 (lower part of FIG. 18B). is not taken over, the charge amount of the push button object OB3 the lock is released (bottom of FIG. 18 (b)) is set to zero at the timing of the release.

Thereafter, the game calculation unit 110 increases or decreases the charge amount of the push button object OB1 according to the viewing time of the player P with respect to the locked push button object OB1 (provided that the number of locked objects is " If it is 2 "or more, the combo process is continued, so the integrated charge amount is increased or decreased according to the viewing time of the object locked at the earliest time.)

  In addition, the game calculation unit 110 increases or decreases the charge amount of the push button object OB3 in accordance with the viewing time of the player P with respect to the unlocked push button object OB3.

  Thus, the player P, after activation of the combo treatment, only re visually particular push button object OB3, while maintaining the locking of the other push button object OB1, be released only locking of the push button object OB3 Can be. Moreover, since the charge amount before releasing is taken over to the charge amount after release, it is also not wasted the visual motion of the player P that were made prior to release.

  In the present embodiment, as shown in FIG. 18B, the overall scale of the charge amount and the remaining charge amount is set to a size corresponding to the number of objects to which the charge amount is applied. According to this setting, the smaller the number of objects to which the charge amount is applied, the shorter the viewing time required for determination and the shorter the remaining viewing time until release. Incidentally, the size reduction of the charge amount of the scale, for example, can be realized by the reduction of the second threshold value Th2, instead of reducing the second threshold value Th2, similar by a steep increase rate and decrease rate of the amount of charge effect can also be obtained.

  Also, here, a partial release treatment has been described as a process to be executed during activation of the combo treatment can also be performed during non-activation of the combo treatment. That is, when the player P performs the above operations (1) to (3) on the object within a sufficiently short predetermined time during a period in which the certain object is locked, the game operation unit 110 May be received, and the charge amount of the object may be reset to zero.

2-12. Control of Lock Strength The game calculation unit 110 determines a criterion for determining that the player P is looking at the locked object (a criterion for visually determining the locked object), and sets the criterion for determining whether the locked object is a non-locked object to the player. P than criteria for determining to be visually (criterion visual determination of the object being unlocked), set loosely. When loose the criteria, it is possible to increase the locking strength of the object. The "locking strength" refers to the possibility of low lock is released.

  Therefore, the player P cannot lock the object without intentionally viewing the unlocked object, but it is easy to maintain the lock without strongly consciously viewing the locked object. .

  Here, as shown in FIG. 12, the push button object OB1 will be described as an example, but the same applies to other objects.

  As described above, the game calculation unit 110 performs the visual determination of the push button object OB1 based on whether at least a part of the hit area OBHA of the push button object OB1 and at least a part of the visual recognition area LSA overlap. . Then, the game calculation unit 110 determines that the user is “visually watching” when at least a part of the hit area OBHA of the push button object OB1 overlaps with at least a part of the viewing area LSA. It determined as "not visually".

  Therefore, the game calculation unit 110 increases the size of at least one of the hit area OBHA and the visual recognition area LSA of the push button object OB1 in order to loosen the criterion for the visual determination of the push button object OB1.

  Here, in consideration of performing the control of the criterion for each object, a case where the size of the hit area OBHA is variable and the size of the visual recognition area LSA is fixed will be described for simplicity. The adjustment of the size, may be continuous, a case which is graded as an example.

  Furthermore, the game calculation unit 110 sets a gradual criterion for visual determination of the push button object OB1 as the charge amount of the push button object OB1 increases. That is, the game calculation unit 110 increases the size of the hit area OBHA of the push button object OB1 as the charge amount of the push button object OB1 increases.

  For example, when the push button object OB1 is not locked, the game calculation unit 110 sets the size of the hit area OBHA of the push button object OB1 to, for example, the “standard” size shown in FIG. When the charge amount of OB1 is less than a predetermined value (for example, “3”) between the thresholds Th1 and Th2, the size of the hit area OBHA of the push button object OB1 is changed to the “medium” size shown in FIG. set, when the charge amount of the push button object OB1 is the predetermined value ( "3") or more, sets the size of the hit area OBHA pushbutton object OB1, the size of "large" shown in FIG. 20 (c) to.

  In this case, the longer the player P views the push button object OB1, the higher the lock strength of the push button object OB1.

  In addition, as shown in FIGS. 20A, 20B, and 20C, the game calculation unit 110 determines the hit area OBHA of the player P in the left-right direction more than the enlargement ratio of the size of the hit area OBHA in the vertical direction. the expansion ratio of the size of OBHA, is set to be higher.

  According to this setting, towards the locking strength of the left and right direction than the vertical direction of the lock strength of the push-button object OB1 is relatively high.

  In general, the direction of the line of sight of the player P (determined by the posture of the neck in the present embodiment) is more likely to be unstable in the left-right direction than in the up-down direction. If this is done, it is conceivable that eye input errors (unintended unlocking of the player P in the present embodiment) can be reduced without impairing operability.

2-13. Supplement for control of the lock strength The game calculation section 110 of this embodiment, the control of the locking strength, was performed by at least one of the size adjustment of the viewing area LSA (spatial regulation), the rate of decrease in charge amount (Temporal adjustment) or a combination of spatial adjustment and temporal adjustment.

  For example, the game calculation section 110 of this embodiment, the charge amount smaller the charge amount of the push button object OB1 is large may be made gentle speed approaching the third threshold value Th3. Note that the speed can be adjusted by adjusting the threshold value or adjusting the increase / decrease speed of the charge amount as described above.

  In this case, for example, in the example, when the player P is wondering whether to lock certain object you can not lock the object to be visually over the object to a predetermined time or more. On the contrary, if after the object has been locked, so long as not remove the line of sight for a long time from the object, the object lock is maintained.

  In addition, the game calculation unit 110 of the present embodiment has adjusted the size of the hit area OBHA in the virtual three-dimensional space OBS in order to perform spatial adjustment, but has adjusted the size of the visual recognition area LSA in the virtual three-dimensional space OBS. may be, it may be adjusted both the hit area OBHA the size of the viewing area LSA. In this case, for example, the game calculation unit 110 of the present embodiment may control the size of the viewing area LSA according to the charge amount of the object closest to the viewing area LSA.

2-14. Flow of reception processing eye input will be described a flow of reception processing of eye input by the game calculation section 110 with reference to FIG. 21.

  Flow of reception processing of the eye input, for example, during the execution of the heights fear experience game (8, 9), before execution, or after the execution, requires the game system 1 accepts an instruction from the player P 1 or more It is performed appropriately if occurs. The flow of the eye input accepting process is executed for each object (the object that can be specified by the player P) subjected to the eye input accepting process. Here, mention selection screen (FIG. 10) as an example.

  For example, when the mode of the game processing has been set to the “single player mode” or the “two player mode”, each of the push button objects OB1 and OB2 on the select screen (FIG. 10) is subjected to the reception processing. , And each of the push button objects OB3 and OB4 is subjected to an eye input accepting process.

  When the mode of the game process has been set to the “beginner mode” or the “advanced mode”, the push button objects OB3 and OB4 on the select screen (FIG. 10) are excluded from the receiving process. each button object OB1, OB2 are subject to reception processing in the eye input.

  Hereinafter, the flow of FIG. 21 will be described.

  First, the game calculation unit 110 starts displaying an object to be subjected to the receiving process (step S11). The display of the object is performed by arranging the object in the virtual three-dimensional space.

  Next, the game calculation section 110 executes visual judgment processing object (step S13), and if the object is visible (step S13Y), starts charging of the visual time of the object (step S15) Otherwise (step S13N), the visual determination (step S13) is repeated. The “charging of the viewing time” is a measurement of the viewing time, in which the charge amount is increased according to the time during which the object is viewed, and the charging of the object is determined according to the time during which the object is out of sight. is the process of reducing the amount. The game calculation section 110 starts the charging (S15), and executes the visual judgment, and a process of increasing or decreasing the charge amount in accordance with the result of the visual judgment, during the period until the charge amount is reset, For example, periodically repeated. Period of repetition is, for example, set to the same period as the frame period.

Next, the game calculation unit 110 sets the charge amount to the first threshold value Th1 (Step S19N) unless the charge amount does not exceed the first threshold value Th1 (= 2) (Step S17N). = 2) to reach the process of determining whether or not (step S17), the determination process whether or off the line of sight from the object (step S19), and repeats.

  The game calculation section 110, the prior charge amount exceeds the first threshold value Th1 (= 2) (step S17N), if the line of sight is out of the object (step S19Y), the resets the charge amount of the object to zero back from it to (step S20), visual determination process (step S13).

  Further, when the charge amount exceeds the first threshold value Th1 (= 2) (Step S17Y), the game calculation unit 110 receives an object lock (Step S21). Thus, the object is locked.

  When an object is locked (step S21), and the game calculation section 110, until the charge amount has not reached the second threshold value Th2 (= 5) (step S23N), the charge amount of the third threshold value Th3 (= zero) As long as the charge amount does not decrease (step S25N), the process of determining whether the charge amount has reached the second threshold value Th2 (= 5) (step S23) and whether the charge amount has decreased to the third threshold value Th3 (= zero) Is repeated (step S25).

  Thereafter, when the charge amount has decreased to the third threshold value Th3 (= zero) (Step S25Y), the game calculation unit 110 accepts the release of the lock of the object (Step S29), and performs an initial visual determination process (Step S29). Return to S13).

  Also, if the charge amount reaches the second threshold value Th2 (= 5) (step S23Y), the game calculation section 110 receives the determination of the lock (step S27), after resetting the charge amount to zero ( Step S30), end the flow. Thereby, the lock of the object is determined.

  Although not been shown in the above flow, the game calculation section 110, when the charge amount of the object exceeds the first threshold value Th1 (step S17Y), the object until the charge amount of the object reaches the second threshold value Th2 If the line of sight is out (step S19Y), when the charge amount of the object has reached the second threshold value Th2 (step S23Y), when the charge amount of the object is lowered to the third threshold value Th3 (step S25Y), the object Of the visual effect (the visual effect of the object itself) is changed (see FIG. 14 and the like).

2-15. Next, a flow of a process related to the combo process will be described with reference to FIG.

  The flow of the process related to the combo process is executed in parallel with the flow of the eye input receiving process (FIG. 21). Flow of processing according to the combo treatment, rather than being executed for each object, the player P is carried out for the entire plurality can be specified in the object.

  First, unless two or more objects are locked (step S31N), the game calculation unit 110 repeats the determination process (step S31) as to whether two or more objects are locked.

  Thereafter, when two or more objects are locked (Step S31Y), the game calculation section 110 proceeds to the next processing (Step S33).

  Next, the game calculation section 110, of the two or more objects in the lock determination process (step whether initially locked object is re-visual (i.e., whether the combo transition condition is satisfied) S33) is executed, and if the combo activation condition is not satisfied (step S33N), the process returns to the lock determination process (step S31). If the combo activation condition is satisfied (step S33Y), the combo process (step S35). To S43).

  In the combo process (steps S35 to S43), first, the game calculation unit 110 executes an integration process (step S35) for integrating the charge amounts of two or more locked objects. Thus, the charge amount of the two or more objects are integrated in the integrated charge amount.

  Next, the game calculation section 110, even before the integrated charge amount is returned to zero (step S37N), (2 or any one re visual objects in the lock) starting condition of partial release processing is not satisfied unless (step S41N), repeats the determination process whether integrated charge amount becomes zero (step S37), the determination process of the start condition (step S41).

  Thereafter, when the start condition is satisfied (Step S41Y), the game calculation section 110 executes a partial release process (Step S43) for separating the charge amount of the re-viewed object from the integrated charge amount. According to the partial release process (step S43), the lock of the revisited object is released, and the charge amount of the revisited object is set to zero.

  Further, when the integrated charge amount becomes zero (step S37Y), the game calculation section 110 executes separation processing for separating the charge of all the objects in the lock (step S39). The separation process (step S39) is a process of setting the charge amounts of all locked objects to individual charge amounts and setting the individual charge amounts to zero. After executing the separation processing (step S39), the game calculation section 110 ends the flow.

  Incidentally, the visual although not shown in the above flow, the game calculation section 110, when the combo process is activated (step S53), in a case where partial release processing is performed (step S43), applied to an object A process for changing the mode of the effect is executed (see FIGS. 15 and 17).

2-16. Flow of Lock Strength Control Processing Next, a flow of lock strength control processing will be described with reference to FIG.

  The flow of the lock strength control process is executed in parallel with the flow of the eye input accepting process (FIG. 21). Further, the flow of the lock strength control process is repeatedly executed for each object subjected to the eye input accepting process.

  First, the game calculation section 110 determines whether or not the object is locked (Step S51).

  Then, when the object is not locked (step S51N), the game calculation unit 110 sets the size of the hit area to “standard” (step S53), and sets the reduction rate of the charge amount when the line of sight is lost. "High" is set (step S55), and the flow ends. However, the decreasing speed of the charge amount is slower than the increasing speed of the charge amount.

On the other hand, if the object is locked (step S51Y), the game calculation section 11
If it is 0, it is determined whether or not the charge amount of the object is “3” or more (step S57).

  When the charge amount is not equal to or more than “3” (step S57N), the game calculation unit 110 sets the size of the hit area to “medium” (step S59), and decreases the charge amount when the line of sight is lost. The speed is set to “medium”, which is slower than “high” (step S61), and the flow ends.

  On the other hand, when the charge amount is equal to or more than “3” (step S57Y), the game calculation unit 110 sets the size of the hit area to “large” (step S65), and calculates the charge amount when the line of sight is lost. The decreasing speed is set to a slower speed “low” than “medium” (step S67), and the flow ends.

  Although not shown in the above flow, the game calculation unit 110 sets the enlargement ratio of the size of the player P in the left-right direction larger than the enlargement ratio of the size of the player P in the vertical direction (see FIG. 20). . In the above flow, the order of the steps can be changed within a possible range.

2-17. Application Example of Eye Input For example, in the high-fear experience game of the present embodiment, a mode in which the task is to capture (rescue) the cat effect object 80, and capture (rescue) the cat effect object 80 There is a mode in which the task is not performed.

  In this case, the game calculation section 110, hit in the start of the game, for example, a character image that as shown in FIG. 24 "Do you want to capture the cat?", And the cat object, and a push-button object OB5, OB6, a virtual three-dimensional It is located in spaces OBS.

  Among them, the push button object OB5 is a push button object for the player P to input the intention of “YES” to the simulation control device 100, and the push button object OB6 is the player P for the simulation control of the intention of “NO”. A push button object for input to the device 100.

  For example, when the player P locks the push button object OB6 corresponding to “NO” by eye input as shown in FIG. 25 and fixes the push button object OB6, for example, the game calculation unit 110 executes an animation in which the cat object is retreated from the virtual movement path. It is displayed in the virtual three-dimensional space OBS via the object space setting unit 111. In addition, the game operation unit 110 causes the effect object for cat 80 to retreat from the end point of the actual moving route R via the effect control processing unit 114.

  Further, for example, when the player P locks the push button object OB5 corresponding to “YES” by eye input and confirms the game, the game operation unit 110 generates, for example, an animation in which the cat object escapes toward the end point of the virtual movement path. Is displayed in the virtual three-dimensional space OBS via the object space setting unit 111. The game calculation section 110, through the effect control process unit 114, placing the effect for the object 80 cats to the actual end point of the movement path R.

  In the above embodiment, the object that can be specified by the player P by the eye input is the push button object (icon), but the character (enemy character, ally character, animal character, own avatar), the item (treasure box, Card), or a part of a character or an item.

2-18. Operation and effect of the embodiment No. 1
Or as described, the simulation control unit 100 of the present embodiment, charged display processing unit 110A for displaying a virtual three-dimensional space to HMD 20, a visual time of the player P with respect to the object placed in the virtual three-dimensional space, objects If the line of sight of the player P is out of the accepts a measurement unit 110B to reduce the charge amount according to the time line of sight is out, an indication of the lock of the object if the charge amount reaches the first threshold value Th1 When the charge amount has reached the second threshold value Th2 which is larger than the first threshold value Th1, an instruction to fix the object is accepted, and when the charge amount has decreased to the third threshold value Th3 before the fixation, the object is unlocked. And a notifying unit that notifies the player P of the magnitude of the amount of charge. Comprising 10D and, the execution unit 110E for executing a predetermined processing corresponding to the object if the lock object has been determined.

  Therefore, the player P can lock the object by viewing the object until the charge amount of the object reaches the first threshold Th1. On the other hand, when the player P looks at the object within a range not exceeding the first threshold value Th1 (at a glance), the unlocked state of the object can be maintained.

  Further, when the object is locked, the lock is maintained until the charge amount decreases to the third threshold value Th3 even if the player P loses the line of sight of the object. You are not forced to fix your gaze. Further, on the contrary, the player P to the charge amount is decreased to a third threshold value Th3 is by removing the line of sight from the object, it is also possible to unlock the object.

  Further, after the lock of the object, the charge amount is only player P to reach the second threshold value Th2 is visually an object, it is possible to input an instruction of confirmation to the simulation controller 100. On the other hand, after the object is locked, if the player P visually or removes the line of sight of the object so that the charge amount falls between the second threshold value Th2 and the third threshold value Th3, the locked state is continued. Can also.

  Therefore, the player P can freely control the state of the object among three states of “locked”, “unlocked (unlocked)”, and “fixed” by the eye input. “Eye input” means that the player P inputs his / her own instruction to the simulation control device 100 by an action of viewing the object.

  In addition, since the game calculation unit 110 as the notification unit 110D notifies the player P of the charge amount, the player P specifies the object that he or she is looking at, and determines whether or not he or she is looking at the object. it is possible or to distinguish. Further, the player P grasps the remaining time until the object is locked, the remaining time until the lock is released, and the visual time required until the lock is determined based on the notified charge amount. It is also possible.

  Therefore, according to the simulation control device 100 of the present embodiment, the player P can perform the eye input comfortably.

2-19. Operation and effect 2 of embodiment
In addition, when the combo activation condition is satisfied when two or more objects are selected at the same time, the game calculation unit 110 as the receiving unit 110C determines at least the reception of the confirmation and the cancellation of the two or more objects being selected. Is performed based on the common charge amount for all of the objects.

  When combo process is activated, the player P is, it is possible to perform input for two or more objects in the lock in common eye input, than when performing the eye input of two or more objects individually, eye input It is possible to reduce labor (in the present embodiment, the number of times the player P mainly shakes his / her head).

2-20. Operation and effect 3 of embodiment
In addition, the game calculation unit 110 as the measurement unit 110B of the present embodiment determines a determination criterion for determining that the locked object is being viewed by the player P by checking the unlocked object by the player P. Set looser than the criteria for determining that

  Thus, the player P is not able to lock intentionally objects unless visual objects in unlocked, it is easy to maintain the lock without visually strong awareness if the object being locked .

  For example, if the regulatory criteria was performed by the spatial modulating (above), the like when the player P is wondering whether to lock a certain object, the object to be visually located near the center of the object It can not be locked. Conversely, after the object is locked, the lock on the object is maintained unless the user moves his / her gaze to a position away from the center of the object.

  For example, when carried out by adjusting the temporal regulation of criteria (described above), the like when the player P is wondering whether to lock a certain object, if visually over the object to a predetermined time or more objects Can not lock. On the contrary, after the object is locked, the lock of the object is maintained as long as the user does not look away from the object for a long time.

  Therefore, according to the simulation control unit 100 of the present embodiment, it is possible to reduce the eye mistyped after lock (such as the release of the lock by unintended swinging of the player P).

3. Modification 3-1. In the game system of the above embodiment for the motion sensor, but using the imaging camera 70 for detecting the position and orientation of the head of the player P, it may be used motion sensor mounted in the HMD 20, the imaging camera A combination of 70 and a motion sensor may be used. As the motion sensor, an acceleration sensor, an angular velocity sensor (gyro sensor), or the like can be used. The motion sensor is suitable for detecting the movement of a moving object (here, the head of the player P) accompanying a change in posture with high accuracy.

3-2. About Line-of-Sight Detection In the above embodiment, the game calculation unit 110 converts the movement (position and posture) of the display area DS and the viewing area LSA in the virtual three-dimensional space OBS into the movement (position and posture) of the head of the player P. Although the movement is followed, the movement (position and posture) of the eyeball of the player P may be followed.

  Alternatively, both of the above embodiment, the game calculation section 110, the movement of the display area DS and viewing area LSA in the virtual three-dimensional space OBS (position and orientation), and the movement of the movement and the eyeball of the head of the player P May be followed.

  In this case, for example, the game calculation unit 110 causes the movement of the display area DS in the virtual three-dimensional space OBS to follow the movement of the head of the player P, and the movement of the viewing area LSA in the display area DS to the player P. May follow the movement of the eyeball.

  In order to detect the movement of the eyeball of the player P, for example, equipped with a sight line sensor detecting a sight line direction of the player P to HMD 20, the output of the line-of-sight sensor, via the communication unit 196 and the communication control unit 120 The processing unit 101 (the game calculation unit 110) may receive the information.

  Further, as the line-of-sight sensor, at least one of the following line-of-sight sensors (1) and (2) can be employed.

  (1) line-of-sight sensor comprising a camera for imaging at least one eye, and a processing unit for the camera to detect the position of the pupil of the player P based on the captured image (information indicating the direction of the visual axis), the player P.

  (2) a light projecting portion for projecting detection light, such as at least one infrared ocular player P, a detector for detecting the reflected light amount of the detection light at the retina of the eye, the eye on the basis of the output of the detecting unit A gaze sensor including: a processing unit configured to detect a direction of a visual axis.

  In the case of using a line-of-sight sensor, it is desirable to perform a line-of-sight sensor calibration for each player P. The calibration of the line-of-sight sensor is a process for correctly detecting the line-of-sight direction of the player P regardless of variations in the position of the eyeball, variations in the size of the pupils, and variations in the mounting posture of the HMD 20 for each player P. for example, to visually several known direction with respect to the player P who wears the HMD 20, based on the output of the line of sight sensor at that time, a process of adjusting the parameters of the processing unit.

3-3. Regarding the virtual mechanical switch In the above embodiment, there have been described several examples in which the game calculation unit 110 changes the degree of emphasis of an object in order to notify the player P of the charge amount (see FIGS. 14 and 19). Other methods can be used to change the degree of emphasis. For example, there is a method of changing the appearance of the object.

  For example, the game calculation section 110 employs a virtual pushbutton (virtual mechanical switch) player P as the specifiable object may change the depression amount of the virtual mechanical switch according to the charge amount. In this case, the game calculation unit 110 can give the player P a feeling of pressing down the virtual mechanical switch by injecting the line of sight by increasing the amount of pressing down the virtual mechanical switch as the charge amount increases. This virtual mechanical switch is a virtual mechanical switch that is locked by a long press (here, long viewing) and is fixed by a further long press (here, long viewing).

3-4. In the above embodiment will phrase "selection", the game calculation section 110 receives the start of the measurement at the timing when visually certain object is started (charging), "selected at the timing when the charge amount exceeds the first threshold value Th1 (Lock) ”, and accepts“ determination of selection (lock) ”at the timing when the charge amount reaches the second threshold value Th1, and“ releases selection (lock) ”at the timing when the charge amount decreases to the third threshold value Th3. Was accepted. However, the name of the instruction received by the game calculation unit 110 at each timing is for convenience only, and can be replaced with another name.

For example, in the above embodiment, it is also possible to read as follows. That is, the game calculation section 110, at the timing when visually certain object is started accepting the "Select" accepts "Maintaining selected (locked)" at a timing when the charge amount exceeds the first threshold value Th1, the amount of charge May be accepted at the timing when the charge reaches the second threshold Th1, and "release of selection" or "release of maintenance (lock)" may be accepted at the timing when the charge amount decreases to the third threshold Th3.

3-5. Functional elements function in the game system 1 of the present embodiment will sharing may be deformed appropriately within a range that the effect is not impaired.

  For example, some features of the HMD 20 as described above, may be mounted on the side of the simulation control unit 100, a part of or all of the functions of the simulation control unit 100 may be mounted on the side of the HMD 20. Further, the function allocation of each element included in the processing unit 101 of the simulation control device 100 can be appropriately changed.

  For example, part or all of the processing of the display processing unit 110A may be executed by the object space setting unit 111, or part or all of the processing of the object space setting unit 111 may be executed by the display processing unit 110A. it may be.

  In addition, part or all of the processing of the measurement unit 110B may be executed by the state detection processing unit 112, or part or all of the processing of the state detection processing unit 112 may be executed by the measurement unit 110B. .

  Further, the simulation control device 100 may be provided with a dedicated circuit (hardware) for realizing a part or all of the functions of the processing unit 101. In other words, part of the processing in the processing section 101 or the whole may be performed by software, it may be executed by hardware.

3-6. Regarding the Game Machine In the above embodiment, the game system 1 (the simulation control device 100 of the game system 1) including the structure in which the real space in which the player P can move (hereinafter, simply referred to as “real space”) is formed. Although the example in which the eye input by the HMD 20 is applied has been described, the eye input by the HMD 20 can be applied to other game systems.

  For example, the system game is provided to the terminal device from the server apparatus via a network such as the Internet, it may be applied eye input by HMD 20. In that case, the execution of the game program in the system, may be performed on the side of the terminal device, it may be performed on the side of the server device. Further, in that case, the terminal device may realize the game by executing an operation input and image display by streaming.

  Further, also, eye input by HMD20 is, it is also possible to apply to a stand-alone type game apparatus which is not connected to the network is not limited to a game device, a smart phone, a tablet information terminal device, a personal computer, monitor or TV It is also possible to apply the present invention to a terminal device capable of executing an operation input using a touch panel such as a touch panel.

3-7. In the above embodiment the eye input device, but the HMD20 of nontransmitting used in eye input, transmission type HMD, such as monocular HMD, may be used for other kinds of mounted image display apparatus eye input. As for the mounting method of the HMD to the player P, hat-shaped, eye-glass type, helmet type, sun visor type, hair-band, etc., it is possible to adopt a variety of mounting method.

4. Others The present invention is not limited to those described in the above embodiments, and various modifications can be made. For example, a term cited as a broad or synonymous term in the description in the specification or the drawings can be replaced with a broad or synonymous term in other descriptions in the specification or the drawings.

The present invention includes substantially the same configuration as the configuration described in the embodiment (for example, a configuration having the same function, method, and result, or a configuration having the same object and effect). The invention also includes configurations that replace non-essential parts of the configurations described in the embodiments. Further, the invention includes a configuration having the same operation and effect as the configuration described in the embodiment or a configuration capable of achieving the same object. Further, the invention includes configurations in which known techniques are added to the configurations described in the embodiments.

  As described above, it has been described in detail embodiments of the present invention, that many modifications are possible in the embodiments without materially departing from the novel teachings and advantages of the present invention will be readily apparent to those skilled in the art . Therefore, such modifications are all included in the scope of the present invention.

1 ... game system 10 ... structure 20 ... HMD
30 ... hanging unit 40 ... fall prevention unit 50 ... hanging control unit 60 ... marker unit 70 ... imaging camera 80 ... effect object 90 ... effecting device (blower, spring plate panel and movement guidance path)
100 ... Simulation control device

Claims (9)

A display processing unit for displaying the virtual space to mount type image display device,
A measuring unit for measuring a visual time of the user for the arranged in the virtual space object,
A receiving unit that receives selection of the object when the measurement value obtained by the measurement reaches a first threshold, and receives confirmation of the selection when the measurement value reaches a second threshold larger than the first threshold;
A notification unit for notifying the order of magnitude of the measurement value to said user,
With
The measurement unit is
When the user's line of sight has deviated from the object, the measurement value is reduced according to the time during which the line of sight has deviated,
The receiving unit is,
If the measured value drops to a third threshold before the confirmation, the release of the selection is accepted,
The notification unit,
Visually notify the change in the measurement value,
A simulation control device characterized by the above-mentioned. In the simulation apparatus according to claim 1,
The notification unit,
Imparting a visual effect corresponding to the measured value to the object,
A simulation control device characterized by the above-mentioned. In the simulation apparatus according to claim 2,
The notifying unit,
Distinguishing between the selected object and the non-selected object,
Simulation control unit, characterized in that. The simulation control device according to claim 2 or 3 ,
The visual effect is an animation;
A simulation control device characterized by the above-mentioned. The simulation control device according to claim 4 ,
The animation is
Place the annular or part annular gauge outer edge of the object, and an animation to vary the length of the gauge according to the measured value,
A simulation control device characterized by the above-mentioned. The simulation control device according to claim 5 ,
The animation,
Place a mark row to an outer edge portion of the object, and an animation of changing the sequence number of the mark array in response to the measured value,
A simulation control device characterized by the above-mentioned. In the simulation apparatus according to claim 4,
The animation is
An animation that changes the degree of emphasis of the object according to the measurement value.
A simulation control device characterized by the above-mentioned. In the simulation control device according to any one of claims 1 to 7,
Further comprising an execution unit for executing a predetermined processing corresponding to the object when the selection of the object is determined,
Simulation control unit, characterized in that. A display processing unit that displays a virtual space on the wearable image display device;
A measurement unit that measures the user's viewing time for the object placed in the virtual space,
A receiving unit that receives the selection of the object when the measurement value obtained by the measurement reaches a first threshold, and that receives the determination of the selection when the measurement value reaches a second threshold larger than the first threshold;
A notification unit that notifies the user of the magnitude of the measurement value by the measurement,
And let the computer function,
The measurement unit is
When the user's line of sight has deviated from the object, the measurement value is reduced according to the time during which the line of sight has deviated,
The receiving unit is,
If the measured value drops to a third threshold before the confirmation, the release of the selection is accepted,
The notification unit,
Simulation control program characterized that you visually notify a change in the measured value.

Images