JP2014166564A - Game device, control method of the same, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily give an instruction to a game character other than an operation object while a player operates the operation object.SOLUTION: A game device (10) acquires gazing position information on a position in a game screen (92) at which a player gazes. First determination means (108), on the basis of the gazing position information and a position of a game character, determines whether or not the player is conscious of the game character. Second determination means (110), on the basis of the game character's position, visual line, and a virtual viewpoint (90) or a position of an operation object of the player, determines whether or not the game character is conscious of the virtual viewpoint (90) or the operation object of the player. Operation control means (112), on the basis of the determination results of the first determination means (108) and the second determination means (110), allows the game character to perform a predetermined operation or an operation according to the gazing position information.

Description

  The present invention relates to a game device, a game device control method, and a program.

  Conventionally, a technique is known in which a player gives an instruction to a game character other than the operation target while operating the operation target. In Patent Literature 1, a player operates a second operation member (controller B button) while operating an operation target (for example, a first game character) using a first operation member (controller A button). A game device is described that uses and gives instructions to game characters other than the operation target (for example, a second game character).

JP 2005-103154 A

  However, for example, in the technique of Patent Document 1, in order to give an instruction to a game character other than the operation target while the player operates the operation target, the player operates the first operation member and the second operation member. Will be performed simultaneously. Since it is difficult for the player to perform a plurality of types of operations at the same time using a plurality of operation members, the technique of Patent Document 1 sometimes makes it difficult for the player to give instructions to game characters other than the operation target.

  The present invention has been made in view of the above problems, and an object of the present invention is to control a game apparatus and a game apparatus in which a player can easily give instructions to game characters other than the operation target while operating the operation target. It is to provide a method and a program.

  In order to solve the above-described problems, a game device according to the present invention is a game device that executes a game in which a game character moves in a game space, and that stores information related to the position and line of sight of the game character. On the basis of an image obtained from a display control means for displaying on the display means a game screen showing how the game space is viewed from a virtual viewpoint, and an image obtained from a photographing means for photographing the face of the player. First means for determining whether or not the player is aware of the game character based on means for acquiring gaze position information relating to the position in the game screen to be watched, and the gaze position information and the position of the game character. 1 determination means, the position and line of sight of the game character, the position of the virtual viewpoint or the operation target of the player , Based on the determination results of the second determination means for determining whether the game character is aware of the virtual viewpoint or the operation target of the player, and the determination results of the first determination means and the second determination means. And a motion control means for causing the game character to perform a motion according to the gaze position information or a predetermined motion.

  The game apparatus control method according to the present invention is a game apparatus control method for executing a game in which a game character moves in a game space, from the means for storing information on the position and line of sight of the game character. Based on a display control step for displaying on the display means a game screen showing the game space viewed from a virtual viewpoint, and an image obtained from the photographing means for photographing the player's face. Determining whether or not the player is aware of the game character based on the step of acquiring gaze position information relating to the position in the game screen to be watched, and the gaze position information and the position of the game character; 1 determination step, the position and line of sight of the game character, the virtual viewpoint or the player A second determination step for determining whether the game character is aware of the virtual viewpoint or the operation target of the player based on the position of the operation target; the first determination step; and the second determination step. And a motion control step of causing the game character to perform a motion according to the gaze position information or a predetermined motion based on the determination result.

  Further, a program according to the present invention is a program for causing a computer to function as a game device for executing a game in which a game character moves in a game space, from the means for storing information on the position and line of sight of the game character. Based on an image obtained from a means for obtaining information, a display control means for displaying on the display means a game screen showing the game space viewed from a virtual viewpoint, and an image obtained from a photographing means for photographing the face of the player, A first determination for determining whether or not the player is aware of the game character based on the means for acquiring gaze position information relating to the position in the game screen, and the gaze position information and the position of the game character Means, the position and line of sight of the game character, the virtual viewpoint or the play Second determination means for determining whether the game character is aware of the virtual viewpoint or the operation target of the player based on the position of the operation target of the first determination means, the first determination means, and the second determination means Based on the determination result, the computer is caused to function as a game device including a motion control means for causing the game character to perform a motion according to the gaze position information or a predetermined motion.

  An information storage medium according to the present invention is a computer-readable information storage medium recording the above program.

  According to the present invention, the player can easily give instructions to game characters other than the operation target while operating the operation target.

  In one aspect of the present invention, the motion control means determines that the player is conscious of the game character, and the game character is conscious of the virtual viewpoint or the operation target of the player. If it is determined, the game character is caused to perform the action or the predetermined action according to the gaze position information.

  In one aspect of the present invention, the motion control means determines that the player is conscious of the game character, and the game character is conscious of the virtual viewpoint or the operation target of the player. Means for determining whether or not the state determined to have continued for a reference period, and if the state has been determined to have continued for the reference period, the action corresponding to the gaze position information to the game character Alternatively, the predetermined operation is performed.

  In the aspect of the invention, at least a first game character and a second game character that are operation targets of the player are arranged in the game space, and the first determination unit includes the gaze position information. On the basis of the position of the second game character and whether or not the player is conscious of the second game character, and the second determination means includes the position and line of sight of the second game character, Based on the virtual viewpoint or the position of the first game character, it is determined whether or not the second game character is conscious of the virtual viewpoint or the first game character, and the motion control means includes: It is determined that the player is conscious of the second game character, and the second game character is the virtual viewpoint or the first game character. Means for determining whether or not the state determined to be conscious of the data has continued for the reference period, and when it is determined that the state has continued for the reference period, The game apparatus performs the action according to the gaze position information or the predetermined action, and the game device acquires the game parameter from a means for storing the game parameter in association with a combination of a plurality of game characters, and the reference period And a reference period determining means for determining the length of the first game character based on the game parameter associated with the combination of the first game character and the second game character.

  In the aspect of the invention, at least a first game character and a second game character that are operation targets of the player are arranged in the game space, and the first determination unit includes the gaze position information. On the basis of the position of the second game character and whether or not the player is conscious of the second game character, and the second determination means includes the position and line of sight of the second game character, Based on the virtual viewpoint or the position of the first game character, it is determined whether or not the second game character is conscious of the virtual viewpoint or the first game character, and the motion control means includes: Based on the determination results of the first determination means and the second determination means, the second game character is caused to perform the action according to the gaze position information or the predetermined The game apparatus is configured to obtain a game parameter from a means for storing a game parameter in association with a combination of a plurality of game characters, and to perform motion control of the second game character by the motion control means. Limiting means for limiting based on the game parameter associated with the combination of the first game character and the second game character is further included.

  In one aspect of the present invention, the restricting means associates the start of execution of motion control of the second game character by the motion control means with a combination of the first game character and the second game character. Standby means for waiting based on the game parameter.

  In one aspect of the present invention, the motion control means determines that the player is conscious of the game character, and the game character is conscious of the virtual viewpoint or the operation target of the player. The game character is operated based on the change in the gaze position information in the instruction period after the determination.

  Also, in one aspect of the present invention, a plurality of game characters are arranged in the game space, and the game device is a game in which the gaze position information acquired in the instruction period and the motion control unit perform motion control. Based on the position of the game character other than the character, it is determined whether or not there is a game character other than the game character that the motion control means controls in the position or area that the player is conscious of during the instruction period. And the action control by the action control means is inhibited when it is determined that there is a game character other than the game character that the action control means controls in the position or area that the player is aware of during the instruction period. And means for performing the processing.

  In one aspect of the present invention, the game device is configured to perform the instruction period based on the position and line of sight of the game character controlled by the movement control means and the gaze position information acquired in the instruction period. Means for determining whether or not the game character is aware of the position or area in the game space that the player is aware of, and the position in the game space that the player is aware of during the instruction period And a means for suppressing action control by the action control means when it is determined that the game character is not looking.

  In the aspect of the invention, at least a first game character and a second game character that are operation targets of the player are arranged in the game space, and the first determination unit includes the gaze position information. On the basis of the position of the second game character and whether or not the player is conscious of the second game character, and the second determination means includes the position and line of sight of the second game character, Based on the virtual viewpoint or the position of the first game character, it is determined whether or not the second game character is conscious of the virtual viewpoint or the first game character, and the motion control means includes: It is determined that the player is conscious of the second game character, and the second game character is the virtual viewpoint or the first game character. The second game character is operated based on a change in the gaze position information in the instruction period after it is determined that the game device is conscious of the game, and the game device is associated with a combination of a plurality of game characters. Means for obtaining the game parameter from the means for storing the parameter, and an instruction for determining the length of the instruction period based on the game parameter associated with the combination of the first game character and the second game character And a period determining means.

  In the aspect of the invention, the first determination unit includes a unit that acquires a position or region in the game space that the player is conscious of based on the gaze position information, and the player is conscious of the game space. It is determined whether or not the player is aware of the game character by determining whether or not the game character is present at the position or the area in the game space.

  In one aspect of the present invention, the first determination means includes means for acquiring a position or area in the game screen that the player is conscious of based on the gaze position information, and the player is conscious of the game screen. Determining whether or not the player is aware of the game character by determining whether or not the game character is displayed at the position or the area in the game screen. To do.

  In one aspect of the present invention, the second determination means has a predetermined positional relationship between a straight line extending in the line-of-sight direction from the position of the game character and the position of the virtual viewpoint or the operation target of the player. By determining whether or not the game character is aware of the virtual viewpoint or the operation target of the player.

It is a figure which shows a mode that a player plays a game. It is a perspective view showing a mode that it looked at the game device from the front front. It is a figure which shows the hardware constitutions of the game device which concerns on this Embodiment. It is a figure which shows the picked-up image image | photographed by the imaging part. It is a figure for demonstrating the calculation method of the center position of a pupil of a player in a real space coordinate system, and a gaze vector. It is a figure which shows an example of game space. It is a figure which shows an example of a game screen. It is a figure which shows a mode that a player makes eye contact. It is a figure showing signs that a player gives directions to a player character by movement of eyes. It is a functional block diagram which shows the function relevant to this invention among the functions implement | achieved with a game device. It is a figure showing an example of data storage of gaze position history data. It is a figure for demonstrating the determination method of a 1st determination part. It is a figure for demonstrating the determination method of a 2nd determination part. It is a figure which shows a mode that a player character moves based on the change of a gaze point. It is a flowchart which shows the process which a game device performs. It is a flowchart which shows the process which a game device performs. It is a figure which shows an example of a cooperation degree parameter. It is a figure which shows correlation with the conditions regarding a cooperation degree parameter, and a reference period. It is explanatory drawing for demonstrating the flow after this player character starts a motion after seeing the player character of a motion control object. It is a figure which shows correlation with a cooperation degree parameter and a standby | waiting period. It is a figure for demonstrating the determination method of an empty space. It is a figure which shows correlation with a cooperation degree parameter and an instruction | indication period. It is a figure which shows an example of the game screen in a modification (6).

[1. Embodiment]
Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. The game device according to the embodiment of the present invention is realized by, for example, a home game machine (stationary game machine), a portable game machine, a mobile phone (smart phone), a portable information terminal, a personal computer, or the like. Here, a case where the game device according to the embodiment is realized by a portable game machine will be described.

  FIG. 1 is a diagram illustrating how a player plays a game. As shown in FIG. 1, the player 1 plays a game while holding the game apparatus 10 with both hands. Although details will be described later, the game apparatus 10 includes a photographing unit, and the player 1 maintains the posture of the game apparatus 10 so that his / her face is included in the field of view (within the photographing range) of the photographing unit. While playing the game. Hereinafter, the reference numeral of the player 1 is omitted.

[2. Appearance of game device]
FIG. 2 is a perspective view showing the game apparatus 10 as viewed from the front front. As shown in FIG. 2, the game apparatus 10 includes a first housing 20 and a second housing 30. The first housing 20 and the second housing 30 are coupled via the hinge portion 14.

  On the surface 20a of the first housing 20, a touch screen 22, a cross button 24c, a slide pad 24d, buttons 24a, 24b, 24x, 24y, 24e, 24f, 24g, and a power button 24h are provided. The touch screen 22 includes a first liquid crystal display unit 22a and a touch panel 22b (see FIG. 3). The touch panel 22b is overlaid on the first liquid crystal display unit 22a.

  The player uses the touch pen 16 or the like to touch a predetermined position on the touch screen 22 (that is, the touch panel 22b). The player plays the game by touching the touch screen 22 with the touch pen 16 or by sliding (dragging) the touch pen 16 to another position while touching the touch screen 22.

  The cross button 24c and the slide pad 24d are used for a direction instruction operation, for example. Similar to the operation using the touch pen 16, the cross button 24c, the slide pad 24d, and the buttons 24a, 24b, 24x, 24y, 24e, 24f, and 24g are used for various operations. The power button 24h is used to instruct each part of the game apparatus 10 to supply power from a battery (not shown).

  A second liquid crystal display unit 32 is provided on the surface 30 a of the second housing 30. The second liquid crystal display unit 32 may have, for example, an autostereoscopic function. The second housing 30 includes a speaker 34 and an in-camera 36. As shown in FIG. 2, the in-camera 36 is arranged so that the line-of-sight direction of the in-camera 36 is the perpendicular direction of the second liquid crystal display unit 32.

[3. Hardware configuration of game device]
FIG. 3 is a diagram showing a hardware configuration of game device 10 according to the present embodiment. As shown in FIG. 3, the game apparatus 10 includes a touch screen 22 (first liquid crystal display unit 22a and touch panel 22b), operation key unit 24, memory card slot 26, second liquid crystal display unit 32, speaker 34, bus 42, A control unit 44, a storage unit 46, a main memory 48, an image processing unit 50, an input / output processing unit 52, an audio processing unit 54, and a communication interface 56 are included.

  The control unit 44 controls each unit of the game apparatus 10 based on the operating system stored in the storage unit 46, the program stored in the game memory card 40, and various data. The control unit 44 includes a real time clock and functions as a time measuring means.

  The storage unit 46 includes a nonvolatile storage medium such as a flash memory. The storage unit 46 stores an operating system and the like.

  The main memory 48 includes, for example, a RAM. The program read from the game memory card 40 via the memory card slot 26 is written into the main memory 48 as necessary. The main memory 48 is also used as a working memory for the control unit 44.

  The bus 42 is used for exchanging addresses and various data between the respective units of the game apparatus 10. The control unit 44, the main memory 48, the image processing unit 50, and the input / output processing unit 52 are connected by a bus 42 so that mutual data communication is possible.

  The touch screen 22 and the second liquid crystal display unit 32 are configured to include a liquid crystal display panel and the like. In the present embodiment, a case where the display screen of the game apparatus 10 includes the touch screen 22 and the second liquid crystal display unit 32 will be described.

  The image processing unit 50 includes a VRAM. The image processing unit 50 draws an image on the VRAM according to an instruction from the control unit 44. The image drawn on the VRAM is displayed on the first liquid crystal display unit 22a and the second liquid crystal display unit 32 at a predetermined timing.

  In the input / output processing unit 52, the control unit 44 exchanges various data with the touch panel 22b, the operation key unit 24, the memory card slot 26, the audio processing unit 54, the communication interface 56, the sensor unit 58, and the imaging unit 60. Interface. The input / output processing unit 52 is connected to the touch panel 22b, the operation key unit 24, the memory card slot 26, the sound processing unit 54, the communication interface 56, the sensor unit 58, and the imaging unit 60.

  The operation key unit 24 functions as input means for the player to perform an operation. The operation key unit 24 includes a cross button 24c, a slide pad 24d, buttons 24a, 24b, 24x, 24y, 24e, 24f, 24g, and a power button 24h. The input / output processing unit 52 scans the state of each part of the operation key unit 24 at regular intervals (for example, every 1/60 seconds). An operation signal representing the scan result is supplied to the control unit 44 via the bus 42.

  Similar to the operation key unit 24, the touch panel 22b functions as an input unit for the player to perform various operations. The touch panel 22 b supplies instruction position information corresponding to the instruction position on the first liquid crystal display unit 22 a pointed to by the player or an object (touch pen 16) held by the player to the control unit 44 via the input / output processing unit 52.

  The memory card slot 26 reads the game program and game data stored in the game memory card 40 in accordance with instructions from the control unit 44. The game memory card 40 includes, for example, a ROM that stores game data such as game programs and image data, and an EEPROM that stores game data such as save data.

  In the present embodiment, an example in which the game memory card 40 is used to supply the game program and game data to the game apparatus 10 will be described. However, other information storage media such as an optical disk may be used. Also good. In addition, a game program or game data may be supplied to the game apparatus 10 from a remote place via a communication network such as the Internet. Or you may make it a game program and game data be supplied to the game device 10 using various data communications, such as infrared communication.

  The audio processing unit 54 includes a sound buffer. The sound processing unit 54 outputs music and sound from the speaker 34 based on music output data and sound data stored in the sound buffer. The communication interface 56 is an interface for connecting the game apparatus 10 to a communication network.

  The sensor unit 58 includes a gyro sensor, a motion sensor, and the like, and detects the attitude of the game apparatus 10.

  The imaging unit 60 includes an in camera 36, an out camera (not shown), and the like, and generates a captured image. The imaging unit 60 images the player's face. The control unit 44 identifies the player's line of sight and gazing point based on the captured image obtained by capturing the player's face. Here, using the autofocus function of the in-camera 36, a captured image is generated in a state where the position of the player's face is in focus.

  FIG. 4 is a diagram illustrating a captured image captured by the imaging unit 60. As shown in FIG. 4, the captured image 62 includes the player's face. Here, the gazing point of the player is detected using a corneal reflection method that measures the eye movement based on the position of the corneal reflection image (Purkinje image) that appears brightly when the illumination of the player's cornea (black eyes) is illuminated. This method will be described as an example.

  Note that the method of detecting the gazing point of the player is not limited to the corneal reflection method, and the gazing point of the player may be detected by various known methods. In addition, for example, a scleral reflection method (Limbus tracking method) that measures eye movement using a difference in reflectance between the cornea (black eye) and the sclera (white eye) may be used.

  In the present embodiment, first, an eye image 64 indicating the player's eyes photographed in the photographed image 62 is specified. For example, the eye image 64 is specified by preparing a comparison image (teacher image) indicating the eyes and performing pattern matching between the comparison image and the captured image 62. In addition, the eye image 64 may be specified by extracting the outline of the eye based on the difference between the pixel values of the player's white eye and eyelid.

  Next, from the eye image 64a, the reflection image 64a of the light source on the corneal surface of the eye (the center point of the light source reflection image) and the pupil 64b (the center point of the pupil) are specified. The reflected image 64a and the pupil 64b may also be specified based on a pattern matching process with the comparison image or a difference in pixel values with surrounding pixels. Then, based on the positional relationship between the reflected image 64a and the pupil 64b, the center position and the line-of-sight direction of the player's pupil 64b in the three-dimensional space coordinate system (hereinafter referred to as the real space coordinate system) defined in the real space are specified. Is done.

  FIG. 5 is a diagram for explaining a method of calculating the center position of the pupil of the player and the line-of-sight vector in the real space coordinate system. As shown in FIG. 5, the real space coordinate system is a coordinate system in which a reference position in the real space is set as an origin, and three directions orthogonal to each other are set to three axes. Here, the real space coordinate system is set so that the position of the in camera 36 is the origin O, the horizontal direction is the X axis, the vertical direction is the Y axis, and the line of sight of the in camera 36 is the Z axis.

  As shown in FIG. 5, a point separated from the origin O in the Z-axis direction by the focal length of the in-camera 36 is defined as a focal position P. The focal length is determined based on the focus set in the in-camera 36 when the captured image 62 is captured. For example, an object near the focal position P (in the captured image 62 of FIG. 4, near the center of the player's face) appears near the center of the captured image 62.

  Here, a position Q that is separated from the focal position P by a vector from the center point of the captured image 62 toward the position of the reflected image 64a is set as the position of the reflected image 64a in the real space coordinate system. Similarly, a position R that is separated from the focal position P by a vector from the center point of the captured image 62 toward the position of the pupil 64b is set as the center position of the pupil in the real space coordinate system.

  Then, in a direction connecting the origin O and the position Q of the reflected image 64a, only a predetermined distance Δd from the position Q (Δd is a predetermined distance according to a radius of a general human eyeball (for example, 12 mm)). The distant position is set as the center point S of the player's eyeball. The direction from the center point S toward the position R, which is the center point of the pupil, is the line-of-sight direction V of the player.

  Also, coordinate information indicating the position of the screen area of the second liquid crystal display unit 32 in the real space coordinate system is stored in advance, and a straight line (i.e., a player) from the calculated pupil center position R toward the visual line direction V is stored. ) And the position where the screen area intersects is detected as the gazing point T of the player. Here, the gazing point T of the player is a screen coordinate system (a coordinate system in which the upper left end point of the second liquid crystal display unit 32 is the origin Os, the longitudinal direction of the screen is the Xs axis, and the short direction of the screen is the Ys axis). Generated as two-dimensional coordinates.

[4. Game executed on game device]
The game apparatus 10 executes a game in which a game character moves in the game space by executing a game program read from the game memory card 40. In the present embodiment, a soccer game in which a plurality of player characters move is executed in a game space simulating a soccer game venue that is played using a ball.

  In this soccer game, a first team operated by a player (hereinafter referred to as “player team”) and a second team operated by an opponent (computer or other player) (hereinafter referred to as “opponent team”). ) And a soccer game will be held. When the soccer game is started, for example, a game space is constructed in the main memory 48.

  FIG. 6 is a diagram illustrating an example of the game space. A game space 70 shown in FIG. 6 is a virtual three-dimensional space in which three coordinate axes (Xw axis, Yw axis, and Zw axis) orthogonal to each other are set. As shown in FIG. 6, a field 72 that is an object representing a soccer field is arranged in the game space 70.

  On the field 72, two goal lines 74a and 74b, two touch lines 76a and 76b, and a center line 78 are represented. The pitch 80 surrounded by the two goal lines 74a and 54b and the two touch lines 76a and 76b and the periphery of the pitch 80 (a predetermined area outside the pitch 80 in contact with the goal lines 74a and 74b or the touch lines 76a and 76b). In the match.

  On the field 72, there are goals 82 a and 82 b that are objects representing soccer goals, player characters 84 that are objects representing soccer players belonging to the player team, and objects that represent soccer players belonging to the opponent team. A player character 86 and a ball 88 which is an object representing a soccer ball (moving object) are arranged. The position of each object is specified by, for example, three-dimensional coordinates in the world coordinate system (Xw-Yw-Zw coordinate system).

  Although omitted in FIG. 6, eleven player characters 84 belonging to the player team and eleven player characters 86 belonging to the opponent team are arranged on the field 72.

  When the player character 84 (86) and the ball 88 approach, the player character 84 (86) and the ball 88 are associated with each other under a predetermined condition. In this case, the movement action of the player character 84 (86) is a dribbling action. Hereinafter, the state in which the ball 88 is associated with the player character 84 (86) is described as “the player character 84 (86) holds the ball 88”.

  A given virtual camera 90 (viewpoint) is set in the game space 70. For example, the position of the virtual camera 90 is determined based on the position of the tracking target in the game space 70. The tracking target is an object to be included in the field of view of the virtual camera 90, for example, the ball 88. The position of the virtual camera 90 maintains a predetermined positional relationship with the tracking target. For example, the position of the virtual camera 90 is a position away from the tracking target position by a predetermined distance in a predetermined direction.

  The line-of-sight direction of the virtual camera 90 is determined based on the reference direction set in the game space 70 or the representative direction of the tracking target. The reference direction is a predetermined direction. For example, from one object in the game space 70 (for example, the goal 82a associated with the player team) to another object (for example, the goal associated with the opponent team). 82b). The representative direction of the tracking target is a direction associated with the tracking target, for example, a moving direction of the tracking target.

  Here, the position of the virtual camera 90 is a position away from the position of the ball 88 by a predetermined distance in a predetermined direction. Further, the direction from the goal 82 a toward the goal 82 b (the direction from the player team's position to the opponent team's position) is the line-of-sight direction of the virtual camera 90.

  On the second liquid crystal display unit 32, a game screen representing a state in which the game space 70 is viewed from the virtual camera 90 is displayed. The game screen is generated by converting the vertex coordinates of each object arranged in the game space 70 from the world coordinate system to the screen coordinate system using a predetermined coordinate conversion calculation.

  FIG. 7 is a diagram illustrating an example of the game screen. The game screen 92 shown in FIG. 7 includes four player characters 84a, 84b, 84c, 84d belonging to the player team, and a ball 88. In FIG. 7, for example, a player character 84a holding the ball 88 is set as an operation target of the player. A cursor 94 indicating that the player character 84a is set as an operation target of the player is displayed above the player character 84a. The player character 84a acts based on the player's game operation. For example, when the player performs a direction instruction operation from the operation key unit 24, the player character 84a dribbles in this direction.

  On the other hand, the player character 84 (86) that is not set as an operation target behaves based on the operation of the computer. The player character 84 (86) operated by the computer behaves autonomously according to a predetermined behavior algorithm. In the situation shown in FIG. 7, player characters 84b, 84c, 84d other than the player character 84a act based on the operation of the computer.

  In the game device 10 of the present embodiment, when the player character 84 in the direction of the player's line of sight is also looking at the player, the player character 84 moves in the direction in which the player's line of sight has moved. That is, when the player makes eye contact with the player character 84 displayed on the game screen 92, the player character 84 moves in the direction viewed after the player makes eye contact.

  FIG. 8 is a diagram illustrating how the player makes eye contact. As shown in FIG. 8, the player character 84 b is displayed from the position S of the player's eyes to the gazing point T on the game screen 92 that is on the player's line-of-sight direction V. This player character 84b is aware of the direction of the player (actually, the player character 84b is facing the virtual camera 90).

  That is, in the state shown in FIG. 8, the player and the player character 84b are in eye contact. For example, when the state in which the player and the player character 84b are staring continues for a reference period (for example, 1 second), a message 96 indicating that the eye contact is established is displayed on the game screen 92. If the message 96 is displayed at a position away from the player character 84b, the player's line of sight may move to this position. Therefore, as shown in FIG. 8, the message 96 is displayed in the player character 84b in which eye contact is established. Is displayed at a position within a predetermined distance from.

  By displaying the message 96, the player knows that the eye contact with the player character 84b has been established. Thereafter, the player can give an instruction to the player character 84b with a line of sight. For example, when the player moves his / her line of sight in a direction in which the player character 84b is desired to move, the player character 84b moves in this direction.

  FIG. 9 is a diagram illustrating a state in which the player gives an instruction to the player character 84b by eye movement. As shown in FIG. 9, when the player moves his / her line of sight to the left and the gazing point T moves to the left side of the game screen 92, the player character 84b having established eye contact moves to the left as viewed from the player. That is, the player character 84b starts moving in the direction of the arrow 98 connecting the player character 84b and the gazing point T.

  As described above, the game apparatus 10 is configured such that an instruction can be given to the player character 84 by the movement of the eyes of the player without using the operation key unit 24. Hereinafter, the present technology will be described in detail.

[5. Functions realized in game device]
FIG. 10 is a functional block diagram showing functions related to the present invention among the functions realized by the game apparatus 10. As shown in FIG. 10, the game apparatus 10 executes a game program to thereby execute a game data storage unit 100, a game execution unit 102, a display control unit 104, a gaze position information acquisition unit 106, a first determination unit 108, and a first determination unit 108. 2 determination unit 110 and operation control unit 112 are realized.

[5-1. Game data storage unit]
For example, the game data storage unit 100 is implemented mainly by the main memory 48, the game memory card 40, and the like. The game data storage unit 100 stores data necessary for realizing a soccer game, for example. For example, the game data storage unit 100 stores game situation data and gaze position history data indicating a history of gaze position information acquired by the gaze position information acquisition unit 106.

[Game status data]
The game situation data is data indicating the current situation of the game being executed. For example, the following information is included in the game situation data. The game situation data is updated every predetermined time according to the progress of the game.
(1) Information indicating the player character 84 set as the operation target of the player (2) Information indicating the current state (position, line-of-sight direction, posture, moving direction, and moving speed) of the player character 84 (86) ( 3) Information indicating the current state (position, moving direction, moving speed, etc.) of the ball 88 (4) Information indicating the player character 84 (86) holding the ball 88 (5) Current state of the virtual camera 90 Information indicating (position and line-of-sight direction, etc.) (6) Other information indicating current war situation (for example, scores and elapsed time of both teams)

  As described above, the game situation data includes information on the position and line of sight of the player character 84 (86). Here, as the information regarding the line of sight of the player character 84 (86), the line of sight of the player character 84 (86) is used. In addition, for example, information indicating the field of view of the player character 84 (86) itself and the representative direction (face orientation, body orientation) of the player character 84 (86) relate to the line of sight of the player character 84 (86). It may be used as information.

[Gaze position history data]
FIG. 11 is a diagram illustrating a data storage example of gaze position history data. As shown in FIG. 11, information indicating the two-dimensional coordinates of the gazing point in the screen coordinate system is stored in association with the acquisition time when the information is acquired. Each time the gaze position information acquisition unit 106 acquires gaze position information, a new record is stored in the gaze position history data.

[5-2. Game execution part]
For example, the game execution unit 102 is realized mainly by the control unit 44. The game execution unit 102 executes a game in which the player character 84 (86) moves in the game space 70. Here, a plurality of player characters 84 (86) are arranged in the game space 70, and any one of the plurality of player characters 84 (86) is set as an operation target of the player. In the game space 70, at least a first game character (for example, a player character 84a) and a second game character (for example, a player character 84b), which are operation targets of the player, are arranged.

  For example, the game execution unit 102 determines the player character 84 set as the operation target of the player, or determines the action of the player character 84 (86) operated by the computer. Further, the game execution unit 102 updates the game situation data as the game progresses. For example, the game execution unit 102 updates the game situation data based on the action of the player character 84 (86) operated by the computer and the action of the operation target of the player determined by the action control unit 112.

[5-3. Display control unit]
For example, the display control unit 104 is realized mainly by the second liquid crystal display unit 32 and the control unit 44. The display control unit 104 causes the display means (for example, the second liquid crystal display unit 32) to display a game screen 92 that shows the game space 70 viewed from a given virtual viewpoint (for example, the virtual camera 90). A game screen 92 is generated by performing a coordinate conversion process for converting from the world coordinate system to the screen coordinate system on the vertices of the objects included in the field of view determined based on the position and line-of-sight direction of the virtual camera 90. .

[5-4. Gaze position information acquisition unit]
The gaze position information acquisition unit 106 is realized mainly by the imaging unit 60 and the control unit 44, for example. The gaze position information acquisition unit 106 is based on an image (for example, a captured image 62) obtained from an imaging unit (for example, the imaging unit 60) that captures the face of the player, and gazes about the position in the game screen 92 that the player gazes at. Get location information. The gaze position information is information indicating the gaze point of the player, or information indicating the area (the area including the gaze point of the player) that the player is gazing at.

  The gaze position information acquisition unit 106 acquires gaze position information by extracting feature points from the captured image 62. The feature point is a position of a characteristic part of the image showing the eyes of the player, and is extracted by, for example, pattern matching with a comparison image showing the part. The player's cornea (black eye) position, sclera (white eye) position, or reflected image position is extracted as a feature point. For example, the gaze position information acquisition unit 106 extracts a plurality of feature points from the captured image 62 and acquires gaze position information based on the positional relationship between the plurality of feature points.

  Here, a case where the gaze position information acquisition unit 106 acquires gaze position information from the captured image 62 based on the cornea reflection method will be described. For example, the gaze position information acquisition unit 106 extracts an eye image 64 indicating the player's eyes from the captured image 62. For example, the eye image 64 is extracted by performing pattern matching between the captured image 62 and the comparison image. Then, the gaze position information acquisition unit 106 acquires gaze position information based on the eye image 64.

  For example, the gaze position information acquisition unit 106 specifies the positions of the reflected image 64a and the pupil 64b included in the eye image 64. The positions of the reflected image 64a and the pupil 64b included in the eye image 64 are also specified by performing pattern matching. Then, the gaze position information acquisition unit 106 acquires the gaze point of the player based on the positional relationship between the reflected image 64a and the pupil 64b included in the eye image 64.

  Specifically, the gaze position information acquisition unit 106 specifies the position and line-of-sight direction of the player's pupil in the real space coordinate system based on the positional relationship between the reflected image 64a and the pupil 64b in the captured image 62. For example, the positional relationship between the position of the reflected image and the position of the pupil in the real space coordinate system specified based on the information related to the focus of the captured image 62 and the reflected image 64a and the pupil 64b in the captured image 62. Based on this, the viewing direction of the player is acquired. Furthermore, the gazing point of the player is acquired based on the position of the pupil in the real space coordinate system and the viewing direction of the player. For example, an intersection between a straight line extending from the position of the pupil toward the line of sight of the player and the screen area of the second liquid crystal display unit 32 set in advance in the real space coordinate system is acquired as the gazing point of the player.

[5-5. First determination unit]
For example, the first determination unit 108 is realized mainly by the control unit 44. The first determination unit 108 determines whether or not the player is aware of the game character based on the gaze position information and the position of the game character (for example, the player character 84b that is the second game character). “Conscious” here means sensing the object, and means looking at the object. That is, “A is conscious of B” means that “A sees B”.

  For example, whether or not the player is conscious of the player character 84 is determined by determining whether or not the position indicated by the gaze position information and the position of the player character 84 are in a predetermined positional relationship.

  Here, the first determination unit 108 includes means for acquiring a position or area in the game space 70 that the player is aware of based on gaze position information, and a game character (for example, a second character) is included in the position or area. By determining whether or not there is a player character 84b) that is a game character, it is determined whether or not the player is aware of the game character.

  FIG. 12 is a diagram for explaining a determination method of the first determination unit 108. The position in the game space 70 that the player is conscious of is the determination target position U in the game space 70 obtained by performing coordinate conversion processing on the two-dimensional coordinates of the gazing point T indicated by the gazing position information. For example, the Z value (depth information) of the pixel at the gazing point T of the player is referred to, and the screen coordinates indicating the position of the pixel are converted into world coordinates, whereby the determination target position U in the game space 70 is three-dimensional. Coordinates are specified.

  The Z value is calculated when the game screen 92 is generated. That is, here, the inverse transformation of the coordinate transformation process when the game screen 92 is generated from the game space 70 is performed. The first determination unit 108 determines whether or not there is a player character 84 belonging to the player team within a predetermined distance of the determination target position U by referring to the game situation data.

[5-6. Second determination unit]
For example, the second determination unit 110 is realized mainly by the control unit 44. The second determination unit 110 determines the position and line of sight of the game character (for example, the player character 84b, which is the second game character), the virtual viewpoint (for example, the virtual camera 90), or the operation target of the player (for example, the first game character). Based on the position of a certain player character 84a), it is determined whether or not the game character is aware of the virtual viewpoint or the operation target of the player.

  Here, the second determination unit 110 includes a straight line extending in the line-of-sight direction from the position of the game character (for example, the player character 84 (86)), a virtual viewpoint (for example, the virtual camera 90) or the position of the operation target of the player, It is determined whether or not the game character is aware of the virtual viewpoint or the operation target of the player by determining whether or not the positional relationship is a predetermined positional relationship.

  Here, the “predetermined positional relationship” is a positional relationship in which the distance between the straight line and the virtual camera 90 or the position to be operated by the player is within a reference distance, the straight line, the position of the player character 84, and the virtual An area set based on the positional relationship in which the angle formed by the straight line connecting the camera 90 or the position of the operation target of the player is within the reference angle, or the position of the virtual camera 90 or the operation target of the player is the straight line. Is a positional relationship through which.

  FIG. 13 is a diagram for explaining a determination method of the second determination unit 110. As shown in FIG. 13, the visual field E of the player character 84b is determined based on the position of the player character 84b and the line-of-sight direction D. In the second determination unit 110, the distance between the straight line L extending in the line-of-sight direction D from the position of the player character 84 (86) and the operation target (for example, the player character 84a) of the virtual camera 90 or the player is within the reference distance. It is determined whether or not.

[5-7. Operation control unit]
For example, the operation control unit 112 is realized mainly by the control unit 44. Based on the determination results of the first determination unit 108 and the second determination unit 110, the motion control unit 112 performs an action corresponding to the gaze position information on the game character (for example, the player character 84b that is the second game character) or a predetermined value. Let's do the operation.

  For example, the motion control unit 112 determines that the player is conscious of the game character (for example, the player character 84b that is the second game character), and the game character is a virtual viewpoint (for example, the virtual camera 90) or When it is determined that the player's operation target (for example, the player character 84a that is the first game character) is conscious, the game character is caused to perform an action according to the gaze position information or a predetermined action.

  In the present embodiment, the motion control unit 112 determines that the player is conscious of the game character (for example, the player character 84b that is the second game character), and the game character has a virtual viewpoint (for example, virtual The camera 90) or means for determining whether or not the state determined to be conscious of the operation target of the player (for example, the player character 84a as the first game character) has continued for the reference period. When it is determined that the state has continued for the reference period, the player character 84 is caused to perform an action according to the gaze position information or a predetermined action. That is, when it is not determined that the above state has continued for the reference period, the player is restricted so that the player character 84 cannot be instructed with a line of sight.

  Further, here, the motion control unit 112 moves the player character 84 based on the change in the gazing point of the player during the instruction period after the above determination is made. The instruction period is, for example, a period after the message 96 for guiding the player that the eye contact has been established is displayed, and is a period from a predetermined period before the present time to the present time.

  FIG. 14 is a diagram illustrating a state in which the player character 84 moves based on a change in the gazing point. As shown in FIG. 14, it is assumed that the line of sight of the player changes during the instruction period, and the place that the player is conscious of changes from the determination target position U1 to the determination target position U2. In this case, the player character 84b in which the eye contact is established moves toward the determination target position U2. That is, the player instructs the position of the player character 84b to move to with a line of sight.

  Note that when a predetermined action is performed on the player character 84 in which eye contact is established, a given type of action is performed among the types of actions that the player character 84 can perform in the game. For example, a type of action specified in advance by the player (for example, running in a predetermined direction) may be performed.

[6. Processing executed in game device]
15 and 16 are flowcharts showing processing executed by the game apparatus 10. The control unit 44 executes the processes shown in FIGS. 15 and 16 in accordance with a program stored in the game memory card 40 when a given condition for the player to give an instruction with a line of sight is satisfied. This condition is predetermined, for example, whether or not the player has pressed a given button on the operation key unit 24, or whether or not the game situation data satisfies a predetermined condition. There may be.

  First, as shown in FIG. 15, the control unit 44 captures a photographed image 62 by photographing the player with the in-camera 36 (S <b> 1). The control unit 44 uses the corneal reflection method described above to detect the player's gazing point based on the photographed image 62 and acquire the gazing position information (S2). Here, gaze position information indicating two-dimensional coordinates (coordinates of the screen coordinate system) indicating the gazing point T of the player is generated and stored as a new record in the gaze position history data.

  The control unit 44 performs a coordinate conversion process on the gazing point of the player to identify the determination target position U in the game space 70 (S3). In S3, the pixel at the gazing point on the game screen 92 is specified, and the two-dimensional coordinate (screen coordinate) of the gazing point is converted into the three-dimensional coordinate (world coordinate) of the game space 70 based on the Z value of this pixel. Thus, the three-dimensional coordinates of the determination target position U are specified.

  The control unit 44 determines whether or not the player character 84 is present at the determination target position U (S4). It is determined whether or not there is a player character 84 belonging to the player team within a predetermined distance from the three-dimensional coordinates of the determination target position U. When it is determined that there is no player character 84 at the determination target position U (S4; N), the process ends because there is no player character 84 that the player can instruct by eye contact.

  On the other hand, when it is determined that the player character 84 is present at the determination target position U (S4; Y), the control unit 44 refers to the game situation data and a straight line L extending in the line-of-sight direction D from the position of the player character 84. Then, it is determined whether or not the distance from the operation target position of the virtual camera 90 or the player is within the reference distance (S5).

  When it is not determined that the distance between the straight line L extending in the line-of-sight direction D from the position of the player character 84 and the position to be operated by the virtual camera 90 or the player is within the reference distance (S5; N), Since the player is not looking and the eye contact is not established, the process ends.

  On the other hand, when it is determined that the distance between the straight line L extending in the line-of-sight direction D from the position of the player character 84 and the position to be operated by the virtual camera 90 or the player is within the reference distance (S5; Y), the control unit 44 measures the time using the real time clock and updates the time T1 (S6). The time T1 indicates an elapsed time since the time measurement in S6 is started, and information indicating the time T1 is stored in the main memory 48.

  The control unit 44 determines whether or not the time T1 exceeds the reference period (S7). When it is not determined that the time T1 exceeds the reference period (S7; N), the process returns to S1. That is, since the state in which the player and the player character 84 stared has not reached the reference period, it is determined that the eye contact has not yet been established.

  When it is determined that the time T1 has exceeded the reference period (S7; Y), the process proceeds to FIG. 16, and the control unit 44 displays a message 96 indicating that eye contact has been established on the game screen 92 (S8). By displaying the message 96, the player is informed that the eye contact with the player character 84 is established and the player character 84 can be instructed by his / her own line of sight.

  The controller 44 measures time using the real time clock and updates the time T2 (S9). The time T2 indicates an elapsed time since the time measurement in S9 is started, and information indicating the time T2 is stored in the main memory 48.

  The control unit 44 shoots the player with the in-camera 36 and acquires the captured image 62 (S10). The control unit 44 uses the corneal reflection method described above to detect the gazing point of the player based on the photographed image 62 and acquire the gazing position information (S11). The control unit 44 performs a coordinate conversion process on the gazing point of the player and specifies the determination target position U in the game space 70 (S12). The processes of S10 to S12 are the same as the processes of S1 to S3, respectively. The control unit 44 moves the player character 84 in eye contact with the player toward the determination target position U (S13).

  The control unit 44 determines whether or not the time T2 exceeds the instruction period (S14). When it is not determined that the time T2 has exceeded the instruction period (S14; N), the process returns to S9. In this case, the player uses the line of sight to instruct the movement destination of the player character 84 in which the eye contact is established.

  On the other hand, when it is determined that the time T2 has exceeded the instruction period (S14; Y), the process ends.

  According to the game device 10 described above, when the player character 84 in the direction seen by the player is also looking at the player, the player character 84 can be moved in the direction in which the player's line of sight has moved. As a result, the player can easily give an instruction to the player character 84 without using the operation member. In particular, since the player can give instructions to the other player characters 84 with a line of sight while giving instructions to the operation target with the operation key unit 24, the player can easily operate the plurality of player characters 84 simultaneously.

  Further, by assuming that the eye contact is established when the player and the player character 84 stare at each other for a reference period, the player can feel the eye contact with the actual soccer player, and the player feels Reality improves.

[7. Modified example]
The present invention is not limited to the embodiment described above. Modifications can be made as appropriate without departing from the spirit of the present invention.

  (1) For example, the reference period for establishing eye contact is changed according to the level of cooperation between the player's operation target and the player character 84 that makes eye contact (whether the relationship is good or bad). Also good. When the cooperation between the player's operation target and the player character 84 is relatively high, the reference period may be set to be relatively short, and the eye contact may be established in a short time.

  The game data storage unit 100 of the modified example (1) associates a game parameter (for example, a cooperation degree parameter) with a combination of a plurality of game characters (for example, two player characters 84 (86) belonging to the same team). Remember.

  FIG. 17 is a diagram illustrating an example of the cooperation degree parameter. As shown in FIG. 17, in association with a combination of player characters 84 (86) (for example, a combination of player IDs assigned to the player character 84 (86)), the two player characters 84 (86) are linked. A cooperation parameter indicating the height is stored. Here, the cooperation degree parameter takes a numerical value from 0 to 100, and the higher the cooperation degree parameter value, the higher the cooperation degree of the two player characters 84 (86).

  In the game apparatus 10 of the modified example (1), the length of the reference period is associated with the combination of the first game character (player's operation target) and the second game character (player character 84b in which eye contact is established). Reference period determining means for determining based on the game parameter is included. This means is included in the game execution unit 102, for example.

  FIG. 18 is a diagram illustrating the association between the condition related to the cooperation degree parameter and the reference period. As shown in FIG. 18, the condition relating to the cooperation degree parameter is associated with the reference period. The association data shown in FIG. 18 is stored in the game data storage unit 100. This data may be tabular data or mathematical data.

  The condition related to the cooperation degree parameter indicates a range of values of the cooperation degree parameter. A reference period associated with a condition satisfied by the cooperation parameter between the operation target of the player and the player character 84 (86) is set. As illustrated in FIG. 18, the reference period is determined to be shorter as the cooperation between the operation target of the player and the player character 84 at the gaze position indicated by the cooperation degree parameter is higher.

  According to the modified example (1), the eye contact can be established in a shorter time as the cooperation between the operation target of the player and the player character 84 is higher.

  (2) Further, for example, when the player character 84 is moved in S13 of FIG. 16, the movement start timing may be delayed according to the cooperation value parameter. When the cooperation between the player's operation target and the player character 84 is relatively high, the player character 84 starts to move immediately after the player's gazing point T changes, and the player's operation target and the player character 84 cooperate with each other. Is relatively low, the player character 84 may start moving after waiting for several seconds after the player's gazing point T changes.

  In the game apparatus 10 of the modification (2), the motion control of the second game character (for example, the player character 84b) by the motion control unit 112 is performed by combining the first game character (player operation target) and the second game character. Limiting means for limiting based on a game parameter (for example, a linkage value parameter) associated with the. The restriction means is included in the game execution unit 102, for example.

  For example, when the cooperation value parameter is within a predetermined range (when it is equal to or less than the reference value), the movement control of the player character 84 by the movement control unit 112 is suppressed. That is, “restrict operation control” here includes “suppressing execution of operation control”. For example, when the value of the cooperation degree parameter corresponding to the combination of the player's operation target and the player character 84 is very low, the player character 84 is prevented from performing the action instructed by the player's line of sight.

  Further, the start of execution of the action control of the player character 84 by the action control unit 112 is waited based on the cooperation value parameter associated with the combination of the operation target of the player and the player character 84. That is, “restrict operation control” here includes “standby without immediately starting operation”. The waiting period for the start of execution of the action control of the player character 84 by the action control unit 112 is determined based on the cooperation value parameter associated with the combination of the operation target of the player and the player character 84.

  FIG. 19 is an explanatory diagram for explaining a flow from when the player sees the player character 84 to be motion controlled until the player character 84 starts to move. As shown in FIG. 19, first, when the player moves the line of sight and looks at the player character 84 (time t1), time measurement is started in S6. When the reference period elapses, eye contact is established (time t2). After the player sees the position where the player character 84 is desired to move during the instruction period (time t3), the player character 84 is The period until the movement is started (time t3 to t4) is a standby period.

  FIG. 20 is a diagram illustrating the association between the cooperation degree parameter and the standby period. As shown in FIG. 20, the condition related to the cooperation degree parameter and the standby period are associated with each other. The association data shown in FIG. 20 is stored in the game data storage unit 100. This data may be tabular data or mathematical data.

  The standby period associated with the condition that the cooperation parameter between the player's operation target and the player character 84 satisfies is set. As shown in FIG. 20, the longer the waiting period is determined, the higher the cooperation between the player's operation target and the player character 84 indicated by the cooperation degree parameter.

  According to the modified example (2), the movement of the player character 84 can be started in a shorter time as the cooperation between the player's operation target and the player character 84 is higher.

  (3) Further, for example, it is determined whether or not the place viewed by the player after the eye contact between the player and the player character 84 is established is an empty space, and the player character 84 is moved in the case of the empty space. May be. That is, when there is another player character 84 (86) in this space, the player character 84 in which the eye contact is established may be restricted so as not to move.

  The motion control unit 112 of the modified example (3) is a game character other than the gaze position information acquired in the instruction period and the game character (for example, the player character 84b that is the second game character) controlled by the motion control unit 112. Based on the position of the player character (for example, the player character 86 belonging to the opponent team), a game character other than the game character that is controlled by the motion control unit 112 at a position or area that the player is conscious of in the instruction period. Means for determining whether or not there is.

  FIG. 21 is a diagram for explaining a method for determining an empty space. As shown in FIG. 21, the determination target position U in the game space 70 corresponding to the gazing point T of the player at the end of the instruction period is specified. Then, a region R within a predetermined distance from the determination target position U is specified. By determining whether or not the player character 84 (86) is present in the region R, it is determined whether or not there is another player character 84 (86) in the position or region that the player is aware of. Note that the distance between the determination target position U and the player character 84 (86) may be calculated, and it may be determined whether or not there is a player character 84 (86) whose distance is within a predetermined distance.

  The motion control unit 112 is a game character (for example, a player character 84b that is the second game character) other than the game character (for example, the second game character) controlled by the motion control unit 112 at a position or area that the player is conscious of during the instruction period. When it is determined that there is a player character 86) belonging to the opponent team, a means Note for suppressing motion control by the motion control unit 112 is included. For example, when it is determined that there is a player character 86 belonging to the opponent team in the region R, the movement control based on the gaze position information is suppressed.

  According to the modification (3), when the position viewed by the player after the eye contact is established is not an empty space, the player character 84 having established the eye contact can be prevented from moving to this position. it can.

  (4) Also, for example, it is determined whether or not the place seen by the player in the instruction period is included in the visual field of the player character 84 that has been eye-contacted, and when this place is included in the visual field, the player character 84 is moved. You may do it. For example, even if the place viewed by the player is an empty space, if the player character 84 does not see the empty space, the player character 84 may not be moved to this empty space.

  The motion control unit 112 of the modified example (4) includes the position and line of sight of the game character (for example, the player character 84b, which is the second game character) controlled by the motion control unit 112, and gaze position information acquired during the instruction period. And a means for determining whether or not the game character is aware of the position or area in the game space 70 that the player is aware of during the instruction period. That is, when it is determined that this determination target position U or region R is not included in the field of view E of the player character 84 in which the eye contact is established, motion control based on the gaze position information is suppressed.

  According to the modification (4), for example, even if the position viewed by the player after the eye contact is established is an empty space, the player character 84 who has established the eye contact does not see this empty space. Can be prevented from moving to this position.

  (5) Further, for example, the instruction period for the player to search for the movement destination of the player character 84 may be changed according to the cooperation value parameter between the operation target of the player and the player character 84. For example, when the cooperation between the player's operation target and the player character 84 is relatively high, the instruction period may be set to be relatively long so that the player can find the destination carefully.

  In the game apparatus 10 of the modification (5), the length of the instruction period is associated with the combination of the first game character (player operation target) and the second game character (player character 84b that the player is aware of). Instruction period determining means for determining based on the game parameters. This means is included in the game execution unit 102, for example.

  FIG. 22 is a diagram illustrating the association between the cooperation degree parameter and the instruction period. As shown in FIG. 22, the condition relating to the cooperation degree parameter and the instruction period are associated. The association data shown in FIG. 22 is stored in the game data storage unit 100. This data may be tabular data or mathematical data.

  An instruction period associated with a condition satisfied by the cooperation degree parameter between the operation target of the player and the player character 84 (86) is set. As shown in FIG. 22, the instruction period is determined to be longer as the cooperation between the player operation target and the player character 84 indicated by the cooperation degree parameter is higher.

  According to the modified example (5), when the cooperation between the operation target of the player and the player character 84 is relatively high, the instruction period is set to be relatively long so that the player can find the moving destination carefully.

  (6) For example, in the embodiment, the case where the message 96 is displayed near the player character 84 in which the eye contact with the player is established has been described. However, the player is informed that the eye contact has been established by another method. You may make it guide. In addition, for example, the display mode of the player character 84 in which the eye contact with the player is established may be changed.

  FIG. 23 is a diagram showing an example of the game screen 92 in the modification (6). As shown in FIG. 23, when the eye contact between the player and the player character 84b is established, the player is guided that the eye contact is established by changing the display mode of the player character 84b. “Changing the display mode of the player character 84b” means changing the shape, pattern or color of the player character 84b, changing the luminance of the player character 84b, enhancing the contour of the player character 84b, It means at least one of blinking 84b.

  According to the modified example (6), it is possible to make the player know that the eye contact has been established without keeping an eye on the player character 84 who is making eye contact.

  (7) For example, the determination method of the first determination unit 108 and the determination method of the second determination unit 110 are not limited to the methods described above.

  For example, the first determination unit 108 includes means for acquiring a position or region in the game screen 92 that the player is conscious of based on gaze position information, and the position or region in the game screen 92 that the player is conscious of It may be determined whether or not the player is aware of the game character by determining whether or not a game character (for example, a player character 84b as the second game character) is displayed. For example, it is determined whether or not the player character 84 (86) is displayed at the gazing point T of the player, or whether or not the player character 84 (86) is displayed within a predetermined area including the gazing point T. You may do it.

  Further, the second determination unit 110 may determine whether or not there is an operation target of the virtual camera 90 or the player in an area including the line-of-sight direction U of the player character 84 (86). For example, it is determined whether or not the virtual camera 90 or the operation target of the player is in an area in the visual field E of the player character 84 (86) whose distance from the line-of-sight direction U is within a predetermined distance.

  (8) Also, for example, the first determination unit 108 determines that the player is conscious of the player character 84 (86), and the second determination unit 110 causes the player character 84 (86) to be conscious of the player. The player character 84 (86) may be moved by the player's line of sight when only one of the states determined to be in progress is established.

  Furthermore, in the embodiment, when the state where the player and the player character 84 (86) are staring at each other continues for a reference period or longer, the player can send an instruction with a line of sight. Alternatively, the player may be able to send an instruction with a line of sight when the determination result of the determination by the first determination unit 108 and the second determination unit 110 is determined.

  Further, in the embodiment, a case has been described in which the player character 84 (86) is moved according to a change in the line of sight of the player in the instruction period after the eye contact is established, but the instruction period is not set, and the predetermined period after the eye contact is established. You may make it the player character 84 (86) move to the position which the player is conscious of after time.

  (9) For example, in the embodiment, the case where the gazing point of the player is detected by using the corneal reflection method has been described. However, the gazing point of the player is detected from a captured image obtained by shooting the face of the player. In other words, the gazing point of the player may be detected by another method. In addition, for example, the three-dimensional coordinates of the eyeball may be corrected by detecting the orientation of the face from the positional relationship of each part of the face of the player, the player's eyes are continuously photographed, and the position change of the pupil is tracked By doing so, the line of sight of the player may be detected.

  (10) Further, for example, in the embodiment and the modification, the case where the player character 84 moves in the direction in which the player's line of sight has changed has been described. I can't. In addition, for example, when the player character 84 in which the eye contact is established holds the ball 88, the player may make a pass in the direction in which the player's line of sight has changed, or based on the gaze position history data. A trajectory of the gazing point T in the instruction period may be specified, and the player character 84 may be moved along the trajectory.

  (11) Further, for example, in the embodiment, a case has been described where an instruction is sent to the player character 84 belonging to the same team as the operation target of the player by the player's line of sight, but the player character 86 belonging to the opponent team is You may make it move according to a player's eyes | visual_axis. For example, when the player character 86 moves in the direction seen by the player, the game can be played while the opponent is confused.

  (12) For example, the case where the virtual camera 90 moves while maintaining a predetermined positional relationship with the ball 88 has been described. However, the virtual camera 90 moves while maintaining a predetermined positional relationship with the operation target of the player. Also good. In this case, the tracking target of the virtual camera 90 is an operation target of the player, and the position of the virtual camera 90 is determined based on the position of the operation target of the player. For example, the position of the operation target of the player may be set to the position of the virtual camera 90, or the position away from the operation target of the player by a predetermined distance in the predetermined direction is set to the position of the virtual camera 90. It may be.

  Further, the viewing direction of the virtual camera 90 may be determined based on the viewing direction of the operation target of the player. For example, the line-of-sight direction of the virtual camera 90 is set so that the angle formed by the line-of-sight direction of the virtual camera 90 and the line-of-sight direction of the operation target of the player falls within a predetermined range (for example, within 10 °).

  According to the modification (12), what the player's operation target is conscious of is displayed on the game screen 92, and the object in the game screen 92 and the operation target conscious of the player are conscious. Since the positional relationship with the object in the game space 70 is approximated, it is easy to feel the eye contact between the operation target of the player and another game character.

  (13) For example, in the embodiment, the game device 10 including two display units has been described as an example, but the number of display units is not limited to two, and may be one. Three or more may be sufficient. The line-of-sight direction of the camera that shoots the player may be oriented in the direction perpendicular to the display unit viewed by the player.

  (14) Further, for example, the game space 70 has been described as a three-dimensional space as shown in FIG. 2, but the game space according to the present invention has two coordinates such as the position of the player character 84 (86) and the ball 88. It may be a two-dimensional game space managed by elements.

  (15) Further, for example, the present invention can be applied to a game device that executes a game other than a soccer game. The present invention can be applied to a game in which a game character moves in a game space. For example, the present invention can be applied to a game device that executes a basketball game, an ice hockey game, an American football game, or the like. In addition, for example, the present invention can be applied to a game device that executes a shooting game (for example, FPS; First Person Shooting), an action game, a role playing game, and the like.

DESCRIPTION OF SYMBOLS 1 Player, 10 Game apparatus, 12 Portable game machine, 14 Hinge part, 16 Touch pen, 20 1st housing | casing, 20a Surface, 22 Touch screen, 22a 1st liquid crystal display part, 22b Touch panel, 24 Operation key part, 24a, 24b 24c, 24d, 24e, 24f, 24g, 24x, 24y buttons, 24c cross button, 24d slide pad, 24h power button, 26 memory card slot, 30 second housing, 30a
Surface, 32 second liquid crystal display unit, 34 speaker, 36 in camera, 40 game memory card, 42 bus, 44 control unit, 46 storage unit, 48 main memory, 50 image processing unit, 52 input / output processing unit, 54 audio processing Unit, 56 communication interface, 58 sensor unit, 60 imaging unit, 62 captured image, 64-eye image, 64a reflection image, 64b pupil, 70
Game space, 72 fields, 74a, 74b goal line, 76, 76a, 76b touch line, 78 center line, 80 pitch, 82a, 82b goal, 84, 84a, 84b, 84c, 84d, 86 player character, 88 balls, 90 Virtual camera, 92 game screen, 94 cursors, 96 messages, 98 arrows, 100
Game data storage unit, 102 game execution unit, 104 display control unit, 106 gaze position information acquisition unit, 108 first determination unit, 110 second determination unit, 112 operation control unit.

Claims (15)

A game device for executing a game in which a game character moves in a game space,
Means for acquiring the information from means for storing information relating to the position and line of sight of the game character;
Display control means for displaying on the display means a game screen showing the game space viewed from a virtual viewpoint;
Means for acquiring gaze position information relating to a position in the game screen at which the player gazes based on an image obtained from an imaging means for photographing the face of the player;
First determination means for determining whether the player is aware of the game character based on the gaze position information and the position of the game character;
Based on the position and line of sight of the game character and the position of the virtual viewpoint or the operation target of the player, whether or not the game character is aware of the virtual viewpoint or the operation target of the player is determined. 2 determination means;
Action control means for causing the game character to perform an action corresponding to the gaze position information or a predetermined action based on the determination results of the first determination means and the second determination means;
A game apparatus comprising: The motion control means determines that the game is determined when it is determined that the player is conscious of the game character and the game character is conscious of the virtual viewpoint or the operation target of the player. Causing the character to perform the action or the predetermined action according to the gaze position information;
The game device according to claim 1. The operation control means includes
Whether or not the state in which it is determined that the player is conscious of the game character and the game character is conscious of the virtual viewpoint or the operation target of the player has continued for a reference period. Means for determining,
And when it is determined that the state has continued for the reference period, the game character is caused to perform the action or the predetermined action according to the gaze position information.
The game device according to claim 2. In the game space, at least a first game character that is an operation target of the player and a second game character are arranged,
The first determination means determines whether the player is conscious of the second game character based on the gaze position information and the position of the second game character,
The second determination means determines whether the second game character is the virtual viewpoint or the first game character based on the position and line of sight of the second game character and the virtual viewpoint or the position of the first game character. To determine whether or not
The action control means determines that the player is conscious of the second game character, and determines that the second game character is conscious of the virtual viewpoint or the first game character. Means for determining whether or not the state has continued for the reference period, and when it is determined that the state has continued for the reference period, the action corresponding to the gaze position information or the predetermined Let the action
The game device includes:
Means for acquiring the game parameter from means for storing the game parameter in association with a combination of a plurality of game characters;
Reference period determining means for determining the length of the reference period based on the game parameter associated with the combination of the first game character and the second game character;
The game device according to claim 3, further comprising: In the game space, at least a first game character that is an operation target of the player and a second game character are arranged,
The first determination means determines whether the player is conscious of the second game character based on the gaze position information and the position of the second game character,
The second determination means determines whether the second game character is the virtual viewpoint or the first game character based on the position and line of sight of the second game character and the virtual viewpoint or the position of the first game character. To determine whether or not
The action control means causes the second game character to perform the action or the predetermined action according to the gaze position information based on the determination results of the first determination means and the second determination means.
The game device includes:
Means for acquiring the game parameter from means for storing the game parameter in association with a combination of a plurality of game characters;
Limiting means for limiting the action control of the second game character by the action control means based on the game parameter associated with the combination of the first game character and the second game character;
The game apparatus according to claim 1, further comprising: The limiting means is
Standby means for waiting for the start of execution of motion control of the second game character by the motion control means based on the game parameter associated with the combination of the first game character and the second game character;
The game device according to claim 5, comprising: The operation control means includes
Changes in the gaze position information during an instruction period after it is determined that the player is conscious of the game character and the game character is conscious of the virtual viewpoint or the operation target of the player The game character is operated based on
The game device according to claim 1, wherein the game device is a game device. A plurality of game characters are arranged in the game space,
The game device includes:
Based on the gaze position information acquired during the instruction period and the position of a game character other than the game character that is controlled by the movement control means, the position or region that the player is aware of during the instruction period Means for determining whether or not there is a game character other than the game character whose motion is controlled by the motion control means;
Means for inhibiting motion control by the motion control means when it is determined that there is a game character other than the game character controlled by the motion control means at a position or area that the player is conscious of during the instruction period; ,
The game apparatus according to claim 7, further comprising: The game device includes:
Based on the position and line of sight of the game character controlled by the motion control means and the gaze position information acquired during the instruction period, the position in the game space that the player is aware of during the instruction period Or means for determining whether or not the game character is aware of the area;
Means for suppressing motion control by the motion control means when it is determined that the game character does not see the position in the game space that the player is aware of during the instruction period;
The game device according to claim 7, further comprising: In the game space, at least a first game character that is an operation target of the player and a second game character are arranged,
The first determination means determines whether the player is conscious of the second game character based on the gaze position information and the position of the second game character,
The second determination means determines whether the second game character is the virtual viewpoint or the first game character based on the position and line of sight of the second game character and the virtual viewpoint or the position of the first game character. To determine whether or not
The operation control means includes
In the instruction period after it is determined that the player is conscious of the second game character and the second game character is conscious of the virtual viewpoint or the first game character. Based on the change in the gaze position information, the second game character is moved,
The game device includes:
Means for acquiring the game parameter from means for storing the game parameter in association with a combination of a plurality of game characters;
Instruction period determining means for determining the length of the instruction period based on the game parameter associated with the combination of the first game character and the second game character;
The game apparatus according to claim 7, further comprising: The first determination means includes
Means for acquiring a position or area in the game space that the player is aware of based on the gaze position information;
Determining whether or not the player is aware of the game character by determining whether or not the game character is in the position or the area in the game space that the player is aware of;
The game device according to claim 1, wherein the game device is a game device. The first determination means includes
Means for acquiring a position or area in the game screen that the player is aware of based on the gaze position information;
It is determined whether or not the player is aware of the game character by determining whether or not the game character is displayed at the position or area in the game screen that the player is aware of. ,
The game device according to claim 1, wherein the game device is a game device. The second determination means includes
By determining whether or not the positional relationship between the straight line extending in the line-of-sight direction from the position of the game character and the position of the virtual viewpoint or the operation target of the player is a predetermined positional relationship, the game character It is determined whether or not the virtual viewpoint or the operation target of the player is conscious.
The game device according to claim 1, wherein the game device is a game device. A control method of a game device for executing a game in which a game character moves in a game space,
Obtaining the information from means for storing information relating to the position and line of sight of the game character;
A display control step of causing a display means to display a game screen showing the game space viewed from a virtual viewpoint;
Obtaining gaze position information related to a position in the game screen at which the player gazes based on an image obtained from an imaging means for photographing the face of the player;
A first determination step of determining whether or not the player is aware of the game character based on the gaze position information and the position of the game character;
Based on the position and line of sight of the game character and the position of the virtual viewpoint or the operation target of the player, whether or not the game character is aware of the virtual viewpoint or the operation target of the player is determined. 2 determination steps;
An action control step for causing the game character to perform an action or a predetermined action according to the gaze position information based on the determination results of the first determination step and the second determination step;
A method for controlling a game device, comprising: A program for causing a computer to function as a game device that executes a game in which a game character moves in a game space,
Means for acquiring the information from means for storing information relating to the position and line of sight of the game character;
Display control means for displaying on the display means a game screen showing the game space viewed from a virtual viewpoint;
Means for acquiring gaze position information relating to a position in the game screen at which the player gazes based on an image obtained from an imaging means for photographing the face of the player;
First determination means for determining whether the player is aware of the game character based on the gaze position information and the position of the game character;
Based on the position and line of sight of the game character and the position of the virtual viewpoint or the operation target of the player, whether or not the game character is aware of the virtual viewpoint or the operation target of the player is determined. 2 determination means,
Action control means for causing the game character to perform an action according to the gaze position information or a predetermined action based on the determination results of the first determination means and the second determination means;
A program for causing the computer to function as a game device.

Images