JP5331259B2 - Information processing program, information processing apparatus, information processing system, and information processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a game program for properly changing game processing such as the point of view of a game image displayed on a display screen or an operation method, in a game device operated using a pointing device capable of remotely outputting data for coordinate designation to a predetermined detection surface, and to provide a game device and a game system. <P>SOLUTION: A coordinate on the detection surface is acquired using data output from the pointing device, and instructed coordinate-related processing that is game processing using the acquired coordinate is performed. On the other hand, instructed coordinate-unrelated processing that is game processing not using the acquired coordinate is performed. Whether the coordinate within a predetermined area in the detection surface is acquired is detected, and, according to the detection, the instructed coordinate-related processing and the instructed coordinate-unrelated processing are switched and executed. <P>COPYRIGHT: (C)2013,JPO&amp;INPIT

Description

The present invention relates to an information processing program, an information processing apparatus, an information processing system, and relates to an information processing method, and more particularly, capable of outputting a pointing device data for designating coordinates remotely with respect to a predetermined detection surface the information processing program executed in the equipment you operate with, the information processing apparatus, an information processing system, and an information processing method.

  2. Description of the Related Art Conventionally, there is a game apparatus that is operated using a pointing device that remotely designates coordinates on a display screen as a predetermined detection surface (see, for example, Patent Document 1). The video game disclosed in Patent Document 1 is a game in which a gun 20 is used to designate a position on the display screen 3A to shoot a target, and is displayed on the display screen 3A by operating the foot switch 70. Change the viewpoint of the game image to be played.

  In addition, there is a game device that changes the viewpoint of the game image displayed on the display screen (see, for example, Patent Documents 2 and 3). The electronic game machine disclosed in Patent Document 2 detects the posture of the player and changes the viewpoint of the game image displayed on the display screen according to the posture. The video game device disclosed in Patent Document 3 changes the viewpoint of the game image displayed on the display screen according to the display position and behavior of the player character, for example. Specifically, when the player character is moving in the game space, the video game apparatus has an overhead viewpoint (a viewpoint in the game space located at the upper rear of the player character) in response to the player's operation. When the character is stopped, a subjective viewpoint (a viewpoint in the game space that substantially coincides with the position of the player character) is used, and when the player character infiltrates a specific place in the game space, the subjective viewpoint is also used.

  On the other hand, unlike the viewpoint of a game image, there is a game device that changes an operation method for the device (see, for example, Patent Documents 4 to 6). The hand-held liquid crystal game machine disclosed in Patent Document 4 changes the operation method for the device depending on whether the game to be executed is a portrait screen game or a landscape screen game. The information distribution apparatus disclosed in Patent Document 5 changes an operation method by a user defining a key operation and a response to the operation. The game device disclosed in Patent Document 6 changes game control performed in response to an operation signal generated in response to a player's operation, according to the attitude of the operation unit 50.

Japanese Patent Laid-Open No. 11-90043 Japanese Patent Laid-Open No. 7-116343 Japanese Patent Laid-Open No. 11-272841 Japanese Patent Laid-Open No. 10-2335014 JP 2001-109714 A JP 2003-251070 A

  However, the video game disclosed in Patent Document 1 has poor operability because it is necessary to operate the foot switch in order to change the viewpoint of the game image displayed on the display screen. In addition, since the electronic game machine disclosed in Patent Document 2 and the video game device disclosed in Patent Document 3 perform game input by a player operating a key, a joystick, or the like, On the other hand, it is not suitable to be applied as it is to a game apparatus operated using a pointing device for specifying coordinates from a remote location.

  The hand-held liquid crystal game machine disclosed in Patent Document 4 changes the operation method in accordance with the type of game executed on the game machine, and changes the operation method as appropriate during execution of the same game. It is not a thing. The information distribution apparatus disclosed in Patent Document 5 requires a user to define a key operation and a response to the operation each time, and the operation becomes complicated. In addition, the game device disclosed in Patent Document 6 performs game input by a player operating a direction key, a button, or the like. Therefore, the game device is operated using a pointing device that remotely designates coordinates on a detection surface. Even if it is applied to the game device as it is, it is not suitable.

SUMMARY OF THE INVENTION Therefore, an object of the present invention is to solve at least one of the above-mentioned problems, and to operate using a pointing device capable of outputting data for remotely designating coordinates for a predetermined detection surface. in that equipment, the information processing program appropriately changing the processing, such as viewpoint and operating methods of the images that displays on the display screen, the information processing apparatus is to provide an information processing system, and an information processing method.

  In order to achieve the above object, the present invention adopts the following configuration. Note that the reference numerals in parentheses, step numbers, and the like indicate correspondence relationships with embodiments described later in order to help understanding of the present invention, and do not limit the scope of the present invention.

  The first invention is executed by a computer (30) of a game apparatus (3) using a pointing device (7, 74, 8) capable of outputting data for remotely instructing coordinates on a predetermined detection surface. Game program (GP). The game program includes a coordinate acquisition step (S51), designated coordinate related processing steps (S90 to S93), designated coordinate non-related processing steps (S86, S87, S92, S93), a detection step (S54), and a switching step (S55 to S55). S85, S88, and S89) are executed by the computer. In the coordinate acquisition step, the coordinates (Db3) on the detection surface are acquired using the data output from the pointing device. The designated coordinate related processing step performs designated coordinate related processing, which is game processing using the coordinates acquired in the coordinate acquisition step (FIGS. 16, 17, and 20). The designated coordinate unrelated processing step performs designated coordinate unrelated processing, which is a game process that does not use the coordinates acquired in the coordinate acquisition step (FIGS. 14, 15, and 19). In the detection step, it is detected whether or not the coordinates within the predetermined region (predetermined range) on the detection surface have been acquired (FIGS. 10 to 12) (FIGS. 8 and 9). The switching step is executed by switching between the designated coordinate related processing step and the designated coordinate non-related processing step according to the detection by the detection step.

  The pointing device is capable of outputting data for instructing coordinates with respect to a predetermined detection surface remotely (that is, from a position away from the detection surface), and is typically held by a player. Data for acquiring the position on the detection surface pointed by the housing is output. For example, a straight line extending from a predetermined position (such as an end portion) of the housing held by the player in a predetermined direction (for example, a direction determined according to the attitude of the housing, such as the longitudinal direction of the housing) intersects a predetermined detection surface. There is one that outputs data for acquiring a position (that is, coordinates in a detection coordinate system set on the detection surface). Further, it is preferable that the relationship between the detection output data from the pointing device and the designated coordinates is a fixed relationship (that is, the designated coordinates obtained immediately before according to the data output from the pointing device). It is preferable that the designated coordinates are acquired uniquely or one-to-one according to the data output from the pointing device, instead of determining the change with respect to. The detection surface may be a display screen on which a game image is displayed, or the detection surface may be different from the display screen. In the latter case, the coordinates on the detection surface and the coordinates on the display screen are used. (In other words, the former detects coordinates on the display screen as they are, the latter detects coordinates on a detection surface different from the display screen, and coordinates on the detection surface. To convert to coordinates on the display screen). When the detection surface and the display screen match, the maximum detectable region may be a region that matches the display screen (or the display region where the game image is displayed), or the display screen (or display). The area may be larger than (area) or may be smaller. When the detection surface matches the display screen, the predetermined area may be an area that matches the display screen (or a display area where the game image is displayed), a larger area, or a small area. It may be a region. Further, the “predetermined area” may be an area smaller than the maximum detectable area or the maximum area. In the latter case, the detection step detects whether the coordinates have been acquired by the coordinate acquisition step or whether they have not been acquired.

  Further, the pointing device may calculate the indicated coordinates by hardware, or may calculate the indicated coordinates by performing software processing on the detection value detected by the hardware. In the latter case, the software processing may be performed by software built in the pointing device, or may be performed by software processing in the game application.

  Further, the designated coordinate-related processing step may perform the game process using the acquired coordinates only when the coordinates in the predetermined area are acquired by the coordinate acquisition step. In this case, the predetermined area (first area) used in the determination by the detection step and the predetermined area (second area) used in the game process by the designated coordinate related processing step may be the same or different. If different, the first region is preferably a region including the second region and further including a peripheral region of the second region. For example, the first area may be set as the maximum detectable area (in this case, the detection step determines whether coordinates are acquired or not acquired), and the second area may be set as a display area where a game image is displayed. . The predetermined detection surface may be a surface that does not actually exist and that is virtually set in the real space, or may be a surface that actually exists such as a display screen.

  In a second aspect based on the first aspect, in the detection step, it is detected whether or not the coordinates on the detection surface have been acquired by the coordinate acquisition step (S52).

  In a third aspect based on the first aspect, the computer is further caused to execute the display control step (S93). The display control step displays a game image viewed from the virtual camera (C) arranged in the virtual three-dimensional game space (S) on the display screen. The designated coordinate unrelated processing step includes a first virtual camera control step (S86). In the first virtual camera control step, the virtual camera parameters are determined by performing a first calculation based on the game parameter (Ph) (FIG. 15). The designated coordinate related processing step includes a second virtual camera control step (S90). The second virtual camera control step determines the parameters of the virtual camera by performing a second calculation different from the first calculation based on the game parameters (FIG. 17).

  In a fourth aspect based on the first aspect, the display control step is further executed by a computer. The display control step displays the game image viewed from the virtual camera arranged in the virtual three-dimensional game space on the display screen. The designated coordinate unrelated processing step includes a first virtual camera control step. In the first virtual camera control step, parameters of the virtual camera are determined so that a game image in which the player character existing in the virtual three-dimensional game space is objectively viewed is generated. The designated coordinate related processing step includes a second virtual camera control step. In the second virtual camera control step, the parameters of the virtual camera are determined so that a game image in which the player character subjectively views the virtual three-dimensional game space is generated. Typically, in the first virtual camera control step, the player character and the virtual game space in the entire circumferential direction are photographed. In the second virtual camera control step, a predetermined direction (from the position of the player character) It is set so that a virtual game space in a direction of a range of 180 ° or less at most is photographed.

  In a fifth aspect based on the first aspect, the computer further executes a display control step. The display control step displays the game image viewed from the virtual camera arranged in the virtual three-dimensional game space on the display screen. The designated coordinate unrelated processing step includes a first virtual camera control step. The first virtual camera control step determines the parameters of the virtual camera so that the gazing point of the virtual camera substantially coincides with the position (Ph) of the player character. The designated coordinate related processing step includes a second virtual camera control step. In the second virtual camera control step, the parameters of the virtual camera are determined so that the viewpoint of the virtual camera substantially coincides with the position of the player character. In the designated coordinate unrelated processing step, the distance between the virtual camera's point of sight and the position of the player character is smaller in the three-dimensional virtual game space than the distance between the viewpoint of the virtual camera and the position of the player character. The virtual camera parameters are determined, and in the designated coordinate related processing step, the virtual camera is so arranged that the distance between the virtual camera viewpoint and the player character position is smaller than the distance between the virtual camera gaze point and the player character position. Preferably, the camera parameters are determined.

  In a sixth aspect based on the first aspect, the computer further executes a display control step. The display control step displays the game image viewed from the virtual camera arranged in the virtual three-dimensional game space on the display screen. In the designated coordinate non-related processing step, the parameters of the virtual camera are determined so that the distance from the viewpoint of the virtual camera to the position of the player character is longer than the distance determined in the designated coordinate related processing step.

  In a seventh aspect based on the first aspect, the computer further executes a display control step. The display control step displays the game image viewed from the virtual camera arranged in the virtual three-dimensional game space on the display screen. In the designated coordinate unrelated processing step, the parameters of the virtual camera are determined so that a game image in which the virtual three-dimensional game space is viewed from the lateral direction with respect to the traveling direction or direction (Pd) of the player character is generated. In the designated coordinate related processing step, the parameters of the virtual camera are determined so that a game image in which the virtual three-dimensional game space is viewed in the moving direction or direction of the player character is generated. In the designated coordinate non-related processing step, the direction in which the direction of the virtual camera is projected on the virtual horizontal plane is the direction in which the character is traveling or the direction of the character (the direction in which the face or body is facing) is projected on the virtual horizontal plane. The directions are substantially orthogonal to each other, and in the designated coordinate-related processing step, these two projection directions are substantially matched.

  In an eighth aspect based on any one of the first to seventh aspects, the pointing device includes a direction indicating section (72). The direction instructing unit can instruct a direction by a player's operation, separately from a pointing operation for specifying coordinates from a remote location. In the designated coordinate non-related processing step, the player character is controlled to move in the virtual three-dimensional game space in accordance with the operation data from the direction designating unit.

  In a ninth aspect based on the first aspect, the pointing device includes an input unit (72, 701). The input unit can detect an operation by the player separately from the pointing operation (74) for designating coordinates from a remote location. In the designated coordinate non-related process step, as the designated coordinate non-related process, a predetermined game process is executed based on the operation data generated by the input unit (FIG. 19). In the designated coordinate related process step, in addition to the designated coordinate related process, a game process different from the predetermined game process is executed based on the same operation data generated by the input unit (FIG. 20). The pointing device preferably includes a housing held by the player, and the input unit is preferably provided in the housing. The “input unit” detects a pressing operation, for example, an operation switch or a cross key, a joystick for detecting a tilting operation, for example, a touch panel for detecting a touch operation, an acceleration generated in the housing in accordance with an operation for moving the housing by the player. For example, it is an acceleration sensor to detect, and may be provided on the surface of the housing or may be provided inside. In addition, the “input unit” is an operation unit using a device that can detect the player operation independently (that is, the player operation is performed only on the surface of the housing or inside the housing without using other devices provided outside the housing). It is preferable that the operation unit is a device using a device capable of detecting.

  In a tenth aspect based on the first aspect, the pointing device includes a housing (71) held by the player. A first input portion and a second input portion (72) capable of detecting an operation by the player are provided at different positions on the surface of the housing. In the designated coordinate non-related process step, as the designated coordinate non-related process, a predetermined game process is executed based on the operation data generated by the first input unit. In the designated coordinate related process step, in addition to the designated coordinate related process, the same game process as the predetermined game process is executed based on the operation data generated by the second input unit.

  In an eleventh aspect based on the eighth aspect, in the designated coordinate related processing step, a game process different from the predetermined game process is executed based on operation data generated by the first input unit.

  In a twelfth aspect based on the first aspect, the pointing device includes an input unit. The input unit can detect an operation by the player separately from a pointing operation for specifying coordinates from a remote location. In the designated coordinate related processing step, as the designated coordinate related processing, a predetermined game parameter is determined based on the coordinates acquired in the coordinate acquisition step. In the designated coordinate non-related processing step, as designated coordinate non-related processing, a game parameter is determined based on operation data generated by the input unit.

  In a thirteenth aspect based on the twelfth aspect, the game parameter is a direction parameter indicating a direction in the virtual three-dimensional game space. The input unit is an input unit capable of direction indication. In the designated coordinate related processing step, the direction parameter is determined based on the coordinates acquired in the coordinate acquisition step as the designated coordinate related processing. In the designated coordinate unrelated processing step, the direction parameter is determined based on the direction designated by the input unit as the designated coordinate unrelated process. Note that in the instruction coordinate unrelated processing, for example, a direction parameter is determined corresponding to the output of the acceleration sensor, the tilt sensor, and the direction sensor (that is, the acceleration in the real world detected by the acceleration sensor, the tilt sensor, the direction, etc.). The direction parameter of the virtual world is determined according to the angular velocity and direction in the real world detected by the sensor), the direction parameter is determined according to the inclination of the joystick, and the change of the direction parameter is determined. In the designated coordinate related processing, for example, the position in the virtual three-dimensional game space that overlaps the position of the player character in the virtual three-dimensional game space and the screen coordinates corresponding to the coordinates acquired according to the data output from the pointing device. Based on (for example, in the direction connecting the two), the direction parameter in the virtual game space is determined.

  In a fourteenth aspect based on the first aspect, the detection surface is set corresponding to the display screen (2) on which the game image is displayed. The pointing device can output data for instructing coordinates on the display screen from a remote location. The game program causes the computer to further execute a display control step and a game space coordinate calculation step (S92). The display control step displays a game image representing the game space on the display screen. The game space coordinate calculation step calculates a corresponding coordinate (Dc1) of the game space in which the coordinates acquired in the coordinate acquisition step overlap on the game image. In the designated coordinate related processing step, as the designated coordinate related processing, processing according to the position of the virtual three-dimensional game space calculated in the game space coordinate calculating step is performed.

  In a fifteenth aspect based on the first aspect, the pointing device further includes an input unit. The input unit generates operation data corresponding to the operation of the player, separately from the pointing operation for specifying coordinates from a remote location. In the designated coordinate related process step, in addition to the designated coordinate related process, a game process different from the game process in the designated coordinate related process is performed based on the operation data from the input unit. In the detection step, it is detected that the coordinate acquisition step has shifted from a state where it is detected that coordinates within a predetermined area on the detection surface have been acquired to a state where the detection is not performed. In the switching step, even when the transition is detected by the detection step, when the predetermined operation data is output from the input unit, the instruction coordinate related processing step is not switched to the instruction coordinate unrelated processing step and executed. The execution of the designated coordinate related processing step is continued.

  In a sixteenth aspect based on the first aspect, the pointing device further includes an input unit. The input unit generates operation data corresponding to the operation of the player, separately from the pointing operation for specifying coordinates from a remote location. In the designated coordinate non-related processing step, game processing is performed based on operation data from the input unit as designated coordinate non-related processing. In the detection step, it is detected that the coordinate acquisition step has shifted from a state where it is not detected that coordinates within a predetermined area on the detection surface have been acquired to a state where the detection is performed. In the switching step, even when the transition is detected by the detection step, when the predetermined operation data is output from the input unit, the instruction coordinate non-related processing step is not switched to the designated coordinate related processing step. The execution of the designated coordinate unrelated processing step is continued.

  In a seventeenth aspect based on the first aspect, the pointing device further includes an input unit. The input unit generates operation data corresponding to the operation of the player, separately from the pointing operation for specifying coordinates from a remote location. The game program further causes the computer to execute a display control step. The display control step displays the game image viewed from the virtual camera arranged in the virtual three-dimensional game space on the display screen. In the detection step, it is detected that the coordinate acquisition step has shifted from a state where it is detected that coordinates within a predetermined area on the detection surface have been acquired to a state where the detection is not performed. In the switching step, when the transition is detected by the detection step and the predetermined operation data is output from the input unit, the switching is not performed by switching from the designated coordinate related processing step to the designated coordinate non-related processing step. The execution of the related processing step is continued, and the line-of-sight direction of the virtual camera is changed according to the coordinates acquired by the coordinate acquisition step. In addition, when a coordinate is not acquired by a coordinate acquisition step, you may change the visual line direction of a virtual camera based on the coordinate acquired last. Further, the line-of-sight direction of the virtual camera may be changed based on the coordinates in the predetermined area last acquired by the coordinate acquisition step. Further, the line-of-sight direction may be changed with the position of the viewpoint of the virtual camera as it is.

  In an eighteenth aspect based on the first aspect, the game program causes the computer to further execute a player character action control step (S92). In the player character movement control step, the player character existing in the virtual game world is moved according to the operation of the player. In the detection step, it is detected that the coordinate acquisition step has shifted from a state where it is detected that coordinates within a predetermined area on the detection surface have been acquired to a state where the detection is not performed. In the switching step, when a transition is detected in the detection step, and the player character is performing a specific motion, the instruction coordinate related processing step is not executed by switching from the specified coordinate related processing step to the specified coordinate non-related processing step. Step execution continues.

  In a nineteenth aspect based on the first aspect, the pointing device includes a housing held by the player. The housing is provided with a motion sensor. The game program further causes the computer to execute a data acquisition step (S51) and a motion processing step. In the data acquisition step, data (Da4) detected and output by the motion sensor is acquired. The motion processing step performs a predetermined game process based on the data acquired by the motion data acquisition step. In the detection step, it is detected that the coordinate acquisition step has shifted from a state where it is detected that coordinates within a predetermined area on the detection surface have been acquired to a state where the detection is not performed. In the switching step, even when a transition is detected in the detection step, when the motion sensor indicates an output equal to or greater than a predetermined threshold, the instruction coordinate related processing step is switched to the instruction coordinate non-related processing step. Instead, the execution of the designated coordinate related processing step is continued. Note that the motion sensor is capable of detecting data that can acquire the motion of itself or a housing in which the motion sensor is housed. For example, the motion sensor is an acceleration sensor that detects acceleration in a predetermined linear direction generated in the housing.

  A twentieth invention is a game apparatus using a pointing device capable of outputting data for instructing coordinates to a predetermined detection surface from a remote location. The game apparatus includes coordinate acquisition means, designated coordinate related processing means, designated coordinate non-related processing means, detection means, and switching means. The coordinate acquisition unit acquires the coordinates on the detection surface using the data output from the pointing device. The designated coordinate related processing means performs designated coordinate related processing, which is game processing using the coordinates acquired by the coordinate acquisition means. The designated coordinate non-related processing means performs designated coordinate non-related processing which is a game process that does not use the coordinates acquired by the coordinate acquiring means. The detecting means detects whether or not coordinates within a predetermined area on the detection surface have been acquired by the coordinate acquiring means. The switching means switches between the designated coordinate related processing means and the designated coordinate non-related processing means in accordance with detection by the detecting means.

  A twenty-first invention is a game system including a game apparatus using a pointing device capable of outputting data for remotely instructing coordinates on a predetermined detection surface. The pointing device includes a vertically long housing that is gripped by the player, and data for acquiring a position where a straight line extending in the major axis direction from the end in the major axis direction intersects with the detection surface as instruction coordinates. Output. The housing is provided with operation keys on both sides along the long axis direction. The game apparatus includes coordinate acquisition means, designated coordinate related processing means, designated coordinate non-related processing means, detection means, and switching means. The coordinate acquisition unit acquires the coordinates on the detection surface based on the data output from the pointing device. The designated coordinate related processing means performs designated coordinate related processing, which is game processing using the coordinates acquired by the coordinate acquisition means. The designated coordinate non-related processing means performs designated coordinate non-related processing which is a game process using operation data output from the operation keys on both sides without using the coordinates acquired by the coordinate acquisition means. The detecting means detects whether or not coordinates within a predetermined area on the detection surface have been acquired by the coordinate acquiring means. The switching means switches between the designated coordinate related processing means and the designated coordinate non-related processing means in accordance with detection by the detecting means.

  According to the first aspect of the present invention, in a game in which game processing is performed by a player specifying coordinates using a pointing device, the game processing content is automatically changed according to the output of the pointing device. The Therefore, it is possible to provide the player with an operation environment rich in variations and good operability.

  According to the second aspect, the game processing contents differ depending on whether the coordinates on the detection surface can be acquired according to the output of the pointing device or the coordinates on the detection surface cannot be acquired. Automatically changed.

  According to the third aspect, the game image is automatically changed to each game image having a different viewpoint according to the output of the pointing device. Therefore, it is possible to change game images rich in variations in the player in an operation environment with good operability.

  According to the fourth to seventh inventions, since the parameters of the virtual camera in the game space are changed according to the output of the pointing device, for example, the player can easily switch between the subjective image and the objective image. Can do. In addition, since the game image that allows the player character to see the situation around the player character and the game image that allows the user character to see the field of view viewed from the player character are switched according to the output of the pointing device, the game according to the game situation Images can be switched with good operability.

  According to the eighth aspect, when the detected coordinates acquired from the output from the pointing device cannot be acquired, the player character can be moved using the direction instruction unit.

  According to the ninth aspect, even if the same operation is performed on the same operation unit, different game processes are performed according to the output of the pointing device. Further, for example, the game process for the operation unit can be appropriately assigned according to the direction in which the player holds the pointing device.

  According to the tenth and eleventh aspects of the invention, the same game process is performed using different operation units in accordance with the output of the pointing device, so that the player can change in an operation environment rich in variations. . In addition, for example, an operation unit that instructs a predetermined game process according to a direction in which the player holds the pointing device can be appropriately assigned to an operation unit that is easy for the player to operate.

  According to the twelfth aspect, even when the detection coordinates acquired from the output from the pointing device cannot be acquired, the same game process can be performed using the other input unit.

  According to the thirteenth aspect, when calculating the direction parameter according to the detected coordinate acquired from the output from the pointing device, even when the detected coordinate cannot be acquired, the same direction parameter is calculated using another input unit. Can be calculated.

  According to the fourteenth aspect, it is possible to perform a game operation that directly indicates a position in the game space in accordance with the detected coordinates acquired from the output from the pointing device.

  According to the fifteenth and sixteenth aspects, since the game process is not switched when the player is operating the operation unit, the player's operation can be prevented from being confused.

  According to the seventeenth aspect of the invention, it is possible to achieve both line-of-sight change processing by specifying coordinates outside the display screen while operating a predetermined operation unit.

  According to the eighteenth aspect, since the game process is not switched when the player character is in a specific motion, it is possible to prevent the player from being confused.

  According to the nineteenth aspect, when the player causes acceleration or the like by moving the entire pointing device (for example, swinging up the pointing device), the coordinate designation position of the pointing device deviates from the predetermined area. Sometimes. If the game process is shifted in accordance with this deviation, the player's operation is confused. Therefore, when the acceleration data indicates an output (acceleration or the like) equal to or higher than a predetermined threshold, such a change in the game process can be prevented by prohibiting the transition.

  Further, according to the game device or the game system of the present invention, it is possible to obtain the same effect as the above-described game program.

  In addition, the pointing device can be held vertically to enable game operations by specifying coordinates, and the pointing device can be held sideways to enable game operations using the operation keys on both sides, switching between vertical holding and horizontal holding. It is possible to switch to an appropriate game process automatically in conjunction with the natural movement at the time.

1 is an external view for explaining a game system 1 according to an embodiment of the present invention. Functional block diagram of the game apparatus 3 of FIG. The perspective view seen from the upper surface back of the controller 7 of FIG. The perspective view which looked at the controller 7 of FIG. 3 from the lower surface front The perspective view which shows the state which removed the upper housing | casing of the controller 7 of FIG. The perspective view which shows the state which removed the lower housing | casing of the controller 7 of FIG. The block diagram which shows the structure of the controller 7 of FIG. An illustrative view outlining the state when a game is operated in the first operation mode using the controller 7 of FIG. An example of a state in which the player holds the controller 7 sideways and is gripped with both hands in the first operation mode, as viewed from the side of the controller 7 An illustrative view outlining the state when the game is operated in the second operation mode using the controller 7 of FIG. An example in which the player holds the controller 7 with his right hand in the second operation mode as seen from the front side of the controller 7 An example of a state in which the player holds the controller 7 with the right hand as viewed from the left side of the controller 7 in the second operation mode. The figure for demonstrating the viewing angle of the markers 8L and 8R and the imaging information calculating part 74 An example of a game image by an objective image displayed on the monitor 2 in the first operation mode Schematic overhead view of the position of the virtual camera C in the objective image as seen from above the player character P An example of a game image by a subjective image displayed on the monitor 2 in the second operation mode Schematic view of the position of the virtual camera C in the subjective image as seen from the side of the player character P The figure which shows the main data memorize | stored in the main memory 33 of the game device 3 The figure which shows an example of the 1st operation table data Dc4 memorize | stored in the main memory 33 The figure which shows an example of 2nd operation table data Dc5 memorize | stored in the main memory 33 The flowchart which shows the flow of the first half of the game process performed in the game device 3 The flowchart which shows the flow of the second half of the game process performed in the game device 3

  A game system 1 according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 is an external view for explaining the game system 1. Hereinafter, the game system 1 of the present invention will be described using a stationary game apparatus as an example.

  In FIG. 1, the game system 1 includes a stationary game apparatus (hereinafter referred to as a monitor) 2 connected to a display (hereinafter referred to as a monitor) 2 having a speaker 2a such as a home television receiver via a connection cord. 3) and a controller 7 that gives operation information to the game apparatus 3. The game apparatus 3 is connected to the receiving unit 6 via a connection terminal. The receiving unit 6 receives transmission data wirelessly transmitted from the controller 7, and the controller 7 and the game apparatus 3 are connected by wireless communication. Further, an optical disk 4 as an example of an information storage medium that can be used interchangeably with the game apparatus 3 is attached to and detached from the game apparatus 3. An upper main surface of the game apparatus 3 is provided with a power ON / OFF switch of the game apparatus 3, a game process reset switch, and an OPEN switch for opening the lid of the upper part of the game apparatus 3. Here, when the player presses the OPEN switch, the lid is opened, and the optical disk 4 can be attached and detached.

  Further, an external memory card 5 equipped with a backup memory or the like for storing save data or the like in a fixed manner is detachably attached to the game apparatus 3 as necessary. The game apparatus 3 displays a result as a game image on the monitor 2 by executing a game program or the like stored on the optical disc 4. Furthermore, the game apparatus 3 can reproduce the game state executed in the past by using the save data stored in the external memory card 5 and display the game image on the monitor 2. Then, the player of the game apparatus 3 can enjoy the progress of the game by operating the controller 7 while viewing the game image displayed on the monitor 2.

  The controller 7 wirelessly transmits transmission data from a communication unit 75 (described later) provided therein to the game apparatus 3 to which the receiving unit 6 is connected, using, for example, Bluetooth (registered trademark) technology. The controller 7 is an operation means for operating a player object appearing in a game space mainly displayed on the monitor 2. The controller 7 is provided with an operation unit such as a plurality of operation buttons, keys, and sticks. Further, as will be apparent from the description below, the controller 7 includes an imaging information calculation unit 74 that captures an image viewed from the controller 7. In addition, as an example of an imaging target of the imaging information calculation unit 74, two LED modules (hereinafter referred to as markers) 8L and 8R are installed near the display screen of the monitor 2. These markers 8L and 8R each output infrared light toward the front of the monitor 2.

  Next, the configuration of the game apparatus 3 will be described with reference to FIG. FIG. 2 is a functional block diagram of the game apparatus 3.

  In FIG. 2, the game apparatus 3 includes, for example, a risk (RISC) CPU (Central Processing Unit) 30 that executes various programs. The CPU 30 executes a startup program stored in a boot ROM (not shown), initializes a memory such as the main memory 33, and the like, then executes a game program stored in the optical disc 4, and according to the game program Game processing and the like. A GPU (Graphics Processing Unit) 32, a main memory 33, a DSP (Digital Signal Processor) 34, and an ARAM (Audio RAM) 35 are connected to the CPU 30 via a memory controller 31. The memory controller 31 is connected to a controller I / F (interface) 36, a video I / F 37, an external memory I / F 38, an audio I / F 39, and a disk I / F 41 via a predetermined bus. The receiving unit 6, the monitor 2, the external memory card 5, the speaker 2a, and the disk drive 40 are connected.

  The GPU 32 performs image processing based on an instruction from the CPU 30, and is configured by a semiconductor chip that performs calculation processing necessary for displaying 3D graphics, for example. The GPU 32 performs image processing using a memory dedicated to image processing (not shown) and a partial storage area of the main memory 33. The GPU 32 generates game image data and movie video to be displayed on the monitor 2 using these, and outputs them to the monitor 2 through the memory controller 31 and the video I / F 37 as appropriate.

  The main memory 33 is a storage area used by the CPU 30 and stores game programs and the like necessary for the processing of the CPU 30 as appropriate. For example, the main memory 33 stores a game program read from the optical disc 4 by the CPU 30 and various data. The game program and various data stored in the main memory 33 are executed by the CPU 30.

  The DSP 34 processes sound data generated by the CPU 30 when the game program is executed, and is connected to an ARAM 35 for storing the sound data. The ARAM 35 is used when the DSP 34 performs a predetermined process (for example, storage of a pre-read game program or sound data). The DSP 34 reads the sound data stored in the ARAM 35 and outputs the sound data to the speaker 2 a included in the monitor 2 via the memory controller 31 and the audio I / F 39.

  The memory controller 31 controls the overall data transfer and is connected to the various I / Fs described above. The controller I / F 36 includes, for example, four controller I / Fs 36a to 36d, and connects the external device and the game apparatus 3 that can be fitted to each other via a connector included in the controller I / F 36 so as to communicate with each other. For example, the receiving unit 6 is fitted with the connector and connected to the game apparatus 3 via the controller I / F 36. As described above, the receiving unit 6 receives the transmission data from the controller 7 and outputs the transmission data to the CPU 30 via the controller I / F 36. A monitor 2 is connected to the video I / F 37. An external memory card 5 is connected to the external memory I / F 38 and can access a backup memory or the like provided in the external memory card 5. A speaker 2a built in the monitor 2 is connected to the audio I / F 39 so that sound data read out from the ARAM 35 by the DSP 34 or sound data directly output from the disk drive 40 can be output from the speaker 2a. A disk drive 40 is connected to the disk I / F 41. The disk drive 40 reads data stored on the optical disk 4 arranged at a predetermined reading position, and outputs the data to the bus of the game apparatus 3 and the audio I / F 39.

  The controller 7 will be described with reference to FIGS. 3 and 4. FIG. 3 is a perspective view of the controller 7 as viewed from the upper rear side. FIG. 4 is a perspective view of the controller 7 as viewed from the lower front side.

  3 and 4, the controller 7 includes a housing 71 formed by plastic molding, for example, and the housing 71 is provided with a plurality of operation units 72. The housing 71 has a substantially rectangular parallelepiped shape whose longitudinal direction is the front-rear direction, and is a size that can be gripped with one hand of an adult or a child as a whole.

  A cross key 72 a is provided on the center front side of the upper surface of the housing 71. The cross key 72a is a cross-shaped four-way push switch, and operation portions corresponding to the four directions (front / rear and left / right) are arranged at 90 ° intervals on the protrusions of the cross. The player selects one of the front, rear, left and right directions by pressing one of the operation portions of the cross key 72a. For example, when the player operates the cross key 72a, it is possible to instruct the moving direction of the player character or the like appearing in the virtual game world, or to instruct the moving direction of the cursor.

  Note that the cross key 72a is an operation unit that outputs an operation signal in response to the above-described direction input operation of the player, but may be an operation unit of another mode. For example, four push switches may be provided in the cross direction, and an operation unit that outputs an operation signal according to the push switch pressed by the player may be provided. Further, apart from the four push switches, a center switch may be provided at a position where the cross direction intersects, and an operation unit in which the four push switches and the center switch are combined may be provided. An operation unit that outputs an operation signal in accordance with the tilt direction by tilting a tiltable stick (so-called joystick) protruding from the upper surface of the housing 71 may be provided instead of the cross key 72a. Furthermore, an operation unit that outputs an operation signal corresponding to the sliding direction by sliding a horizontally movable disk-shaped member may be provided instead of the cross key 72a. Further, a touch pad may be provided instead of the cross key 72a.

  A plurality of operation buttons 72 b to 72 g are provided on the rear surface side of the cross key 72 a on the upper surface of the housing 71. The operation buttons 72b to 72g are operation units that output operation signals assigned to the operation buttons 72b to 72g when the player presses the button head. For example, functions as a first button, a second button, and an A button are assigned to the operation buttons 72b to 72d. Further, functions as a minus button, a home button, a plus button, and the like are assigned to the operation buttons 72e to 72g. These operation buttons 72 a to 72 g are assigned with respective operation functions according to the game program executed by the game apparatus 3, and as will become apparent later, the operation functions assigned according to the direction in which the player operates the controller 7. Switch. In the arrangement example shown in FIG. 3, the operation buttons 72 b to 72 d are arranged side by side along the center front-rear direction on the upper surface of the housing 71. Further, the operation buttons 72e to 72g are arranged in parallel between the operation buttons 72b and 72d along the left-right direction of the upper surface of the housing 71. The operation button 72f is a type of button whose upper surface is buried in the upper surface of the housing 71 and is not accidentally pressed by the player.

  An operation button 72h is provided on the front surface side of the cross key 72a on the upper surface of the housing 71. The operation button 72h is a power switch for remotely turning on / off the game apparatus 3 main body. This operation button 72h is also a type of button whose upper surface is buried in the upper surface of the housing 71 and that the player does not accidentally press.

  A plurality of LEDs 702 are provided on the rear surface side of the operation button 72 c on the upper surface of the housing 71. Here, the controller 7 is provided with a controller type (number) to distinguish it from other controllers 7. For example, the LED 702 is used to notify the player of the controller type currently set in the controller 7. Specifically, when transmission data is transmitted from the controller 7 to the receiving unit 6, the LED corresponding to the type among the plurality of LEDs 702 is turned on according to the controller type.

  Further, on the upper surface of the housing 71, a sound release hole is formed between the operation button 72b and the operation buttons 72e to 72g for emitting sound from a speaker (speaker 706 in FIG. 5) described later to the outside.

  On the other hand, a recess is formed on the lower surface of the housing 71. As will be described later, the recess on the lower surface of the housing 71 is formed at a position where the player's index finger or middle finger is positioned when the player grips the front surface of the controller 7 with one hand toward the markers 8L and 8R. The And the operation button 72i is provided in the rear surface side inclined surface of the said recessed part. The operation button 72i is an operation unit that functions as a B button, for example. As will become apparent from the description below, the operation function assigned to the operation button 72i is also switched according to the direction in which the player operates the controller 7.

  An imaging element 743 that constitutes a part of the imaging information calculation unit 74 is provided on the front surface of the housing 71. Here, the imaging information calculation unit 74 is a system for analyzing the image data captured by the controller 7 to determine a location where the luminance is high and detecting the position of the center of gravity, the size, and the like of the location. Since the maximum sampling period is about 200 frames / second, even a relatively fast movement of the controller 7 can be tracked and analyzed. The detailed configuration of the imaging information calculation unit 74 will be described later. A connector 73 is provided on the rear surface of the housing 70. The connector 73 is a 32-pin edge connector, for example, and is used for fitting and connecting with a connection cable, for example.

  Next, the internal structure of the controller 7 will be described with reference to FIGS. FIG. 5 is a perspective view of a state in which the upper casing (a part of the housing 71) of the controller 7 is removed as viewed from the rear side. FIG. 6 is a perspective view of a state in which the lower casing (a part of the housing 71) of the controller 7 is removed as seen from the front side. Here, the substrate 700 shown in FIG. 6 is a perspective view seen from the back surface of the substrate 700 shown in FIG.

  In FIG. 5, a substrate 700 is fixed inside the housing 71, and operation buttons 72a to 72h, an acceleration sensor 701, an LED 702, an antenna 754, and the like are provided on the upper main surface of the substrate 700. These are connected to the microcomputer 751 and the like (see FIGS. 6 and 7) by wiring (not shown) formed on the substrate 700 and the like. Further, the controller 7 functions as a wireless controller by a wireless module 753 (see FIG. 7) and an antenna 754 (not shown). A quartz oscillator 703 (not shown) is provided inside the housing 71 and generates a basic clock for the microcomputer 751 described later. A speaker 706 and an amplifier 708 are provided on the upper main surface of the substrate 700. Since the acceleration sensor 701 is provided in the peripheral portion instead of the central portion of the substrate 700, in addition to the change in the direction of gravity acceleration in accordance with the rotation about the longitudinal direction of the controller 7, the component due to the centrifugal force is included. Therefore, the rotation of the controller 7 can be determined with a good sensitivity from the detected acceleration data by a predetermined calculation.

  On the other hand, in FIG. 6, an imaging information calculation unit 74 is provided at the front edge on the lower main surface of the substrate 700. The imaging information calculation unit 74 includes an infrared filter 741, a lens 742, an imaging element 743, and an image processing circuit 744 in order from the front of the controller 7, and each is attached to the lower main surface of the substrate 700. A connector 73 is attached to the rear edge on the lower main surface of the substrate 700. Further, a sound IC 707 and a microcomputer 751 are provided on the lower main surface of the substrate 700. The sound IC 707 is connected to the microcomputer 751 and the amplifier 708 through wiring formed on the substrate 700 or the like, and outputs an audio signal to the speaker 706 via the amplifier 708 according to the sound data transmitted from the game apparatus 3. A vibrator 704 is attached on the lower main surface of the substrate 700. The vibrator 704 is, for example, a vibration motor or a solenoid. Since the vibration is generated in the controller 7 by the operation of the vibrator 704, the vibration is transmitted to the hand of the player holding it, and a so-called vibration-compatible game can be realized. Since the vibrator 704 is arranged slightly forward of the housing 71, the housing 71 vibrates greatly when the player is holding it, and it is easy to feel the vibration.

  Next, the internal configuration of the controller 7 will be described with reference to FIG. FIG. 7 is a block diagram showing the configuration of the controller 7.

  In FIG. 7, the controller 7 includes a communication unit 75 in addition to the above-described operation unit 72, imaging information calculation unit 74, acceleration sensor 701, speaker 706, sound IC 707, and amplifier 708.

  The imaging information calculation unit 74 includes an infrared filter 741, a lens 742, an imaging element 743, and an image processing circuit 744. The infrared filter 741 allows only infrared rays to pass from light incident from the front of the controller 7. The lens 742 condenses the infrared light that has passed through the infrared filter 741 and outputs the condensed infrared light to the image sensor 743. The imaging element 743 is a solid-state imaging element such as a CMOS sensor or a CCD, for example, and images the infrared rays collected by the lens 742. Therefore, the image sensor 743 captures only the infrared light that has passed through the infrared filter 741 and generates image data. Image data generated by the image sensor 743 is processed by an image processing circuit 744. Specifically, the image processing circuit 744 processes the image data obtained from the image sensor 743 to detect high-luminance portions, and transmits processing result data indicating the result of detecting the position coordinates and area of the communication unit 75. Output to. The imaging information calculation unit 74 is fixed to the housing 71 of the controller 7, and the imaging direction can be changed by changing the direction of the housing 71 itself. As will be apparent from the following description, a signal corresponding to the position and movement of the controller 7 can be obtained based on the processing result data output from the imaging information calculation unit 74.

  The controller 7 preferably includes a triaxial (X, Y, Z axis) acceleration sensor 701. The three-axis acceleration sensor 701 detects linear acceleration in three directions, that is, an up-down direction, a left-right direction, and a front-rear direction. In other embodiments, depending on the type of control signal used in the game process, biaxial acceleration detection that detects only linear acceleration along each of the vertical and horizontal directions (or other paired directions). Means may be used. For example, the triaxial or biaxial acceleration sensor 701 may be of the type available from Analog Devices, Inc. or ST Microelectronics NV. The acceleration sensor 701 may be a capacitance type (capacitive coupling type) based on a MEMS (Micro Electro Mechanical Systems) technique in which silicon is finely processed. However, the triaxial or biaxial acceleration sensor 701 may be provided by using existing acceleration detecting means technology (for example, a piezoelectric method or a piezoresistive method) or other appropriate technology developed in the future.

  As known to those skilled in the art, the acceleration detection means used in the acceleration sensor 701 can detect only the acceleration (linear acceleration) along a straight line corresponding to each axis of the acceleration sensor. That is, the direct output from the acceleration sensor 701 is a signal indicating linear acceleration (static or dynamic) along each of the two or three axes. For this reason, the acceleration sensor 701 cannot directly detect physical characteristics such as movement, rotation, rotational movement, angular displacement, inclination, position, or posture along a non-linear (for example, arc) path.

  However, it is easy for those skilled in the art to estimate or calculate further information regarding the controller 7 by performing additional processing on the acceleration signal output from the acceleration sensor 701 from the description of the present specification. Will understand. For example, when static acceleration (gravity acceleration) is detected, the output of the acceleration sensor 701 is used to calculate the inclination of the target (controller 7) with respect to the gravity vector by calculation using the inclination angle and the detected acceleration. Each can be guessed. Thus, by using the acceleration sensor 701 in combination with the microcomputer 751 (or other processor), the inclination, posture or position of the controller 7 can be determined. Similarly, when the controller 7 including the acceleration sensor 701 is dynamically accelerated, for example, by a user's hand and moved, the various movements of the controller 7 are processed by processing the acceleration signal generated by the acceleration sensor 701. And / or position can be calculated or inferred, respectively. In another embodiment, the acceleration sensor 701 is a built-in signal processing device or the like for performing desired processing on the acceleration signal output from the built-in acceleration detection means before outputting the signal to the microcomputer 751. This type of processing device may be provided. For example, a built-in or dedicated processing device converts the detected acceleration signal into a corresponding tilt angle when the acceleration sensor is for detecting static acceleration (for example, gravitational acceleration). There may be. Data indicating the acceleration detected by the acceleration sensor 701 is output to the communication unit 75.

  In an example of another embodiment, a gyro sensor incorporating a rotation element or a vibration element may be used instead of the acceleration sensor 701. An example of a MEMS gyro sensor used in this embodiment is available from Analog Devices, Inc. Unlike the acceleration sensor 701, the gyro sensor can directly detect rotation (or angular velocity) about the axis of at least one gyro element incorporated therein. As described above, since the gyro sensor and the acceleration sensor are basically different from each other, it is necessary to appropriately change the processing to be performed on the output signals from these devices depending on which device is selected for each application. There is.

  Specifically, when the inclination or posture is calculated using a gyro sensor instead of the acceleration sensor, a significant change is made. That is, when the gyro sensor is used, the inclination value is initialized in the detection start state. Then, the angular velocity data output from the gyro sensor is integrated. Next, a change amount of the inclination from the initialized inclination value is calculated. In this case, the calculated inclination is a value corresponding to the angle. On the other hand, when the inclination is calculated by the acceleration sensor, the inclination is calculated by comparing the value of the component relating to each axis of the gravitational acceleration with a predetermined reference, so the calculated inclination can be expressed by a vector. Thus, it is possible to detect the absolute direction detected using the acceleration detecting means without performing initialization. In addition, the property of the value calculated as the inclination is an angle when a gyro sensor is used, but a vector when an acceleration sensor is used. Therefore, when a gyro sensor is used instead of the acceleration sensor, it is necessary to perform predetermined conversion in consideration of the difference between the two devices with respect to the tilt data. Since the characteristics of the gyroscope as well as the basic differences between the acceleration detection means and the gyroscope are known to those skilled in the art, further details are omitted here. While the gyro sensor has the advantage of being able to directly detect rotation, in general, the acceleration sensor has the advantage of being more cost effective than the gyro sensor when applied to a controller as used in this embodiment. Have.

  The communication unit 75 includes a microcomputer (microcomputer) 751, a memory 752, a wireless module 753, and an antenna 754. The microcomputer 751 controls the wireless module 753 that wirelessly transmits transmission data while using the memory 752 as a storage area during processing. The microcomputer 751 controls the operations of the sound IC 707 and the vibrator 704 in accordance with data from the game apparatus 3 received by the wireless module 753 via the antenna 754. The sound IC 707 processes sound data transmitted from the game apparatus 3 via the communication unit 75.

  An operation signal (key data) from the operation unit 72 provided in the controller 7, an acceleration signal from the acceleration sensor 701 (X, Y, and Z-axis direction acceleration data; hereinafter simply referred to as acceleration data), and imaging information The processing result data from the calculation unit 74 is output to the microcomputer 751. The microcomputer 751 temporarily stores each input data (key data, acceleration data, processing result data) in the memory 752 as transmission data to be transmitted to the receiving unit 6. Here, the wireless transmission from the communication unit 75 to the receiving unit 6 is performed every predetermined cycle, but since the game processing is generally performed in units of 1/60 seconds, it is shorter than that. It is necessary to transmit at periodic intervals. Specifically, the processing unit of the game is 16.7 ms (1/60 seconds), and the transmission interval of the communication unit 75 configured by Bluetooth (registered trademark) is 5 ms. When the transmission timing to the receiving unit 6 comes, the microcomputer 751 outputs the transmission data stored in the memory 752 as a series of operation information and outputs it to the wireless module 753. The wireless module 753 then modulates the operation information using a carrier wave having a predetermined frequency based on, for example, Bluetooth (registered trademark) technology, and radiates the radio signal from the antenna 754. That is, key data from the operation unit 72 provided in the controller 7, acceleration data from the acceleration sensor 701, and processing result data from the imaging information calculation unit 74 are modulated into radio signals by the wireless module 753 and transmitted from the controller 7. Is done. The reception unit 6 of the game apparatus 3 receives the radio signal, and the game apparatus 3 demodulates and decodes the radio signal to obtain a series of operation information (key data, acceleration data, and processing result data). To do. And CPU30 of the game device 3 performs a game process based on the acquired operation information and a game program. When the communication unit 75 is configured using Bluetooth (registered trademark) technology, the communication unit 75 can also have a function of receiving transmission data wirelessly transmitted from other devices.

  Next, before describing specific processing performed by the game apparatus 3, an outline of a game performed by the game apparatus 3 will be described. In the game, at least two operation modes (first operation mode and second operation mode) are set, and the viewpoint of the game image displayed on the monitor 2 is switched.

  FIG. 8 shows an example in which the player operates the controller 7 in the first operation mode set for the game. FIG. 9 is an example of a state in which the player holds the controller 7 sideways and grips it with both hands in the first operation mode, as viewed from the side of the controller 7. As shown in FIGS. 8 and 9, in the first operation mode, for example, the player holds and operates the controller 7 with both hands with the long axis direction of the controller 7 being horizontal. Specifically, the player holds the front side of the controller 7 with the left hand, holds the rear side of the controller 7 with the right hand, and uses the left and right fingers to operate the operation unit 72 (for example, the cross key 72a and the operation buttons 72b to 72g). A game operation is performed by pressing the button. In this case, the controller 7 is gripped so that the side surface of the controller 7 (the right side surface in the examples of FIGS. 8 and 9) faces the display screen of the monitor 2. For example, the player attaches both palms to the front and rear surfaces of the controller 7, and attaches an index finger, middle finger, ring finger, and little finger to the lower surface of the controller 7. Then, the thumbs of both hands are attached to the operation unit 72 (for example, the vicinity of the cross key 72a or the operation buttons 72b to 72d) provided on the upper surface of the controller 7. At this time, since the controller 7 has a vertically long shape and the cross key 72a is disposed at one end portion in the longitudinal direction, the cross key 72a with the thumb of one hand or the like when the player holds the controller 7 sideways. The operation of becomes easier. Further, since the operation button 72b and the operation button 72c are disposed at the other end portion in the longitudinal direction, the operation can be easily performed with the thumb of the other hand when the user holds the device sideways. On the other hand, the operation button 72i is difficult to operate because it is a blind spot of the player when the player holds the controller 7 as shown in FIG. The player's finger is naturally separated from 72i. Thus, in the first operation mode, the operation unit 72 such as the cross key 72a and the operation buttons 72b to 72d can be easily operated in a state where the player holds the controller 7 sideways.

  FIG. 10 shows an example in which the player operates the controller 7 in the second operation mode set for the game. FIG. 11 is an example of a state in which the player holds the controller 7 with the right hand as viewed from the front side of the controller 7 in the second operation mode. FIG. 12 is an example of a state in which the player holds the controller 7 with the right hand as viewed from the left side of the controller 7 in the second operation mode. As shown in FIGS. 10 to 12, in order to play the game in the second operation mode, the front surface of the controller 7 (the light entrance side imaged by the imaging information calculation unit 74) faces the display screen of the monitor 2. Thus, the player holds the controller 7 with one hand (for example, the right hand). When the player's thumb is attached to the upper surface of the controller 7 (for example, near the operation button 72d) and the player's index finger is attached to a concave portion (for example, near the operation button 72i) of the controller 7, it is provided on the front surface of the controller 7. The light incident port of the imaging information calculation unit 74 is exposed in the forward direction of the player. On the other hand, in the vicinity of the display screen of the monitor 2, two markers 8L and 8R are installed. These markers 8 </ b> L and 8 </ b> R each output infrared light toward the front of the monitor 2 and become imaging targets of the imaging information calculation unit 74. The markers 8L and 8R may be provided integrally with the monitor 2 or may be provided separately from the monitor 2 and placed near the monitor 2 (such as above or below the monitor 2) for use. It may be a thing. It goes without saying that such a gripping state with respect to the controller 7 can be similarly performed even with the left hand of the player.

  As described above, in the second operation mode, the controller 7 can easily operate the operation units 72 such as the operation buttons 72d and 72i in a state where the player holds with one hand. Further, when the player holds the controller 7 with one hand, the light incident port of the imaging information calculation unit 74 provided on the front surface of the controller 7 is exposed, so the infrared light from the two markers 8L and 8R described above. Can be easily taken in from the light entrance. That is, the player can hold the controller 7 with one hand without hindering the function of the imaging information calculation unit 74. Here, since the controller 7 has a vertically long shape, and the light incident port of the imaging information calculation unit 74 is disposed in front of the longitudinal end portion, the player uses the imaging information calculation unit 74 to control the player. It is suitable for the operation to point. On the other hand, when the player holds the controller 7 vertically as shown in FIG. 12, the operation button 72 i can be easily operated with the player's finger because it is disposed on the rear inclined surface of the concave portion of the controller 7. Thus, in the second operation mode, the imaging information calculation unit 74 and the operation unit 72 can be easily operated in a state where the player holds the controller 7 while holding the controller 7 vertically.

  Here, as shown in FIG. 13, the markers 8L and 8R each have a viewing angle θ1. Further, the image sensor 743 has a viewing angle θ2. For example, the viewing angles θ1 of the markers 8L and 8R are both 34 ° (half-value angle), and the viewing angle θ2 of the image sensor 743 is 41 °. When the markers 8L and 8R are both present in the viewing angle θ2 of the imaging device 743, and the imaging device 743 is present in the viewing angle θ1 of the marker 8R and in the viewing angle θ1 of the marker 8R, the game device 3 calculates the position of the controller 7 using the position data relating to the high luminance point by the two markers 8L and 8R.

  When the player holds the controller 7 so that the front surface thereof faces the monitor 2, infrared light output from the two markers 8 </ b> L and 8 </ b> R enters the imaging information calculation unit 74. Then, the imaging device 743 captures the incident infrared light through the infrared filter 741 and the lens 742, and the image processing circuit 744 processes the captured image. Here, the imaging information calculation unit 74 detects the infrared component output from the markers 8L and 8R, whereby position information (position of the target image), area, diameter, and width of the markers 8L and 8R in the captured image. Get size information. Specifically, the image processing circuit 744 analyzes the image data captured by the image sensor 743, and first excludes images that cannot be infrared light from the markers 8L and 8R from the area information, and further increases the luminance. The point is determined as the position of each of the markers 8L and 8R. Then, the imaging information calculation unit 74 acquires position information such as the barycentric position of the determined bright spots and outputs it as the processing result data. Here, the position information as the processing result data may be output as a coordinate value with a predetermined reference point in the captured image (for example, the center or upper left corner of the captured image) as the origin, and a bright spot at a predetermined timing The position may be used as a reference point, and the difference in the current bright spot position from the reference position may be output as a vector. That is, the position information of the target image is a parameter used as a difference with respect to the reference point when a predetermined reference point is set for the captured image captured by the image sensor 743. By transmitting such position information to the game apparatus 3, in the game apparatus 3, based on the difference of the position information from the reference, the imaging information calculation unit 74 for the markers 8L and 8R, that is, the movement and posture of the controller 7 The amount of change in signal according to the position or the like can be obtained. Specifically, since the position of the high luminance point in the image transmitted from the communication unit 75 is changed by moving the controller 7, direction input or coordinate input corresponding to the change in the position of the high luminance point is performed. By doing so, it is possible to perform direction input and coordinate input along the moving direction of the controller 7 in the three-dimensional space. In the game processing operation example to be described later, an example is used in which the imaging information calculation unit 74 acquires at least the coordinates of the center of gravity of each of the target images of the markers 8L and 8R in the captured image and outputs it as the processing result data.

  As described above, the image processing unit 74 of the controller 7 captures a fixedly installed marker (in the embodiment, infrared light from the two markers 8L and 8R), thereby performing game processing in the game apparatus 3. In this case, the data output from the controller 7 is processed so that the operation corresponding to the movement, posture, position, etc. of the controller 7 can be performed. It becomes. Further, as described above, since the markers 8L and 8R are installed in the vicinity of the display screen of the monitor 2, the position with respect to the markers 8L and 8R is converted into the movement, posture, position, etc. of the controller 7 with respect to the display screen of the monitor 2. It is also easy to do. That is, the processing result data based on the movement, posture, position, and the like of the controller 7 can be used as an operation input that directly acts on the display screen of the monitor 2. Therefore, in the second operation mode, it is possible to provide an operation input in which the movement of the player's hand acts directly on the display screen by moving the hand holding the controller 7 with respect to the display screen of the monitor 2. The controller 7 functions as a pointing device that can output data for remotely designating coordinates on the display screen.

  Further, in any of the first operation mode and the second operation mode, by using the output (acceleration data) from the acceleration sensor 701 provided in the controller 7 as described above, the tilt, posture, or position of the controller 7 is used. Can be determined. That is, when the player moves his / her hand holding the controller 7 up / down / left / right, etc., the controller 7 functions as an operation input means corresponding to the movement and orientation of the player's hand.

  In the game of the present embodiment, the game images (objective image and subjective image) displayed on the monitor 2 are switched according to the first operation mode and the second operation mode. The objective image is an image obtained by objectively viewing the player character and the surrounding virtual game space, and the subjective image is an image obtained by subjectively viewing the virtual game space from the player character.

  FIG. 14 is an example of an objective image displayed on the monitor 2 in the first operation mode. FIG. 15 is a bird's-eye schematic view of the position of the virtual camera C when generating an objective image as viewed from above the player character P. As shown in FIG. 14, in the first operation mode, an action game or the like is represented on the monitor 2 in accordance with operation information (key data, acceleration data) received from the controller 7 excluding the processing result data. Specifically, in the first operation mode, the player character P is positioned relatively far in the lateral direction (the lateral direction with respect to the player character's orientation or the lateral direction with respect to the traveling direction of the player character). The virtual game space with the gazing point at the player character P (or its vicinity) from the viewpoint in the virtual game space to be displayed is represented on the monitor 2 as a three-dimensional game image (this game image is described as an objective image) . Then, a player character P, an enemy character E, and the like operated by the player are arranged in the virtual game space S and expressed on the monitor 2. As shown in FIG. 14, according to the objective image set in the first operation mode, the whole body of the player character P is represented, and a field of view over which the game world including the player character P is objectively widened is a game. Generated with images.

  An example of parameter settings for the virtual camera C when generating an objective image will be described with reference to FIG. A route R is set in the space S in advance, and the player character P is set to be movable on the route R. That is, when the left side of the cross key 72a is pressed, the player character P moves on the route R to the left, and when the right side of the cross key 72a is pressed, the player character P moves on the route R to the right. The gazing point of the virtual camera C is set to the current position Ph of the player character P in the space S (for example, the position coordinates (xh, yh, zh) of the head of the player character P). Note that the point of sight of the virtual camera C is a point away from the current position Ph by a certain distance (for example, the forward direction or the traveling direction of the player character P, the attack direction by the player character P (the direction in which the gun is facing, etc.)) Or a point separated by a certain distance along the route R. However, even in this case, it is preferable that the certain distance is sufficiently small with respect to the range of the game space photographed by the virtual camera C, and the distance from the gazing point to the player character P is from the viewpoint to the player character P. It is preferable to make it smaller than the distance.

  On the other hand, the viewpoint of the virtual camera C is a point Cph (xcp) in the virtual game space determined corresponding to each position Ph (xh, yh, zh) of the player character P (that is, each point on the route R). , Ycp, zcp) based on the direction Pd of the player character P (the direction is, for example, the forward direction or the traveling direction of the player character P, but may be the attacking direction by the player character P). It is set at a position deviating from the reference. Specifically, the direction from the viewpoint to the gazing point and the distance between the gazing point and the gazing point are set in advance corresponding to each point on the route R, and the position Ph (xh, yh, zh) Let a point Cph (xcp, ycp, zcp) be a distance from the distance in the direction corresponding to the position by the distance. For example, the direction from the point Cph to the gazing point is set to a horizontal direction perpendicular to the route R. Further, the distance between the point Cph and the gazing point is set to several times (for example, about 8 times) a predetermined distance (for example, the shoulder width of the player character P). The viewpoint of the virtual camera C is the direction Pd of the player character P (the direction is, for example, the attack direction by the player character P (the muzzle direction of the gun G possessed by the player character P)), but the forward direction of the player character Alternatively, it may be set in a position shifted several times (for example, about 5 times) the predetermined distance from the point Cph in the opposite direction (that is, backward) to the traveling direction.

  Note that the viewpoint of the virtual camera C may be set to the point Cph. Further, in the present embodiment, the above-described direction and distance are set corresponding to each of the positions of the player character P (each of the points on the route R), so that depending on the situation of the game space and the situation of the game The above direction and distance can be arbitrarily changed. However, with the above direction and distance fixed, for example, a direction (such as a substantially vertical direction) based on the trajectory direction of the route R or the forward direction or the traveling direction of the player character P is used as the line-of-sight direction, or from the viewpoint. The distance up to may be made constant.

  Note that the position and direction of the virtual camera C in the objective image described above are basic settings in the first operation mode, and the virtual camera C moves from the basic position in response to an operation on the controller 7 in the first operation mode. Sometimes. However, in the first operation mode, even if the player moves from the basic position, an image is generated that is objectively overlooked from the distant position of the space S with the position of the player character P or the vicinity thereof as a gazing point. In the invention, such an image is defined as an objective image.

  In the above description, the virtual space is photographed with the viewpoint of a relatively far side of the player character P and the current position of the player character P as a gazing point. The virtual game space may be photographed with the current position of P as the gazing point. In the above description, the positions of the viewpoint and the gazing point in the horizontal plane have been mainly described. However, the positions of the viewpoint and the gazing point in the height direction may coincide with the current position of the player character P. It may be set at a high position (in some cases, it may be installed at a low position).

  FIG. 16 is an example of a subjective image displayed on the monitor 2 in the second operation mode. FIG. 17 is a schematic view of the position of the virtual camera C when the subjective image is generated as viewed from the side of the player character P. As shown in FIG. 16, in the second operation mode, an action game or the like is represented on the monitor 2 according to operation information (key data, acceleration data, processing result data) received from the controller 7. Specifically, in the second operation mode, the virtual game space viewed from the viewpoint in the virtual game space that substantially matches the position of the player character P is represented on the monitor 2 as a three-dimensional game image. (This game image is described as a subjective image). As shown in FIG. 16, according to the subjective image set in the second operation mode, a field of view in which a part of the player character P is represented and the player character P is subjectively looking at the space S. Is generated with a game image.

  An example of the position of the virtual camera C in the subjective image will be described with reference to FIG. The gazing point of the virtual camera C is set in front of the player character P with reference to the position Ph of the player character P in the space S. Specifically, the horizontal position of the gazing point of the virtual camera C is a predetermined distance from the position coordinates Ph (xh, yh, zh) of the head of the player character P to the front (forward direction or traveling direction of the player character P). The position is further shifted by several times (for example, about 4 times) the predetermined distance from the position separated by (for example, the shoulder width of the player character P) in the attack direction of the player character P (muzzle direction of the gun G possessed by the player character). The position (T1 in the figure) is set. Further, the vertical position of the gazing point of the virtual camera C is a position (T2 in the figure) shifted downward from the position coordinates Ph (xh, yh, zh) by a fraction (for example, about 1/4) of the predetermined distance. Set to

  On the other hand, the viewpoint of the virtual camera C is set near the rear of the player character P with reference to the position Ph of the player character P in the space S. Specifically, the horizontal position of the viewpoint of the virtual camera C is determined by the player character P's attack direction (possibly possessed by the player character P from a position that is a predetermined distance away from the position coordinate Ph (xh, yh, zh) in front. A position shifted by several times (for example, about twice) the predetermined distance in the direction opposite to the muzzle direction of the gun G to be operated (illustrated V1; substantially, a position separated backward from the position coordinate Ph by the predetermined distance). ). Further, the vertical position of the viewpoint of the virtual camera C is shifted from the position coordinates Ph (xh, yh, zh) by about the size of the head of the player character P (about ¼ of the predetermined distance) ( V2) shown in the figure. Note that the horizontal position of the viewpoint of the virtual camera C is further changed from the position of V2 to the right or left direction of the player character P (rightward or orthogonal to the direction or direction of travel of the player character P). A position shifted by about half the predetermined distance in the left direction may be set as the viewpoint. In addition, when switching to the second operation mode while moving right on the route R in the first operation mode, the player character P is shifted to the right direction, and on the route R in the first operation mode. When the player character P is switched to the second operation mode while proceeding in the left direction, the player character P may be shifted in the left-right direction.

  In FIG. 17, a line extending left and right from the position Ph of the head of the player character P indicates the line-of-sight direction of the player character P (different from the line-of-sight direction of the virtual camera C). In the above description, it has been described that the line-of-sight direction of the player character P is the horizontal direction. When the line-of-sight direction of the player character P is tilted up and down, the line extending left and right in FIG. 17 is also tilted, and the gazing point of the virtual camera C is a point on the line extending left and right (a point away from Ph by T1). The point of the virtual camera C is shifted downward by V2 from the point on the line extending left and right (the point separated from Ph by V1).

  Further, the position and direction of the virtual camera C in the subjective image described above are basic settings in the second operation mode, and the virtual camera C moves from the basic position in response to an operation on the controller 7 in the second operation mode. Sometimes. However, in the second operation mode, even if the player character P is moved from the basic position, the position near or coincides with the position of the player character P is regarded as a viewpoint, and in the present invention, such a game image is defined as a subjective image.

  As apparent from a comparison between FIG. 14 and FIG. 16, the game image based on the objective image is a suitable image when the player character P moves in the space S because the space S around the player character P can be widely viewed. It is. On the other hand, the game image based on the subjective image is an image suitable for the situation where the enemy character E is shot with the gun G because the player character P is in the field of view as if looking at the space S. Further, the position of the aiming cursor T (shooting position) is directly indicated by moving the hand holding the controller 7 by the player with respect to the display screen of the monitor 2, and the operation buttons 72d and 72i (see FIG. 3). ) Is controlled so that the gun G possessed by the player character P is fired toward the aiming cursor T, thereby obtaining an operational feeling as if the player is shooting the enemy character E. It is done.

  Next, the details of the game process performed in the game system 1 will be described. First, main data used in the game process will be described with reference to FIGS. FIG. 18 is a diagram illustrating an example of main programs and data stored in the main memory 33 of the game apparatus 3. FIG. 19 is a diagram illustrating an example of the first operation table data Dc4 stored in the main memory 33. FIG. 20 is a diagram illustrating an example of the second operation table data Dc5 stored in the main memory 33.

  As shown in FIG. 18, the main memory 33 stores a game program GP, operation information Da, operation state information Db, game information Dc, and the like. In the main memory 33, in addition to the data included in the information shown in FIG. 18, other data related to the player character appearing in the game, enemy character data, and game space data (terrain data, etc.) Necessary data is stored.

  The game program GP is a program that the CPU 30 reads a program necessary for processing from the optical disc 4 and stores it appropriately, and is a program that defines game processing (step 50 to step 94 described later). Game processing is started by the start of execution of the game program GP.

  The operation information Da is a series of operation information transmitted as transmission data from the controller 7, and is updated to the latest operation information. The operation information Da includes first coordinate data Da1 and second coordinate data Da2 corresponding to the processing result data described above. The first coordinate data Da1 is coordinate data representing the position (position in the captured image) of one of the two markers 8L and 8R with respect to the captured image captured by the image sensor 743. The second coordinate data Da2 is coordinate data representing the position of the image of the other marker (position in the captured image). For example, the position of the marker image is represented by an XY coordinate system in the captured image.

  The operation information Da includes coordinate data (first coordinate data Da1 and second coordinate data Da2) as an example of processing result data obtained from the captured image, as well as key data Da3 and acceleration sensor 701 obtained from the operation unit 72. The acceleration data Da4 obtained from the above is included. The receiving unit 6 provided in the game apparatus 3 receives operation information Da transmitted from the controller 7 at a predetermined interval, for example, every 5 ms, and is stored in a buffer (not shown) provided in the receiving unit 6. Thereafter, the game processing interval is read, for example, every frame (1/60 seconds), and the latest information is stored in the main memory 33.

  The operation state information Db is information obtained by determining the operation state of the controller 7 based on the captured image. The operation state information Db is data obtained from the position and orientation of the target image (marker) included in the captured image. Specifically, the direction data Db1, the midpoint data Db2, the screen coordinate data Db3, and the check counter data Db4. And valid flag data Db5 and the like. The direction data Db1 is data indicating a direction from the first coordinate data Da1 to the second coordinate data Da2. For example, the direction data Db1 is vector data having the position of the first coordinate data Da1 as the start point and the position of the second coordinate data Da2 as the end point. The midpoint data Db2 indicates the coordinates of the midpoint between the first coordinate data Da1 and the second coordinate data Da2. Here, when the images of two markers (markers 8L and 8R) are viewed as one target image, the midpoint data Db2 indicates the position of the target image. The screen coordinate data Db3 is position data in the screen coordinate system indicating the position indicated by the controller 7 with respect to the display screen of the monitor 2, and is calculated using the direction data Db1 and the midpoint data Db2. The check counter data Db4 is data indicating the check counter value CC. The check counter value CC indicates the number of times that the position indicated by the controller 7 is continuously within a predetermined range by a positive integer, and indicates the number of times that the position is continuously outside the predetermined range by a negative integer. The valid flag data Db5 is data indicating the state of the valid flag f. The valid flag f is set to true when the processing result data from the controller 7 can be used for game processing, and when the processing result data cannot be used for game processing. Set to invalid.

  The game information Dc includes designated position data Dc1, player character position data Dc2, virtual camera data Dc3, first operation table data Dc4, second operation table data Dc5, image data Dc6, and the like. The designated position data Dc1 is coordinate data indicating the position of the virtual game space corresponding to (overlapping with) the screen coordinates on the virtual three-dimensional game image displayed on the display screen based on the screen coordinate data Db3. The player character position data Dc2 is coordinate data indicating the position of the virtual game space where the player character P is placed. The virtual camera data Dc3 is data indicating the viewpoint position and line-of-sight direction of the virtual game space where the virtual camera C is arranged. The first operation table data Dc4 and the second operation table data Dc5 are data indicating game control process contents corresponding to the operation means in the first operation mode and the second operation mode, respectively. The image data Dc6 includes player character image data, other character image data, background image data, and the like, and is data for arranging a player character and other characters in the virtual game space to generate a game image.

  An example of the first operation table data Dc4 will be described with reference to FIG. The first operation table data Dc4 is data indicating a first operation table in which game control processing content corresponding to the player's operation is described in the first operation mode described above. For example, in the first operation table, the virtual key is displayed in response to the player pressing down a vertical protruding piece of the cross key (operation button 72a) (a horizontal protruding piece when viewed from the player when the controller 7 is held sideways). It is described that the player character P moves left and right in the game space. It is described that the player character P crouches in the virtual game space in response to the player pressing the left-side protruding piece of the cross key (when the controller 7 is held sideways, the downward protruding piece as viewed from the player). Has been. It is described that the player character P shoots the first beam in response to the player pressing the first button (the operation button 72b). Shooting the first beam after the player character P is charged in response to the player depressing (long-pressing) the No. 1 button for a predetermined time (stopping and releasing) the No. 1 button. Is described. In response to the player pressing the first button while pressing the right-side protruding piece of the cross key (the protruding piece upward when viewed from the player when the controller 7 is held sideways), the player character P receives the first beam. It is described to shoot a second beam different from. It is described that the player character P jumps in the virtual game space in response to the player pressing the second button (the operation button 72c). It is described that the distance between the virtual camera C and the player character P is increased in response to the player pressing the A button (operation button 72d). Then, according to the inclination of the controller 7 calculated using the acceleration data Da4, the muzzle direction of the gun G possessed by the player character P (the attack direction of the player character P and the bullet firing direction) can be changed. Has been described (ie, the bullet firing direction parameter is determined). Specifically, for example, when the left end of the controller is lifted upward while being held sideways, the bullet firing direction is set to be the upper left direction from the position of the player character.

  In this embodiment, as will be described later, since the player character P moves on the route R, the movement control of the player character P is performed only in the left and right direction of the cross key, but the player character P is limited to the route R. If the player character P can move freely, the player character P may be moved in the other direction by an instruction in the up / down direction of the cross key.

  An example of the second operation table data Dc5 will be described with reference to FIG. The second operation table data Dc5 is data indicating a second operation table in which game control processing content corresponding to the player's operation is described in the second operation mode described above. For example, the second operation table describes that the player moves the aiming cursor T to the position of the screen coordinates pointed by the controller 7 (the aiming cursor T indicates the shooting position, and the aiming cursor T The bullet firing direction parameter is determined by moving T. More specifically, the direction connecting the position in the virtual game space corresponding to the aiming cursor T and the position of the player character is set as the firing direction parameter. ). It is described that the direction of the virtual camera C is changed in response to the player pointing the peripheral area of the game image with the controller 7 while pressing the B button (operation button 72i). It is described that the player character P shoots the first beam in response to the player pressing the A button. It is described that the player character P shoots the first beam after charging when the player presses the A button for a long time and then releases the A button. It is described that the player character P shoots the first missile in response to releasing only the A button after the player presses the A button and the B button. It is described that the player character P shoots a second missile different from the first missile in response to a long press and release of the A button after the player presses the A button and the B button.

  It is described that the player character P jumps in the virtual game space when the motion of the controller 7 calculated using the acceleration data Da4 is a swinging motion. It is described that the player character P looks back in the virtual game space when the movement of the controller 7 calculated using the acceleration data Da4 is a pulling action. It is described that the viewpoint of the virtual camera C moves to the head of the player character P (that is, moves to the position Ph described above) while the player presses the B button. Further, when the player moves the controller 7 up and down while holding down the A button while pointing the virtual game space (pseudo three-dimensional image) with the aiming cursor T on the controller 7, the aiming cursor Shoot a second beam different from the first beam at the position in the virtual game space pointed to by T (or a weapon such as a chain with a chain at the tip may fly) It is described. In this case, by pressing the A button, the determination in step 84 described later becomes YES, and even if the position coordinates of the screen coordinate system pointed to by the controller 7 are not within the predetermined range due to the swing of the controller 7, the objective is Switching to the target image and switching to the first operation mode are not performed.

  In the present embodiment, control is performed so that bullets are fired at the position of the virtual game space corresponding to the position of the aiming cursor T. You may control so that the player character P moves toward.

  As is apparent from a comparison between the first operation table and the second operation table, the game control process contents corresponding to the operation means are different. For example, in response to the player pressing the A button, the position of the virtual camera C is changed in the first operation table, but the player character P shoots the first beam in the second operation table. In the first operation table, the processing result data from the imaging information calculation unit 74 and the process using the B button are not described. This is because, in the first operation mode, the player holds the controller 7 sideways, so that it is difficult to press the B button, and the imaging information calculation unit 74 cannot capture the markers 8L and 8R. This is because it is difficult to use the operation means. Thus, in the first operation table and the second operation table, game control content suitable for the player's operation is described in accordance with the operation mode switched according to the direction in which the player holds the controller 7 or the direction indicated by the controller 7. The

  Next, with reference to FIG. 21 and FIG. 22, the details of the game process performed in the game apparatus 3 will be described. FIG. 21 is a flowchart showing the first half of the game process executed in the game apparatus 3. FIG. 22 is a flowchart showing the second half of the game process executed in the game apparatus 3. In the flowcharts shown in FIG. 21 and FIG. 22, the game process relating to the switching of the operation mode using the controller 7 is mainly described among the game processes, and the other game processes not directly related to the present invention are described in detail. Description is omitted. 21 and 22, each step executed by the CPU 30 is abbreviated as “S”.

  When the power of the game apparatus 3 is turned on, the CPU 30 of the game apparatus 3 executes a startup program stored in a boot ROM (not shown), thereby initializing each unit such as the main memory 33. Then, the game program stored in the optical disc 4 is read into the main memory 33, and the CPU 30 starts executing the game program. The flowcharts shown in FIG. 21 and FIG. 22 are flowcharts showing the game process performed after the above process is completed.

  In FIG. 21, the CPU 30 performs an initial setting of the game process (step 50), and advances the process to the next step. For example, the CPU 30 sets the check counter value CC to 0 and stores it as check counter data Db4. Further, the CPU 30 sets the valid flag f to false and stores it as valid flag data Db5.

  Next, the CPU 30 acquires the operation information received from the controller 7 (step 51), and advances the processing to the next step. Then, the CPU 30 stores the operation information as operation information Da in the main memory 33. Here, the operation information acquired in step 51 includes coordinate data (first coordinate data Da1 and second coordinate data Da2) indicating the positions of the markers 8L and 8R in the captured image, and the operation unit 72 of the controller 7. Includes data (key data Da3) indicating how the data is operated, and data (acceleration data Da4) indicating the acceleration detected by the acceleration sensor 701. Here, the communication unit 75 transmits the operation information to the game apparatus 3 at a predetermined time interval (for example, at an interval of 5 ms). The CPU 30 uses operation information for each frame. Therefore, the processing loop from step 51 to step 94 shown in FIGS. 21 and 22 is repeatedly executed for each frame.

  Next, the CPU 30 determines whether valid processing result data (first coordinate data Da1 and second coordinate data Da2) is obtained from the controller 7 (step 52). For example, the CPU 30 captures at least one of the markers 8L and 8R when at least one of the first coordinate data Da1 and the second coordinate data Da2 is updated to the latest coordinate information (that is, the imaging information calculation unit 74 captures at least one of the markers 8L and 8R). It is determined that valid processing result data is obtained. Then, when valid process result data is obtained, the CPU 30 advances the process to the next step 53. On the other hand, if valid process result data is not obtained, the CPU 30 advances the process to the next step 58.

  In step 53, the CPU 30 calculates the position coordinate of the screen coordinate system using the operation information acquired in step 51 and stores it as screen coordinate data Db3 (step 51), and advances the process to the next step 54. Hereinafter, an example of calculating the screen coordinates using the operation information will be described in detail.

  In step 53, the CPU 30 calculates direction data Db1 from the first coordinate data Da1 to the second coordinate data Da2. Specifically, the CPU 30 refers to the first coordinate data Da1 and the second coordinate data Da2, and calculates a vector having the position of the first coordinate data Da1 as the start point and the position of the second coordinate data Da2 as the end point. Then, the CPU 30 stores the calculated vector data in the main memory 33 as the direction data Db1. Based on the difference between the direction data Db1 and a predetermined reference direction, rotation about the direction perpendicular to the imaging surface of the controller 7 can be calculated.

  Further, the CPU 30 calculates midpoint data Db2 indicating the midpoint between the first coordinate data Da1 and the second coordinate data Da2. Specifically, the CPU 30 refers to the first coordinate data Da1 and the second coordinate data Da2, and calculates the coordinates of the midpoint. Then, the CPU 30 stores the calculated midpoint coordinate data in the main memory 33 as the midpoint data Db2. Here, the midpoint data Db2 indicates the position of the target image (markers 8L and 8R) in the captured image. The change in the image position due to the change in the position of the controller 7 can be calculated from the difference between the midpoint data Db2 and the predetermined reference position.

  Here, the positional relationship among the markers 8L and 8R, the display screen of the monitor 2, and the controller 7 will be considered. For example, when two markers 8L and 8R are installed on the upper surface of the monitor 2 (see FIG. 10) and the player points to the center of the display screen of the monitor 2 using the controller 7 whose upper surface is directed upward (imaging information) Consider a state in which the center of the display screen is imaged in the center of the captured image of the calculation unit 74. At this time, in the captured image of the imaging information calculation unit 74, the position of the middle point (middle point of the markers 8L and 8R) of the target image does not match the position (center of the display screen). Specifically, the position of the target image in the captured image is a position above the center of the captured image. When the target image is located at such a position, a reference position is set such that the center of the display screen is pointed. On the other hand, the position of the target image in the captured image is also moved in accordance with the movement of the controller 7 (the movement direction is the reverse direction), so the display screen is displayed in correspondence with the movement of the position of the target image in the captured image. By performing the process of moving the indicated position, the display screen reference position (position coordinate in the screen coordinate system) indicated by the controller 7 can be calculated. Here, for setting the reference position, the player may point in advance to a predetermined position on the display screen, and the position of the target image at that time may be stored in association with the predetermined position. If the positional relationship with the screen is fixed, it may be set in advance. Further, when the markers 8L and 8R are provided separately from the monitor 2 and are placed and used near the monitor 2 (eg, above or below the monitor 2), before the game starts Then, the player inputs the position where the markers 8L and 8R are placed with respect to the monitor (for example, selected from options such as placed on or below the monitor 2), and the optical disc. 4 and the built-in non-volatile memory of the game apparatus 3 store reference position data when placed on the monitor and reference position data when placed under the monitor, respectively, and select them. May be used. The position coordinates of such a screen coordinate system are calculated by linear conversion using a function for calculating the display screen reference coordinates (screen coordinate data Db3) of the monitor 2 from the midpoint data Db2. This function converts the value of the midpoint coordinate calculated from a certain captured image into coordinates representing the position on the display screen (position coordinate in the screen coordinate system) indicated by the controller 7 when the captured image is captured. To convert. With this function, the pointing position based on the display screen can be calculated from the midpoint coordinates.

  However, when the player points to the center of the display screen of the monitor 2 using the controller 7 whose upper surface is other than upward (for example, rightward), the position of the target image in the captured image is above the center of the captured image. The position is shifted in a direction other than (for example, left). That is, due to the inclination of the controller 7, the movement direction of the controller 7 does not match the movement direction of the display screen reference position. Therefore, the midpoint data Db2 is corrected based on the direction data Db1. Specifically, the midpoint data Db2 is corrected to the midpoint coordinates when the upper surface of the controller 7 is in the upward direction. More specifically, when the reference position is set, the direction data reference is also set, and the midpoint data Db2 calculated in step 64 is an amount corresponding to the angle difference between the direction data Db1 and the reference direction. Thus, the coordinates indicated by the midpoint data Db2 are rotated and corrected around the center of the captured image. Then, the screen coordinate data Db3 is calculated as described above using the corrected midpoint data Db2.

  Returning to FIG. 21, in step 54, the CPU 30 determines whether or not the position coordinates of the screen coordinate system are within a predetermined range. If the position coordinates are within the predetermined range, the CPU 30 advances the process to the next step 55. On the other hand, if the position coordinates are outside the predetermined range, the CPU 30 advances the process to the next step 58. Here, the predetermined range may be any range as long as the position indicated by the controller 7 is within a detectable range. For example, when the detectable range is an area larger than the display screen of the monitor 2, the predetermined range may be specified as the same range as the display screen, or may be specified as a range larger than the display screen. Further, a part of the display screen may be specified within the predetermined range.

  In step 55, the CPU 30 determines whether or not the check counter value CC stored as the check counter data Db4 is less than zero. If the check counter value CC is less than 0, the CPU 30 sets the check counter value CC to 0 (step 56), and proceeds to the next step 57. On the other hand, when the check counter value CC is 0 or more, the CPU 30 proceeds to the next step 57 as it is. Then, the CPU 30 adds 1 to the current check counter value CC in step 57 to update the check counter data Db4, and advances the processing to the next step 61.

  On the other hand, when valid processing result data is not obtained (No in Step 52) and when the position coordinates of the screen coordinate system are outside the predetermined range (No in Step 54), the CPU 30 proceeds to Step 58. Proceed. In step 58, the CPU 30 determines whether or not the check counter value CC stored as the check counter data Db4 is greater than zero. If the check counter value CC is greater than 0, the CPU 30 sets the check counter value CC to 0 (step 59), and proceeds to the next step 60. On the other hand, if the check counter value CC is 0 or less, the CPU 30 proceeds to the next step 60 as it is. In step 60, the CPU 30 subtracts 1 from the current check counter value CC to update the check counter data Db4, and advances the processing to the next step 61.

  Next, the CPU 30 determines whether or not the check counter value CC stored in the check counter data Db4 is larger than 2 (step 61) and whether or not the check counter value CC is −8 or less (step 63). . If the check counter value CC is larger than 2 (Yes in step 61), the CPU 30 sets the valid flag f to true and stores it as valid flag data Db5 (step 62), and the process proceeds to the next step 81 ( Proceed to FIG. On the other hand, when the check counter value CC is -8 or less (Yes in Step 63), the CPU 30 sets the valid flag f to false and stores it as the valid flag data Db5 (Step 64). Proceed to 81. On the other hand, when the check counter value CC is larger than −8 and equal to or smaller than 2 (both Step 61 and Step 63 are No), the CPU 30 proceeds to the next Step 81 as it is.

  As is clear from the processing in steps 52 to 64 above, the check counter value CC is set to 0 when the position coordinate of the screen coordinate system moves from outside the predetermined range to within the predetermined range, and the screen coordinates are continuously displayed again. When it is confirmed that the position coordinates of the system are within the predetermined range, the valid flag f is set to true. As long as the position coordinates of the screen coordinate system are within the predetermined range, the valid flag f is true. On the other hand, the check counter value CC is set to 0 when the position coordinate of the screen coordinate system moves from within the predetermined range to outside the predetermined range, and then the position coordinate of the screen coordinate system is continuously set within the predetermined range in seven processing cycles. When it is confirmed that it is outside, the valid flag f is set to false. As long as the position coordinates in the screen coordinate system are outside the predetermined range, the valid flag f is false. That is, the change of the valid flag f from true to false is slower than the change of the valid flag f from false to true. Therefore, as will be apparent later, the transition from the first operation mode to the second operation mode is fast, and the transition from the second operation mode to the first operation mode is slow.

  In FIG. 22, in step 81, the CPU 30 determines whether or not the validity flag f stored as the validity flag data Db5 is false. When the valid flag f is false, the CPU 30 determines whether the current image is an objective image (step 82), whether a special operation is being performed (step 83), and whether a special operation is being performed. Whether or not (step 84) and whether or not the acceleration change amount is greater than or equal to a threshold value (step 85) are determined, respectively, and if step 82 to step 85 are all No, the process proceeds to the next step 86. On the other hand, if the valid flag f is true, or if at least one of the determinations in steps 83 to 85 is Yes, the CPU 30 advances the process to the next step 88. On the other hand, if the determination in step 82 is Yes, the CPU 30 advances the process to the next step 92.

  In step 86, the CPU 30 shifts from the second operation mode to the first operation mode, calculates the position and direction of the virtual camera C switched to the objective image (see FIGS. 14 and 15), and generates the virtual camera data Dc3. Remember. Note that the position and direction of the virtual camera C in the objective image are the same as those described with reference to FIGS. 14 and 15, and thus detailed description thereof is omitted here. Then, the CPU 30 switches the operation table used for the game control process from the second operation table to the first operation table (see FIG. 19) (step 87), and advances the process to the next step 92.

  On the other hand, when the valid flag f is true, or when at least one of the determinations in steps 83 to 85 is Yes, the CPU 30 determines whether the current image is a subjective image (step 88) and is in a special operation. Whether or not (step 89). If the determinations at step 88 and step 89 are both No, the process proceeds to the next step 90. On the other hand, if at least one of the determinations in step 88 and step 89 is Yes, the CPU 30 advances the process to the next step 92.

  In step 90, the CPU 30 shifts from the first operation mode to the second operation mode, switches to a subjective image (see FIGS. 16 and 17), calculates the position and direction of the virtual camera C, and generates virtual camera data Dc3. Remember. Note that the position and direction of the virtual camera C in the subjective image are the same as those described with reference to FIGS. 16 and 17, and thus detailed description thereof is omitted here. Then, the CPU 30 switches the operation table used for the game control process from the first operation table to the second operation table (see FIG. 20) (step 91), and advances the process to the next step 92.

  In step 92, the CPU 30 performs a game control process according to the operation information acquired in step 51 using the first operation table or the second operation table that is currently targeted, and advances the process to the next step. . The CPU 30 uses the key data Da3 and acceleration data Da4 updated and stored as the operation information Da, and the screen coordinate data Db3 and pointing position data Dc1 updated and stored as the operation state information Db. An action or movement is performed on the character P, or the virtual camera C is moved. Here, since the operation table used in step 92 is different depending on the first operation mode and the second operation mode, the contents of the game control process corresponding to each operation means are different. Therefore, the player can control the game by operating the controller 7 in accordance with each operation mode.

  In the second operation mode, when the position coordinate in the screen coordinate system calculated in step 53 is converted into a coordinate representing the position in the game space, the position in the game space corresponding to the position in the screen coordinate system. Can be further converted to. Here, the position in the game space corresponding to the position in the screen coordinate system is a position in the game space displayed at a position on the display screen of the monitor 2 (for example, a position projected through) or a position in the screen coordinate system. It is a three-dimensional coordinate value of the game space that is directly specified from the position coordinates.

  The essential principle of the calculation process of the screen coordinate data Db3 is that the displacement of the indicated two-dimensional coordinates from the predetermined reference position is calculated by setting the coordinates by changing the position of the target image by the movement of the controller 7. It is to do. Therefore, the position coordinates in the screen coordinate system can be widely used as input for other two-dimensional coordinates. For example, the position coordinates in the screen coordinate system can be used directly as the x and y coordinate values in the world coordinate system. In this case, a calculation process for associating the movement of the target image with the movement of the x coordinate and the y coordinate from the reference position in the world coordinate system may be performed regardless of the display screen of the monitor 2. Further, when a two-dimensional game image is displayed on the monitor 2, the position coordinates in the screen coordinate system can be directly used as the values of the x coordinate and the y coordinate in the two-dimensional game coordinate system.

  Next, the CPU 30 draws a virtual game space with the virtual camera C as a viewpoint, displays a game image on the monitor 2 (step 93), and advances the processing to the next step. Here, the parameters are set so that the virtual camera C in the virtual game space becomes an objective image or a subjective image with respect to the player character P according to the current operation mode. And according to a player's operation, the arrangement position of virtual camera C is adjusted and a game picture is generated.

  For example, when the player is pressing the first button (operation button 72b) of the controller 7 in the second operation mode, the virtual camera C is arranged at the position of the subjective image with the head of the player character P as the viewpoint. .

  In the second operation mode, when the player moves the position indicated by the controller 7 (the position of the aiming cursor T) while pressing the B button (the operation button 72i) of the controller 7, the position of the aiming cursor T is the game position. When entering the peripheral area of the image (for example, the peripheral area A in the display image shown in FIG. 16 or the peripheral area outside the display image) or in a state where the aiming cursor T is in the peripheral area. When the B button is pressed, the direction of the virtual camera C is changed so that the position of the virtual game space corresponding to the position of the aiming cursor T is displayed on the display screen of the monitor 2 (at this time, It is not necessary to change the viewpoint position of the virtual camera C). That is, when the aiming cursor T is in the upper area of the game image, the direction of the virtual camera C is changed upward from the current direction. When the aiming cursor T is in the lower area, the direction is changed downward from the current direction to the right area. In some cases, the current direction is changed to the right, and in the left area, the current direction is changed to the left (that is, the game image is scrolled in a direction in which the player points outside the display screen with the controller 7). As shown on the monitor 2). In this state (that is, when the aiming cursor enters the peripheral area while pressing the B button, or when the B button is pressed while the aiming cursor is in the peripheral area, the virtual camera C In addition, when the position indicated by the controller 7 is outside the game image, outside the display screen, or becomes undetectable, as long as the B button continues to be pressed, The direction of the virtual camera may be continuously changed in the upward / downward / leftward / rightward direction according to the region (upper / lower / left / right) where the aiming cursor was present.

  Here, the state in which the above-described game image is scrolled will be apparent from the following, but the first operation is started from the second operation mode in spite of being determined Yes in step 84 and indicating that the controller 7 is outside the predetermined range. The mode is not changed. That is, this state may give the player anxiety that the controller 7 does not shift to the first operation mode even though the controller 7 points outside the predetermined range. For example, this situation becomes conspicuous when the player changes the controller 7 from vertical holding to horizontal holding while pressing the B button. However, since the B button provided in the recess on the lower surface of the controller 7 is forcibly separated from the player's finger when the controller 7 is held sideways (see FIG. 9), it is possible to naturally avoid the above-mentioned anxiety.

  Next, the CPU 30 determines whether or not to end the game (step 94). As a condition for ending the game, for example, a condition for game over (for example, a parameter indicating the physical strength of the player character P becomes 0) is satisfied, or the player performs an operation to end the game. There are things. CPU30 returns to the said step 51 (FIG. 21) when not ending a game, and repeats a process, and complete | finishes the process by the said flowchart, when a game is complete | finished.

  Here, the specific contents of the above-described steps 81 to 85 will be described. The condition for executing the above steps 83 to 85 is a state where the valid flag f is false and the image is a subjective image. That is, the viewpoint of the virtual camera C is subjective while the position coordinate of the screen coordinate system pointed to by the controller 7 is not within the predetermined range (for example, the player does not point the front of the controller 7 at the monitor 2). This is the state set for the target image. Specifically, during a special operation, during a special operation, and when the amount of change in acceleration is equal to or greater than a threshold value, the transition from the second operation mode to the first operation mode and the transition from the subjective image to the objective image are performed. Not performed.

  The special action that is the condition of step 83 indicates that the player character P is performing a special action in the virtual game space in the second operation mode. Thus, a state in which the player character P is jumping in the virtual game space, a state in which beam charging is performed by long-pressing the A button, and the like. When determining the state during the jump, it may be determined as “in operation” until the jump operation is completed, or may be determined as “in operation” for a while after the jump operation is completed. Alternatively, it may be determined as “in operation” only for a predetermined period until the middle of the jump operation. The special operation being the condition of step 84 indicates that the player is in the middle of performing a special operation using the controller 7 in the second operation mode. This indicates that the operation button (operation button 72i) or the first button (operation button 72b) is being pressed. Here, as shown in FIG. 20, when the player presses the B button in the second operation mode, the operation is performed depending on the state in which the game image is displayed to be scrolled or a combination of other button operations. Often in the middle of Further, when the player is pressing the first button in the second operation mode, the viewpoint is moving to the head of the player character P. As in these examples, if the operation mode or viewpoint is forcibly switched during a special operation or special operation, the player's operation is forcibly canceled or the game screen changes that are impossible for viewpoint switching May cause confusion in the operation. In order to prevent such a mode change, mode switching is partly restricted during operation and operation.

  When the acceleration change amount that is the condition of step 85 is equal to or greater than a threshold value, the change amount obtained by combining the accelerations in the X, Y, and Z axis directions detected by the acceleration sensor 701 is equal to or greater than a preset threshold value. (It may be detected that the predetermined component is equal to or greater than the threshold). For example, when the player is operating by moving the entire controller 7 in the second operation mode (for example, swinging up the controller 7), the position indicated by the controller 7 deviates from the predetermined range described above. There is also. If the second operation mode is shifted to the first operation mode in accordance with the deviation from the predetermined range, the player's operation is confused. Further, it is very difficult to move the entire controller 7 without the position indicated by the controller 7 deviating from the predetermined range. Therefore, in order to prevent such a mode change, when the player moves the entire controller 7, any of the X, Y, and Z axis direction acceleration changes detected by the acceleration sensor 701 is large. Thus, control is performed so that the mode is not changed while the controller 7 is moving.

  In addition, the specific contents of the above-described steps 81, 88, and 89 will be described. The condition for executing step 89 is a state where the valid flag f is true and the image is an objective image. In other words, the viewpoint of the virtual camera C is objective while the position coordinates of the screen coordinate system pointed to by the controller 7 are in a predetermined range (for example, the player points the front of the controller 7 toward the monitor 2). This is the state set for the target image. Specifically, during a special operation, the transition from the first operation mode to the second operation mode and the transition from the objective image to the subjective image are not performed.

  The special action being the condition of step 89 indicates that the player character P is performing a special action in the virtual game space in the first operation mode. For example, the same as in step 83 above. In other words, the player character P is jumping in the virtual game space. If the operation mode or the viewpoint is forcibly switched during a special operation as in this example, the operation may be disrupted due to a game screen change that is impossible to switch the viewpoint. In order to prevent such a mode change, mode switching is partly restricted during operation even in the transition from the first operation mode to the second operation mode.

  Note that the above-described objective image and subjective image, and the game control content corresponding to the operation on each operation means are merely examples, and the present invention can be realized even if other viewpoint changes or other game control content are set. Needless to say. For example, in the first operation mode, the muzzle direction in the virtual game space is changed according to the acceleration detected by the acceleration sensor 701, but may be changed by any operation of the operation unit 72 provided in the controller 7. It doesn't matter. When the controller 7 is provided with a joystick, in the first operation mode, the muzzle direction may be changed according to the tilting direction of the stick. As described above, according to the mode of the operation unit 72 provided in the controller 7, various changes can be made by setting the game control content corresponding to the operation of each operation means in accordance with the operation posture of the player. Become.

  As described above, each operation mode having different game processing contents is automatically set according to the position where the player designates coordinates using a pointing device capable of outputting data for remotely designating coordinates on the display screen. Be changed. As an example of the changed game processing content, the arrangement position and direction of the virtual camera C in the game space are changed to a subjective image or an objective image. As another example of the changed game process content, game control content corresponding to an operation on each operation means is changed. For example, in the first operation mode, the muzzle direction (sighting position) of the gun possessed by the player character P in the virtual game space is changed according to the acceleration detected by the acceleration sensor 701 and the operation on the operation unit 72. In the two-operation mode, the aiming position is changed according to the processing result data of the imaging information calculation unit 74. In the first operation mode, when the player holds the controller 7 sideways, a game image in which the gazing point is substantially matched with the player character P from the lateral direction of the player character P is displayed. In the second operation mode, a game in which the player holds the controller 7 vertically so as to point to the monitor 2, thereby making the viewpoint substantially coincide with the player character P and setting the gazing point in the direction in which the player character P faces. An image is displayed. Therefore, in the present invention, in a game apparatus using a pointing device capable of outputting data for remotely specifying coordinates on the display screen, the operation method and the viewpoint are automatically changed appropriately during execution of the same game. Can do.

  In the above description, as an example of a pointing device that can output data for remotely specifying coordinates on the display screen, image data obtained by imaging an imaging target with the imaging element 743 provided in the controller 7 is analyzed. Thus, a mode in which coordinates are designated on the display screen of the monitor 2 was used. In this aspect, two markers to be imaged are installed in the vicinity of the display screen, and a device including an imaging unit and a housing capable of freely changing the imaging direction detects the two markers in the captured image, and the imaging The coordinate position designated by the device is derived based on the position of the marker in the image. However, the pointing device may be configured in another manner.

  For example, the imaging target placed in the vicinity of the display screen may be a member that reflects light, or a physical marker having a specific color or shape, in addition to the electrical marker (LED module) described above. Further, the imaging target may be displayed on the display screen of the monitor 2. Further, the monitor itself may be an imaging target by reading the scanning line of the raster scan type monitor with the imaging means provided in the controller 7. Further, a magnetic generator may be provided, and coordinates may be specified from a remote location using magnetism generated from the magnetic generator. In this case, the controller 7 is provided with a magnetic sensor for detecting the magnetism.

  In the above description, the infrared light from the two markers 8L and 8R is the imaging target of the imaging information calculation unit 74 of the controller 7, but other objects may be the imaging target. For example, one or three or more markers may be installed in the vicinity of the monitor 2, and infrared light from these markers may be used as an imaging target of the imaging information calculation unit 74. For example, even if one marker having a predetermined length is installed in the vicinity of the monitor 2, the present invention can be similarly realized. In addition, the display screen itself of the monitor 2 or other light emitters (such as room lights) may be the imaging target of the imaging information calculation unit 74. If the position of the controller 7 with respect to the display screen is calculated based on the arrangement relationship between the imaging target and the display screen of the monitor 2, various light emitters can be used as the imaging target of the imaging information calculation unit 74.

  Further, an imaging target such as a marker may be provided on the controller 7 side, and the imaging means may be provided on the monitor 2 side. In still another example, a mechanism for emitting light from the front surface of the controller 7 may be provided. In this case, an imaging device that images the display screen of the monitor 2 is installed at a location different from the controller 7 and the monitor 2, and the imaging device indicates the position where the light emitted from the controller 7 is reflected on the display screen of the monitor 2. By analyzing the captured image, a pointing device that can output data for remotely specifying coordinates on the display screen can be configured. Furthermore, it may be configured such that coordinates are remotely specified on the display screen by calculating the attitude and operation of the controller 7 using acceleration data from the acceleration sensor 701 provided in the controller 7. Thus, even a controller having an acceleration sensor in the housing can similarly form a pointing device that can output data for remotely designating coordinates on the display screen.

  In the above description, the controller 7 and the game apparatus 3 are connected by wireless communication. However, the controller 7 and the game apparatus 3 may be electrically connected via a cable. In this case, the cable connected to the controller 7 is connected to the connection terminal of the game apparatus 3.

  Further, the reception unit 6 connected to the connection terminal of the game apparatus 3 has been described as the reception means for receiving transmission data wirelessly transmitted from the controller 7. However, the reception module provided in the main body of the game apparatus 3 has been described. The receiving unit may be configured as follows. In this case, the transmission data received by the receiving module is output to the CPU 30 via a predetermined bus.

  Further, the image data picked up by the image pickup device 743 is analyzed to obtain the infrared light position coordinates and the barycentric coordinates thereof from the markers 8L and 8R, and these are generated in the controller 7 as processing result data to generate a game. Although the aspect of transmitting to the device 3 has been described, data of other processing stages may be transmitted from the controller 7 to the game device 3. For example, the image data captured by the image sensor 743 may be transmitted from the controller 7 to the game apparatus 3, and the CPU 30 may perform the above analysis process to acquire the processing result data. In this case, the image processing circuit 744 provided in the controller 7 becomes unnecessary. Further, the data during the analysis of the image data may be transmitted from the controller 7 to the game apparatus 3. For example, data indicating brightness, position, area, and the like obtained from the image data may be transmitted from the controller 7 to the game apparatus 3, and the CPU 30 may perform the remaining analysis processing to obtain processing result data.

  In addition, the shape of the controller 7 described above and the shape, number, and installation position of the operation unit 72 provided in them are merely examples, and even if the shape, number, and installation position are other, It goes without saying that the invention can be realized. Further, the position of the imaging information calculation unit 74 in the controller 7 (the light incident port of the imaging information calculation unit 74) does not have to be the front surface of the housing 71. If light can be taken in from the outside of the housing 71, the position is different. It does not matter if it is provided.

  In the above description, the game image in the first operation mode and the game image in the second operation mode are both generated by changing the viewpoint with respect to the same three-dimensional game space. The game image may be displayed on the monitor 2. For example, at least one of the game images may be a two-dimensional game image. One game image may be a functional image such as an icon image. For example, by displaying a functional image in which a plurality of icons are displayed as game images in the second operation mode, a mode suitable for the player's operation such as selecting an icon pointed to by the controller 7 is obtained.

  The game program, the game device, and the game system according to the present invention provide a game processing content according to a position where a player designates coordinates using a pointing device that can output data for remotely designating coordinates on a display screen. Can be automatically changed to different operation modes, and is useful as a game program, a game device, a game system, or the like executed by a game device operated using the pointing device or the like.

DESCRIPTION OF SYMBOLS 1 ... Game system 2 ... Monitor 2a, 706 ... Speaker 3 ... Game device 30 ... CPU
31 ... Memory controller 32 ... GPU
33 ... Main memory 34 ... DSP
35 ... ARAM
36 ... Controller I / F
37 ... Video I / F
38 ... External memory I / F
39 ... Audio I / F
40 ... disk drive 41 ... disk I / F
DESCRIPTION OF SYMBOLS 4 ... Optical disk 5 ... External memory card 6 ... Reception unit 7 ... Controller 71 ... Housing 72 ... Operation part 73 ... Connector 74 ... Imaging information calculating part 741 ... Infrared filter 742 ... Lens 743 ... Imaging element 744 ... Image processing circuit 75 ... Communication Part 751 ... Microcomputer 752 ... Memory 753 ... Wireless module 754 ... Antenna 700 ... Substrate 701 ... Acceleration sensor 702 ... LED
703 ... Crystal oscillator 704 ... Vibrator 707 ... Sound IC
708 ... Amplifier 8 ... Marker

Claims (22)

An information processing program that is executed by a computer of a device that is wirelessly connected to a pointing device that can wirelessly output data for instructing coordinates to a predetermined detection surface remotely,
The pointing device includes a vertically long housing that is gripped by a user, and obtains a position at which a straight line extending in the long axis direction from an end in the long axis direction intersects the detection surface as indicated coordinates. Wirelessly outputting data to the device ,
The housing is provided with operation portions on both sides along the long axis direction,
In the computer,
A coordinate acquisition step of receiving data wirelessly output from the pointing device and acquiring coordinates on the detection surface;
A detection step of detecting whether or not coordinates within a predetermined area on the detection surface are acquired by the coordinate acquisition step;
In response to the detection by the detection step, the designated coordinate related processing step and the designated coordinate non-related processing step are performed by switching and executed,
In the designated coordinate related processing step, the computer is caused to execute designated coordinate related processing which is information processing using the coordinates obtained in the coordinate obtaining step,
In the designated coordinate non-related processing step, the designated coordinate non-related processing which is information processing using the operation data output from the operation units on both sides is not performed on the computer without using the coordinates obtained in the coordinate obtaining step. An information processing program to be executed.   The information processing program according to claim 1, wherein in the detection step, it is detected whether or not the coordinates on the detection surface can be acquired by the coordinate acquisition step. Causing the computer to further execute a display control step of displaying an image viewed from a virtual camera arranged in a virtual three-dimensional space on a display screen;
The designated coordinate unrelated processing step includes a first virtual camera control step of determining a parameter of the virtual camera by performing a first calculation based on an information processing parameter;
The instruction coordinate related processing step includes a second virtual camera control step of determining a parameter of the virtual camera by performing a second calculation different from the first calculation based on an information processing parameter. 1. An information processing program according to 1. Causing the computer to further execute a display control step of displaying an image viewed from a virtual camera arranged in a virtual three-dimensional space on a display screen;
The designated coordinate unrelated processing step includes a first virtual camera control step of determining parameters of the virtual camera so that an image in which an object existing in the virtual three-dimensional space is objectively viewed is generated.
2. The specified coordinate related processing step includes a second virtual camera control step of determining parameters of the virtual camera so that an image in which a virtual three-dimensional space is subjectively viewed from the object is generated. The information processing program described. Causing the computer to further execute a display control step of displaying an image viewed from a virtual camera arranged in a virtual three-dimensional space on a display screen;
The designated coordinate unrelated processing step includes a first virtual camera control step of determining a parameter of the virtual camera so that a gazing point of the virtual camera substantially matches a position of the object,
2. The information processing program according to claim 1, wherein the designated coordinate related processing step includes a second virtual camera control step of determining a parameter of the virtual camera so that a viewpoint of the virtual camera substantially coincides with a position of the object. . Causing the computer to further execute a display control step of displaying an image viewed from a virtual camera arranged in a virtual three-dimensional space on a display screen;
In the designated coordinate non-related processing step, the parameters of the virtual camera are determined such that the distance from the viewpoint of the virtual camera to the position of the object is longer than the distance determined in the designated coordinate related processing step. The information processing program according to claim 1. Causing the computer to further execute a display control step of displaying an image viewed from a virtual camera arranged in a virtual three-dimensional space on a display screen;
In the designated coordinate unrelated processing step, the parameters of the virtual camera are determined so that an image in which the virtual three-dimensional space is viewed from the lateral direction with respect to the traveling direction or orientation of the object is generated,
The information processing according to claim 1, wherein in the designated coordinate-related processing step, parameters of the virtual camera are determined so that an image in which a virtual three-dimensional space is viewed in the traveling direction or direction of the object is generated. program. The operation unit includes a direction instruction unit capable of instructing a direction by a user operation,
The information processing program according to any one of claims 1 to 7, wherein, in the designated coordinate unrelated processing step, an object is controlled to move in a virtual three-dimensional space in accordance with operation data from the direction designating unit. In the designated coordinate non-related process step, as the designated coordinate non-related process, predetermined information processing is executed based on operation data generated by the operation unit,
The information processing different from the predetermined information processing is executed in the instruction coordinate related processing step, in addition to the instruction coordinate related processing, based on the same operation data generated by the operation unit. Information processing program. The pointing device includes a housing that is gripped by a user;
The operation unit includes a first operation unit and a second operation unit that can detect an operation by a user.
In the designated coordinate non-related process step, as the designated coordinate non-related process, predetermined information processing is executed based on operation data generated by the first operation unit,
The information processing same as the predetermined information processing according to claim 1, wherein, in the designated coordinate related processing step, in addition to the designated coordinate related processing, the same information processing as the predetermined information processing is executed based on operation data generated by the second operation unit. Information processing program.   The information processing program according to claim 10, wherein in the designated coordinate related processing step, information processing different from the predetermined information processing is further executed based on operation data generated by the first operation unit. In the designated coordinate related processing step, as the designated coordinate related processing, a predetermined information processing parameter is determined based on the coordinates obtained in the coordinate obtaining step,
The information processing program according to claim 1, wherein, in the designated coordinate non-related processing step, the information processing parameter is determined based on operation data generated by the operation unit as the designated coordinate non-related processing. The information processing parameter is a direction parameter indicating a direction in a virtual three-dimensional space,
The operation unit includes an operation unit capable of instructing a direction,
In the designated coordinate related processing step, as the designated coordinate related processing, the direction parameter is determined based on the coordinates obtained in the coordinate obtaining step,
13. The information processing program according to claim 12, wherein in the designated coordinate non-related processing step, the direction parameter is determined based on a direction designated by the operation unit capable of directing the direction as the designated coordinate non-related processing. The detection surface is set corresponding to a display screen on which an image is displayed,
The pointing device is capable of outputting data for remotely instructing coordinates on the display screen,
The information processing program causes the computer to further execute a display control step of displaying an image representing a space on the display screen,
2. The process according to claim 1, wherein in the designated coordinate-related processing step, as the designated coordinate-related process, processing according to a position of a corresponding coordinate in a space where the coordinates acquired in the coordinate obtaining step overlap on the image is performed. Information processing program. In the designated coordinate related processing step, in addition to the designated coordinate related processing, based on operation data from the operation unit, information processing different from information processing in the designated coordinate related processing is performed.
In the detection step, it is detected that the state has been shifted from a state where it is detected that the coordinates within the predetermined area on the detection surface have been acquired by the coordinate acquisition step,
In the switching step, even when the transition is detected by the detection step, when predetermined operation data is output from the operation unit, the designated coordinate related processing step to the designated coordinate non-related processing step. The information processing program according to claim 1, wherein the execution of the designated coordinate-related processing step is continued without being executed. In the detection step, it is detected that the coordinate acquisition step has shifted to a state in which the detection is performed from a state in which the coordinates in the predetermined area on the detection surface are acquired and are not detected,
In the switching step, even when the transition is detected by the detection step, when predetermined operation data is output from the operation unit, the designated coordinate related processing step to the designated coordinate related processing step. The information processing program according to claim 1, wherein the execution of the designated coordinate unrelated processing step is continued without being switched to. The information processing program causes the computer to further execute a display control step of displaying an image viewed from a virtual camera arranged in a virtual three-dimensional space on a display screen,
In the detection step, it is detected that the state has been shifted from a state where it is detected that the coordinates within the predetermined area on the detection surface have been acquired by the coordinate acquisition step,
In the switching step, when the transition is detected by the detection step and the predetermined operation data is output from the operation unit, the designated coordinate related processing step is switched to the designated coordinate non-related processing step. The information processing program according to claim 1, wherein the information processing program is not executed, the execution of the designated coordinate-related processing step is continued, and the line-of-sight direction of the virtual camera is changed according to the coordinates acquired by the coordinate acquisition step. . The information processing program causes the computer to further execute an object operation control step for operating an object placed in a virtual world according to a user operation,
In the detection step, it is detected that the state has been shifted from a state where it is detected that the coordinates within the predetermined area on the detection surface have been acquired by the coordinate acquisition step,
In the switching step, when the transition is detected by the detection step and the object is performing a specific motion, the instruction coordinate related processing step is not switched to the instruction coordinate non-related processing step. The information processing program according to claim 1, wherein execution of the designated coordinate related processing step is continued. The pointing device includes a housing that is gripped by a user;
The housing is provided with a motion sensor;
In the detection step, when it is detected that the state where the coordinates within the predetermined area on the detection surface have been acquired is shifted to the state where the detection is not performed, the transition step detects the transition in the switching step. Even when the motion sensor indicates an output equal to or greater than a predetermined threshold, it is not executed by switching from the designated coordinate related processing step to the designated coordinate non-related processing step. The information processing program according to claim 1, wherein execution of the steps is continued. An information processing apparatus wirelessly connected to a pointing device capable of wirelessly outputting data for instructing coordinates to a predetermined detection surface remotely,
The pointing device includes a vertically long housing that is gripped by a user, and obtains a position at which a straight line extending in the long axis direction from an end in the long axis direction intersects the detection surface as indicated coordinates. Wirelessly outputting data to the information processing apparatus ;
The housing is provided with operation portions on both sides along the long axis direction,
Coordinate acquisition means for receiving data wirelessly output from the pointing device and acquiring coordinates on the detection surface;
Designated coordinate related processing means for performing designated coordinate related processing which is information processing using the coordinates acquired by the coordinate acquisition means;
Instruction coordinate unrelated processing means for performing instruction coordinate non-related processing which is information processing using operation data output from the operation units on both sides without using the coordinates acquired by the coordinate acquisition means;
Detecting means for detecting whether or not coordinates within a predetermined region on the detection surface are acquired by the coordinate acquiring means;
An information processing apparatus comprising: a switching unit that switches and executes the designated coordinate related processing unit and the designated coordinate non-related processing unit in response to detection by the detection unit. An information processing system including an information processing apparatus wirelessly connected to a pointing device capable of wirelessly outputting data for instructing coordinates to a predetermined detection surface remotely,
The pointing device includes a vertically long housing that is gripped by a user, and obtains a position at which a straight line extending in the long axis direction from an end in the long axis direction intersects the detection surface as indicated coordinates. Wirelessly outputting data to the information processing apparatus ;
The housing is provided with operation portions on both sides along the long axis direction,
The information processing apparatus includes:
Coordinate acquisition means for receiving data wirelessly output from the pointing device and acquiring coordinates on the detection surface;
Designated coordinate related processing means for performing designated coordinate related processing which is information processing using the coordinates acquired by the coordinate acquisition means;
Instruction coordinate unrelated processing means for performing instruction coordinate non-related processing which is information processing using operation data output from the operation units on both sides without using the coordinates acquired by the coordinate acquisition means;
Detecting means for detecting whether or not coordinates within a predetermined region on the detection surface are acquired by the coordinate acquiring means;
An information processing system comprising: switching means for switching and executing the designated coordinate related processing means and the designated coordinate non-related processing means in response to detection by the detection means. An information processing method in which the following steps are realized by computer processing using a pointing device capable of wirelessly outputting data for instructing coordinates to a predetermined detection surface remotely,
The pointing device includes a vertically long housing that is gripped by a user, and obtains a position at which a straight line extending in the long axis direction from an end in the long axis direction intersects the detection surface as indicated coordinates. Wirelessly outputting data to the computer ,
The housing is provided with operation portions on both sides along the long axis direction,
A coordinate acquisition step of receiving data wirelessly output from the pointing device and acquiring coordinates on the detection surface;
A detection step of detecting whether or not coordinates within a predetermined area on the detection surface are acquired in the coordinate acquisition step;
In accordance with detection in the detection step, includes a switching step of switching and executing a designated coordinate related processing step and a designated coordinate non-related processing step,
In the designated coordinate related processing step, designated coordinate related processing that is information processing using the coordinates acquired in the coordinate acquisition step is performed.
In the designated coordinate non-related processing step, the designated coordinate non-related processing which is information processing using the operation data output from the operation unit on both sides is performed without using the coordinates obtained in the coordinate obtaining step. Information processing method.

Images