JP5806510B2 - Information processing program, information processing apparatus, information processing system, and information processing method - Google Patents

Description

  The present invention relates to an information processing program, an information processing apparatus, an information processing system, and an information processing method, and more particularly to an information processing program, an information processing apparatus, an information processing system, and an information processing method for displaying a virtual world.

  Conventionally, there is a game in which a user grips and operates a mobile portable terminal (portable game device), and an event is executed according to the posture and position of the mobile portable terminal in real space (see, for example, Patent Document 1). . The mobile portable terminal described in Patent Document 1 includes a sensor that detects the position and orientation of the mobile mobile terminal in real space, and the user of the terminal moves the mobile mobile terminal itself or moves the mobile mobile terminal itself. Proceed with the game while changing the attitude. For example, the mobile mobile terminal scrolls the image displayed on the display screen of the mobile mobile terminal according to the attitude of the mobile mobile terminal in real space. Then, when a scope is displayed in the center of the display screen of the mobile portable terminal and a predetermined button of the mobile portable terminal is pressed in a state where a virtual object (for example, insect object) is entered in the scope, the virtual object is displayed in the scope. Is considered captured.

Japanese Unexamined Patent Publication No. 2011-1981

  However, when the mobile portable terminal disclosed in Patent Document 1 is to change the viewpoint of the image of the virtual world displayed on the display screen, the image must be scrolled according to the attitude of the mobile portable terminal itself. Therefore, in order to move the viewpoint of the virtual world, it is necessary to move the mobile portable terminal itself, which may be difficult for the user to operate. For example, in order to greatly move the viewpoint of the virtual world, the mobile mobile terminal itself needs to be moved greatly, and in addition to requiring a large operation by the user, the real space in which the mobile mobile terminal itself can be moved is limited. In such a case, the user may not be able to move the viewpoint to a desired position.

  Therefore, an object of the present invention is to provide an information processing program and information that can further facilitate the operation of changing the viewpoint when the viewpoint of the image displayed on the apparatus changes depending on the movement or posture of the apparatus main body. A processing system and an information processing method are provided.

  In order to achieve the above object, the present invention may employ the following configuration, for example. When interpreting the description of the claims, it is understood that the scope should be interpreted only by the description of the claims, and the description of the claims and the description in this column are contradictory. In that case, priority is given to the claims.

  One configuration example of the information processing program of the present invention includes main body state data corresponding to the attitude and / or movement of the portable display device main body and touch position data corresponding to a touch position on a touch panel provided in the portable display device. Are executed by a computer of an information processing apparatus capable of displaying an image on the portable display device that outputs at least. The information processing program causes the computer to function as first virtual camera control means and display control means. The first virtual camera control means controls the attitude and / or position of the first virtual camera for generating an image of the virtual world based on the main body state data and the touch position data. The display control means displays a first image indicating the virtual world viewed from the first virtual camera on the portable display device.

  The information processing apparatus may be an apparatus that executes a game process and generates an image based on the game process, or may be a versatile apparatus such as a general personal computer. The portable display device may be a size that can be carried by a user, and is typically a display device that allows a user to visually recognize an image displayed on the portable display device in a posture held by both hands. Also good. Further, the portable display device, like a terminal device in an embodiment to be described later, includes means for outputting at least data corresponding to the attitude and / or movement of the portable display device body, and a display screen of the portable display device. Other than the display screen for displaying the first image and the means for outputting the touch position data corresponding to the touch position on the touch panel provided on the surface may be provided.

  According to the above, when the viewpoint of an image displayed on the device changes depending on the movement or posture of the portable display device body, the viewpoint can be changed by a touch operation, so that the user can change the viewpoint more easily. Can be. For example, even when it is desired to move the viewpoint greatly in the virtual world, the viewpoint can be moved by a touch operation, and thus an operation for moving the viewpoint by moving the portable display device body greatly is not necessary.

  The information processing program may further cause the computer to function as posture movement calculation means. The posture movement calculating means calculates the posture and / or movement of the portable display device based on the main body state data. In this case, the first virtual camera control unit is configured to determine the posture and / or the first virtual camera based on the posture and / or movement of the portable display device calculated by the posture and motion calculation unit and the touch position indicated by the touch position data. Alternatively, the position may be controlled.

  According to the above, the posture and / or movement of the portable display device is calculated using the main body state data output from the portable display device, and the first and second movements are calculated based on the posture and / or movement of the portable display device. It becomes possible to control the attitude and / or position of the virtual camera.

  The first virtual camera control means controls the attitude of the first virtual camera by rotating the first virtual camera relative to the virtual world based on the attitude and / or movement of the portable display device. Then, based on the touch position indicated by the touch position data, the position of the first virtual camera may be controlled by moving the first virtual camera relative to the virtual world.

  According to the above, the first virtual camera is relatively rotated in the virtual world by an operation based on the attitude and / or movement of the portable display device main body, and the touch operation on the touch panel provided on the display screen of the portable display device is performed. Various user operations such as relatively moving the first virtual camera in the virtual world are possible.

  Further, the first virtual camera control means rotates the first virtual camera relative to the object arranged in the virtual world based on the attitude and / or movement of the portable display device. The position of the first virtual camera may be controlled by controlling the posture of the camera and moving the first virtual camera relative to the object based on the touch position indicated by the touch position data.

  According to the above, when the viewpoint of an object displayed on the device changes depending on the movement or posture of the portable display device body, the viewpoint can be changed by a touch operation. Can be further facilitated. For example, even if you want to move the display range of an object greatly, the display range can be moved by touch operation. Such an operation is unnecessary.

  The information processing program may further cause the computer to function as player object control means. The player object control means controls the action of the player object arranged in the virtual world based on the attitude and / or movement of the portable display device calculated by the attitude movement calculating means and the touch position indicated by the touch position data. In this case, the first virtual camera control means may arrange the first virtual camera at a position where a virtual world image including at least the player object is generated.

  According to the above, an operation for controlling the motion of the player object can be performed simultaneously with the operation for changing the posture and / or position of the first virtual camera.

  Further, the first virtual camera control means may arrange the first virtual camera at a position overlooking the player object from directly above in the virtual world.

  Based on the above, it is possible to display on the portable display device an image in which the player object placed in the virtual world is looked down on.

  Further, the player object control means sends a player object to the virtual world around the vertical direction of the virtual world with the same rotation direction and rotation angle as the first virtual camera based on the attitude and / or movement of the portable display device. You may control the attitude | position of the said player object by rotating relatively. The first virtual camera control means moves the player object relative to the virtual world in the same moving direction and moving distance as the first virtual camera based on the touch position indicated by the touch position data, and The position may be controlled.

  According to the above, since the posture and / or position of the player object changes in the same manner as the change in the posture and / or position of the first virtual camera, the player object is always in the same state with respect to the display screen of the portable display device. Can be generated. Further, since the player object is always displayed on the display screen in the same state, the operation for controlling the movement of the player object according to the posture and / or movement and touch position of the portable display device body is intuitive and easy.

  The information processing program may further cause the computer to function as touch position displacement calculation means. The touch position displacement calculating means calculates the displacement of the touch position input to the touch panel based on the touch position data. In this case, the first virtual camera control means may move the first virtual camera relative to the virtual world based on the displacement of the touch position.

  According to the above, the first virtual camera can be relatively moved in the virtual world by an operation that changes the touch position on the touch panel, such as a drag operation on the touch panel.

  The first virtual camera control means calculates a movement direction for moving the first virtual camera based on the displacement direction of the touch position, and moves the first virtual camera relative to the virtual world in the movement direction. It may be moved.

  According to the above, since the moving direction of the first virtual camera is set based on the direction in which the touch position on the touch panel is changed, the first virtual camera can be relatively moved in the direction desired by the user.

  The first virtual camera control means may calculate the direction opposite to the displacement direction of the touch position as the movement direction.

  Further, the first virtual camera control means may calculate, as the movement direction, a direction opposite to the direction corresponding to the displacement direction in the virtual world displayed overlapping the displacement of the touch position.

  According to the above, the first virtual camera moves in the direction opposite to the direction of changing the touch position on the touch panel, and the virtual world displayed on the display screen is scrolled so as to follow the moving direction of the touch position on the touch panel. Therefore, an operation for moving the viewpoint intuitively can be performed.

  The first virtual camera control means calculates a moving distance for moving the first virtual camera based on the displacement amount of the touch position, and moves the first virtual camera relative to the virtual world by the moving distance. It may be moved.

  According to the above, since the moving distance of the first virtual camera is set based on the amount by which the touch position on the touch panel is changed, the first virtual camera can be relatively moved by a user-desired distance.

  Further, the first virtual camera control means may calculate a distance corresponding to the displacement amount in the virtual world displayed overlapping the displacement of the touch position as the movement distance.

  According to the above, since the first virtual camera can be relatively moved by the same distance as the amount by which the touch position on the touch panel is changed, an operation for moving the viewpoint intuitively can be performed.

  Further, the posture movement calculation means may calculate at least a posture and / or a movement of the portable display device rotating around a depth direction of the display screen perpendicular to the display screen of the portable display device. The first virtual camera control means may control the attitude of the first virtual camera according to the attitude and / or movement of the portable display device that rotates around the depth direction.

  According to the above, the attitude of the first virtual camera can be changed by moving the portable display device so as to rotate (roll) around the depth direction of the display screen of the portable display device.

  Further, the first virtual camera control means rotates relative to the virtual world in the rotation direction around the viewing direction of the first virtual camera in accordance with the rotation direction in which the portable display device rotates around the depth direction. Then, the attitude of the first virtual camera may be controlled.

  According to the above, when the portable display device is moved so as to rotate (roll) around the depth direction of the display screen of the portable display device, the first around the viewing direction in the same direction as the rotation direction of the display screen. Since the virtual camera rotates relatively, it is possible to display an image as if looking into the virtual world via the display screen of the portable display device.

  Further, the first virtual camera control means rotates the first virtual camera relative to the virtual world according to an angle at which the orientation of the portable display device body changes around the depth direction, and the first virtual camera The posture may be controlled.

  Based on the above, the user can control the attitude of the first virtual camera by changing the direction of the portable display device.

  Further, the first virtual camera control means rotates the first virtual camera relative to the virtual world by the same angle as the angle at which the orientation of the portable display device body changes to change the attitude of the first virtual camera. You may control.

  Based on the above, it is possible to relatively rotate the first virtual camera by the same angle as the angle for changing the posture and / or position of the portable display device.

  In addition, the first virtual camera control means may move the virtual world in the rotation direction by the rotation angle around the viewing direction of the first virtual camera according to the rotation direction and rotation angle in which the portable display device rotates in the depth direction. When the touch position data indicates an operation of dragging the touch panel, the touch position data overlaps with the touch position indicated by the touch position data and is displayed on the display screen. In accordance with the moving direction and moving distance of the touch position in the virtual world, the first virtual camera is moved relative to the virtual world in the direction opposite to the moving direction along the plane perpendicular to the line-of-sight direction. And the position of the first virtual camera may be controlled.

  According to the above, when the portable display device is moved so as to rotate (roll) around the depth direction of the display screen of the portable display device, the same direction as the rotation direction of the display screen is rotated by the same angle around the line-of-sight direction. Since the first virtual camera rotates relatively, the virtual world displayed on the display screen is always displayed in the same direction in the real space even if the display screen of the portable display device rotates. be able to. Further, when a drag operation is performed on the touch panel of the portable display device, the virtual world displayed on the display screen can be moved and displayed so as to follow the drag operation.

  The information processing program may further cause the computer to function as load acquisition means. The load acquisition means acquires data based on the load applied to the load detection device. In this case, the player object control means may control the position of the player object by moving the player object relative to the virtual world based on the data acquired by the load acquisition means.

  The load detection device is, for example, a device that loads at least a part of the user's body and detects a load applied to the load detection device, or is turned on / off according to the load. There are things that are operated by riding with the soles of both feet in contact, those that the user operates with only one foot on the upper surface, those that the user operates with other body parts (for example, hands), etc. .

  According to the above, the player object can be moved by a user operation using the load detection device. Therefore, the user moves the player object using the load detection device while adjusting the viewpoint by moving the portable display device or operating the touch panel while viewing the first image on the portable display device. Since the operation is possible, the user can operate in an unprecedented operation environment.

  The portable display device may include at least one of a gyro sensor and an acceleration sensor. The posture movement calculation unit may calculate the posture and / or movement of the portable display device based on data output from at least one of the gyro sensor and the acceleration sensor.

  According to the above, by using the data indicating the angular velocity generated in the portable display device output from the gyro sensor and / or the data indicating the acceleration generated in the portable display device output from the acceleration sensor, The attitude and movement of the portable display device can be accurately calculated.

  The display control means may output image data indicating the first image to the portable display device. The portable display device may include image data acquisition means for acquiring image data output from the information processing device. The display screen of the portable display device may display the first image indicated by the image data acquired by the image data acquisition means.

  Based on the above, the portable display device can function as a so-called thin client terminal that does not execute information processing such as game processing.

  The information processing program may further cause the computer to function as compressed image generation means. The compressed image generation means generates compressed image data by compressing image data indicating the first image. In this case, the display control means may output the compressed image data generated by the compressed image generation means to the portable display device. The image data acquisition unit may acquire compressed image data output from the information processing apparatus. The portable display device may further include display image expansion means for expanding the compressed image data to obtain image data indicating the first image. The display screen of the portable display device may display the first image indicated by the image data acquired by the image data acquisition unit and expanded by the display image expansion unit.

  According to the above, since the first image is compressed and output from the information processing device to the portable display device, the first image can be output at high speed, and the first image is generated after the first image is generated. Can be delayed until the image is displayed on the portable display device.

  The display control means may further display a second image indicating the virtual world viewed from the second virtual camera on another display device connected to the information processing device, separately from the first image.

  The other display device is a display device connected to the information processing device like the monitor 2 in an embodiment described later, and may be a separate body from the portable display device, and is generated by the information processing device. Any other image can be used as long as it can display the second image. For example, the another display device may be configured integrally with the information processing device (in one housing).

  According to the above, when the process based on the operation of moving the portable display device and the touch operation is performed, the processing result is displayed not only on the portable display device but also on another display device connected to the information processing device. be able to. Therefore, for example, the user can use the images displayed on the two devices according to the operation status and preference, and can also view an image suitable for the user operation. Further, an image to be displayed on another display device connected to the information processing device can be used as an image for other people to view, for example, different from the user, and is also suitable when a plurality of people view the processing result. Can be a comfortable viewing environment.

  The information processing program may further cause the computer to function as compressed image generation means. The compressed image generation means generates compressed image data by compressing image data indicating the first image. In this case, the display control unit outputs the compressed image data generated by the compressed image generation unit to the portable display device, and separately from the compressed image data, the image data indicating the second image is not compressed. You may output to a display apparatus. The portable display device includes an image data acquisition unit that acquires compressed image data output from the information processing device, and a display image expansion unit that expands the compressed image data to obtain image data indicating the first image. Also good. The display screen of the portable display device may display the first image indicated by the image data acquired by the image data acquisition unit and expanded by the display image expansion unit.

  According to the above, since the first image is compressed and output from the information processing device to the portable display device, the first image can be output at high speed, and the first image is generated after the first image is generated. Can be delayed until the image is displayed on the portable display device.

  The information processing program may further cause the computer to function as second virtual camera control means. The second virtual camera control means sets the second virtual camera at a position different from the first virtual camera, and controls the attitude and / or position of the second virtual camera.

  According to the above, the same virtual world is displayed not only on the portable display device but also on another display device, and images of virtual worlds with different viewpoints are displayed. Therefore, the user can use the images displayed on the two devices according to the operation situation and preference when operating.

  The second virtual camera control means sets the line-of-sight direction of the second virtual camera so as to be parallel to the line-of-sight direction of the first virtual camera, and sets the second virtual camera behind the first virtual camera. May be. The display control means may display a range wider than the range of the virtual world indicated by the first image on another display device as the second image.

  According to the above, a virtual world image having a wider display range than the virtual world image displayed on the portable display device is displayed on another display device connected to the game device. It is possible to display an image suitable for user operation on each display device.

  The first virtual camera control means may set the line-of-sight direction of the first virtual camera in the vertical direction of the virtual world. The second virtual camera control means may set the line-of-sight direction of the second virtual camera in the vertical direction of the virtual world.

  According to the above, the same virtual world is displayed not only on the portable display device but also on another display device, and the portable display device and another display device display the bird's-eye view of the virtual world. For example, an image suitable for a user operation when presenting the state of the virtual world to the user can be displayed on each display device.

  In addition, the present invention may be implemented in the form of an information processing apparatus and an information processing system including the above-described units and an information processing method including operations performed by the above units.

  ADVANTAGE OF THE INVENTION According to this invention, when the viewpoint of the image displayed on the said apparatus changes with a motion and attitude | position of a portable display apparatus main body, operation which changes the said viewpoint can be made still easier.

1 is an external view showing an example of a game system 1 according to an embodiment of the present invention. Functional block diagram showing an example of the game apparatus body 5 of FIG. The figure which shows an example of an external appearance structure of the terminal device 6 of FIG. The figure which shows an example of a mode that the user hold | gripped the terminal device 6. The block diagram which shows an example of an internal structure of the terminal device 6 of FIG. The perspective view which shows an example of the external appearance of the board type controller 9 of FIG. The figure which shows an example of the AA sectional drawing of the board-type controller 9 shown in FIG. 6, and an example by which the part of the corner where the load sensor 94 is arrange | positioned is enlargedly displayed. FIG. 6 is a block diagram showing an example of an electrical configuration of the board type controller 9 of FIG. The figure which shows an example of the mode of the user who operates using the terminal device 6 and the board type controller 9 The figure which shows an example of the image displayed on the monitor 2 The figure which shows an example of the image displayed on LCD61 of the terminal device 6 The figure which shows an example of the image displayed on the monitor 2, when operation by the attitude | position of the terminal device 6 has shown the reference | standard operation instruction | indication direction The figure which shows an example of the image displayed on LCD61 of the terminal device 6 in the state in which operation by the attitude | position of the terminal device 6 has shown the reference | standard operation instruction | indication direction 11 is a diagram showing an example of an image displayed on the monitor 2 when the terminal device 6 is rolled counterclockwise on the desktop from the state shown in FIG. 11B. 11 is a diagram showing an example of an image displayed on the LCD 61 of the terminal device 6 when the terminal device 6 is rolled counterclockwise on the desktop from the state shown in FIG. 11B. 11 is a diagram illustrating an example of an image displayed on the monitor 2 when the terminal device 6 is rotated 90 ° counterclockwise on the desktop from the state illustrated in FIG. 11B. 11 is a diagram showing an example of an image displayed on the LCD 61 of the terminal device 6 when the terminal device 6 is rotated 90 ° counterclockwise on the desktop from the state shown in FIG. 11B. The figure for demonstrating rotation operation of a player object and a virtual camera as an example corresponding to the change of the operation instruction | indication direction obtained from the attitude | position of the terminal device 6 The figure for demonstrating rotation operation | movement of a terrain object as another example corresponding to the change of the operation instruction | indication direction obtained from the attitude | position of the terminal device 6 The figure which shows an example of the image displayed on the monitor 2 when the touch panel 62 of the terminal device 6 is touch-operated from the state shown to FIG. 11B. 11 is a diagram showing an example of an image displayed on the LCD 61 of the terminal device 6 when the touch panel 62 of the terminal device 6 is touched from the state shown in FIG. 11B. The figure for demonstrating the movement operation | movement of a player object and a virtual camera as an example corresponding to the touch operation to the touch panel 62 of the terminal device 6. FIG. The figure for demonstrating the movement operation | movement of a terrain object as another example corresponding to the touch operation to the touch panel 62 of the terminal device 6. FIG. The figure which shows an example of main data and a program memorize | stored in the main memory of the game device main body 5 of FIG. The flowchart which shows an example of the game process performed in the game device main body 5 of FIG. Subroutine showing an example of the game control process of step 44 in FIG. Subroutine showing an example of the object setting process in step 83 in FIG. Subroutine showing an example of the movement process of step 118 in FIG.

  With reference to FIG. 1, an information processing apparatus that executes an information processing program according to an embodiment of the present invention and an information processing system including the information processing apparatus will be described. Hereinafter, for the sake of specific explanation, a stationary game apparatus body 5 will be used as an example of the information processing apparatus, and a game system including the game apparatus body 5 will be described. FIG. 1 is an external view showing an example of a game system 1 including a stationary game apparatus 3. FIG. 2 is a block diagram illustrating an example of the game apparatus body 5. Hereinafter, the game system 1 will be described.

  In FIG. 1, a game system 1 includes a home television receiver (hereinafter referred to as a monitor) 2 which is an example of display means, and a stationary game apparatus 3 connected to the monitor 2 via a connection cord. Composed. The monitor 2 includes a speaker 2a for outputting the audio signal output from the game apparatus 3 as audio. In addition, the game apparatus 3 executes an optical disc 4 on which a program (for example, a game program) as an example of the information processing program of the present invention is recorded, and executes the program on the optical disc 4 to display and output a game screen on the monitor 2. A game apparatus body 5 equipped with a computer, a terminal device 6, a controller 7 for giving the game apparatus body 5 operation information necessary for operating an object or the like displayed on the display screen, and a board-type controller 9 including. The game system 1 executes a game process in the game apparatus body 5 based on a game operation using at least one of the terminal device 6, the controller 7, and the board type controller 9, and monitors a game image obtained by the game process 2 and / or the terminal device 6. Note that the game apparatus body 5, the terminal device 6, the controller 7, and the board-type controller 9 are connected so as to be capable of wireless communication by radio. For example, the wireless communication is executed in accordance with the Bluetooth (registered trademark) standard or the IEEE 802.11n standard, but may be executed in accordance with other standards such as infrared rays.

  An optical disc 4, which is an example of an information storage medium that can be used interchangeably with respect to the game device main body 5, is detachably inserted into the game device main body 5. The optical disc 4 stores an information processing program (typically a game program) to be executed in the game apparatus body 5. An insertion slot for the optical disc 4 is provided on the front surface of the game apparatus body 5. The game apparatus body 5 executes the game process by reading and executing the information processing program stored in the optical disc 4 inserted into the insertion slot.

  The monitor 2 is connected to the game apparatus body 5 via a connection cord. The monitor 2 displays a game image obtained by a game process executed in the game apparatus body 5. The monitor 2 has a speaker 2a, and the speaker 2a outputs game sound obtained as a result of the game processing. In other embodiments, the game apparatus body 5 and the stationary display apparatus may be integrated. Communication between the game apparatus body 5 and the monitor 2 may be wireless communication.

  The game apparatus body 5 is equipped with a flash memory 17 (see FIG. 2) that functions as a backup memory that stores data such as save data in a fixed manner. The game apparatus main body 5 displays the result as a game image on the monitor 2 and / or the terminal device 6 by executing a game program or the like stored on the optical disc 4. The game program or the like is not limited to the optical disc 4 and may be executed in advance recorded in the flash memory 17. Further, the game apparatus body 5 can reproduce the game state executed in the past by using the save data stored in the flash memory 17 and display the game image on the monitor 2 and / or the terminal device 6. . Then, the user of the game device 3 operates at least one of the terminal device 6, the controller 7, and the board type controller 9 while watching the game image displayed on the monitor 2 and / or the terminal device 6, thereby playing the game You can enjoy the progress.

  The controller 7 and the board-type controller 9 wirelessly transmit transmission data such as operation information to the game apparatus body 5 incorporating the controller communication module 19 by using, for example, Bluetooth technology. The controller 7 is an operation means for mainly selecting an option displayed on the display screen of the monitor 2. The controller 7 is provided with a housing large enough to be held with one hand, and a plurality of operation buttons (including a cross key and the like) exposed on the surface of the housing. Further, as will be apparent from the description below, the controller 7 includes an imaging information calculation unit that captures an image viewed from the controller 7. Then, as an example of the imaging target of the imaging information calculation unit, two LED modules (hereinafter referred to as markers) 8L and 8R are installed near the display screen of the monitor 2 (upper side of the screen in FIG. 1). Although details will be described later, the user (player) can perform a game operation to move the controller 7, and the marker 8 is used by the game apparatus body 5 to calculate the movement, position, posture, and the like of the controller 7. The marker 8 includes two markers 8L and 8R at both ends thereof. The marker 8R (same for the marker 8L) is specifically one or more infrared LEDs (Light Emitting Diodes), and outputs infrared light toward the front of the monitor 2. The marker 8 is connected to the game apparatus body 5, and the game apparatus body 5 can control lighting of each infrared LED included in the marker 8. The marker 8 is portable, and the user can install the marker 8 at a free position. Although FIG. 1 shows a mode in which the marker 8 is installed on the monitor 2, the position and orientation in which the marker 8 is installed are arbitrary. In addition, the controller 7 can receive transmission data wirelessly transmitted from the controller communication module 19 of the game apparatus body 5 by the communication unit, and can generate sound and vibration corresponding to the transmission data.

  In other embodiments, the controller 7 and / or the board-type controller 9 and the game apparatus body 5 may be connected by wire. In this embodiment, the game system 1 includes one controller 7 and one board-type controller 9, but the game apparatus body 5 can communicate with a plurality of controllers 7 and a plurality of board-type controllers 9. By using the number of controllers 7 and the board type controller 9 at the same time, it is possible to play a game with a plurality of people.

  The controller 7 has a housing formed by plastic molding, for example, and a plurality of operation portions (operation buttons) are provided in the housing. Then, the controller 7 transmits operation data indicating an input state to the operation unit (whether or not each operation button is pressed) to the game apparatus body 5.

  In addition, the controller 7 has an imaging information calculation unit that analyzes the image data captured by the imaging unit and determines a region having high luminance in the region, thereby calculating the position of the center of gravity, the size, and the like of the region. For example, the imaging information calculation unit includes imaging means fixed to the housing of the controller 7 and targets a marker that outputs infrared light such as the marker unit 65 and / or the marker 8 of the terminal device 6 as an imaging target. Then, the imaging information calculation unit calculates the position of the imaging target in the captured image captured by the imaging unit, and transmits marker coordinate data indicating the calculated position to the game apparatus body 5. Since this marker coordinate data changes corresponding to the direction (inclination angle) and position of the controller 7 itself, the game apparatus body 5 can calculate the direction and position of the controller 7 using this marker coordinate data.

  Further, the controller 7 includes an acceleration sensor and / or a gyro sensor. The acceleration sensor detects acceleration (including gravitational acceleration) generated in the controller 7 and transmits acceleration data indicating the detected acceleration to the game apparatus body 5. Since the acceleration detected by the acceleration sensor changes in accordance with the direction (tilt angle) and movement of the controller 7 itself, the game apparatus body 5 calculates the direction and movement of the controller 7 using the acquired acceleration data. Can do. The gyro sensor detects angular velocities around the three axes set in the controller 7 and transmits angular velocity data indicating the detected angular velocities to the game apparatus body 5. Since the angular velocity detected by the gyro sensor changes in accordance with the direction (tilt angle) and movement of the controller 7 itself, the game apparatus body 5 calculates the direction and movement of the controller 7 using the acquired angular velocity data. Can do. In this way, the user can perform a game operation by pressing an operation unit provided in the controller 7 and moving the controller 7 itself to change its position and posture (tilt).

  The controller 7 is provided with a speaker and a vibrator. The controller 7 processes the sound data transmitted from the game apparatus body 5 and outputs sound corresponding to the sound data from the speaker. Further, the controller 7 processes the vibration data transmitted from the game apparatus body 5 and activates the vibrator according to the vibration data to generate vibration. In the embodiment of the present invention to be described later, it is possible to play a game without using the controller 7. The detailed configuration of the board type controller 9 will be described later.

  The terminal device 6 is large enough to be gripped by the user, and the user can use the terminal device 6 by holding it in his hand or by placing the terminal device 6 in a free position. This is a portable device. Although the detailed configuration will be described later, the terminal device 6 includes an LCD (Liquid Crystal Display) 61 that is a display means, and input means (a touch panel 62, a gyro sensor 604, etc., which will be described later). The terminal device 6 and the game apparatus body 5 (terminal communication module 28 (see FIG. 2)) can communicate wirelessly (may be wired). The terminal device 6 receives data of an image (for example, a game image) generated by the game apparatus body 5 from the game apparatus body 5 and displays an image indicated by the data on the LCD 61. In this embodiment, an LCD is used as the display device. However, the terminal device 6 may have any other display device such as a display device using EL (Electro Luminescence). . In addition, the terminal device 6 transmits operation data representing the content of the operation performed on the own device to the game apparatus body 5 including the terminal communication module 28.

  Next, the internal configuration of the game apparatus body 5 will be described with reference to FIG. FIG. 2 is a block diagram illustrating an example of the configuration of the game apparatus body 5. The game apparatus body 5 includes a CPU (Central Processing Unit) 10, a system LSI (Large Scale Integration) 11, an external main memory 12, a ROM / RTC (Read Only Memory / Real Time Clock) 13, a disk drive 14, and an AV-IC. (Audio Video-Integrated Circuit) 15 and the like.

  The CPU 10 executes processing by executing a program stored on the optical disc 4 and functions as a game processor. The CPU 10 is connected to the system LSI 11. In addition to the CPU 10, an external main memory 12, a ROM / RTC 13, a disk drive 14, and an AV-IC 15 are connected to the system LSI 11. The system LSI 11 performs processing such as control of data transfer between components connected thereto, generation of an image to be displayed, and acquisition of data from an external device. The internal configuration of the system LSI 11 will be described later. The volatile external main memory 12 stores a program read from the optical disk 4, a program read from the flash memory 17, and various data, and stores a work area and a buffer of the CPU 10. Used as a region. The ROM / RTC 13 includes a ROM (so-called boot ROM) in which a program for starting up the game apparatus body 5 is incorporated, and a clock circuit (RTC) that counts time. The disk drive 14 reads program data, texture data, and the like from the optical disk 4 and writes the read data to the internal main memory 35 or the external main memory 12 described later.

  The system LSI 11 includes an input / output processor (I / O processor) 31, a GPU (Graphics Processor Unit) 32, a DSP (Digital Signal Processor) 33, a VRAM (Video RAM) 34, and an internal main memory 35. Although not shown, these components 31 to 35 are connected to each other by an internal bus.

  The GPU 32 forms part of the drawing means and generates an image in accordance with a graphics command (drawing command) from the CPU 10. The VRAM 34 stores data (data such as polygon data and texture data) necessary for the GPU 32 to execute the graphics command. When an image is generated, the GPU 32 creates image data using data stored in the VRAM 34. In the present embodiment, the game apparatus body 5 may generate both a game image to be displayed on the monitor 2 and a game image to be displayed on the terminal device 6. Hereinafter, a game image displayed on the monitor 2 may be referred to as a “monitor game image”, and a game image displayed on the terminal device 6 may be referred to as a “terminal game image”.

  The DSP 33 functions as an audio processor, and generates sound data using sound data and sound waveform (tone color) data stored in the internal main memory 35 and the external main memory 12. In the present embodiment, both game sound output from the speaker 2a of the monitor 2 and game sound output from the speaker of the terminal device 6 may be generated for the game sound as well as the game image. Hereinafter, the game sound output from the monitor 2 may be referred to as “monitor game sound”, and the game sound output from the terminal device 6 may be referred to as “terminal game sound”.

  Of the images and sounds generated in the game apparatus body 5 as described above, the image data and sound data output to the monitor 2 are read out by the AV-IC 15. The AV-IC 15 outputs the read image data to the monitor 2 via the AV connector 16 and outputs the read audio data to the speaker 2 a built in the monitor 2. As a result, an image is displayed on the monitor 2 and a sound is output from the speaker 2a.

  Of the images and sounds generated in the game apparatus body 5, image data and sound data output to the terminal device 6 are transmitted to the terminal device 6 by the input / output processor 31 or the like. Data transmission to the terminal device 6 by the input / output processor 31 and the like will be described later.

  The input / output processor 31 transmits / receives data to / from components connected to the input / output processor 31 or downloads data from an external device. The input / output processor 31 is connected to the flash memory 17, network communication module 18, controller communication module 19, expansion connector 20, memory card connector 21, and codec LSI 27. An antenna 22 is connected to the network communication module 18. An antenna 23 is connected to the controller communication module 19. The codec LSI 27 is connected to a terminal communication module 28, and an antenna 29 is connected to the terminal communication module 28.

  The game apparatus body 5 can connect to a network such as the Internet and communicate with an external information processing apparatus (for example, another game apparatus or various servers). That is, the input / output processor 31 is connected to the network via the network communication module 18 and the antenna 22 and can communicate with an external information processing apparatus connected to the network. The input / output processor 31 periodically accesses the flash memory 17 to detect the presence / absence of data that needs to be transmitted to the network. If the data is present, the data is sent via the network communication module 18 and the antenna 22. To the network. Further, the input / output processor 31 receives data transmitted from the external information processing apparatus or data downloaded from the download server via the network, the antenna 22 and the network communication module 18, and receives the received data in the flash memory 17. To remember. By executing the program, the CPU 10 reads out the data stored in the flash memory 17 and uses it in the program. In the flash memory 17, in addition to data transmitted and received between the game apparatus body 5 and the external information processing apparatus, save data (process result data or intermediate data) of a game played using the game apparatus body 5 is stored. It may be stored. The flash memory 17 may store a program such as a game program.

  Further, the game apparatus body 5 can receive operation data from the controller 7 and / or the board type controller 9. That is, the input / output processor 31 receives operation data and the like transmitted from the controller 7 and / or the board-type controller 9 via the antenna 23 and the controller communication module 19 and buffers the internal main memory 35 or the external main memory 12. Store in the area (temporary storage). As in the case of the external main memory 12, the internal main memory 35 may store a program read from the optical disc 4, a program read from the flash memory 17, or various data. The CPU 10 may be used as a work area or a buffer area.

  Further, the game apparatus body 5 can transmit and receive data such as images and sounds to and from the terminal device 6. When the game image (terminal game image) is transmitted to the terminal device 6, the input / output processor 31 outputs the game image data generated by the GPU 32 to the codec LSI 27. The codec LSI 27 performs predetermined compression processing on the image data from the input / output processor 31. The terminal communication module 28 performs wireless communication with the terminal device 6. Therefore, the image data compressed by the codec LSI 27 is transmitted to the terminal device 6 via the antenna 29 by the terminal communication module 28. In the present embodiment, the image data transmitted from the game apparatus body 5 to the terminal device 6 is used for the game. In the game, if the displayed image is delayed, the operability of the game is adversely affected. For this reason, it is preferable that the transmission of image data from the game apparatus body 5 to the terminal device 6 should be as delayless as possible. Therefore, in this embodiment, the codec LSI 27 is, for example, H.264. The image data is compressed using a highly efficient compression technique such as H.264 standard. Other compression techniques may be used, and when the communication speed is sufficient, the image data may be transmitted without compression. The terminal communication module 28 is a communication module that has received, for example, Wi-Fi authentication. For example, the terminal communication module 28 uses a MIMO (Multiple Input Multiple Output) technology adopted in the IEEE 802.11n standard, for example. Wireless communication may be performed at high speed, or another communication method may be used.

  In addition to the image data, the game apparatus body 5 transmits audio data to the terminal device 6. That is, the input / output processor 31 outputs the audio data generated by the DSP 33 to the terminal communication module 28 via the codec LSI 27. The codec LSI 27 performs compression processing on the audio data in the same manner as the image data. The compression method for the audio data may be any method, but a method with a high compression rate and less deterioration of the sound is preferable. In other embodiments, audio data may be transmitted without being compressed. The terminal communication module 28 transmits the compressed image data and audio data to the terminal device 6 via the antenna 29.

  Furthermore, the game apparatus body 5 transmits various control data to the terminal device 6 as needed in addition to the image data and the sound data. The control data is data representing a control instruction for the constituent elements included in the terminal device 6, for example, an instruction for controlling lighting of the marker unit (marker unit 65 shown in FIG. 5) or a camera (camera 66 shown in FIG. 5). Indicates an instruction to control imaging. The input / output processor 31 transmits control data to the terminal device 6 in accordance with an instruction from the CPU 10. With respect to this control data, the codec LSI 27 does not perform data compression processing in the present embodiment, but may perform compression processing in other embodiments. Note that the above-described data transmitted from the game apparatus body 5 to the terminal device 6 may or may not be encrypted as necessary.

  Further, the game apparatus body 5 can receive various data from the terminal device 6. Although details will be described later, in the present embodiment, the terminal device 6 transmits operation data, image data, and audio data. Each data transmitted from the terminal device 6 is received by the terminal communication module 28 via the antenna 29. Here, the image data and audio data from the terminal device 6 are subjected to the same compression processing as the image data and audio data from the game apparatus body 5 to the terminal device 6. Therefore, these image data and audio data are sent from the terminal communication module 28 to the codec LSI 27, subjected to expansion processing by the codec LSI 27, and output to the input / output processor 31. On the other hand, the operation data from the terminal device 6 has a smaller data amount than images and sounds, and therefore may not be subjected to compression processing. Further, encryption may or may not be performed as necessary. Therefore, the operation data is received by the terminal communication module 28 and then output to the input / output processor 31 via the codec LSI 27. The input / output processor 31 stores (temporarily stores) the data received from the terminal device 6 in the buffer area of the internal main memory 35 or the external main memory 12.

  Further, the game apparatus body 5 can be connected to other devices and external storage media. That is, the expansion connector 20 and the memory card connector 21 are connected to the input / output processor 31. The expansion connector 20 is a connector for an interface such as USB or SCSI, and connects a medium such as an external storage medium, a peripheral device such as another controller, or a wired communication connector. By connecting, communication with the network can be performed instead of the network communication module 18. The memory card connector 21 is a connector for connecting an external storage medium such as a memory card. For example, the input / output processor 31 can access an external storage medium via the expansion connector 20 or the memory card connector 21 to store data or read data.

  The game apparatus body 5 (for example, the front main surface) is provided with a power button 24, a reset button 25, an insertion port for attaching / detaching the optical disk 4, an eject button 26 for removing the optical disk 4 from the insertion port of the game apparatus body 5, and the like. It has been. The power button 24 and the reset button 25 are connected to the system LSI 11. When the power button 24 is turned on, power is supplied to each component of the game apparatus body 5. When the reset button 25 is pressed, the system LSI 11 restarts the startup program of the game apparatus body 5. The eject button 26 is connected to the disk drive 14. When the eject button 26 is pressed, the optical disk 4 is ejected from the disk drive 14.

  In other embodiments, some of the components included in the game apparatus body 5 may be configured as expansion devices that are separate from the game apparatus body 5. At this time, the expansion device may be connected to the game apparatus body 5 via the expansion connector 20, for example. Specifically, the expansion device includes, for example, the codec LSI 27, the terminal communication module 28, and the antenna 29, and may be detachable from the expansion connector 20. According to this, the said game device main body can be set as the structure which can communicate with the terminal device 6 by connecting the said extended apparatus with respect to the game device main body which is not provided with said each component.

  Next, the configuration of the terminal device 6 will be described with reference to FIGS. FIG. 3 is a diagram illustrating an example of an external configuration of the terminal device 6. 3A is a front view of the terminal device 6, FIG. 3B is a top view, FIG. 3C is a right side view, and FIG. 3D is a bottom view. FIG. 4 is a diagram illustrating an example of a state in which the user holds the terminal device 6.

  As shown in FIG. 3, the terminal device 6 includes a housing 60 that is roughly a horizontally-long rectangular plate shape. The housing 60 is large enough to be gripped by the user. Accordingly, the user can move the terminal device 6 or change the arrangement position of the terminal device 6.

  The terminal device 6 has an LCD 61 on the surface of the housing 60. The LCD 61 is provided near the center of the surface of the housing 60. Therefore, the user can move the terminal device 6 while looking at the screen of the LCD 61 by holding the housings 60 on both sides of the LCD 61 as shown in FIG. FIG. 4 shows an example in which the user holds the terminal device 6 sideways by holding the housings 60 on both the left and right sides of the LCD 61 (that is, the terminal device 6 is held with the long side direction in the horizontal direction). However, it is also possible to hold the terminal device 6 vertically (that is, hold the terminal device 6 with the long side direction vertical).

  As illustrated in part (a) of FIG. 3, the terminal device 6 includes a touch panel 62 on the screen of the LCD 61 as an operation unit. In the present embodiment, the touch panel 62 is a resistive film type touch panel. However, the touch panel 62 is not limited to the resistive film type, and any type of touch panel such as a capacitance type can be used. The touch panel 62 may be a single touch method or a multi touch method. In this embodiment, a touch panel 62 having the same resolution (detection accuracy) as the resolution of the LCD 61 is used. However, the resolution of the touch panel 62 and the resolution of the LCD 61 are not necessarily matched. The input to the touch panel 62 is normally performed using a touch pen. However, the input to the touch panel 62 is not limited to the touch pen and can be performed by a user's finger. The housing 60 may be provided with a storage hole for storing a touch pen used for performing an operation on the touch panel 62. Thus, since the terminal device 6 includes the touch panel 62, the user can operate the touch panel 62 while moving the terminal device 6. That is, the user can directly input (by the touch panel 62) to the screen while moving the screen of the LCD 61.

  As shown in FIG. 3, the terminal device 6 includes two analog sticks 63A and 63B and a plurality of operation buttons 64A to 64L as operation means. Each analog stick 63A and 63B is a device that indicates a direction. Each analog stick 63A and 63B is configured such that the stick portion operated by the user's finger can slide or tilt in any direction (any angle in the up / down / left / right and diagonal directions) with respect to the surface of the housing 60. Has been. The left analog stick 63A is provided on the left side of the screen of the LCD 61, and the right analog stick 63B is provided on the right side of the screen of the LCD 61. Therefore, the user can input with the left or right hand to instruct the direction using the analog stick 63A or 63B. Further, as shown in FIG. 4, the analog sticks 63 </ b> A and 63 </ b> B are provided at positions where the user can operate while holding the left and right portions of the terminal device 6. Also, the analog sticks 63A and 63B can be easily operated.

  The operation buttons 64A to 64L are operation means for performing predetermined inputs. As shown below, each operation button 64A-64L is provided in the position which a user can operate in the state which hold | gripped the right-and-left part of the terminal device 6 (refer FIG. 4). Therefore, the user can easily operate these operation means even when the user moves the terminal device 6.

  As shown in part (a) of FIG. 3, among the operation buttons 64A to 64L, a cross button (direction input button) 64A and operation buttons 64B to 64H are provided on the surface of the housing 60. These operation buttons 64A to 64G are arranged at positions where they can be operated with the thumb of the user (see FIG. 4).

  The cross button 64A is provided on the left side of the LCD 61 and below the left analog stick 63A. That is, the cross button 64A is arranged at a position where it can be operated with the left hand of the user. The cross button 64 </ b> A has a cross shape and is a button capable of instructing the vertical and horizontal directions. The operation buttons 64B to 64D are provided below the LCD 61. These three operation buttons 64B to 64D are arranged at positions that can be operated by both the left and right hands. The four operation buttons 64E to 64H are provided on the right side of the LCD 61 and below the right analog stick 63B. That is, the four operation buttons 64E to 64H are arranged at positions that can be operated with the user's right hand. Further, the four operation buttons 64E to 64H are arranged so as to have a vertical / left / right positional relationship (relative to the center position of the four operation buttons 64E to 64H). Therefore, the terminal device 6 can also function the four operation buttons 64E to 64H as buttons for instructing the user in the up / down / left / right directions.

  Further, as shown in FIGS. 3A, 3B, and 3C, the first L button 64I and the first R button 64J are provided on an oblique upper portion (upper left portion and upper right portion) of the housing 60. Provided. Specifically, the first L button 64I is provided at the left end of the upper side surface of the plate-like housing 60, and protrudes from the upper and left side surfaces. The first R button 64J is provided at the right end of the upper side surface of the housing 60, and protrudes from the upper and right side surfaces. In this way, the first L button 64I is disposed at a position operable with the user's left index finger, and the first R button 64J is disposed at a position operable with the user's right hand index finger (see FIG. 4).

  As shown in FIGS. 3B and 3C, the second L button 64K and the second R button 64L are provided on the back surface of the plate-like housing 60 (that is, the surface opposite to the surface on which the LCD 61 is provided). Are protruded from the leg portions 68A and 68B. Specifically, the second L button 64K is provided slightly above the left side (left side when viewed from the front side) of the housing 60, and the second R button 64L is provided on the right side (from the front side) of the back side of the housing 60. It is provided slightly above the right side when viewed. In other words, the second L button 64K is provided at a position substantially opposite to the left analog stick 63A provided on the front surface, and the second R button 64L is provided at a position substantially opposite to the right analog stick 63B provided on the front surface. It is done. The second L button 64K is disposed at a position that can be operated by the user's left hand middle finger, and the second R button 64L is disposed at a position that can be operated by the user's right hand middle finger (see FIG. 4). Further, as shown in FIG. 3C, the second L button 64K and the second R button 64L are provided on the diagonally upward surfaces of the feet 68A and 68B, and have button surfaces that are diagonally upward. When the user grips the terminal device 6, it is considered that the middle finger moves in the vertical direction. Therefore, the user can easily press the second L button 64K and the second R button 64L by turning the button surface upward. Further, by providing the foot portions 68A and 68B on the back surface of the housing 60, the user can easily grip the housing 60, and the operation buttons are provided on the foot portions 68A and 68B, so that the housing 60 is held. It becomes easy to operate.

  3, since the second L button 64K and the second R button 64L are provided on the back surface, the terminal device 6 is placed with the screen of the LCD 61 (the surface of the housing 60) facing upward. The screen may not be completely horizontal. Therefore, in other embodiments, three or more legs may be formed on the back surface of the housing 60. According to this, since the terminal device 6 can be placed so that three or more feet are in contact with the floor surface when the screen of the LCD 61 is facing upward, the terminal device 6 is placed so that the screen is horizontal. can do. Alternatively, the terminal device 6 may be placed horizontally by attaching a detachable foot.

  Functions corresponding to the game program are appropriately assigned to the operation buttons 64A to 64L. For example, the cross button 64A and the operation buttons 64E to 64H may be used for a direction instruction operation or a selection operation, and the operation buttons 64B to 64E may be used for a determination operation or a cancel operation.

  Although not shown, the terminal device 6 has a power button for turning on / off the terminal device 6. Further, the terminal device 6 has an operation button for turning on / off the screen display of the LCD 61, an operation button for setting connection (pairing) with the game apparatus body 5, and a speaker (a speaker 607 shown in FIG. 5). ) May have an operation button for adjusting the volume.

  As shown in part (a) of FIG. 3, the terminal device 6 includes a marker part (marker part 65 shown in FIG. 5) including a marker 65 </ b> A and a marker 65 </ b> B on the surface of the housing 60. As an example, the marker unit 65 is provided on the upper side of the LCD 61. Like the markers 8L and 8R of the marker 8, the marker 65A and the marker 65B are each composed of one or more infrared LEDs. Similar to the marker 8 described above, the marker unit 65 is used by the game apparatus body 5 to calculate the movement of the controller 7 with respect to the marker unit 65. Further, the game apparatus body 5 can control lighting of each infrared LED included in the marker unit 65.

  The terminal device 6 includes a camera 66 that is an imaging unit. The camera 66 includes an imaging device (for example, a CCD image sensor or a CMOS image sensor) having a predetermined resolution, and a lens. For example, the camera 66 is provided on the surface of the housing 60. Therefore, the camera 66 can take an image of the face of the user who has the terminal device 6, and can take an image of the user who is playing the game while viewing the LCD 61 as an example.

  The terminal device 6 includes a microphone (a microphone 609 shown in FIG. 5) that is a voice input unit. A microphone hole 60 b is provided on the surface of the housing 60. The microphone 609 is provided inside the housing 60 that is inside the microphone hole 60b. The microphone 609 detects sounds around the terminal device 6 such as a user's voice.

  The terminal device 6 includes a speaker (speaker 607 shown in FIG. 5) that is an audio output means. As shown in part (d) of FIG. 3, a speaker hole 60 a is provided on the lower side surface of the housing 60. The output sound of the speaker 607 is output from the speaker hole 60a. In the present embodiment, the terminal device 6 includes two speakers, and a speaker hole 60a is provided at each position of the left speaker and the right speaker.

  The terminal device 6 includes an expansion connector 67 for connecting other devices to the terminal device 6. In the present embodiment, the extension connector 67 is provided on the lower side surface of the housing 60 as shown in FIG. Note that any other device connected to the expansion connector 67 may be used. For example, a controller (such as a gun-type controller) used for a specific game or an input device such as a keyboard may be used. If it is not necessary to connect another device, the expansion connector 67 may not be provided.

  In addition, regarding the terminal device 6 shown in FIG. 3, the shape of each operation button and the housing 60, the number of components, the installation position, and the like are merely examples, and other shapes, numbers, and installation positions are included. Also good.

  Next, the internal configuration of the terminal device 6 will be described with reference to FIG. FIG. 5 is a block diagram illustrating an example of the internal configuration of the terminal device 6. As shown in FIG. 5, in addition to the configuration shown in FIG. 3, the terminal device 6 includes a touch panel controller 601, a magnetic sensor 602, an acceleration sensor 603, a gyro sensor 604, a user interface controller (UI controller) 605, a codec LSI 606, a speaker. 607, a sound IC 608, a microphone 609, a wireless module 610, an antenna 611, an infrared communication module 612, a flash memory 613, a power supply IC 614, a battery 615, and a vibrator 619. These electronic components are mounted on an electronic circuit board and stored in the housing 60.

  The UI controller 605 is a circuit for controlling data input / output with respect to various input / output units. The UI controller 605 includes a touch panel controller 601, an analog stick 63 (analog sticks 63A and 63B), operation buttons 64 (operation buttons 64A to 64L), a marker unit 65, a magnetic sensor 602, an acceleration sensor 603, a gyro sensor 604, and a vibrator. 619. The UI controller 605 is connected to the codec LSI 606 and the expansion connector 67. Further, a power supply IC 614 is connected to the UI controller 605, and power is supplied to each unit via the UI controller 605. A built-in battery 615 is connected to the power supply IC 614 to supply power. The power supply IC 614 can be connected to a charger 616 or a cable that can acquire power from an external power source via a connector or the like. Power supply and charging can be performed. The terminal device 6 may be charged by attaching the terminal device 6 to a cradle having a charging function (not shown).

  The touch panel controller 601 is a circuit that is connected to the touch panel 62 and controls the touch panel 62. The touch panel controller 601 generates touch position data in a predetermined format based on a signal from the touch panel 62 and outputs it to the UI controller 605. The touch position data represents the coordinates of the position where the input is performed on the input surface of the touch panel 62. The touch panel controller 601 reads signals from the touch panel 62 and generates touch position data at a rate of once per predetermined time. Various control instructions for the touch panel 62 are output from the UI controller 605 to the touch panel controller 601.

  The analog stick 63 outputs to the UI controller 605 stick data representing the direction and amount in which the stick unit operated by the user's finger has slid (or tilted). In addition, the operation button 64 outputs operation button data representing the input status (whether or not it has been pressed) to each of the operation buttons 64 </ b> A to 64 </ b> L to the UI controller 605.

  The magnetic sensor 602 detects the direction by detecting the magnitude and direction of the magnetic field. The azimuth data indicating the detected azimuth is output to the UI controller 605. Also, a control instruction for the magnetic sensor 602 is output from the UI controller 605 to the magnetic sensor 602. Regarding the magnetic sensor 602, an MI (magnetic impedance) element, a flux gate sensor, a Hall element, a GMR (giant magnetoresistance) element, a TMR (tunnel magnetoresistance) element, an AMR (anisotropic magnetoresistance) element, or the like was used. Although there is a sensor, any sensor may be used as long as it can detect the direction. Strictly speaking, in a place where a magnetic field is generated other than the geomagnetism, the obtained azimuth data does not indicate the azimuth, but even in such a case, the terminal device 6 moves. Since the azimuth data changes, the change in the attitude of the terminal device 6 can be calculated.

  The acceleration sensor 603 is provided inside the housing 60 and detects the magnitude of linear acceleration along the direction of the three axes (the xyz axis shown in FIG. 3A). Specifically, the acceleration sensor 603 sets the long side direction of the housing 60 to the x axis (in the state in which the marker unit 65 is arranged on the upper side of the LCD 61, the right direction along the long side direction toward the display screen of the LCD 61). x-axis positive direction), the short side direction of the housing 60 is the y-axis (the marker unit 65 is arranged on the upper side of the LCD 61, and the upward direction along the short side direction toward the display screen of the LCD 61 is the y-axis. The magnitude of the linear acceleration of each axis is detected with the direction perpendicular to the surface of the housing 60 as the z-axis (the display screen depth direction of the LCD 61 is the z-axis positive direction). Acceleration data representing the detected acceleration is output to the UI controller 605. Further, a control instruction for the acceleration sensor 603 is output from the UI controller 605 to the acceleration sensor 603. The acceleration sensor 603 is, for example, a capacitive MEMS acceleration sensor in the present embodiment, but other types of acceleration sensors may be used in other embodiments. Further, the acceleration sensor 603 may be an acceleration sensor that detects a uniaxial or biaxial direction.

  The gyro sensor 604 is provided inside the housing 60 and detects angular velocities around the three axes of the x-axis, the y-axis, and the z-axis. Angular velocity data representing the detected angular velocity is output to the UI controller 605. Further, a control instruction for the gyro sensor 604 is output from the UI controller 605 to the gyro sensor 604. Any number and combination of gyro sensors may be used for detecting the triaxial angular velocity, and the gyro sensor 604 may be composed of a two-axis gyro sensor and a one-axis gyro sensor. Good. Further, the gyro sensor 604 may be a gyro sensor that detects a uniaxial or biaxial direction.

  The vibrator 619 is, for example, a vibration motor or a solenoid, and is connected to the UI controller 605. In response to a control instruction output from the UI controller 605 to the vibrator 619, the vibrator 619 operates to generate vibration in the terminal device 6. As a result, a so-called vibration-compatible game in which the vibration is transmitted to the user's hand holding the terminal device 6 can be realized.

  The UI controller 605 outputs operation data including touch position data, stick data, operation button data, azimuth data, acceleration data, and angular velocity data received from the above components to the codec LSI 606. When another device is connected to the terminal device 6 via the expansion connector 67, the operation data may further include data representing an operation on the other device.

  The codec LSI 606 is a circuit that performs compression processing on data transmitted to the game apparatus body 5 and expansion processing on data transmitted from the game apparatus body 5. Connected to the codec LSI 606 are an LCD 61, a camera 66, a sound IC 608, a wireless module 610, a flash memory 613, and an infrared communication module 612. The codec LSI 606 includes a CPU 617 and an internal memory 618. For example, although the terminal device 6 is configured not to perform the game process itself, it is necessary to execute a minimum program for management and communication of the terminal device 6. As an example, when the power is turned on, a program stored in the flash memory 613 is read into the internal memory 618 and executed by the CPU 617, whereby the terminal device 6 is activated. A part of the internal memory 618 is used as a VRAM for the LCD 61.

  The camera 66 captures an image in accordance with an instruction from the game apparatus body 5 and outputs the captured image data to the codec LSI 606. Control instructions for the camera 66 such as an image capturing instruction are output from the codec LSI 606 to the camera 66. Note that the camera 66 can also capture moving images. That is, the camera 66 can repeatedly capture images and repeatedly output image data to the codec LSI 606.

  The sound IC 608 is a circuit that is connected to the speaker 607 and the microphone 609 and controls input / output of audio data to and from the speaker 607 and the microphone 609. That is, when audio data is received from the codec LSI 606, the sound IC 608 outputs an audio signal obtained by performing D / A conversion on the audio data to the speaker 607, and outputs sound from the speaker 607. The microphone 609 detects sound (such as user's voice) transmitted to the terminal device 6 and outputs a sound signal indicating the sound to the sound IC 608. The sound IC 608 performs A / D conversion on the audio signal from the microphone 609 and outputs audio data in a predetermined format to the codec LSI 606.

  The codec LSI 606 transmits image data from the camera 66, audio data from the microphone 609, and operation data from the UI controller 605 to the game apparatus body 5 via the wireless module 610 as terminal operation data. In the present embodiment, the codec LSI 606 performs the same compression processing as the codec LSI 27 on the image data and audio data. The compressed image data and audio data and the terminal operation data are output to the wireless module 610 as transmission data. An antenna 611 is connected to the wireless module 610, and the wireless module 610 transmits the transmission data to the game apparatus body 5 via the antenna 611. The wireless module 610 has the same function as the terminal communication module 28 of the game apparatus body 5. That is, the wireless module 610 has a function of connecting to a wireless LAN by a method compliant with, for example, the IEEE 802.11n standard. Data transmitted from the wireless module 610 may or may not be encrypted as necessary.

  As described above, the transmission data transmitted from the terminal device 6 to the game apparatus body 5 includes operation data (terminal operation data), image data, and audio data. When another device is connected to the terminal device 6 via the extension connector 67, the data received from the other device may be further included in the transmission data. In addition, the infrared communication module 612 performs infrared communication with other devices in accordance with, for example, the IRDA standard. The codec LSI 606 may transmit the data received by infrared communication to the game apparatus body 5 by including the data in the transmission data as necessary.

  Further, as described above, compressed image data and audio data are transmitted from the game apparatus body 5 to the terminal device 6. These data are received by the codec LSI 606 via the antenna 611 and the wireless module 610. The codec LSI 606 decompresses the received image data and audio data. The expanded image data is output to the LCD 61, and an image corresponding to the image data is displayed on the LCD 61. The expanded audio data is output to the sound IC 608, and a sound corresponding to the audio data is output from the speaker 607.

  When the control data is included in the data received from the game apparatus body 5, the codec LSI 606 and the UI controller 605 issue a control instruction to each unit according to the control data. As described above, the control data is for each component included in the terminal device 6 (in this embodiment, the camera 66, the touch panel controller 601, the marker unit 65, the sensors 602 to 604, the vibrator 619, and the infrared communication module 612). Data representing a control instruction. In the present embodiment, as the control instruction represented by the control data, an instruction to operate each of the above components or to stop (stop) the operation can be considered. In other words, components that are not used in the game may be paused in order to reduce power consumption. In this case, the transmission data transmitted from the terminal device 6 to the game device body 5 includes data from the paused components. Do not include. In addition, since the marker unit 65 is an infrared LED, the control may simply be ON / OFF of power supply.

  As described above, the terminal device 6 includes operation means such as the touch panel 62, the analog stick 63, and the operation buttons 64. However, in other embodiments, instead of these operation means or together with these operation means. The configuration may include other operation means.

  Further, the terminal device 6 includes a magnetic sensor 602, an acceleration sensor 603, and a gyro sensor 604 as sensors for calculating the movement of the terminal device 6 (including changes in position and orientation, or position and orientation). In other embodiments, the configuration may include only one or two of these sensors. Moreover, in other embodiment, it may replace with these sensors or the structure provided with another sensor with these sensors may be sufficient.

  Moreover, although the terminal device 6 is a structure provided with the camera 66 and the microphone 609, in other embodiment, it does not need to be provided with the camera 66 and the microphone 609, and may be provided only with either one. Good.

  Further, the terminal device 6 is configured to include a marker unit 65 as a configuration for calculating the positional relationship between the terminal device 6 and the controller 7 (the position and / or orientation of the terminal device 6 viewed from the controller 7). In other embodiments, the marker unit 65 may not be provided. Moreover, in other embodiment, the terminal device 6 may be provided with another means as a structure for calculating the said positional relationship. For example, in another embodiment, the controller 7 may include a marker unit, and the terminal device 6 may include an imaging element. Furthermore, in this case, the marker 8 may be configured to include an imaging element instead of the infrared LED.

  Next, the configuration of the board type controller 9 will be described with reference to FIGS. FIG. 6 is a perspective view showing an example of the appearance of the board-type controller 9 shown in FIG. As shown in FIG. 6, the board-type controller 9 includes a base 9a on which the user rides (a user's foot is placed), and at least four load sensors 94a to 94d for detecting a load applied to the base 9a. . Each of the load sensors 94a to 94d is included in the base 9a (see FIG. 7), and in FIG. 6, their arrangement positions are indicated by broken lines. In the following description, the four load sensors 94a to 94d may be described as the load sensor 94 when collectively described.

  The base 9a is formed in a substantially rectangular parallelepiped and has a substantially rectangular shape when viewed from above. For example, the base 9a has a rectangular short side set to about 30 cm and a long side set to about 50 cm. The upper surface of the base 9a is formed flat, and a pair of surfaces are set for the user to put on both feet and ride. Specifically, on the upper surface of the base 9a, a surface on which the user places the left foot (a region surrounded by a double line on the left back side in FIG. 6) and a surface on which the left foot is placed (the right front side in FIG. 6). (Regions surrounded by double lines) are set. And the side surfaces of the four corners of the base 9a are formed, for example, so as to partially protrude in a columnar shape.

  In the table 9a, the four load sensors 94a to 94d are arranged at a predetermined interval. In this embodiment, the four load sensors 94a to 94d are arranged at the peripheral edge of the base 9a, specifically at the four corners. The interval between the load sensors 94a to 94d is set to an appropriate value so that the intention of the game operation according to the user's load applied to the table 9a can be detected with higher accuracy.

  FIG. 7 shows an example of an AA sectional view of the board-type controller 9 shown in FIG. 6 and an example in which a corner portion where the load sensor 94 is arranged is enlarged. In FIG. 7, the base 9 a includes a support plate 90 and legs 92 for the user to ride. The load sensors 94a to 94d are respectively provided at locations where the legs 92 are disposed. In this embodiment, since the four legs 92 are provided at the four corners, the four load sensors 94a to 94d are respectively arranged at the four corners. The leg 92 is formed in a substantially bottomed cylindrical shape by plastic molding, for example, and the load sensor 94 is disposed on a spherical component 92 a provided on the bottom surface in the leg 92. The support plate 90 is supported by the legs 92 via the load sensor 94.

  The support plate 90 includes an upper layer plate 90a that forms the upper surface and the upper side surface, a lower layer plate 90b that forms the lower surface and the lower side surface, and a middle layer plate 90c provided between the upper layer plate 90a and the lower layer plate 90b. The upper layer plate 90a and the lower layer plate 90b are formed by plastic molding, for example, and are integrated by adhesion or the like. The middle layer plate 90c is formed by press molding of one metal plate, for example. The middle layer plate 90c is fixed on the four load sensors 94a to 94d. The upper layer plate 90a has lattice-like ribs (not shown) on the lower surface thereof, and is supported by the middle layer plate 90c via the ribs. Therefore, when the user gets on the base 9a, the load is transmitted to the four legs 92 via the support plate 90 and the load sensors 94a to 94d. As indicated by arrows in FIG. 7, the reaction from the floor caused by the input load is transmitted from the leg 92 to the upper layer plate 90a via the spherical component 92a, the load sensors 94a to 94d, and the middle layer plate 90c. To do.

  The load sensor 94 is, for example, a strain gauge (strain sensor) type load cell, and is a load converter that converts an input load into an electric signal. In the load sensor 94, in response to the load input, the strain generating body 95 is deformed to cause distortion. This strain is converted into a change in electrical resistance by a strain sensor 96 attached to the strain generating body 95 and further converted into a change in voltage. Therefore, the load sensor 94 can output a voltage signal indicating the input load from the output terminal.

  The load sensor 94 may be another type of load sensor such as a tuning fork vibration type, a string vibration type, a capacitance type, a piezoelectric type, a magnetostrictive type, or a gyro type.

  Returning to FIG. 6, the board type controller 9 is further provided with a power button 9c. When the power button 9c is operated (for example, the power button 9c is pressed) while the board type controller 9 is not activated, power is supplied to each circuit component (see FIG. 8) of the board type controller 9. However, the board-type controller 9 may be turned on in accordance with an instruction from the game apparatus body 5 to start supplying power to each circuit component. The board-type controller 9 may be automatically turned off when the state in which the user is not on continues for a certain time (for example, 30 seconds) or longer. Further, when the power button 9c is operated again while the board-type controller 9 is activated, the power supply may be turned off and the power supply to each circuit component may be stopped.

  FIG. 8 is a block diagram showing an example of the electrical configuration of the board-type controller 9. In FIG. 8, the flow of signals and data is indicated by solid arrows, and the supply of power is indicated by broken arrows.

  In FIG. 8, the board type controller 9 includes a microcomputer 100 for controlling the operation thereof. The microcomputer 100 includes a CPU, a ROM, a RAM, and the like (not shown), and the CPU controls the operation of the board type controller 9 according to a program stored in the ROM.

  The microcomputer 100 is connected to the power button 9c, the AD converter 102, the DC-DC converter 104, and the wireless module 106. Further, an antenna 106 a is connected to the wireless module 106. The four load sensors 94a to 94d are connected to the AD converter 102 via the amplifier 108, respectively.

  The board-type controller 9 houses a battery 110 for supplying power to each circuit component. In another embodiment, an AC adapter may be connected to the board type controller 9 instead of the battery 110 so that commercial power is supplied to each circuit component. In this case, instead of the DC-DC converter 104, it is necessary to provide in the board type controller 9 a power supply circuit that converts alternating current into direct current and steps down and rectifies the direct current voltage. In this embodiment, power supply to the microcomputer 100 and the wireless module 106 is performed directly from the battery 110. That is, power from the battery 110 is always supplied to some components (CPU) and the wireless module 106 in the microcomputer 100, and whether the power button 9c is turned on or not is turned on from the game apparatus body 5. It is detected whether or not a command instructing is transmitted. On the other hand, power from the battery 110 is supplied to the load sensors 94 a to 94 d, the AD converter 102, and the amplifier 108 via the DC-DC converter 104. The DC-DC converter 104 converts the voltage value of the direct current from the battery 110 into a different voltage value and supplies the voltage value to the load sensors 94 a to 94 d, the AD converter 102, and the amplifier 108.

  The power supply to the load sensors 94a to 94d, the AD converter 102, and the amplifier 108 may be performed as necessary under the control of the DC-DC converter 104 by the microcomputer 100. In other words, the microcomputer 100 controls the DC-DC converter 104 to operate the load sensors 94a to 94d to detect the load, thereby controlling the load sensors 94a to 94d, the AD converter 102, and Power may be supplied to the amplifier 108.

  When power is supplied, the load sensors 94a to 94d each output a signal indicating the input load. These signals are amplified by the amplifiers 108, converted from analog signals to digital data by the AD converter 102, and input to the microcomputer 100. Identification information of the load sensors 94a to 94d is given to the detection values of the load sensors 94a to 94d so that the detection values of the load sensors 94a to 94d can be identified. In this way, the microcomputer 100 can acquire data indicating the load detection values of the four load sensors 94a to 94d at the same time.

  On the other hand, when it is determined that the load sensors 94a to 94d do not need to be operated, that is, when the load detection timing is not reached, the microcomputer 100 controls the DC-DC converter 104 to load sensors 94a to 94d and the AD converter 102. , And the power supply to the amplifier 108 is stopped. Thus, since the board type controller 9 can detect the load and the distance by operating the load sensors 94a to 94d only when necessary, the power consumption for load detection can be suppressed. .

  The case where load detection is necessary is typically when the game apparatus body 5 (FIG. 1) wants to acquire load data. For example, when the game apparatus body 5 requires load information, the game apparatus body 5 transmits an information acquisition command to the board-type controller 9. When the microcomputer 100 receives an information acquisition command from the game apparatus body 5, the microcomputer 100 controls the DC-DC converter 104 to supply power to the load sensors 94 a to 94 d and detect the load. On the other hand, when the microcomputer 100 has not received the information acquisition command from the game apparatus body 5, the microcomputer 100 controls the DC-DC converter 104 to stop the power supply to the load sensors 94 a to 94 d and the like.

  Note that the microcomputer 100 may control the DC-DC converter 104 by determining that the load detection timing comes at regular intervals. When such periodic load detection is performed, the period information may be given to the microcomputer 100 of the board-type controller 9 from the game apparatus body 5 at the start of the game, for example, or stored in the microcomputer 100 in advance. May be installed.

  Data indicating detection values from the load sensors 94a to 94d is transmitted from the microcomputer 100 to the game apparatus body 5 via the wireless module 106 and the antenna 106a as board operation data (input data) of the board type controller 9. For example, when a load is detected in response to a command from the game apparatus body 5, the microcomputer 100 receives the detected value data of the load sensors 94 a to 94 d from the AD converter 102 and receives the detected value data as a game. It transmits to the apparatus main body 5. Note that the microcomputer 100 may transmit the detection value data to the game apparatus body 5 at regular intervals. When the transmission cycle is longer than the load detection cycle, data including load values at a plurality of detection timings detected up to the transmission timing may be transmitted.

  The wireless module 106 can communicate with the same wireless standard (Bluetooth, wireless LAN, etc.) as the controller communication module 19 of the game apparatus body 5. Therefore, the CPU 10 of the game apparatus body 5 can transmit an information acquisition command to the board-type controller 9 via the controller communication module 19 or the like. Thus, the board type controller 9 can receive commands from the game apparatus body 5 via the wireless module 106 and the antenna 106a. Further, the board-type controller 9 can transmit board operation data including load detection values (or load calculation values) of the load sensors 94 a to 94 d to the game apparatus body 5.

  For example, in the case of a game that is executed using a mere total value of four load values detected by the four load sensors 94a to 94d, the user uses the four load sensors 94a to 94d of the board type controller 9. Any position can be taken. That is, the user can play the game by riding in any direction on any position on the table 9a. However, depending on the type of game, it is necessary to perform processing by identifying which direction the load value detected by the four load sensors 94 is viewed from the user. That is, it is necessary to grasp the positional relationship between the four load sensors 94 of the board-type controller 9 and the user. In this case, for example, it may be assumed that the positional relationship between the four load sensors 94 and the user is defined in advance, and the user gets on the table 9a so as to obtain the predetermined positional relationship. Typically, a positional relationship in which there are two load sensors 94a to 94d on each of the front, rear, left and right of the user who rides on the center of the base 9a, that is, the user gets on the center of the base 9a of the board type controller 9 A positional relationship is defined. In this case, in this embodiment, the base 9a of the board-type controller 9 is formed in a rectangular shape in plan view, and the power button 9c is provided on one side (long side) of the rectangle. As a mark, the user decides in advance that the user should get on the base 9a so that the long side provided with the power button 9c is in a predetermined direction (front, back, left or right). . In this way, the load values detected by the load sensors 94a to 94d are load values in a predetermined direction (right front, left front, right rear, and left rear) as viewed from the user. Therefore, the board-type controller 9 and the game apparatus body 5 use the identification information of the load sensor 94 included in the load detection value data and the arrangement data indicating the position or direction of the load sensor 94 set (stored) with respect to the user. Based on this, it is possible to grasp which direction each load detection value corresponds to when viewed from the user. Thereby, for example, it is possible to grasp the intention of the game operation by the user, such as the front / rear / left / right operation direction or the distinction of the raised foot.

  Next, before describing specific processing performed by the game apparatus body 5, an outline of game processing performed by the game apparatus body 5 will be described with reference to the drawings. FIG. 9 is a diagram showing an example of a state of a user who operates using the terminal device 6 and the board type controller 9. FIG. 10A is a diagram illustrating an example of an image displayed on the monitor 2. FIG. 10B is a diagram illustrating an example of an image displayed on the LCD 61 of the terminal device 6. FIG. 11A is a diagram illustrating an example of an image displayed on the monitor 2 when the operation based on the attitude of the terminal device 6 indicates the reference operation instruction direction. FIG. 11B is a diagram illustrating an example of an image displayed on the LCD 61 of the terminal device 6 in a state where the operation based on the attitude of the terminal device 6 indicates the reference operation instruction direction. FIG. 12A is a diagram illustrating an example of an image displayed on the monitor 2 when the terminal device 6 is rolled counterclockwise on the desktop from the state illustrated in FIG. 11B. FIG. 12B is a diagram illustrating an example of an image displayed on the LCD 61 of the terminal device 6 when the terminal device 6 is rolled counterclockwise on the table from the state illustrated in FIG. 11B. FIG. 13A is a diagram illustrating an example of an image displayed on the monitor 2 when the terminal device 6 is rotated 90 ° counterclockwise on the desktop from the state illustrated in FIG. 11B. FIG. 13B is a diagram illustrating an example of an image displayed on the LCD 61 of the terminal device 6 when the terminal device 6 is rotated 90 ° counterclockwise on the desktop from the state illustrated in FIG. 11B. FIG. 14 is a diagram for explaining the rotation operation of the player object and the virtual camera as an example corresponding to the change in the operation instruction direction obtained from the attitude of the terminal device 6. FIG. 15 is a diagram for explaining the rotation operation of the terrain object as another example corresponding to the change in the operation instruction direction obtained from the attitude of the terminal device 6. FIG. 16A is a diagram illustrating an example of an image displayed on the monitor 2 when the touch panel 62 of the terminal device 6 is touched from the state illustrated in FIG. 11B. FIG. 16B is a diagram illustrating an example of an image displayed on the LCD 61 of the terminal device 6 when the touch panel 62 of the terminal device 6 is touched from the state illustrated in FIG. 11B. FIG. 17 is a diagram for explaining the movement operation of the player object and the virtual camera as an example corresponding to the touch operation on the touch panel 62 of the terminal device 6. FIG. 18 is a diagram for explaining the movement operation of the terrain object as another example corresponding to the touch operation on the touch panel 62 of the terminal device 6.

  As shown in FIG. 9, the user operates using the terminal device 6 and the board type controller 9 to change the posture and direction of the terminal device 6, touch the touch panel 62 of the terminal device 6, The operation of changing the load applied to the mold controller 9 is performed. Specifically, the user holds the main body of the terminal device 6 in a state where the terminal device 6 is placed on a table and puts both feet on the board type controller 9. Then, the user operates on the board-type controller 9 while watching the image displayed on the monitor 2 or the image displayed on the LCD 61 of the terminal device 6 (for example, the board-type controller so that the user steps on the sitting posture). The operation of repeatedly applying a change to the load applied to the board type controller 9 by operating both feet on 9). Further, the user plays by performing an operation of moving the terminal device 6 itself on the table or touching the touch panel 62 of the terminal device 6. Then, on the LCD 61 and the monitor 2 of the terminal device 6, a player object in the virtual world operates (for example, for example, according to the direction (posture) of the terminal device 6 on the table and the touch operation on the touch panel 62 of the terminal device 6 (for example, A game image in which the posture and position of the virtual camera set in the virtual world are changed according to the direction and position of the player object. Further, the player object moves (for example, moves) in the virtual world in accordance with the user movement on the board type controller 9. In the following description, the player object and the virtual camera are moved by operating the board type controller 9 so that the user steps, and the player object and the virtual camera in the virtual world are moved by operating the terminal device 6 on the table. A description will be given using a game example in which the player object and the virtual camera move in the virtual world when the direction changes and the touch operation on the touch panel 62 of the terminal device 6 moves.

  As shown in FIG. 10A, the monitor 2 displays an image of the virtual world as seen from the far distant position directly above the terrain object as the state of the entire terrain object set in the virtual world. In the example shown in FIG. 10A, the current location of the player object Po moving on the terrain object and the terminal device display range displayed on the LCD 61 of the terminal device 6 centering on the current location are drawn on the terrain object. ing. Then, the entire terrain object is displayed on the monitor 2 with the north direction (N direction in the figure) of the terrain object facing the virtual world reference direction (for example, the upward direction of the virtual world displayed on the monitor 2). In this way, by displaying on the monitor 2 a state in the virtual world overlooking the entire terrain object, the user can determine the overall situation of the terrain object and the position of the terrain object and the current location (terminal device display range) of the player object Po. The relationship can be easily grasped, and another person watching the user playing the game can enjoy watching the player object Po moving on the terrain object.

  Further, as shown in FIG. 10B, the LCD 61 of the terminal device 6 has an image of the virtual world as seen from the position immediately above the player object Po as the player object Po moves on the terrain object in the virtual world. Is displayed. The viewpoint of the virtual world displayed on the LCD 61 is relatively close to the terrain object (player object Po), and the distance from the viewpoint to the player object Po is from the viewpoint of the virtual world displayed on the monitor 2 ( It is set relatively shorter than the distance to the player object Po). In the example shown in FIG. 10B, a terrain object and a player object Po moving on the terrain object are displayed. The LCD 61 displays a terrain object within the terminal device display range, and a player object Po is displayed at a position on the terrain object substantially at the center of the LCD 61. When the operation based on the attitude of the terminal device 6 indicates a reference operation instruction direction to be described later, a part of the terrain object is displayed so that the north direction of the terrain object is the upward direction of the LCD 61 (y-axis positive direction). Then, the player object Po is displayed at the center position of the LCD 61 in such a posture that the front direction (the F direction in the drawing) of the player object Po is the upward direction of the LCD 61. In this way, by displaying the terrain object and the player object Po on the LCD 61 from the position immediately above the player object Po, the user who is operating the terminal device 6 on the table and watching the display on the LCD 61 displays the player object Po from directly above. You can play the game as you see it, giving you a sense of realism in the virtual world.

  In the example shown in FIG. 10A, the state in the virtual world viewed from a position just above the terrain object is displayed on the monitor 2, but the virtual world from another viewpoint may be displayed on the monitor 2. . By displaying the same virtual world not only on the terminal device 6 but also on the monitor 2 and displaying images of the virtual worlds with different viewpoints, the images displayed on the two display devices when the user operates can be changed to It becomes possible to use properly according to preference. If the range of the virtual world displayed on the monitor 2 becomes wider than the range of the virtual world displayed on the terminal device 6, the viewpoint of the virtual world displayed on the monitor 2 is not a position directly above the terrain object, but an obliquely upper position, etc. But it doesn't matter.

  As an example, when the user performs a stepping action on the board-type controller 9, the player object Po moves on the terrain object at a speed corresponding to the stepping action in the front direction (F direction in the figure) of the player object Po. . For example, the movement speed of the player object Po increases as the cycle of the user stepping on the board-type controller 9 is shorter. Thus, the user can move the player object Po or change the moving speed by the operation on the board type controller 9.

  For example, as described above, the board type controller 9 outputs a load detection value corresponding to the user operation on the board type controller 9. If the load detection value is used, the total load applied to the board-type controller 9 can be calculated. If the total load itself or the change in the total load is used, it is possible to estimate what kind of operation the user is performing on the board type controller 9. The movement / stop and movement speed of the player object Po are set in accordance with the user action estimated on the board type controller 9 as described above.

  Further, the relative direction between the player object Po and the virtual camera and the terrain object in the virtual world changes according to the direction (posture) of the terminal device 6 on the table. For example, when the user rotates (rolls) the terminal device 6 around the depth direction (terminal device depth direction) of the LCD 61 in a state where the back surface of the terminal device 6 is in contact with the tabletop, the layer object in the virtual world The relative direction between Po and the virtual camera and the terrain object changes left and right.

  As shown in FIG. 11A, the entire terrain object is displayed on the monitor 2 with the north direction (N direction in the figure) of the terrain object facing the virtual world reference direction (for example, the upward direction of the virtual world displayed on the monitor 2). It is displayed. Further, as shown in FIG. 11B, when the operation based on the attitude of the terminal device 6 indicates the reference operation instruction direction, the terrain object is such that the north direction of the terrain object is the upward direction of the LCD 61 (y-axis positive direction). Is displayed, and the player object Po is displayed at the center position of the LCD 61 with a posture in which the front direction (F direction in the drawing) of the player object Po is the upward direction of the LCD 61. Here, the state in which the operation based on the attitude of the terminal device 6 indicates the reference operation instruction direction is a state in which the terminal device 6 is directed in the same direction as the direction in which the terminal device 6 is placed on the desktop when the initial setting is performed. Typically, the terminal device 6 is placed on the table with the upper direction (y-axis positive direction) facing the front direction of the user (that is, with the y-axis negative direction facing the user). Indicates the state. That is, when the operation based on the attitude of the terminal device 6 indicates the reference operation instruction direction, the player makes the north direction of the terrain object and the front direction (F direction in the drawing) of the player object Po be the upward direction of the LCD 61, respectively. The object Po and the terrain object are displayed.

  When the terminal device 6 indicating the reference operation instruction direction is rotated on the table counterclockwise about the depth direction (z-axis direction) of the LCD 61 (that is, rolled on the table in the direction A shown in FIG. 11B). In such a case, images as shown in FIGS. 12A and 12B are displayed on the monitor 2 and the LCD 61, respectively. As shown in FIG. 12B, when the terminal device 6 is rotated counterclockwise from the state indicating the reference operation instruction direction, a virtual camera that generates a virtual world to be displayed on the LCD 61 according to the roll rotation. Change posture. For example, the virtual camera is rotated in the roll direction (for example, the y axis is rotated around the z axis) by the rotation angle (for example, the angle by which the y axis is rotated around the z axis). The orientation is controlled so as to rotate around the viewing direction of the virtual camera. When the terminal device 6 is rolled counterclockwise from the state indicating the reference operation instruction direction, the vertical direction of the virtual world is changed to the rotation direction rotated by the rotation angle of the terminal device 6 by the roll rotation. The player object Po rotates around and the front direction F changes.

  As an example, as illustrated in FIG. 14, when the terminal device 6 rolls in the A direction by a roll angle C (that is, the y axis rotates around the z axis by the angle C in the A direction), the player object Po is The posture is controlled by rotating in the virtual world by an angle C about the vertical direction of the virtual world in the virtual world, and the front direction of the player object Po is similarly rotated. In addition, the virtual camera arranged at a position overlooking the player object Po is also A with the angle C centered on the visual line direction of the virtual camera (the Z-axis direction in the figure and the same direction as the virtual world vertical direction). Rotate in the virtual world in the direction. Thus, as is apparent from a comparison between FIGS. 11B and 12B, the player object Po rotates in the A direction by an angle C with respect to the terrain object, but the virtual camera also rotates in the same manner. As a result, the player object Po is displayed on the LCD 61 in the same state. On the other hand, the terminal device 6 is rotated by the roll angle C in the A direction. However, since the virtual camera is also rotating in the same manner, the terrain object displayed on the LCD 61 is only the same angle C in the reverse direction of the A direction. As a result, the terrain object is displayed in the same direction as the real space. As is apparent from a comparison between FIG. 11B and FIG. 12B, the player object Po remains relatively relative to the virtual camera even when the terminal device 6 rolls. However, since the LCD 61 (terminal device 6) rotates counterclockwise by the rotation angle C, as a result, it rotates in the same direction as the terminal device 6 in real space, It appears to rotate in the A direction with respect to the terrain object and real space. On the other hand, the terrain object rotates clockwise by a rotation angle C relative to the virtual camera, but the result is that the LCD 61 (terminal device 6) rotates counterclockwise by the rotation angle C. In fact, it appears to be displayed in the same direction in real space.

  The virtual world image generation method described above is performed by, for example, fixing a terrain object in the virtual world and rotating the virtual camera and player object Po for generating a virtual world image to be displayed on the LCD 61 in the virtual world. Yes. However, the virtual world image described above can be generated by other methods as long as the relative direction between the player object Po and the virtual camera and the terrain object in the virtual world is changed.

  For example, when the image of the virtual world in which the terrain object and the player object Po shown in FIG. 11B are arranged is changed to the image shown in FIG. 12B according to the roll rotation of the terminal device 6, as shown in FIG. In addition, the terrain object may be rotated around the viewing direction (virtual world vertical direction) of the virtual camera in accordance with the roll rotation of the terminal device 6. In this case, even if the terminal device 6 rotates counterclockwise by the rotation angle C, the virtual camera and the player object Po are fixedly arranged in the virtual world. On the other hand, when the terminal device 6 rotates counterclockwise by the rotation angle C, the terrain object is rotated clockwise by the rotation angle C around the gazing point (position of the player object Po) of the virtual camera. Even with such a virtual world image generation method, a similar image can be displayed on the LCD 61. Thus, if at least one of the player object Po, the virtual camera, and the terrain object in the virtual world is relatively rotated according to the roll rotation of the terminal device 6, the virtual world images shown in FIGS. 11B and 12B are obtained. In the following, description will be made using a method in which the terrain object is fixed in the virtual world and the virtual camera and the player object Po are rotated in the virtual world.

  On the other hand, as is clear from a comparison between FIG. 11A and FIG. 12A, the image of the entire terrain object displayed on the monitor 2 changes even when the terminal device 6 rotates counterclockwise by the rotation angle C. do not do. However, as described above, since the direction of the range of the terrain object displayed on the LCD 61 of the terminal device 6 changes, the terminal device display range is rotated and displayed in accordance with the direction change of the range. For example, when the terminal device 6 rolls counterclockwise by the rotation angle C, the terminal device display range displayed on the monitor 2 is also displayed by rotating counterclockwise by the rotation angle C around the range center. .

  Further, when the terminal device 6 is rotated in the A direction and the terminal device 6 is rotated 90 ° counterclockwise on the desktop from the state shown in FIG. 11B, images as shown in FIGS. 13A and 13B are displayed. 2 and the LCD 61 respectively. As shown in FIG. 13B, when the terminal device 6 is rotated 90 ° counterclockwise on the table from the state shown in FIG. 11B, the terminal device 6 is further rotated around the viewing direction of the virtual camera by the rotation angle of the roll rotation. Rotate the virtual camera. In addition, the player object Po is arranged on the terrain object in a posture in which the front direction (F direction in the drawing) is rotated in the roll rotation direction by the rotation angle that the terminal device 6 has further rotated. Thus, the player object Po is displayed on the LCD 61 such that the front direction is the upward direction of the LCD 61 (y-axis positive direction), and the north direction of the terrain object is the left-to-right direction of the LCD 61 (x-axis positive direction). Thus, the terrain object is displayed on the LCD 61.

  11B and FIG. 13B, the player object Po changes its direction with respect to the terrain object in the direction A by a rotation angle of 90 ° with respect to the terrain object, but the virtual camera rotates in the same way. As a result, the player object Po is displayed in the same state on the LCD 61 as a result. Then, since the LCD 61 (terminal device 6) rolls counterclockwise by a rotation angle of 90 °, the player object Po eventually rotates in the same direction as the terminal device 6 in real space, and the terrain object And it appears to be rotated 90 ° in the A direction with respect to real space. Further, although the terminal device 6 is rotated in the A direction by a roll angle of 90 °, since the virtual camera is also rotating in the same manner, the terrain object displayed on the LCD 61 has the same angle 90 in the reverse direction of the A direction. As a result, the terrain object is displayed in the same direction as the real space. 11B and FIG. 13B, the player object Po changes its direction with respect to the terrain object in the A direction by a rotation angle of 90 °, but the virtual camera rotates in the same manner. As a result, it is displayed on the LCD 61 in the same state, and the terrain object is displayed as if it is rotated 90 ° in the direction opposite to the A direction.

  On the other hand, as shown in FIG. 13A, when the terminal device 6 is rotated 90 ° counterclockwise on the desktop from the state shown in FIG. 11B, the terminal device display range displayed on the monitor 2 is also around the center of the range. Are rotated counterclockwise by a rotation angle of 90 °.

  As described above, when the user rolls the terminal device 6, the player object Po and the virtual camera can be rotated relative to the terrain object and displayed on the LCD 61. Then, by making the roll angle and roll direction of the terminal device 6 the same as the rotation angle and rotation direction for rotating the player object Po and the virtual camera relative to the terrain object, the user can make the terminal device 6 play the player object. Realistic direction operation as if it became Po becomes possible. In addition, the user can enjoy a feeling as if he / she is looking down from inside the virtual world using the LCD 61 of the terminal device 6 as a viewing window.

  For example, the terminal device 6 outputs acceleration data and angular velocity data corresponding to the posture change of the terminal device 6. And if the acceleration which the said acceleration data shows is used, since the direction of the gravitational acceleration which is acting on the terminal device 6 is computable, what kind of attitude | position is the terminal device 6 on the basis of the perpendicular direction in real space? That is, it is possible to estimate the xyz-axis direction of the terminal device 6 with respect to the vertical direction. In addition, if the angular velocity indicated by the angular velocity data and / or the acceleration indicated by the acceleration data is used, the angular velocity and / or dynamic acceleration acting on the terminal device 6 can be known. By using this, it is possible to estimate a change in posture from the initial posture of the terminal device 6 in real space (that is, a change in the direction of the xyz axis around each xyz axis). The relative direction, posture, position, and the like of the player object Po and the virtual camera and the terrain object are set according to the estimated posture change (xyz axis direction change) of the terminal device 6 in this way.

  Further, by touching the touch panel 62 of the terminal device 6, the player object Po and the virtual camera can be moved relative to the terrain object. For example, when the user performs a touch operation so that the touch panel 62 covering the surface of the LCD 61 is dragged leftward (the B direction shown in FIG. 11B), images as shown in FIGS. 16A and 16B are displayed on the monitor 2 and the LCD 61, respectively. Is displayed. As shown in FIG. 11B, when the user performs a touch operation to drag the touch panel 62 to the left, the player object moves in the dragged direction (direction B in the figure) by a distance corresponding to the dragged length. An image of the virtual world in which the terrain object is moved relative to Po and the virtual camera (that is, the player object Po and the virtual camera are moved relative to the terrain object in the opposite direction of the drag operation) is displayed on the LCD 61. Is displayed. Also, as shown in FIG. 16A, when the user performs a touch operation to drag the touch panel 62 to the left, according to the movement of the range of the terrain object displayed on the LCD 61 (that is, to the length of the drag operation). An image of the entire terrain object whose terminal device display range has been moved is displayed on the monitor 2 in the opposite direction of the drag operation by the corresponding distance.

  As an example, as illustrated in FIG. 17, when the user performs a touch operation so as to drag the touch panel 62 in the left direction (the B direction in the drawing), the player object Po and the virtual camera are moved in the virtual world. It moves by the same distance in the opposite direction (D direction in the figure, which is the right direction (X-axis positive direction) of the virtual camera). Here, the moving direction of the player object Po and the virtual camera is set in the opposite direction of the trajectory on the basis of the trajectory on the virtual world (terrain object) displayed overlapping the trajectory of the touch position during the drag operation. The moving distance of the player object Po and the virtual camera is set to the same length as the trajectory. Thus, when the touch panel 62 is dragged, the terrain object displayed on the LCD 61 follows the movement of the touch position during the drag operation on the touch panel 62, that is, the terrain object displayed overlapping the touch position. The position is set so that the position is always overlapped with the touch position during the drag operation. Even when the user performs a drag operation on the touch panel 62, the player object Po does not change any of the direction, posture, and position on the LCD 61. 11B and FIG. 16B, when the user performs a touch operation to drag the touch panel 62 to the left, the terrain object responds to the drag operation in the direction corresponding to the drag operation. It moves by the distance and is displayed on the LCD 61, and as a result, it seems to move following the movement of the touch position even in the real space. On the other hand, when touch operation is performed on the touch panel 62, the player object Po moves relative to the terrain object in a direction opposite to the direction corresponding to the drag operation by a distance corresponding to the drag operation. Fixed placement.

  The virtual world image generation method described above is performed, for example, by fixing a terrain object in the virtual world and moving the virtual camera and player object Po that generate an image of the virtual world displayed on the LCD 61 in the virtual world. Yes. However, the virtual world image described above can be generated by other methods as long as the relative position between the player object Po and the virtual camera and the terrain object in the virtual world is changed.

  For example, when the image of the virtual world in which the terrain object and the player object Po shown in FIG. 11B are arranged is changed to the image shown in FIG. 16B according to the touch operation on the touch panel 62, as shown in FIG. In addition, the terrain object may be moved according to the touch operation. In this case, even when a drag operation is performed using the touch panel 62, the player object Po and the virtual camera are fixedly arranged in the virtual world. On the other hand, when a drag operation is performed using the touch panel 62, the left of the virtual camera is displayed in the direction corresponding to the drag operation (the drag operation in the B direction illustrated in the left direction (x-axis negative direction) of the touch panel 62. The terrain object is moved in the virtual world by a distance corresponding to the drag operation in the direction (B direction in the figure, which is the negative direction of the X axis). Even with such a virtual world image generation method, a similar image can be displayed on the LCD 61. As described above, if at least one of the player object Po, the virtual camera, and the terrain object in the virtual world is relatively moved according to the touch operation on the touch panel 62, the virtual world images shown in FIGS. 11B and 16B are displayed. In the following description, a method of fixing a terrain object in the virtual world and moving the virtual camera and the player object Po in the virtual world will be described.

  Thus, when the user performs a touch operation on the touch panel 62 of the terminal device 6, the player object Po and the virtual camera can be moved relative to the terrain object and displayed on the LCD 61. Then, by setting the relative moving direction and moving distance of the player object Po and the virtual camera so that the movement of the display position of the terrain object follows the moving direction and moving distance of the touch position on the touch panel 62, it is as if A realistic game in which the user slides the terrain object by a touch operation can be realized.

  The movement mode of the player object Po with respect to the terrain object is changed depending on whether the user moves the player object Po by an operation using the board-type controller 9 or moves the player object Po by a touch operation on the touch panel 62. Can be considered. For example, when the player object Po moves by an operation using the board-type controller 9, the player object Po can move according to a movable route or a movable area expressed by the terrain object, and an action ( For example, an action for acquiring an item on the terrain object and an action between other objects on the terrain object) are possible. On the other hand, when the player object Po moves by a touch operation on the touch panel 62, the player object Po moves regardless of the movable path and the movable area expressed by the terrain object (for example, moves in the air on the terrain object). Action on the terrain object is not possible. As a result, the user needs to use the board-type controller 9 and the touch operation properly in accordance with the purpose of movement of the player object Po, and can perform operations utilizing the merits of each movement mode.

  The monitor 2 uses an example in which an image in which the center of the entire terrain object is arranged at the center of the screen is used. However, the image is displayed on the monitor 2 with the center of the entire terrain object shifted from the center of the screen. It doesn't matter. For example, the terrain cloth object may be arranged so that the current location of the player object Po placed on the terrain object is always located at the center of the screen of the monitor 2 with the second virtual camera as the gazing point. . Thus, even when the player object Po moves, the current location is always arranged at the center of the monitor 2 and the display position of the current location does not move greatly due to the movement of the player object Po. We can expect effect to make it easy.

  Next, details of processing performed in the game system 1 will be described. First, main data used in the processing will be described with reference to FIG. FIG. 19 is a diagram showing an example of main data and programs stored in the main memory of the game apparatus body 5.

  As shown in FIG. 19, in the data storage area of the main memory, board operation data Da, terminal operation data Db, load value data Dc, terminal device direction / posture data Dd, operation direction data De, player object data Df, terrain object Data Dg, terminal device display range data Dh, previous touch position data Di, footstep flag data Dj, movement speed data Dk, virtual camera data Dm, image data Dn, and the like are stored. In addition to the data included in the information shown in FIG. 19, the main memory appropriately stores data necessary for processing such as image data of various objects displayed on the monitor 2 and the LCD 61 and sound data used for processing. Is done. Various program groups Pa constituting the information processing program are stored in the program storage area of the main memory.

  The board operation data Da stores a series of operation information (board operation data) transmitted as transmission data from the board type controller 9 and is updated to the latest board operation data. For example, the board operation data Da includes load data Da1 and the like. The load data Da1 is data indicating load detection values detected by the load sensors 94a to 94d of the board type controller 9, respectively.

  The terminal operation data Db stores a series of operation information (terminal operation data) transmitted from the terminal device 6 as transmission data, and is updated to the latest terminal operation data. For example, the terminal operation data Db includes acceleration data Db1, angular velocity data Db2, touch position data Db3, and the like. The acceleration data Db1 is data representing the acceleration (acceleration vector) detected by the acceleration sensor 603. For example, the acceleration data Db1 represents a three-dimensional acceleration having acceleration components in the xyz three-axis directions shown in FIG. 3 as components, but in another example, acceleration data in any one or more directions is expressed. It may represent. The angular velocity data Db2 is data representing the angular velocity detected by the gyro sensor 604. For example, the angular velocity data Db2 represents the angular velocities around the three axes xyz shown in FIG. 3, but in other examples, the angular velocity data Db2 may represent angular velocities around any one or more axes. . The touch position data Db3 is data representing the coordinates of the position where an input has been made on the input surface of the touch panel 62.

  Note that the game apparatus body 5 includes data (for example, load detection values) included in operation information transmitted at predetermined intervals (for example, every 1/200 second) from the controller 7, the board-type controller 9, and the terminal device 6, respectively. , Data indicating acceleration and angular velocity) are sequentially received. For example, the received data is sequentially stored in the main memory by the input / output processor 31. In the processing flow described later, the CPU 10 reads the latest board operation data and terminal operation data from the main memory every frame (for example, every 1/60 seconds), and updates the board operation data Da and the terminal operation data Db, respectively. An example is used.

  Further, the operation information transmitted from the controller 7, the board type controller 9, and the terminal device 6 at each predetermined period may be temporarily stored in a buffer (not shown) provided in the controller communication module 19, the terminal communication module 28, or the like. In this case, the data stored in the buffer is read for each frame, and board operation data Da (for example, load data Da1) and terminal operation data Db (for example, acceleration data Db1, angular velocity data Db2) in the main memory. , And touch position data Db3) are updated and used. At this time, since the cycle for receiving the operation information and the processing cycle are different, the operation information received at a plurality of times is described in the buffer. Of the operation information received at a plurality of times, The process is executed using only the latest operation information.

  The load value data Dc is a set of data indicating the load value detected by the board type controller 9. For example, the load value data Dc is a set of data indicating the total value (total load value) of the loads detected by the load sensors 94a to 94d. Specifically, the load value data Dc is an array of data indicating the total load value within a predetermined period calculated in time series, and data indicating the total load value in each element of the array is time-series. Stored.

  The terminal device direction / posture data Dd is data indicating the current direction and posture of the terminal device 6 in the real space. For example, the terminal device orientation / posture data Dd is calculated based on the acceleration data Db1 and the angular velocity data Db2 included in the terminal operation data Db.

  The operation direction data De includes reference operation instruction direction data De1, operation instruction direction data De2, and the like. The reference operation instruction direction data De1 is data that is set at the time of initial setting and indicates a direction serving as a reference for the operation instruction direction. The operation instruction direction data De2 is data indicating the operation instruction direction currently instructed by the user. Note that the calculation method of the reference operation instruction direction and the operation instruction direction will be described later.

  The player object data Df is data related to the player object Po in the virtual world. For example, the player object data Df is data indicating the position, posture, direction, etc. of the player object Po in the virtual world.

  The terrain object data Dg is data regarding terrain objects in the virtual world. For example, the terrain object data Dg is data indicating the position, posture, direction, and the like of the terrain object in the virtual world.

  The terminal device display range data Dh is data indicating the terminal device display range drawn on the terrain object. For example, the terminal device display range data Dh is data indicating the drawing position, line type, and the like of the terminal device display range for the terrain object.

  The previous touch position data Di is data indicating the touch position where the touch panel 62 is touched in the previous process.

  The footstep flag data Dj is set to ON when a load greater than or equal to the threshold is applied to the board type controller 9, and is set to OFF when the load applied to the board type controller 9 is less than the threshold. Data indicating a flag.

  The moving speed data Dk is data indicating the speed at which the player object Po moves in the virtual world in response to an operation on the board-type controller 9, and the speed at which the player object Po moves with respect to the terrain object.

  The virtual camera data Dm is data related to the virtual camera set in the virtual world. For example, the virtual camera data Dm includes data relating to a first virtual camera for generating a game image to be displayed on the LCD 61 of the terminal device 6 and data relating to a second virtual camera for generating a game image to be displayed on the monitor 2. including.

  The image data Dn includes player object Po image data Dn1, terrain object image data Dn2, and the like. The player object Po image data Dn1 is data for arranging the player object Po in the virtual world and generating a game image. The terrain object image data Dn2 is data for arranging a terrain object in the virtual world to generate a game image.

  Next, with reference to FIGS. 20 to 23, details of the game process performed in the game apparatus body 5 will be described. FIG. 20 is a flowchart showing an example of game processing executed in the game apparatus body 5. FIG. 21 is a subroutine showing an example of the game control process in step 44 in FIG. FIG. 22 is a subroutine showing an example of the object setting process in step 83 in FIG. FIG. 23 is a subroutine showing an example of the movement process of step 118 in FIG. Here, in the flowcharts shown in FIGS. 20 to 23, the player object Po and the virtual camera are relative to the terrain object in accordance with the user operation using the terminal device 6 and the board-type controller 9 in the game process. The processing that is displayed by operating automatically will be mainly described, and detailed description of other processing not directly related to the present invention will be omitted. 20 to 23, each step executed by the CPU 10 is abbreviated as “S”.

  When the power of the game apparatus body 5 is turned on, the CPU 10 of the game apparatus body 5 executes a startup program stored in the ROM / RTC 13, thereby initializing each unit such as the main memory. Then, the game program stored in the optical disc 4 is read into the main memory, and the CPU 10 starts executing the program. The flowchart shown in FIGS. 20-23 is a flowchart which shows the process performed after the above process is completed.

  In FIG. 20, the CPU 10 executes an initial process (step 40), and proceeds to the next step. For example, in the initial processing in step 40, the CPU 10 constructs a virtual world and places the player object Po, the terrain object, and the virtual cameras (first virtual camera and second virtual camera) in a predetermined position in the virtual world. Also, initial values of various parameters used in the game process are set. Note that the first virtual camera is initially arranged at a position overlooking the position directly above the player object Po so that the front direction of the player object Po is the upward direction (Y-axis positive direction) of the first virtual camera.

  Next, the CPU 10 calculates a reference operation instruction direction based on the data transmitted from the terminal device 6 (step 41), and proceeds to the next step. Hereinafter, an example in which the CPU 10 calculates the reference operation instruction direction will be described.

  The terminal device 6 repeatedly transmits data as described above to the game apparatus body 5. In the game apparatus body 5, the terminal communication module 28 sequentially receives the data, and the input / output processor 31 sequentially stores the terminal operation data, camera image data, and microphone sound data in the main memory. In step 41, the CPU 10 reads the latest terminal operation data from the main memory and updates the acceleration data Db1, the angular velocity data Db2, and the touch position data Db3.

  Next, the CPU 10 calculates the direction and orientation of the terminal device 6 in real space. For example, the CPU 10 indicates data indicating the current direction and orientation of the terminal device 6 based on the acceleration indicated by the acceleration data Db1 and the angular velocity indicated by the angular velocity data Db2 (for example, data indicating the respective directions of the xyz axes of the terminal device 6). And the terminal device direction / posture data Dd is updated using the data indicating the calculated direction and posture of the terminal device 6. For example, the CPU 10 can calculate the amount of rotation (direction change amount) in the real space per unit time of the terminal device 6 using the angular velocity indicated by the angular velocity data Db2. Further, in a state where the terminal device 6 is almost stationary in a real space (static state), the acceleration applied to the terminal device 6 is a gravitational acceleration, and therefore the terminal device 6 is accelerated by the acceleration indicated by the acceleration data Db1. The gravity direction to be applied (that is, the attitude of the terminal device 6 with respect to the vertical direction in the real space) can be calculated. Therefore, the CPU 10 can calculate data indicating the direction and orientation of the terminal device 6 based on the acceleration indicated by the acceleration data Db1 and the angular velocity indicated by the angular velocity data Db2.

  In the present embodiment, the direction and orientation of the terminal device 6 are calculated based on the data indicating the acceleration and angular velocity detected by the terminal device 6, but in other embodiments, any one of the data and 3 You may calculate the direction and attitude | position of the terminal device 6 using two or more data. For example, the magnetic sensor 602 provided in the terminal device 6 detects the magnetism applied to the terminal device 6, and has a predetermined orientation (that is, a predetermined direction) with respect to the terminal device 6 from the direction of geomagnetism applied to the terminal device 6. The attitude of the terminal device 6 with respect to the azimuth can be calculated. Note that the amount of rotation of the terminal device 6 can be calculated even when a magnetic field other than geomagnetism is generated in the real space where the terminal device 6 is disposed. Therefore, the CPU 10 can calculate the direction and orientation of the terminal device 6 by using at least one of data indicating acceleration, angular velocity, and magnetism detected by the terminal device 6.

  The specific calculation method of the direction and orientation of the terminal device 6 may be any method. For example, the direction and orientation of the terminal device 6 calculated based on the angular velocity indicated by the angular velocity data Db2 A method of correcting using the acceleration indicated by the acceleration data Db1 and the direction of magnetism detected by the magnetic sensor 602 can be considered.

  Specifically, the CPU 10 first calculates the attitude of the terminal device 6 based on the angular velocity indicated by the angular velocity data Db2. Any method may be used to calculate the attitude of the terminal device 6 from the angular velocity, but as an example, the previous attitude (direction of the xyz axis calculated last time) and the current angular speed (in the current processing loop). And the angular velocity obtained in step 42). The CPU 10 calculates a new xyz-axis direction by rotating the previous xyz-axis direction by a unit time around each axis at the current angular velocity. The previous xyz-axis direction is represented by the terminal device direction / attitude data Dd, and the current angular velocity is represented by the angular velocity data Db2. Therefore, the CPU 10 reads the terminal device direction / attitude data Dd and the angular velocity data Db2 and calculates the attitude (new xyz axis direction) of the terminal device 6. As described above, in step 41, the initial posture of the terminal device 6 is determined. Therefore, when calculating the attitude of the terminal device 6 from the angular velocity, the CPU 10 can calculate the current attitude of the terminal device 6 with reference to the initially calculated initial attitude of the terminal device 6.

  Next, CPU10 correct | amends the attitude | position (xyz-axis direction) of the terminal device 6 calculated based on angular velocity using the acceleration which acceleration data Db1 shows. Specifically, the CPU 10 calculates the attitude (xyz axis direction) of the terminal device 6 based on the acceleration indicated by the acceleration data Db1. Here, in a state where the terminal device 6 is substantially stationary, the acceleration applied to the terminal device 6 is a gravitational acceleration. Therefore, in this state, since the direction of gravity acceleration (gravity direction) can be calculated using the direction of acceleration indicated by the acceleration data Db1, the direction of the terminal device 6 with respect to the gravity direction (xyz with respect to the gravity direction). Axial direction) can be calculated.

  When the posture of the terminal device 6 based on the acceleration is calculated, the CPU 10 corrects the posture based on the angular velocity using the posture based on the acceleration. Specifically, the CPU 10 brings the attitude of the terminal device 6 calculated based on the angular velocity (in the xyz axis direction) closer to the attitude of the terminal device 6 calculated based on the acceleration (in the xyz axis direction) at a predetermined rate. Make corrections. The predetermined ratio may be a predetermined fixed value, or may be set according to an acceleration or the like indicated by the acceleration data Db1. In addition, regarding the attitude of the terminal device 6 calculated based on the acceleration, the attitude cannot be calculated for the rotation direction with the gravity direction as an axis, so the CPU 10 does not correct the rotation direction. Also good. When correcting the attitude of the terminal device 6 calculated based on the angular velocity based on the magnetic direction detected by the magnetic sensor 602, the CPU 10 determines the attitude of the terminal device 6 calculated based on the angular velocity. The terminal device 6 calculated based on the direction of magnetism may be approximated at a predetermined rate. Based on the above, the CPU 10 can accurately calculate the attitude of the terminal device 6.

  Then, based on the direction and orientation of the terminal device 6 in the real space, a reference operation instruction direction serving as a reference for the operation instruction direction is calculated. In the following description, as an example, the operation instruction direction is set from the direction in which the upper surface of the terminal device 6 faces in real space (the y-axis positive direction shown in FIG. 3 and the terminal device upward direction). In the operation instruction direction calculation process, the operation instruction direction is calculated by performing various corrections on the attitude and direction of the terminal device 6. Then, a reference operation instruction direction is set using the operation instruction direction calculated in step 41, and the reference operation instruction direction De1 is updated using the reference operation instruction direction.

  When calculating the operation instruction direction, the inclination of the terminal device 6 around the x axis and the y axis is corrected. For example, the x-axis direction and the y-axis direction are forcibly corrected to the horizontal direction using the directions of the xyz axes indicated by the terminal device direction / attitude data Dd (for example, the vertical direction components in the x-axis direction and the y-axis direction are respectively 0, and the x-axis direction and the y-axis direction are corrected to the directions projected onto the horizontal plane of the real space in the vertical direction). Next, a new z-axis direction is calculated based on the outer product of the x-axis direction and the y-axis direction corrected in the horizontal direction. Then, a new y-axis direction is calculated by the outer product of the newly calculated z-axis direction and the x-axis component corrected in the horizontal direction, and the newly calculated y-axis positive direction (operation instruction direction) is used. The reference operation instruction direction De1 is updated.

  The reference operation instruction direction may be corrected and calculated based on the acceleration indicated by the acceleration data Db1, or may be corrected and calculated based on the magnetic direction detected by the magnetic sensor 602. By causing the user to perform a predetermined operation in a state in which the terminal device 6 is in a specific posture (for example, a state where the terminal device 6 is placed on a table and stationary), the x-axis direction and y at the time when the predetermined operation is performed It may be calculated on the assumption that the axial direction is in the horizontal direction. The timing for setting the reference operation instruction direction, that is, the timing for executing the step 41 may be automatically performed at the time of starting the game, or the user can use the terminal device 6 to perform a predetermined operation (for example, a predetermined operation). The operation may be performed in response to the operation of pressing the operation button 64).

  Following step 41, the process of step 42 is executed. Thereafter, a processing loop composed of a series of processes from step 42 to step 51 is repeatedly executed at a rate of once per predetermined time (one frame time).

  In step 42, the CPU 10 acquires board operation data transmitted from the board type controller 9, and proceeds to the next step. Here, the board-type controller 9 repeatedly transmits board operation data to the game apparatus body 5. Therefore, in the game apparatus body 5, the controller communication module 19 sequentially receives the board operation data, and the received board operation data is sequentially stored in the main memory by the input / output processor 31. The board operation data transmission interval of the board-type controller 9 is preferably shorter than the game processing time (one frame time), for example, 1/200 second. In step 42, the CPU 10 reads the latest board operation data from the main memory and updates the load data Da1. The board operation data includes data indicating identification information of the load sensors 94a to 94d and data indicating load detection values detected by the load sensors 94a to 94d, respectively. Is used to update the load data Da1.

  Next, the CPU 10 acquires various data transmitted from the terminal device 6 (step 43), and proceeds to the next step. Here, the terminal device 6 repeatedly transmits the data to the game apparatus body 5. Therefore, in the game apparatus body 5, the terminal communication module 28 sequentially receives the data, and the camera image data and the microphone sound data are sequentially subjected to expansion processing by the codec LSI 27. Then, the input / output processor 31 sequentially stores terminal operation data, camera image data, and microphone sound data in the main memory. In step 43, the CPU 10 reads the latest terminal operation data from the main memory and updates the acceleration data Db1, the angular velocity data Db2, and the touch position data Db3.

  Next, the CPU 10 performs a game control process (step 44), and proceeds to the next step. The game control process is a process for executing the game by executing the player object Po, the terrain object, and the virtual camera in the virtual world according to the game operation by the user. In the game example, the user can play various games using the terminal device 6 and the board type controller 9. Hereinafter, the game control process in step 44 will be described with reference to FIG.

  In FIG. 21, the CPU 10 calculates the total load value (step 81) and proceeds to the next step. For example, the CPU 10 calculates the total load value by adding the loads detected by the load sensors 94a to 94d indicated by the load data Da1, and uses the data indicating the total load value to calculate the total load value in the load value data Dc. The latest data in the time series data array shown is updated. Specifically, since the load data Da1 indicates the latest load detection values detected by the load sensors 94a to 94d, the total load value is calculated by using the load detection values. The total load value calculated in this way changes according to the user operation on the board type controller 9. As an example, when the user performs an operation of applying a load on the board type controller 9, the total load value increases according to the applied load.

  Next, the CPU 10 calculates the direction and orientation of the terminal device 6 (step 82), and proceeds to the next step. For example, the CPU 10 indicates data indicating the current direction and orientation of the terminal device 6 based on the acceleration indicated by the acceleration data Db1 and the angular velocity indicated by the angular velocity data Db2 (for example, data indicating the respective directions of the xyz axes of the terminal device 6). And the terminal device direction / posture data Dd is updated using the data indicating the calculated direction and posture of the terminal device 6. Note that a method for calculating data indicating the current direction and orientation of the terminal device 6 is the same as the method described in step 41 above, and thus detailed description thereof is omitted.

  Next, the CPU 10 performs an object setting process (step 83), and proceeds to the next step. Hereinafter, the object setting process in step 83 will be described with reference to FIG.

  In FIG. 22, the CPU 10 calculates the operation instruction direction (step 111), and proceeds to the next step. For example, the CPU 10 forcibly corrects the x-axis direction and the y-axis direction to the horizontal direction by using the directions of the xyz axes indicated by the terminal device direction / attitude data Dd, and the corrected x-axis direction and y in the horizontal direction. The z-axis direction is newly calculated from the outer product with the axial direction. Then, the CPU 10 newly calculates the y-axis direction based on the outer product of the newly calculated z-axis direction and the x-axis component corrected in the horizontal direction, and newly calculated y-axis positive direction (operation instruction direction). Is used to update the operation instruction direction De2.

  Next, the CPU 10 sets the direction (posture) of the player object Po and the first virtual camera in the virtual world according to the operation instruction direction calculated in step 111 (step 112), and the process is performed in the next step. Proceed. For example, the CPU 10 uses the reference operation instruction direction indicated by the reference operation instruction direction data De1 and the operation instruction direction indicated by the operation instruction direction data De2 to calculate the change angle and change direction of the operation instruction direction with respect to the reference operation instruction direction. To do. Then, the CPU 10 refers to the virtual world reference direction (for example, the upward direction of the virtual world displayed on the monitor 2, and in this embodiment, the direction of the terrain object is fixed with respect to the virtual world, so the north direction of the terrain object). On the other hand, the front direction of the player object Po (for example, the F direction shown in FIG. 14) is set using the direction in the virtual world rotated in the change direction by the change angle, and the player object data Df is updated. Further, the CPU 10 uses the direction in the virtual world that is rotated in the change direction by the change angle with respect to the virtual world reference direction to move upward in the first virtual camera (for example, the positive Y-axis direction shown in FIG. 14). And the virtual camera data Dm is updated. For example, as shown in FIG. 14, when the change angle of the operation instruction direction with respect to the reference operation instruction direction is the rotation angle C and the change direction is counterclockwise when viewed in the positive z-axis direction, the front of the player object Po The direction (direction F in the figure) is set to a direction rotated counterclockwise as viewed in the virtual world vertical direction from the virtual world reference direction by the rotation angle C. Further, the upward direction of the first virtual camera (for example, the positive Y-axis direction in the figure) is also rotated counterclockwise as viewed in the line-of-sight direction from the virtual world reference direction by the rotation angle C, similarly to the front direction of the player object Po. Set in the direction.

  Next, the CPU 10 determines whether or not a touch operation on the touch panel 62 is performed (step 113). For example, the CPU 10 refers to the touch position data Db3 and determines whether or not the user is performing a touch operation on the touch panel 62. Then, when a touch operation on the touch panel 62 is performed, the CPU 10 advances the processing to the next step 114. On the other hand, when the touch operation on the touch panel 62 is not performed, the CPU 10 advances the process to the next step 117.

  In step 114, the CPU 10 sets the moving speed to 0 and proceeds to the next step. For example, the CPU 10 updates the moving speed data Dk using the moving speed set to 0.

  Next, based on the moving distance and moving direction from the previous touch position to the current touch position, the CPU 10 sets the positions of the player object Po and the first virtual camera in the direction opposite to the moving direction by the moving distance. (Step 115), and the process proceeds to the next step. For example, the CPU 10 uses the current touch position indicated by the touch position data Db3 and the previous touch position indicated by the previous touch position data Di to change the virtual world overlapping the previous touch position from the virtual world position overlapping the current touch position. Calculate the distance and direction to the position. Then, the CPU 10 moves the positions of the player object Po and the first virtual camera in the calculated direction (moving direction) of the virtual world by the calculated distance (moving distance) of the virtual world, and uses the positions to determine the player object. Data Df and virtual camera data Dm are updated. As a result, as shown in FIG. 17, the position of the player object Po is the length of the drag operation in the direction opposite to the direction of the virtual world (D direction in the figure) overlapping the drag operation direction (B direction in the figure) with respect to the touch panel 62. It moves relative to the terrain object by a distance corresponding to. Further, since the position of the first virtual camera also moves relative to the terrain object by the same movement distance in the same movement direction as the player object Po, the display position of the player object Po displayed on the LCD 61 is consequently moved. Instead, the terrain object displayed on the LCD 61 is moved and displayed so as to follow the movement of the touch position during the drag operation on the touch panel 62.

  Next, the CPU 10 updates the previous touch position using the current touch position (step 116), and proceeds to the next step 119. For example, the CPU 10 newly sets the previous touch position data using the current touch position indicated by the touch position data Db3, and updates the previous touch position data Di using the newly set previous touch position data.

  On the other hand, in step 117, the CPU 10 initializes the previous touch position and proceeds to the next step. For example, the CPU 10 initializes the previous touch position to Null, and updates the previous touch position data Di using the initialized previous touch position.

  Next, the CPU 10 performs a movement process (step 118), and proceeds to the next step 119. Hereinafter, the movement process performed in step 118 will be described with reference to FIG.

  In FIG. 23, the CPU 10 determines whether or not the footstep flag indicated by the footstep flag data Dj is set to ON (step 121). Then, the CPU 10 advances the processing to the next step 122 when the stepping flag is set to OFF. On the other hand, if the footstep flag is set to ON, the CPU 10 proceeds to the next step 125.

  In step 122, the CPU 10 determines whether or not the total load value indicated by the load value data Dc is equal to or greater than a predetermined threshold value. And CPU10 advances a process to the following step 123, when a total load value is more than a predetermined threshold value. On the other hand, if the total load value is less than the predetermined threshold value, the CPU 10 proceeds to the next step 127. Here, the threshold value used in step 122 is a value for detecting that the user has stepped on the board-type controller 9, and may be a preset value or a value set by a user operation. .

In step 123, the CPU 10 sets the moving speed and proceeds to the next step. For example, the CPU 10 sets the moving speed V to V = (1 / F) * Vs
And the moving speed data Dk is updated using the calculated moving speed V. Here, F indicates the number of frames from when the footstep flag is turned on to the current time (the number of times the game processing cycle has been repeated, where game processing time = 1 frame time). The number of frames from when it was detected that the last step on the mold controller 9 was detected to the present time (that is, when the current step is detected) is shown. Vs is a predetermined maximum moving speed.

  Next, the CPU 10 sets the footstep flag on to update the footstep flag data Dj (step 124), and proceeds to the next step 127.

  On the other hand, when it is determined in step 121 that the footstep flag is set to ON, the CPU 10 determines whether or not the total load value indicated by the load value data Dc is less than a predetermined threshold (step 125). ). Then, when the total load value is less than the predetermined threshold value, the CPU 10 proceeds to the next step 126. On the other hand, if the total load value is equal to or greater than the predetermined threshold value, the CPU 10 proceeds to the next step 127. Here, the threshold value used in the above step 125 is to count the one stepping by detecting that the load once increased by the user once stepping on the board type controller 9 is lowered. This value may be a preset value or a value set by a user operation.

  In step 126, the CPU 10 sets the footstep flag to off, updates the footstep flag data Dj, and proceeds to the next step 127.

  In step 127, the CPU 10 attenuates the moving speed and proceeds to the next step. For example, the CPU 10 multiplies the movement speed indicated by the movement speed data Dk by a predetermined positive value less than 1, or subtracts a predetermined value until the movement speed becomes 0, thereby reducing the movement speed. Attenuate. Then, the CPU 10 updates the moving speed data Dk using the moving speed after attenuation.

  Next, the CPU 10 moves the positions of the player object Po and the first virtual camera in the virtual world according to the moving speed in the front direction of the player object Po (step 128), and ends the processing by the subroutine. For example, the CPU 10 uses the front direction of the player object Po indicated by the player object data Df and the moving speed indicated by the moving speed data Dk, in the virtual world, by the distance corresponding to the moving speed in the front direction of the player object Po. And the player object data Df is updated using the position. Further, the CPU 10 moves the position of the first virtual camera in the same front direction as the player object Po by the same movement distance, and updates the virtual camera data Dm using the position.

  Returning to FIG. 22, in step 119, the CPU 10 sets the terminal device display range based on the position and direction of the first virtual camera with respect to the terrain object (or the position and direction of the player object Po) and sets the terminal device display range. The data Dh is updated, and the processing by the subroutine is finished. For example, the CPU 10 is based on the position of the first virtual camera indicated by the virtual camera data Dm (or the position and direction of the player object Po indicated by the player object data Df) and the position of the terrain object indicated by the terrain object data Dg. The position of the terminal device display range is set. Specifically, the position of the terminal device display range with respect to the terrain object is set so that the gazing point (position of the player object Po) of the first virtual camera becomes the center position of the terminal device display range. Then, the CPU 10 uses the roll direction of the first virtual camera (the front direction of the player object Po) so as to substantially match the shape and direction of the range of the virtual world displayed on the LCD 61. Set the shape and direction.

  Returning to FIG. 21, after the object setting process in step 83, the CPU 10 sets the parameters related to the second virtual camera and updates the virtual camera data Dm (step 84), and ends the process of the subroutine. For example, the monitor game image is generated by a three-dimensional CG image obtained by arranging a virtual camera in the virtual world and calculating a game space viewed from the virtual camera. As an example, the second virtual camera for generating the monitor game image is set in the same virtual world in which the first virtual camera described above is set, and a distant position directly above the terrain object placed in the virtual world Fixedly arranged. The orientation of the second virtual camera is such that the vertical direction of the virtual world is the line-of-sight direction of the second virtual camera, and the virtual world reference direction (in this embodiment, the direction of the terrain object is fixed relative to the virtual world) The north direction of the object) is set to be the upward direction of the second virtual camera. In this way, since the terminal game image and the monitor game image become virtual world game images viewed from different viewpoints, the virtual world game viewed from different viewpoints also on the LCD 61 and the monitor 2 on which they are displayed. An image will be displayed.

  Returning to FIG. 20, after the game control process in step 44, the CPU 10 and the GPU 32 generate a monitor game image to be displayed on the monitor 2 (step 45), and the process proceeds to the next step. For example, the CPU 10 and the GPU 32 read out each data representing the result of the game control process in step 44 from the main memory, read out data necessary for generating a monitor game image from the VRAM 34, generate a game image, and generate The monitored game image is stored in the VRAM 34. The monitor game image may be generated by any method as long as it represents the result of the game control process in step 44. For example, in the monitor game image, the second virtual camera is arranged in the virtual world based on the parameters related to the second virtual camera indicated by the virtual camera data Dm, and the player object data Df, the terrain object data Dg, and the terminal device display range data A three-dimensional CG image obtained by arranging the player object Po and the terrain object on which the terminal device display range is drawn based on Dh in the virtual world and calculating the virtual world viewed from the second virtual camera. Generated by. Specifically, the CPU 10 draws the terminal device display range on the terrain object (the terminal device display range may be drawn outside the frame of the terrain object) based on the terminal device display range data Dh. Then, the CPU 10 places the player object Po and the terrain object in the virtual world based on the position and direction indicated by the player object data Df and the terrain object data Dg.

  Next, the CPU 10 and the GPU 32 generate a terminal game image to be displayed on the terminal device 6 (step 46), and proceed to the next step. For example, the CPU 10 and the GPU 32 read out each data representing the result of the game control process in step 44 from the main memory, read out data necessary for generating a terminal game image from the VRAM 34, generate a game image, and generate The monitored game image is stored in the VRAM 34. The terminal game image may be generated by any method as long as it represents the result of the game control process in step 44 as in the case of the monitor game image. Further, the terminal game image may be generated by the same method as the monitor game image or may be generated by a different method. For example, in the terminal game image, the first virtual camera is arranged in the virtual world based on the parameters relating to the first virtual camera indicated by the virtual camera data Dm, and the player object Po and the terrain object are respectively set in the virtual world in the same manner as in step 45. And a virtual world image is generated by a three-dimensional CG image obtained by calculating the virtual world viewed from the first virtual camera.

  Next, the CPU 10 generates a monitor game sound to be output to the speaker 2a of the monitor 2 (step 47), and proceeds to the next step. For example, the CPU 10 causes the DSP 33 to generate a monitor game sound to be output from the speaker 2a in accordance with the result of the game control process in step 44. As an example, in the virtual world set according to the result of the game control process in the above step 44, the CPU 10 uses the operation sound and sound effect of each object assumed to be heard based on the position of the second virtual camera. The DSP 33 generates monitor game sound to which BGM or the like to be output from the monitor 2 is added.

  Next, the CPU 10 generates a terminal game sound to be output to the speaker 607 of the terminal device 6 (step 48), and proceeds to the next step. For example, the CPU 10 causes the DSP 33 to generate terminal game sound to be output from the speaker 607 in accordance with the result of the game control process in step 44. As an example, in the virtual world set according to the result of the game control process in the above step 44, the CPU 10 uses the operation sound and sound effect of each object assumed to be heard based on the position of the first virtual camera. The DSP 33 generates a terminal game sound to which BGM or the like to be output from the terminal device 6 is added. The terminal game sound may be the same as or different from the monitor game sound. Further, the terminal game sound may be a part of the sound different from the monitor game sound (for example, sound effects are different but BGM is the same). If the monitor game sound and the terminal game sound are the same, the generation process of the terminal game sound may not be executed in step 48.

  Next, the CPU 10 outputs the monitor game image and the monitor game sound to the monitor 2 (step 49), and proceeds to the next step. For example, the CPU 10 sends the monitor game image data stored in the VRAM 34 and the monitor game sound data generated by the DSP 33 to the AV-IC 15. In response to this, the AV-IC 15 outputs data indicating the monitor game image and the monitor game sound to the monitor 2 via the AV connector 16. As a result, the monitor game image is displayed on the monitor 2 and the monitor game sound is output from the speaker 2a.

  Next, the CPU 10 transmits the terminal game image and the terminal game sound to the terminal device 6 (step 50), and proceeds to the next step. For example, the CPU 10 sends the terminal game image data stored in the VRAM 34 and the terminal game sound data generated by the DSP 33 to the codec LSI 27, and the codec LSI 27 performs a predetermined compression process. Further, the terminal game image data and the terminal game sound data subjected to the compression processing are transmitted to the terminal communication module 28 by the codec LSI 27 and transmitted to the terminal device 6 by the terminal communication module 28 via the antenna 29. The The terminal game image data and the terminal game sound data transmitted from the game apparatus body 5 are received by the wireless module 610 of the terminal apparatus 6 and subjected to predetermined decompression processing by the codec LSI 606. The terminal game image data that has undergone the decompression process is output to the LCD 61, and the data sound data of the terminal game sound that has undergone the decompression process is output to the sound IC 608. As a result, the terminal game image is displayed on the LCD 61 and the terminal game sound is output from the speaker 607.

  Next, the CPU 10 determines whether or not to end the game (step 51). As a condition for ending the game, for example, a condition that a game is over or a game is cleared is satisfied, or a user performs an operation to end the game. If the game is not finished, the CPU 10 returns to step 42 and repeats the process. If the game is finished, the process according to the flowchart is finished. Thereafter, the series of processing from step 42 to step 51 is repeatedly executed until it is determined in step 51 that the game is to be ended.

  According to the processing described above, it is possible to control the virtual camera (first virtual camera) in the virtual world by an operation based on the attitude or movement of the terminal device 6 and a touch operation on the touch panel 62 of the terminal device 6. . For example, the virtual camera can be controlled to roll and rotate in the virtual world by an operation based on the attitude and movement of the terminal device 6, and the virtual camera can be controlled to move in the virtual world by a drag operation on the touch panel 62. ing. As described above, according to the above-described processing, when the viewpoint (position and orientation of the first virtual camera) of the image displayed on the terminal device 6 changes depending on the movement and orientation of the terminal device 6, the viewpoint can be changed even by a touch operation. Since it can be changed, the user can further easily change the viewpoint.

  Further, according to the above-described processing, the operation of the player object Po in the virtual world is performed by the operation based on the attitude and movement of the terminal device 6, the touch operation on the touch panel 62 of the terminal device 6, and the operation based on the load applied to the board type controller 9. Can be controlled. For example, it is possible to control the direction of the player object Po in the virtual world by an operation based on the attitude or movement of the terminal device 6, and the player object Po can be controlled by a drag operation on the touch panel 62 or an operation by a load applied to the board type controller 9. Control that moves in the virtual world is also possible. Thus, according to the above-described processing, when a plurality of objects appear in the virtual world, it is possible to diversify user operations on the objects.

  In the above description, the game example in which the player object Po and the terrain object appear in the virtual world is used. However, the virtual world in which these objects are not arranged is displayed on the LCD 61 of the terminal device 6. Even if it exists, this invention is applicable. For example, a virtual camera for generating a virtual world image to be displayed on the LCD 61 is arranged in the virtual world. Then, the attitude and position of the virtual camera in the virtual world are changed according to the attitude and movement of the terminal device 6, and the attitude and position of the virtual camera in the virtual world are changed according to a touch operation on the touch panel 62. As an example, when the terminal device 6 rolls, the virtual camera is rotated relative to the virtual world around the viewing direction according to the roll rotation. When a drag operation is performed on the touch panel 62, the virtual camera is moved relative to the virtual world in a direction corresponding to the drag operation or a reverse direction by a distance corresponding to the drag operation. Even when the virtual camera is simply arranged in the virtual world as described above, the virtual world can be displayed on the LCD 61 from the viewpoint desired by the user in accordance with the operation on the terminal device 6. The operation of changing the viewpoint can be facilitated.

  In the above-described game example, the game image displayed on the LCD 61 of the terminal device 6 and the game image displayed on the monitor 2 are both images showing the same virtual world. It is an image with a different viewpoint and range. Therefore, the user can see the virtual world that is displayed in different views and display ranges displayed on the two display screens, and can view a suitable game image as appropriate according to the game situation and the like. In the above-described game example, the user moves and operates the terminal device 6 on the table, and the direction of the player object Po is changed relative to the terrain object according to the posture and position of the terminal device 6 in the real space. In addition, the image displayed on the LCD 61 can be changed according to the change. Accordingly, it is possible to give a virtual world a sense of presence to a user who views an image displayed on the LCD 61 while moving the terminal device 6. On the other hand, if only the image displayed on the LCD 61 is viewed, it may be difficult to grasp the position of the entire virtual world and the situation around the player object Po. By displaying the world, such a problem can be solved.

  In the above-described embodiment, a three-dimensional CG image or the like obtained by calculating the game space viewed from the virtual camera is displayed on the LCD 61 or the monitor 2, but the virtual world generated by other image processing is displayed. These images may be displayed on the LCD 61 or the monitor 2. For example, a two-dimensional virtual world image in which the player object Po or the terrain object is represented by a two-dimensional image may be displayed on the LCD 61 or the monitor 2.

  In the above description, a game example in which the player object Po moves on the terrain object has been used, but it goes without saying that the present invention is not limited to this game. For example, it is conceivable to apply the present invention to a game in which a board is cut with a saw. In the game, the display object is displayed on the LCD 61 and the monitor 2 by performing the same display control using the terrain object as a plate material and the player object Po as a saw, and the operation of the load applied to the board type controller 9 by the saw. Is done. Even in such a game, the effects of the present invention described above can be obtained similarly.

  The game system 1 can play various games as described above using the terminal device 6 and the board-type controller 9 as operation means. While the terminal device 6 can be used as a portable display or a second display, the terminal device 6 can also be used as a controller that performs input by operation of the main body, touch operation, button operation, etc. According to the system 1, it becomes possible to implement a wide range of games. That is, since the terminal device 6 functions as a display device and also as an operation device, the terminal device 6 is used as a display means without using the monitor 2 and the controller 7, and the terminal device 6 and the board are used. There may be a form such as a game system using the mold controller 9 as an operation means. Furthermore, since the terminal device 6 functions as a display device and also as an operation device, the terminal device 6 is used as a display means without using the monitor 2, the controller 7, and the board type controller 9. There may be a game system that uses the terminal device 6 as an operation means.

  Moreover, in the said embodiment, the terminal device 6 functions as what is called a thin client terminal which does not perform a game process. However, in the terminal device 6, at least a part of the series of game processes executed by the game apparatus body 5 in the above embodiment may be executed by the terminal device 6. As an example, the terminal device 6 may execute a part of processing (for example, processing for generating a terminal game image). As another example, the terminal device 6 may execute all the series of game processes executed by the game apparatus body 5. In this case, since the terminal device 6 functions as a display device and also functions as a processing device that executes game processing, the terminal device 6 does not use the monitor 2, the game device body 5, and the controller 7. Can be used as a display means, a board type controller 9 is used as an operation means, and a terminal system 6 is used as a processing means. In the game system, only the terminal device 6 and the board type controller 9 are connected wirelessly or by wire, and various kinds of games can be performed by outputting board operation data from the board type controller 9 to the terminal device 6. Needless to say, when the board-type controller 9 is not used, the terminal device 6 may be used as a display unit, an operation unit, and a processing unit.

  In the above embodiment, posture data (for example, magnetic sensor 602, acceleration) used to calculate the posture and / or movement of the terminal device 6 (including the position and posture itself, or changes in the position and posture). At least one data output from the sensor 603 and the gyro sensor 604) is output from the terminal device 6 to the game apparatus body 5, and the attitude and / or movement of the terminal apparatus 6 is calculated by information processing in the game apparatus body 5. Yes. However, the attitude and / or movement of the terminal device 6 calculated in the game apparatus main body 5 may be calculated in the terminal device 6. In this case, data indicating the posture and / or movement of the terminal device 6 calculated by the terminal device 6 (that is, the position and posture of the terminal device 6 itself calculated using the posture data, or the position and posture of the terminal device 6). Data indicating a change) is output from the terminal device 6 to the game apparatus main body 5, and the data is used in information processing in the game apparatus main body 5.

  Further, in the above description, a mode in which the terminal device 6 and the game device body 5 and the board type controller 9 and the game device body 5 are connected by wireless communication is used. Wireless communication between them may be performed. As a first example, the terminal device 6 functions as a relay device for other wireless communication. In this case, the board operation data of the board type controller 9 is wirelessly transmitted to the terminal device 6, and the terminal device 6 wirelessly transmits the terminal operation data of the terminal device 6 to the game apparatus body 5 together with the received board operation data. In this case, the terminal device 6 and the game apparatus body 5 are directly connected by wireless communication, but the board-type controller 9 is connected to the game apparatus body 5 by wireless communication via the terminal device 6. . As a second example, the board type controller 9 functions as another wireless communication relay device. In this case, the terminal operation data of the terminal device 6 is wirelessly transmitted to the board type controller 9, and the board type controller 9 wirelessly transmits the board operation data of the board type controller 9 to the game apparatus body 5 together with the received terminal operation data. In this case, the board type controller 9 and the game apparatus body 5 are directly connected by wireless communication, but the terminal device 6 is connected to the game apparatus body 5 by wireless communication via the board type controller 9. Become. When another device relays and transmits operation data to the game apparatus main body 5, an electrical connection is established between the device that generates the operation data and another device that relays the operation data via a cable. It doesn't matter.

  Further, the terminal device 6 and / or the board-type controller 9 and the game apparatus body 5 may be electrically connected via a cable. In this case, the cable connected to the terminal device 6 and / or the board type controller 9 is connected to the connection terminal of the game apparatus body 5. As a first example, the terminal device 6 and the game apparatus body 5 are electrically connected via a first cable, and the board-type controller 9 and the game apparatus body 5 are electrically connected via a second cable. Connected. As a second example, the terminal device 6 and the game apparatus body 5 are electrically connected via a cable. In this case, the board operation data of the board type controller 9 may be transmitted wirelessly to the terminal device 6 and then transmitted to the game apparatus body 5 via the cable, or directly from the board type controller 9 to the game apparatus body 5. It may be transmitted wirelessly. As a third example, the board type controller 9 and the game apparatus body 5 are electrically connected via a cable. In this case, the terminal operation data of the terminal device 6 may be transmitted wirelessly to the board type controller 9 and then transmitted to the game apparatus body 5 via the cable, or directly from the terminal apparatus 6 to the game apparatus body 5. May be sent.

  In the above embodiment, the game system 1 has one terminal device 6 and one board-type controller 9, but the game system 1 has a plurality of sets of terminal devices 6 and a board-type controller 9. It may be. That is, the game apparatus main body 5 can wirelessly communicate with a plurality of sets of terminal devices 6 and board type controllers 9, and transmits game image data, game sound data, and control data to each terminal device 6. Operation data, camera image data, microphone sound data, and board operation data may be received from each terminal device 6 and the board type controller 9. The game apparatus body 5 performs wireless communication with each of the plurality of terminal apparatuses 6 and the board type controller 9. At this time, the game apparatus body 5 performs wireless communication with each terminal apparatus 6 and the board type controller 9. It may be performed by time division or may be performed by dividing the frequency band.

  As described above, when a plurality of sets of terminal devices 6 and the board-type controller 9 are provided, more types of games can be played using the game system 1. For example, when the game system 1 has two sets of terminal devices 6 and a board type controller 9, two users can play a game simultaneously. Further, when the game system 1 has two sets of terminal devices 6 and a board-type controller 9, the game system 1 has three display devices, so that game images for each of the three users can be displayed. It can be generated and displayed on each display device.

  In the above description, the board-type controller 9 is provided with a plurality of load sensors 94. However, since the information on the center of gravity of the load applied to the board-type controller 9 is unnecessary in the above processing, the board-type controller 9, at least one load sensor 94 may be provided in the board-type controller 9.

  In the above embodiment, the stationary game apparatus 3 has been described. However, the information processing program of the present invention is executed by an information processing apparatus such as a portable game apparatus or a general personal computer. May be realized. In another embodiment, the present invention is not limited to a game device, and may be any portable electronic device such as a PDA (Personal Digital Assistant), a mobile phone, a personal computer, a camera, or the like. In any device, the present invention can be realized by connecting the device, the terminal device 6 and the board-type controller 9 wirelessly or by wire.

  In the above description, an example in which the game process is performed by the game apparatus main body 5 is used. However, at least a part of the process steps in the game process may be performed by another apparatus provided outside the game system 1. . For example, when the game apparatus body 5 is configured to be communicable with another apparatus (for example, a server or another game apparatus), the game apparatus body 5 and the other apparatus cooperate in the processing steps in the game process. It may be executed by doing. As an example, processing for setting an object, a virtual world, or the like is performed in another device, and the game processing is performed by transmitting data related to the movement and posture of the object from the game device body 5 to the other device. Conceivable. Then, image data indicating the virtual world generated by another device is transmitted to the game apparatus body 5 and the virtual world is displayed on the monitor 2 or the LCD 61. As described above, by performing at least a part of the processing steps in the game process with another device, the same process as the game process described above can be performed. Note that at least a part of the processing steps in the information processing may be performed by the board-type controller 9 (microcomputer 100). Further, the above-described game processing can be executed by cooperation between one processor or a plurality of processors included in an information processing system configured by at least one information processing apparatus. In the above embodiment, the CPU 10 of the game apparatus body 5 executes the predetermined program, so that the process according to the above-described flowchart is performed. All may be done.

  Further, the shape of the game apparatus main body 5 described above, the shape of the terminal device 6, the controller 7, and the board-type controller 9, and the shapes, numbers, and installation positions of various operation buttons and sensors are merely examples. It goes without saying that the present invention can be realized even in the shape, number, and installation position. In addition, the processing order, setting value, display mode, value used for determination, and the like used in the information processing described above are merely examples, and the present invention can be realized even in other orders, display modes, and values. Needless to say.

  The information processing program may be supplied not only to the game apparatus body 5 through an external storage medium such as the optical disc 4 but also to the game apparatus body 5 through a wired or wireless communication line. Further, the information processing program may be recorded in advance in a nonvolatile storage device inside the game apparatus body 5. The information storage medium for storing the information processing program may be a CD-ROM, DVD, or an optical disk storage medium similar to them, a flexible disk, a hard disk, a magneto-optical disk, a magnetic tape, or the like. The information storage medium for storing the information processing program may be a nonvolatile semiconductor memory or a volatile memory. Such a storage medium can be referred to as a computer-readable recording medium. For example, the various functions described above can be provided by causing a computer or the like to read and execute the programs of these recording media.

  Although the present invention has been described in detail above, the above description is merely illustrative of the present invention in all respects and is not intended to limit the scope thereof. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. It is understood that the scope of the present invention should be construed only by the claims. Moreover, it is understood that those skilled in the art can implement an equivalent range from the description of the specific embodiments of the present invention based on the description of the present invention and the common general technical knowledge. In addition, it is to be understood that the terms used in the present specification are used in the meaning normally used in the art unless otherwise specified. Thus, unless defined otherwise, all technical and technical terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. In case of conflict, the present specification, including definitions, will control.

  An information processing program, an information processing apparatus, an information processing system, and an information processing method according to the present invention further perform an operation of changing the viewpoint when the viewpoint of an image displayed on the apparatus changes depending on the movement or posture of the apparatus body. It is easy to use, and is useful as an information processing program, an information processing apparatus, an information processing system, and an information processing method for performing processing for controlling a viewpoint based on a user operation.

DESCRIPTION OF SYMBOLS 1 ... Game system 2 ... Monitor 3 ... Game device 4 ... Optical disk 5 ... Game device main body 10,617 ... CPU
11 ... System LSI
12 ... External main memory 13 ... ROM / RTC
14 ... Disk drive 15 ... AV-IC
16 ... AV connector 17 ... Flash memory 18 ... Network communication module 19 ... Controller communication module 20 ... Expansion connector 21 ... Memory card connectors 22, 23, 29, 611, 754 ... Antenna 24 ... Power button 25 ... Reset button 26 ... Eject Button 27 ... Codec LSI
28 ... Terminal communication module 31 ... Input / output processor 32 ... GPU
33 ... DSP
34 ... VRAM
35 ... Internal main memory 6 ... Terminal devices 60, 71 ... Housing 61 ... LCD
62 ... Touch panel 63 ... Analog stick 64 ... Operation button 65 ... Marker part 66 ... Camera 67 ... Expansion connector 68 ... Foot part 601 ... Touch panel controller 602 ... Magnetic sensors 603, 701 ... Acceleration sensors 604, 703 ... Gyro sensor 605 ... UI controller 606. Codec LSI
607, 706 ... Speaker 608 ... Sound IC
609 ... Microphone 612 ... Infrared communication module 613 ... Flash memory 614 ... Power supply IC
616 ... Charger 618 ... Internal memory 619, 704 ... Vibrator 7 ... Controller 72 ... Operation unit 73 ... Connector 74 ... Imaging information calculation unit 700 ... Board 702 ... LED
741 ... Infrared filter 742 ... Lens 743 ... Image sensor 744 ... Image processing circuit 75 ... Communication unit 752 ... Memory 8 ... Marker 9 ... Board type controller 90 ... Support plate 92 ... Leg 94 ... Load sensor 95 ... Strain body 96 ... Strain Sensor 102 ... AD converter 104 ... DC-DC converter 106, 610, 753 ... Wireless module 108 ... Amplifier 100, 751 ... Microcomputer 110, 615 ... Battery

Claims (31)

In the portable display device that outputs at least the main body state data according to the attitude and / or movement of the portable display device main body and the touch position data according to the touch position on the touch panel provided in the portable display device, An information processing program executed by a computer of an information processing apparatus capable of displaying an image,
The computer,
It controls the first direction position of the virtual camera moves in order to generate a virtual image of the world based on the body condition data, and controls the position of the first virtual camera on the basis of the touch position data First virtual camera control means;
An information processing program for causing a first image indicating a virtual world viewed from the first virtual camera to function as display control means for displaying on the portable display device. Based on the main body state data, further causing the computer to function as a posture movement calculating means for calculating the posture and / or movement of the portable display device,
The first virtual camera control means is configured to determine the attitude and / or movement of the first virtual camera based on the attitude and / or movement of the portable display device calculated by the attitude movement calculation means and the touch position indicated by the touch position data. The information processing program according to claim 1 which controls a position.   The first virtual camera control means controls the attitude of the first virtual camera by rotating the first virtual camera relative to the virtual world based on the attitude and / or movement of the portable display device. The information processing according to claim 2, wherein the position of the first virtual camera is controlled by moving the first virtual camera relative to the virtual world based on the touch position indicated by the touch position data. program.   The first virtual camera control means rotates the first virtual camera relative to an object arranged in the virtual world based on the attitude and / or movement of the portable display device. The posture of the camera is controlled, and the position of the first virtual camera is controlled by moving the first virtual camera relative to the object based on the touch position indicated by the touch position data. Information processing program described in 1. As a player object control means for controlling the movement of the player object arranged in the virtual world based on the attitude and / or movement of the portable display device calculated by the attitude movement calculation means and the touch position indicated by the touch position data. And further functioning the computer,
The information processing program according to claim 3, wherein the first virtual camera control unit arranges the first virtual camera at a position where an image of a virtual world including at least the player object is generated.   The information processing program according to claim 5, wherein the first virtual camera control unit arranges the first virtual camera at a position overlooking the player object from directly above in the virtual world. The player object control means is configured to move the player object with respect to the virtual world around the vertical direction of the virtual world at the same rotation direction and rotation angle as the first virtual camera based on the attitude and / or movement of the portable display device. Are rotated relatively to control the posture of the player object,
The first virtual camera control means moves the player object relative to the virtual world in the same movement direction and distance as the first virtual camera based on the touch position indicated by the touch position data. The information processing program according to claim 5 or 6, which controls a position of a player object. Based on the touch position data, as a touch position displacement calculating means for calculating the displacement of the touch position input to the touch panel, further causing the computer to function,
The information processing according to any one of claims 3 to 7, wherein the first virtual camera control means moves the first virtual camera relative to the virtual world based on the displacement of the touch position. program.   The first virtual camera control means calculates a movement direction for moving the first virtual camera based on the displacement direction of the touch position, and moves the first virtual camera relative to the virtual world in the movement direction. The information processing program according to claim 8, wherein the information processing program is moved.   The information processing program according to claim 9, wherein the first virtual camera control unit calculates a direction opposite to a displacement direction of the touch position as the movement direction.   The information processing program according to claim 10, wherein the first virtual camera control unit calculates, as the movement direction, a direction opposite to a direction corresponding to the displacement direction in the virtual world displayed overlapping the displacement of the touch position. .   The first virtual camera control means calculates a movement distance for moving the first virtual camera based on a displacement amount of the touch position, and moves the first virtual camera relative to the virtual world by the movement distance. The information processing program according to any one of claims 8 to 11, wherein the information processing program is moved.   The information processing program according to claim 12, wherein the first virtual camera control means calculates a distance corresponding to the displacement amount in the virtual world displayed overlapping the displacement of the touch position as the movement distance. The posture movement calculating means calculates at least a posture and / or movement of the portable display device rotating around a depth direction of the display screen perpendicular to the display screen of the portable display device;
The first virtual camera control means controls the posture of the first virtual camera according to the posture and / or movement of the portable display device that rotates around the depth direction. The information processing program according to one.   The first virtual camera control means is relative to the virtual world in the rotation direction around the viewing direction of the first virtual camera in accordance with the rotation direction in which the portable display device rotates around the depth direction. The information processing program according to claim 14, wherein the information processing program is rotated to control the attitude of the first virtual camera.   The first virtual camera control means rotates the first virtual camera relative to the virtual world in accordance with an angle at which the orientation of the portable display device main body changes around the depth direction. The information processing program according to claim 14 or 15, which controls a posture of the camera.   The first virtual camera control means rotates the first virtual camera relative to the virtual world by the same angle as the angle at which the orientation of the portable display device body changes, and changes the attitude of the first virtual camera. The information processing program according to claim 16 for controlling. The first virtual camera control means is virtual in the rotation direction by the rotation angle around the line-of-sight direction of the first virtual camera according to the rotation direction and the rotation angle of the portable display device rotating around the depth direction. When the orientation of the first virtual camera is controlled by rotating relative to the world, and the touch position data indicates an operation of dragging the touch panel, the touch position indicated by the touch position data overlaps the touch position. According to the moving direction and moving distance of the touch position in the virtual world displayed on the display screen, the first virtual camera is virtually moved in the direction opposite to the moving direction along the plane perpendicular to the line-of-sight direction. The information processing program according to any one of claims 14 to 17, which controls the position of the first virtual camera by being moved relative to the world. As a load acquisition means for acquiring data based on the load applied to the load detection device, further causing the computer to function,
The player object control means controls the position of the player object by moving the player object relative to the virtual world based on the data acquired by the load acquisition means. The information processing program as described in any one. The portable display device includes at least one of a gyro sensor and an acceleration sensor,
The posture movement calculation unit calculates a posture and / or movement of the portable display device based on data output from at least one of the gyro sensor and the acceleration sensor. Information processing program described in 1. The display control means outputs image data indicating the first image to the portable display device,
The portable display device includes image data acquisition means for acquiring image data output from the information processing device,
21. The information processing program according to claim 1, wherein the display screen of the portable display device displays the first image indicated by the image data acquired by the image data acquisition unit. And further causing the computer to function as compressed image generation means for generating compressed image data by compressing image data representing the first image,
The display control means outputs the compressed image data generated by the compressed image generation means to the portable display device,
The image data acquisition means acquires the compressed image data output from the information processing apparatus;
The portable display device further includes display image expansion means for expanding the compressed image data to obtain image data indicating the first image,
A display screen of the portable display device, the image data acquisition means the display image Shin Zhang means acquires displays the first image represented by the Shin Zhang image data storage medium according to claim 21 .   The display control means further displays, separately from the first image, a second image showing the virtual world viewed from a second virtual camera on another display device connected to the information processing device. The information processing program according to any one of 1 to 20. And further causing the computer to function as compressed image generation means for generating compressed image data by compressing image data representing the first image,
The display control means outputs the compressed image data generated by the compressed image generation means to the portable display device, and separately from the compressed image data, the separate image data indicating the second image is not compressed. Output to the display device
The portable display device is:
Image data acquisition means for acquiring compressed image data output from the information processing apparatus;
Display image decompression means for decompressing the compressed image data to obtain image data representing the first image,
A display screen of the portable display device, the image data acquisition means the display image Shin Zhang means acquires displays the first image represented by the Shin Zhang image data storage medium according to claim 23 .   The second virtual camera is set at a position different from the first virtual camera, and the computer is further caused to function as second virtual camera control means for controlling the attitude and / or position of the second virtual camera. Item 25. The information processing program according to item 23 or 24. The second virtual camera control means sets the line-of-sight direction of the second virtual camera so as to be parallel to the line-of-sight direction of the first virtual camera, and places the second virtual camera behind the first virtual camera. Set,
The information processing program according to claim 25, wherein the display control means displays a range wider than the range of the virtual world indicated by the first image as the second image on the other display device. The first virtual camera control means sets the viewing direction of the first virtual camera in the vertical direction of the virtual world,
27. The information processing program according to claim 25 or 26, wherein the second virtual camera control means sets a line-of-sight direction of the second virtual camera in a vertical direction of the virtual world. The first virtual camera control means controls the direction in which the position of the first virtual camera moves at a predetermined speed based on the main body state data, and the first virtual camera control means regardless of the speed based on the touch position data. The information processing program according to claim 1, which controls a position of one virtual camera. In the portable display device that outputs at least the main body state data according to the attitude and / or movement of the portable display device main body and the touch position data according to the touch position on the touch panel provided in the portable display device, An information processing apparatus capable of displaying an image,
It controls the first direction position of the virtual camera moves in order to generate a virtual image of the world based on the body condition data, and controls the position of the first virtual camera on the basis of the touch position data First virtual camera control means;
An information processing apparatus comprising: a display control unit configured to display a first image indicating a virtual world viewed from the first virtual camera on the portable display device. A plurality of devices are configured to be communicable, and main body state data corresponding to the attitude and / or movement of the portable display device main body and touch position data corresponding to the touch position on the touch panel provided in the portable display device. An information processing system capable of displaying an image on at least the portable display device that outputs,
It controls the first direction position of the virtual camera moves in order to generate a virtual image of the world based on the body condition data, and controls the position of the first virtual camera on the basis of the touch position data First virtual camera control means;
An information processing system comprising: display control means for displaying a first image showing a virtual world viewed from the first virtual camera on the portable display device. In the portable display device that outputs at least the main body state data according to the attitude and / or movement of the portable display device main body and the touch position data according to the touch position on the touch panel provided in the portable display device, An information processing method executed by cooperation between one processor or a plurality of processors included in an information processing system including at least one information processing apparatus capable of displaying an image,
It controls the first direction position of the virtual camera moves in order to generate a virtual image of the world based on the body condition data, and controls the position of the first virtual camera on the basis of the touch position data A first virtual camera control step;
A display control step of displaying a first image showing a virtual world viewed from the first virtual camera on the portable display device.

Images