US20030032478A1 - Orientation detection marker, orientation detection device and video game decive - Google Patents
Orientation detection marker, orientation detection device and video game decive Download PDFInfo
- Publication number
- US20030032478A1 US20030032478A1 US10/213,248 US21324802A US2003032478A1 US 20030032478 A1 US20030032478 A1 US 20030032478A1 US 21324802 A US21324802 A US 21324802A US 2003032478 A1 US2003032478 A1 US 2003032478A1
- Authority
- US
- United States
- Prior art keywords
- orientation detection
- screen
- player
- light source
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 208
- 239000003550 marker Substances 0.000 title claims abstract description 127
- 230000000007 visual effect Effects 0.000 claims description 49
- 238000003384 imaging method Methods 0.000 claims description 41
- 230000002250 progressing effect Effects 0.000 claims description 2
- 230000004397 blinking Effects 0.000 claims 1
- 238000005259 measurement Methods 0.000 abstract description 3
- 238000012545 processing Methods 0.000 description 183
- 238000010586 diagram Methods 0.000 description 88
- 241000086550 Dinosauria Species 0.000 description 64
- 238000000034 method Methods 0.000 description 29
- 239000000758 substrate Substances 0.000 description 29
- 239000011148 porous material Substances 0.000 description 16
- 239000002184 metal Substances 0.000 description 15
- 229910052751 metal Inorganic materials 0.000 description 15
- 238000003702 image correction Methods 0.000 description 13
- NIXOWILDQLNWCW-UHFFFAOYSA-N acrylic acid group Chemical group C(C=C)(=O)O NIXOWILDQLNWCW-UHFFFAOYSA-N 0.000 description 11
- 238000012937 correction Methods 0.000 description 10
- 238000003780 insertion Methods 0.000 description 10
- 230000037431 insertion Effects 0.000 description 10
- 230000004044 response Effects 0.000 description 8
- 239000003086 colorant Substances 0.000 description 7
- 230000014759 maintenance of location Effects 0.000 description 6
- 238000011160 research Methods 0.000 description 6
- 238000013459 approach Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 5
- 239000011159 matrix material Substances 0.000 description 5
- 238000011156 evaluation Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000000717 retained effect Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003213 activating effect Effects 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000013075 data extraction Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000002372 labelling Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 241000272525 Anas platyrhynchos Species 0.000 description 1
- 101001139126 Homo sapiens Krueppel-like factor 6 Proteins 0.000 description 1
- 206010029216 Nervousness Diseases 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000000149 penetrating effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/55—Controlling game characters or game objects based on the game progress
- A63F13/57—Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game
- A63F13/577—Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game using determination of contact between game characters or objects, e.g. to avoid collision between virtual racing cars
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
- A63F13/525—Changing parameters of virtual cameras
- A63F13/5255—Changing parameters of virtual cameras according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/219—Input arrangements for video game devices characterised by their sensors, purposes or types for aiming at specific areas on the display, e.g. light-guns
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
- A63F13/245—Constructional details thereof, e.g. game controllers with detachable joystick handles specially adapted to a particular type of game, e.g. steering wheels
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
- A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
- A63F13/426—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/80—Special adaptations for executing a specific game genre or game mode
- A63F13/812—Ball games, e.g. soccer or baseball
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/80—Special adaptations for executing a specific game genre or game mode
- A63F13/837—Shooting of targets
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1012—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1062—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted to a type of game, e.g. steering wheel
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/64—Methods for processing data by generating or executing the game program for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
- A63F2300/643—Methods for processing data by generating or executing the game program for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car by determining the impact between objects, e.g. collision detection
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/66—Methods for processing data by generating or executing the game program for rendering three dimensional images
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/66—Methods for processing data by generating or executing the game program for rendering three dimensional images
- A63F2300/6661—Methods for processing data by generating or executing the game program for rendering three dimensional images for changing the position of the virtual camera
- A63F2300/6676—Methods for processing data by generating or executing the game program for rendering three dimensional images for changing the position of the virtual camera by dedicated player input
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
- A63F2300/8011—Ball
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
- A63F2300/8076—Shooting
Definitions
- the present invention relates to an orientation detection device and orientation detection marker for detecting the orientation of a controller for performing input operations by orienting the screen of the display unit for displaying images.
- a CCD camera By imaging the movement of the respective detection subjects with the CCD camera, the movement of the player; for instance, the extension of the arm, is detected and reflected in the game progress in the likes of a hand-to-hand combat game.
- the present invention was devised in view of the foregoing problems, and the object thereof is to provide an orientation marker capable of remotely measuring the movement, particularly the orientation, of a controller having a simple structure, which may be employed in a more sophisticated game, and which is highly versatile; an orientation detection device for remotely measuring the orientation (posture) of the controller with such orientation detection marker; and a video game device employing the above.
- the orientation detection marker according to the present invention is provided in either one of the device main body and a controller for performing input operations as being pointed to a screen of a display unit provided to the device main body for displaying images, for detecting the orientation of the controller with respect to the screen, and which supplies information for computing said orientation to a picture image generated by imaging means provided in the other of the device main body and the controller, wherein said orientation detection marker comprises a light source having a mode including biaxial direction information.
- a picture image is generated with the imaging means provided to the device main body side and one of the controllers.
- An image of the orientation detection markers is contained in the picture image. Since the orientation detection marker includes biaxial direction information, in addition to the position information of the controller, and (rotation) inclination centered around the axis of orientation of the controller; that is, rotation angle information is also included in the picture image.
- the orientation of the controller with respect to the screen may be computed from this position information and rotation angle information.
- FIGS. 1A and 1B are diagrams showing the shifting of the projected image on the screen of the shooting video game machine pertaining to the first and second embodiments of the present invention
- FIG. 2 is a diagram showing the first example of the foregoing projected image
- FIG. 3 is a diagram showing another example of the foregoing projected image
- FIG. 4 is a diagram showing the second example of the foregoing projected image
- FIG. 5 is a diagram showing the change in the displayed image accompanying the player's movement to the left and right;
- FIG. 6 is a diagram showing the appearance of the foregoing video game machine
- FIG. 7 is a typical cross section for explaining the shifting of the projected image on the screen
- FIGS. 8A, 8B and 8 C are diagrams showing the structure of the gun unit, and FIG. 8A is a partial cross section of the side view; FIG. 8B is the front view of the marker substrate; and FIG. 8C is a diagram showing an example of the marker image;
- FIG. 9 is a cross section showing an example of the marker mounting structure
- FIG. 10 is a typical cross section showing the acrylic plate disposed for protecting the rotation of the mirror and projection of the image from the projector;
- FIG. 11A is a diagram showing the structure of the acrylic plate retention member and FIG. 11B is a diagram showing the structure of the acrylic plate;
- FIG. 12 is a block diagram showing the hardware structure of the control unit of the shooting video game machine pertaining to the first embodiment
- FIG. 13 is a flowchart showing the procedure for the shooting video game processing executed with the game control unit (CPU);
- FIG. 14 is a block diagram showing the structure of the principal parts of the game processing unit for performing the processing with the game processing main body;
- FIG. 15 is a flowchart showing the detailed procedure of the processing with the game processing main body
- FIG. 16 is the first diagram for explaining the detection of the player's position on the play area with the player detection sensor
- FIG. 17 is the second diagram for explaining the detection of the player's position on the play area with the player detection sensor
- FIG. 18 is a block diagram showing the structure of the principal parts of the muzzle direction detection unit for performing the muzzle direction detection processing at ST 81 ;
- FIG. 19 is a flowchart showing the detailed procedure of the muzzle direction detection processing at ST 81 ;
- FIG. 20 is a diagram showing the detailed subroutine of ST 815 ;
- FIG. 21 is a block diagram showing the structure of the principal parts of the image processing unit for performing the image display processing at ST 99 ;
- FIG. 22 is a flowchart showing the detailed procedure of the image display processing at ST 99 ;
- FIG. 23 is a diagram for explaining the rotation control of the mirrors corresponding respectively to the two areas in which one stage is divided with the first modified example of the shooting video game machine;
- FIG. 24 is a diagram for explaining the detection of the player's position with the player detection sensor with the second modified example of the shooting video game machine;
- FIG. 25 is the overall perspective view for explaining the video game device, which is a modified mode of the shooting video game machine pertaining to the first embodiment
- FIG. 26 is a front view of the controller simulating a tennis racket
- FIG. 27 is a block diagram of the video game device
- FIG. 28 is a structural diagram of the controller in which the shape of the marker is of a reverse T shape
- FIGS. 29A, 29B and 29 C are structural diagrams of the controller in a case where the video game device is to be used for a table tennis game, and FIG. 29A is the front view, FIG. 29B is the side view, and FIG. 29C is the rear view;
- FIG. 30 is a diagram showing the appearance of the shooting video game machine pertaining to the second embodiment
- FIG. 31 is a typical cross section for explaining the shifting of the projected image on the screen
- FIG. 32 is a diagram showing the structure of the gun unit
- FIGS. 33A and 33B are diagrams showing the marker arrangement for detecting the muzzle direction with respect to the screen together with the CCD camera in the gun unit;
- FIG. 34A is a diagram showing the form of markers, and FIGS. 34B and 34C represent the mounting structure to the screen;
- FIG. 35 is a block diagram showing the hardware structure of the control unit of the shooting video game machine pertaining to the second embodiment
- FIG. 36 is a flowchart showing the procedure for the shooting video game processing executed with the game control unit (CPU);
- FIG. 37 is a block diagram showing the structure of the principal parts of the game processing unit for performing the processing with the game processing main body;
- FIG. 38 is a flowchart showing the detailed procedure of the processing with the game processing main body
- FIG. 39 is the first diagram for explaining the detection of the player's position on the play area with the player detection sensor
- FIG. 40 is the second diagram for explaining the detection of the player's position on the play area with the player detection sensor
- FIG. 41 is a block diagram showing the structure of the principal parts of the marker light-up processing unit for performing the marker light-up processing at ST 280 ;
- FIG. 42 is a block diagram showing the structure of the principal parts of the muzzle direction detection unit for performing the muzzle direction detection processing at ST 281 ;
- FIG. 43 is a flowchart showing the detailed procedure of the muzzle direction detection processing at ST 281 ;
- FIG. 44 is a diagram showing the detailed subroutine of ST 2815 ;
- FIG. 45 is a block diagram showing the structure of the principal parts of the image processing unit for performing the image display processing at ST 299 ;
- FIG. 46 is a flowchart showing the detailed procedure of the image display processing at ST 299 ;
- FIGS. 47A and 47B are diagrams showing the display of the image corrected with the shooting video game machine pertaining to the second embodiment
- FIGS. 48A and 48B are diagrams showing the display of an ordinary image
- FIGS. 49A, 49B and 49 C are diagrams for explaining the image correction parameter set in the shooting video game machine pertaining to the second embodiment
- FIG. 50 is a diagram for explaining the rotation control of the mirrors corresponding respectively to the two areas in which one stage is divided with the first modified example of the shooting video game machine in the second embodiment;
- FIG. 51 is a diagram for explaining the detection of the player's position with the player detection sensor with the second modified example of the shooting video game machine in the second embodiment.
- FIG. 52 is a diagram showing the image correction parameter set in the shooting video game machine of third modified example in the second embodiment.
- FIG. 1 is a diagram showing the shifting of the projected image on the screen 121 of the shooting video game machine.
- FIG. 1A shows the display of the projected image 122 at the lower part of the screen 121
- FIG. 1B shows the display of the projected image 123 at the upper part of the screen 121 .
- FIG. 5 is a diagram showing the change in the displayed image accompanying the movement of the player 300 to the left and right.
- FIG. 2 and FIG. 4 are diagrams showing an example of the projected image 122 at the lower part
- FIG. 3 is a diagram showing an example of the projected image 123 at the upper part.
- the player 300 standing in the play area PE of a prescribed area set in front of the game machine operates the gun unit 10 and virtually shoots the dinosaur as the game character displayed in the projected images 122 , 123 on the screen 121 .
- the dinosaur having a 3D shape and which moves and shifts with the elapse in time within the game space (virtual three-dimensional space) is displayed in the projected image 122 as shown in FIG. 2 when existing afar as an image captured from the virtual viewpoint (which corresponds to the position of the reference viewpoint of the player 300 set in advance), and is displayed in the projected image 123 as shown in FIG. 3 or in the projected image 122 as shown in FIG. 4 when nearby.
- the displayed contents of the projected image 122 (FIG. 1A) displayed at the lower part of the screen 121 changes to the projected image 123 (FIG. 1B) in accordance with the virtual viewpoint moving within the game space and position of the dinosaur while shifting continuously toward the arrow A 1 , and, pursuant to this type of shifting of the projected image on the screen 121 , the visual line of the player 300 changes naturally from the lower part of the screen 121 to the upper part of the screen 121 (from the direction of arrow A 2 of FIG. 1A to the direction of arrow A 3 of FIG. 1B).
- the dinosaur within the game space is to attack the player, and displayed on the upper part of the screen 121 is an image where the dinosaur is trying to bite the player on the play area PE from the state within the projected image 123 of FIG. 3, and an image where the dinosaur is trying to kick (or whipping its tail against) the player is displayed on the lower part of the screen 121 from the state within the projected image 122 of FIG. 4.
- the player 300 may avoid these attacks by the dinosaur by moving to the left and right on the play area PE.
- the player 300 who is shooting toward the head of the dinosaur as shown in FIG. 1B moves to the left and right (direction of arrow A 4 ) on the play area as shown in FIG. 5 upon sensing that the dinosaur will begin its attack, with the present game machine, this movement is detected, the coordinates are set such that the virtual player (virtual viewpoint) moves away from the dinosaur within the game space, and a projected image 123 showing the player 300 moving away from the dinosaur (the dinosaur moves outward toward the direction of arrow A 5 ) is displayed.
- a flying dinosaur (pterosaur) afar from the virtual viewpoint may be displayed on the lower part of the screen 121 , the displayed contents thereof may be continuously changed and continuously shifted in accordance with the flying dinosaur with respect to the virtual viewpoint in order to display the flying dinosaur approaching the virtual viewpoint on the upper part of the screen 121 .
- FIGS. 6 to 11 will now be explained in this order regarding the structure of the present game machine for performing the overall operation described above.
- FIG. 6 and FIG. 7 are diagrams relating to the structure for projecting images and performing imaging with the gun unit 10
- FIG. 8 and FIG. 9 are diagrams relating to the structure of the light source unit (marker) which is the detection subject for detecting the muzzle 16 direction
- FIG. 10 and FIG. 11 are diagrams relating to the structure for protecting the rotation and the like of the mirror 43 .
- FIG. 6 is a diagram showing the appearance of the present game machine
- FIG. 7 is a typical cross section for explaining the shifting of the projected image on the screen 121 .
- the projected image 124 projected from the projector 31 (FIG. 7) on the screen 121 retained with the screen retention table 120 shifts in the arrow A 6 direction, and the gun unit 10 and gun unit 20 are connected to the main body control unit 100 (explained later at FIG. 13) via the gun cable 17 .
- the projected image 124 contains a shooting target such as a dinosaur as described above, and the 1 P player standing on the play area PE operates the gun unit 10 (or the 2P player operates the gun unit 20 ) to virtually shoot the shooting target, and points are scored in accordance with the skill of shooting such as the shooting position and shooting timing.
- the four player detection sensors 51 to 54 mounted on the front face of the base 110 are for detecting the movement of the 1P player when it is a one player game (or 1P player and 2P player when it is a two player game) in the left and right directions, and side plates 125 are provided for preventing the disturbance and the like upon detecting the muzzle direction (described later) with respect to the screen 121 and displaying images on the screen 121 .
- a speaker (top) 32 , speaker (left) 33 and speaker (right) 34 for outputting sounds in the middle and high ranges, and a woofer speaker 35 for outputting sounds in the low ranges are provided in order to output such sounds during the game.
- the speaker (top) 32 and speaker (left) 33 form one pair and the speaker (top) 32 and speaker (right) 34 form one pair in order to playback in stereo sound.
- a coin of a prescribed amount is inserted into the coin insertion slot 38 , the start button 36 is suitably pressed in accordance with the display on the screen 121 , and a one player game with only the 1P player or a two player game with both the 1P player and 2P player is selectively started.
- the rectangular flat mirror 43 as shown in FIG. 7, has a mirror axis 45 extending in the perpendicular direction in the diagram, and both ends of the mirror axis 45 are rotatably retained with the mirror retention member 46 .
- the rotation of the stepping motor 41 connected to the control unit described later is transmitted to the mirror with the timing belt 44 , and the projected image 124 shifts in the arrow A 6 direction on the screen by the mirror 43 being rotated in the direction of arrow A 7 .
- the reference viewpoint set at a prescribed height and position at the front of the present game machine is associated with the virtual viewpoint within the game space, and it is envisioned that a player (of an average height) is able to view the screen 121 from this reference viewpoint position.
- a color CCD camera 6 as the imaging means is mounted in forward orientation at a prescribed height and position at the left, right and center of the screen 121 shown in FIG. 7.
- the CCD camera 6 is directed in the direction of ⁇ so as to at least include the muzzle position in the game of the gun unit 10 operated by the player, and adopted are those which have a prescribed visual field width (solid angle of the range shown with the chain line).
- the CCD camera 6 be built in the likes of a housing 61 for blocking light such that it will not receive the projected light from the projector 31 to the screen 121 .
- FIG. 8 is a diagram showing the structure of the gun unit 10 (similar with the gun unit 20 ) as an example of the controller for accepting input operations from the player
- FIG. 9 is a diagram showing an example of the mounting structure of the marker provided to the gun unit 10 for detecting the direction of the muzzle 16 with respect to the screen 121 .
- the gun unit 10 simulates a pump action gun, and has a trigger switch 11 as the micro switch that is turned on when the player pulls the trigger 14 in the direction of arrow A 8 , a pump trigger switch 12 as the micro switch that is turned on when the player slides the sliding unit 15 in the direction of arrow A 9 , and a marker 13 for detecting the point where the direction of the muzzle with respect to the screen 121 ; that is, the direction of the muzzle 16 (visual line vector) intersects with the screen 121 .
- a trigger switch 11 as the micro switch that is turned on when the player pulls the trigger 14 in the direction of arrow A 8
- a pump trigger switch 12 as the micro switch that is turned on when the player slides the sliding unit 15 in the direction of arrow A 9
- a marker 13 for detecting the point where the direction of the muzzle with respect to the screen 121 ; that is, the direction of the muzzle 16 (visual line vector) intersects with the screen 121 .
- Signals from the trigger switch 11 and the pump trigger switch 12 are transmitted to the main body control unit 100 via the gun cable 17 , virtual shooting is designated by the trigger switch 11 being turned on, and the loading of a prescribed number of virtual bullets is designated to the gun unit 10 when the pump trigger switch 12 is turned on.
- the marker 13 is not of a reflective type and is rather a self-illuminating type, a power source supply line is included in the gun cable.
- the marker 13 mounted on the tip (marker mounting section) of the muzzle 16 of the gun unit 10 comprises a plate shaped substrate 130 , and, for example, LEDs 131 to 135 as the five dotted light sources for emitting prescribed colors having the same shape in the present embodiment are disposed on such plate surface in prescribed intervals, preferably in prescribed equal intervals in the vertical and horizontal directions.
- LEDs 131 to 135 are structured such that LED 131 is at the intersecting point position of the vertical and horizontal axes in the present embodiment, LEDs 132 and 133 are disposed in equal intervals in the vertical axis direction (LED 131 and LED 132 structure the first light source unit, LED 132 and LED 133 structure the second light source unit, and LED 132 is shared in the present embodiment), and LEDs 134 and 135 are disposed in equal intervals in the horizontal direction (LED 131 and LED 134 structure the third light source unit, LED 134 and LED 135 structure the fourth light source unit, and LED 134 is shared in the present embodiment).
- Mounting position information on the respective plate surfaces of LEDs 131 to 135 is, for example, stored in the likes of a ROM 105 of the main body control unit 100 shown in FIG. 12 as position information with LED 131 as the reference. It is preferable that an illuminator capable of emitting infrared light be used as the LEDs 131 to 135 for preventing the erroneous detection by outside light. In a mode where the LED 131 is not shared and respectively divided in the vertical and horizontal directions, the number of LEDs will become six. LED 132 and LED 134 do not have to be shared either.
- the color of the substrate 130 is adopted upon being colored to a color capable of being identified with the CCD camera 6 against the luminescent color of the LED, and, as described later, enabled is the measurement of the vertical and horizontal dimension of the substrate 130 ; that is, dimension of the distance to the CCD camera 6 .
- a CCD camera capable of only receiving infrared light may also be used.
- FIG. 8C is a diagram showing an example of the image imaged with the CCD camera 6 and incorporated in the image memory, and, as illustrated therein, obtained are images of the luminescent spots 131 a to 135 a corresponding to the LEDs 131 to 135 . Moreover, as shown in the diagram, the image is imaged in an oval as shown with the chain line around the substrate; that is, in a posture facing the oblique direction, and it is evident that the luminescent spots 131 a to 135 a are compress and mapped in the left and right directions.
- FIG. 9 is a diagram showing an example of the mounting structure of the dotted light source.
- the LEDs 131 to 135 as the dotted light source are mounted, for example, in an upright posture on the substrate 130 of a prescribed size to which is mounted an LED illuminating drive circuit or the like. Pores 130 a from which the illumination unit 6 of the LEDs 131 to 135 is exposed are provided at prescribed positions on the substrate 130 .
- the pore 130 a is formed in a conical shape (cone shape) broadening toward the front of the of the substrate 130 , and the light emitted from the respective LEDs may be irradiated at a broad angle.
- a stud nut 130 c having a prescribed height is welded at two places at the left and right sides of the thin metal plate 130 b , or established by pressurization (to the pore not shown formed on the thin metal plate 130 c ), and the mounting plate 130 d and the thin metal plate 130 b are integrally formed by mounting a mounting plate 130 d on these nuts 130 c and tightening this with a bolt 130 e from the opposite face.
- the thin metal plate 130 b to the bolt 130 e form the LED supporting unit.
- a pore 130 f is further formed at both end positions of the thin metal plate 130 b , and, although not shown, a triangular screw penetrates the cone shaped pore formed on the substrate 130 in order to integrally form the substrate 130 and muzzle 16 by tightening the bolt via the LED supporting unit.
- FIG. 10 is a typical cross section showing the acrylic plate 142 established for protecting the projection of the image form the projector 31
- FIG. 11 is a diagram showing the structure of the acrylic plate retention member 141 (FIG. 11A) and the acrylic plate 142 (FIG. 11B).
- the acrylic plate 142 (FIG. 11B) established so as to cover the mirror 43 , projector 31 and the like in a state of where the end thereof is passing through the acrylic plate guide groove 143 (FIG. 11A), as shown in FIG. 10, transmits the images from the projector 31 , and protects the inside which houses the likes of the mirror 43 and projector 31 from outside sources. Further, when the real image is projected on the upper part of the screen 121 , an inclination of roughly 10° is provided from the horizontal direction such that the virtual image is connected to the outside of the screen 121 with the light reflected from the likes of the acrylic plate 143 and mirror 43 .
- FIG. 12 is a block diagram showing the hardware structure of the control unit of the present game machine
- FIG. 13 is a flowchart showing the procedure of the shooting game processing (shooting video game program) executed with the game control unit (CPU) 103 .
- FIG. 12 connected to the (game control unit 103 of the) main body control unit 100 set within the base 110 (FIG. 6) are the aforementioned CCD camera 6 ; trigger switches 11 , 21 ; pump trigger switches 12 , 22 ; player detection sensors 51 to 54 ; start button 36 ; projector 31 ; stepping motor 41 ; speakers 32 to 35 ; coin switch 37 for detecting the insertion of the coin from the coin insertion slot 38 ; and position sensor 42 for determining the rotational reference position of the mirror with the semicircular plate mounted on the mirror axis (upon turning on the power), and the display position of the projected image 124 on the screen 121 (FIG. 7) is continuously designated by the game control unit 103 designating the rotation angle from the rotational reference position.
- a ROM 105 storing the program, image data and sound data for the shooting video game processing described later; a RAM 106 for temporarily storing the program read from the ROM 105 and data used in the program; a game control unit 103 for controlling the overall progress of the game based on the program loaded on the RAM 106 ; a drawing control unit (image drawing processor) 101 for writing image data corresponding to the projected image of the projector 31 in the frame buffer 102 while performing processing unique to the image such as polygon drawing and texture mapping in accordance with the coordinates of the object having a 3D shape within the game space; and a sound control unit (sound control processor) 104 comprising an ADPCM sound source for reproducing sounds from the sound data.
- a sound control unit sound control processor
- the start screen is displayed (ST 3 ), (and when the pressing of the start button 36 is further detected) the game start processing is executed (ST 5 ) and the game is started after other game data is read (ST 4 ) which characterizes the image data and sound data differing per stage, and the attack or movement of the enemy character (foregoing dinosaur or other shooting targets) and the movement of the player.
- a virtual life of the player is set and reduced in accordance with the time limit of the game and the attack by the enemy character, and the game is ended when the time is up during the game progress (YES at ST 6 ) or when the life runs out (NO at ST 7 ), and a screen indicated game over is displayed (ST 13 ). If time still remains (NO at ST 6 ) and the life still remains (YES at ST 7 ), the game is continued at the game processing main body (ST 8 , to be described in detail later with reference to FIG. 15 and the like).
- FIG. 14 is a block diagram showing the structure of the principal parts of the game processing unit 400 (part of the shooting video game program) for performing the processing with the game processing main body at ST 8 of FIG. 13, and FIG. 15 is a flowchart showing the detailed procedure of the processing with the game processing main body at ST 8 .
- FIG. 16 and FIG. 17 are diagrams for explaining the detection of the position of the player 300 on the play area PE with the player detection sensors 51 to 54 (in a one player game with only 1P player).
- the game processing unit 400 has a light-up processing unit 400 a for lighting the marker during the game; a muzzle direction detection unit 401 for detecting the position on the screen 121 to which the muzzle is facing based on the image captured with the CCD camera 6 ; an I/O input unit 402 for inputting the on-state of the pump trigger switch 12 and trigger switch 11 and the detection status of the player detection sensors 51 to 54 ; a bullet-loading processing unit 403 for processing the loading of a prescribed number of virtual bullets when the pump trigger switch 12 is turned on; a bullet position computation unit 404 for setting the coordinates so as to move the bullets in a direction according to the direction of the muzzle 16 from the vicinity of the virtual viewpoint within the game space when the trigger switch 11 is turned on; a viewpoint position shifting unit 405 for ordinarily shifting the virtual viewpoint within the game space (
- the game processing unit 400 has an enemy attack setting unit 407 for generating the attack to the player when the enemy character is sufficiently close to the player (using random numbers, etc.); an enemy movement processing unit 408 for moving the enemy character upon setting the enemy character coordinates so as to chase the player within the game space; and an enemy collision judgment unit 409 for judging whether the virtual attack from the player hit the enemy.
- the game processing unit 400 further has an image processing unit 410 for setting data which designates the drawing control unit 101 so as to draw based on the setting of the enemy character coordinates and rotating the stepping motor 41 in accordance with where to display the projected image of the projector 31 on the screen 121 , for example, whether to display the projected image on the upper part or lower part; and a sound processing unit 411 for setting data which designates the sound control unit 104 to selectively reproduce sounds (including music) according to the game progress.
- an image processing unit 410 for setting data which designates the drawing control unit 101 so as to draw based on the setting of the enemy character coordinates and rotating the stepping motor 41 in accordance with where to display the projected image of the projector 31 on the screen 121 , for example, whether to display the projected image on the upper part or lower part
- a sound processing unit 411 for setting data which designates the sound control unit 104 to selectively reproduce sounds (including music) according to the game progress.
- the pump trigger switch 12 is responding (YES at ST 83 )
- the bullets are virtually loaded at the bullet-loading processing unit 403 (ST 84 ).
- the trigger switch 11 is responding (YES at ST 85 )
- the coordinates representing the trajectory of the bullets within the game space are computed (ST 86 ) in accordance with the direction of the muzzle 16 with respect to the screed detected with the muzzle direction detection unit 401 .
- the avoidance movement of the virtual viewpoint is set with the viewpoint position shifting unit 405 (ST 88 ), and, if the response status of the player detection sensors 51 to 54 is not of a prescribed pattern (NO at ST 87 ), the normal movement of the virtual viewpoint is set (ST 89 ).
- the player detection sensors 51 to 54 are range sensors for detecting the distance to the obstacle with supersonic waves or infrared rays, and turning on the signal when the distance to the obstacles is less than a prescribed distance (distance corresponding to the player 300 on the play area PE) (it is not necessary to measure the distance accurately).
- a prescribed distance distance corresponding to the player 300 on the play area PE
- the virtual viewpoint coordinates are set within the game space deeming that the player has moved around to the left side of the dinosaur.
- the virtual viewpoint coordinates are set within the game space deeming that the player has moved around to the right side of the dinosaur.
- the reference position may be moved to the front of the player detection sensor 53 on the inner right side.
- the virtual viewpoint coordinates may be set within the game space deeming that the player has moved around to the right side of the dinosaur, and when it is detected that the player moved to the front of the player detection sensor 52 on the inner left side (or the player detection sensor 51 on the outer left side), the virtual viewpoint coordinates may be set within the game space deeming that the player has moved around to the left side of the dinosaur.
- FIG. 18 is a block diagram showing the structure of the principal parts of the muzzle direction detection unit 401 for performing the muzzle direction detection processing at ST 81 of FIG. 15;
- FIG. 19 is a flowchart showing the detailed procedure of the muzzle direction detection processing at ST 81 ; and
- FIG. 20 is a diagram showing the detailed procedure of the extraction processing of the dotted light source at ST 815 .
- the muzzle direction detection unit 401 has an image processing unit 4011 for repeatedly incorporating in prescribed cycles the CCD image (data per pixel is stored in a prescribed area on the RAM 106 ) which is the picture image of the CCD camera 6 ; a binary processing unit 4012 for binarizing data per imaged pixel as a prescribed threshold and storing this in a prescribed area on the RAM 106 as luminescent spot data, or performing binary processing after temporarily storing the same; a coordinate data extraction unit 4013 for extracting coordinate data in which the binarized luminescent spot data exists and performing prescribed data arrangement; a straight line judgment unit 4014 for successively selecting the combination of the three spots from the extracted luminescent spot data and judging whether such three spots exist on the straight line and whether they are of equal intervals; a vicinity judgment unit 4015 for judging whether another luminescent spot exists in the vicinity of a luminescent spot on one end with respect to the three spots existing on the straight line (main axis); a dotted light source specification unit
- the CCD image includes luminescent spots other than the LED; that is, noise, caused by infrared rays contained in the natural light and infrared rays contained in the fluorescent lights and discharge lamps. Therefore, the straight line judgment unit 4014 and the vicinity judgment unit 4015 endeavor to eliminate the noise by performing judgment processing for all combinations.
- the positions of the LEDs 131 to 135 of the marker when the substrate 130 is flat is Pa (0, 0), Pb (1, 0), Pc (2, 0), Pd (0, 1), Pe (0, 2), and when these are defined upon expanding to the three-dimensional space, the positions will become 0a (0, 0, 0), 0b (1, 0, 0), 0c (2, 0, 0), 0d (0, 1, 0), 0e (0, 2, 0).
- the coordinates will be represented as a value enjoining three-dimensional matrix such as Ca (tx, ty, tz), Cb (tx+r 00 , ty+r 01 , tz+r 02 ), Cc (tx+2 ⁇ r 00 , ty+2 ⁇ r 01 , tz+2 ⁇ r 02 ), Cd (tx+r 10 , ty+r 11 , tz+r 12 ), Ce (tx+2 ⁇ r 10 , ty+2 ⁇ r 11 , tz+2 ⁇ r 12 ).
- the dimension ratio ph, pv in the vertical and horizontal directions of the visual field of the CCD camera and the actual substrate 130 may also be obtained from the imaging dimension of the substrate 130 with respect to the actual dimension
- the coordinates Ga (Ah, Av), Gb (Bh, Bv), Gc (Ch, Cv), Gd (Dh, Dv), Ge (Eh, Ev) of the respective points in the CCD image are all publicly known.
- variables tx, ty, tz, r 00 to r 12 can be computed from these publicly known data and the coordinates of the respective points viewed from the CDD camera 6 , and the components (r 20 , r 21 , r 22 ) of the normal line direction of the substrate 130 are thereby determined.
- the reason why the value contained in the two items of coordinates Cc and Ce was made to be double value against r 00 , r 01 , r 02 , r 10 , r 11 , r 12 ; that is, to be in proportion is because the substrate 130 is represented as a plane (as a simulation).
- the intersecting point (H, V) on the screen 121 of the normal line of the substrate 130 is sought with (tx+tz ⁇ (r 20 /r 22 ), ty+tz ⁇ (r 21 /r 22 )) from the obtained position of the marker 13 , normal line direction information (r 20 , r 21 , r 22 ) of the substrate 130 , and surface position information of the screen with the preset (predefined) CCD camera 6 as the origin. Further, during this computation, since the position of the marker 13 has been computed, this position information may be adopted as necessary, and, for instance, a desired dynamic detection of the controller 10 becomes possible with continuous computation, and it will no longer be necessary to adopt the conventional structure such as the triangular ranging method.
- the game control unit 103 further has a trajectory computation unit for computing the trajectory of bullets flying within the game space from impact position on the screen 121 based on the information obtained with the intersecting point (H, V) computation unit 4018 and the information obtained with the normal line computation unit 4017 and the intersecting point (H, V) computation unit 4018 .
- image (CCD) data is foremost incorporated by activating the CCD camera 6 under trigger conditions such as vertical synchronization (V-sync, V-blank) at a prescribed cycle, ⁇ fraction (1/60) ⁇ seconds for example (ST 811 ), and then the incorporated data is binarized with the binary processing unit 4012 in order to extract luminescent spots (ST 812 ).
- V-sync, V-blank vertical synchronization
- ST 811 image (CCD) data is foremost incorporated by activating the CCD camera 6 under trigger conditions such as vertical synchronization (V-sync, V-blank) at a prescribed cycle, ⁇ fraction (1/60) ⁇ seconds for example
- the incorporated data is binarized with the binary processing unit 4012 in order to extract luminescent spots (ST 812 ).
- coordinates of the binary data to be treated as luminescent spots are incorporated, an identification symbol is added thereto (labeling), and appropriate grouping processing is performed (ST 813 ) in
- each luminescent spot specified at ST 814 is named A to E (ST 815 ).
- the coefficient of the dimension ratio ph, pv is multiplied against the position data of luminescent spots A to E (ST 816 ).
- coordinates tz of the z component are computed with the marker 13 of the CCD camera 6 as the origin regarding the coordinate data of luminescent spots A, B, C (ST 817 ), x component tx, y component ty, r 00 , r 01 , r 02 are then computed from the camera coordinates tz (ST 818 ), r 10 , r 11 , r 12 are thereafter computed based on the coordinate data of luminescent spots D, E and tx, ty, tz (ST 819 ), and the normal line vector (r 20 , r 21 , r 22 ) of the substrate 130 ; that is, the intersecting point (H, V) of the gun unit 13 direction and the screen 121 is then computed as described above (ST 820 ).
- the intersecting point (H, V) which is the computation result is forwarded to the CPU 103 side, and utilized in the collision judgment processing of the shooting against the enemy character (may also be considered for impact presentation) and the like. Moreover, in a case where a plurality of markers are lit up for a two player game, the intersecting point (H, V) of the other markers is similarly computed, and the suitable intersecting point data may be utilized.
- FIG. 20 is a detailed subroutine of ST 815 , and the existing luminescent spot positions are foremost structured (formed) into a graph composed of the vector and distance (ST 831 ).
- the luminescent spot position data within the graph is organized in accordance with the foregoing grouping or in a somewhat sorted state, thereby facilitating the data analysis.
- the vector is utilized to research whether the three luminescent spots are of a straight line relationship be operating the inner product of the adjacent two points for example (ST 832 ). When a straight line relationship does not exist (NO at ST 833 ), it is judged whether processing for all combinations has been completed (ST 834 ), and the routine returns to ST 832 when in the middle, and skips to ST 821 when it has been completed.
- the routine returns to ST 832 , and if it exists, the routine researches the relationship of the luminescent spot in the vicinity and the luminescent structuring the main axis, and the shape of the marker is estimated thereby (ST 839 ).
- the reason such luminescent spot is treated as D depending on the conditions of the existence in the vicinity is because the relationship of the intersection and equal distance with the LED.A will not be established depending on the direction of the camera.
- A, B, C, D are encoded from the positional relationship of the respective luminescent spots in order to determine the arrangement thereof (ST 840 ).
- the muzzle 16 direction detection processing to which part of the screen 121 the muzzle 16 is ultimately facing, and the virtual trajectory position of the bullets fired toward the target object from the muzzle 16 within the game space from a position on the screen may be computed with the characteristics of the positional relationship of the image of the marker within the CCD image.
- FIG. 21 is a block diagram showing the structure of the principal parts of the image processing unit for performing the image display processing at ST 99 of FIG. 15, and FIG. 22 is a flowchart showing the detailed procedure of the image display processing at ST 99 .
- the image processing unit 410 for displaying images while performing such correction has a visual line elevation setting unit 4101 for setting the visual line elevation (angle inclining the visual line upward against the level surface) in accordance with the object position data 421 (data representing the position of the shooting target object within the game space); a mirror inclination control unit 4102 for designating the rotation angle of the mirror in accordance with the visual line elevation and controlling the stepping motor 41 ; and an image generation indication unit 4103 for designating the generation of images to the drawing control unit 101 .
- a visual line elevation setting unit 4101 for setting the visual line elevation (angle inclining the visual line upward against the level surface) in accordance with the object position data 421 (data representing the position of the shooting target object within the game space)
- a mirror inclination control unit 4102 for designating the rotation angle of the mirror in accordance with the visual line elevation and controlling the stepping motor 41
- an image generation indication unit 4103 for designating the generation of images to the drawing control unit 101 .
- the visual line elevation is set with the visual line elevation setting unit 4101 (in accordance with the dinosaur position or the parts of the dinosaur which generate attacks during the approach) (ST 991 ), the mirror rotation angle according to this visual line elevation is designated with the mirror inclination control unit 4102 (ST 992 ), and the mirror 43 rotates as a result of the stepping motor 41 being controlled (ST 993 ).
- drawing of the image captured from the prescribed virtual viewpoint is indicated with the drawing control unit 101 against the set visual line elevation with the image generation indication unit 4104 (ST 994 ), and this processing is returned to the beginning.
- image data is generated upon operating data relating to polygons within the (three-dimensional) game space, this image data is written in the frame buffer 102 , and images are projected on the screen 121 in accordance with the image data on the frame buffer 102 .
- FIG. 23 is a diagram for explaining the rotation control of the mirrors corresponding respectively to the two areas in which one stage is divided with the first modified example of the shooting video game machine.
- an area 501 corresponding to the first half of the first stage and an area 502 corresponding to the second half are assumed, and the player shoots small dinosaurs and flying dinosaurs (ordinary enemy characters) in the first half area 501 and shoots the foregoing enormous dinosaurs (enemy character corresponding to the boss character) in the second half area 502 .
- the virtual player virtual viewpoint
- An enemy character appears when the virtual player passes through prescribed positions 511 to 514 , and the player virtually shoots at the display of such enemy character with the gun unit 10 .
- the player detection sensors 51 to 54 respond, the player is made to move a relatively small distance to the left or right within the game space just enough to avoid the attack from the enemy character, and the mirror for determining the position of the projected image on the screen is rotated based on the data designated in advance.
- the player avoids the attack of the boss character 522 approaching the virtual player 521 within the game space by making the player detection sensors 51 to 54 respond and moving in the arrow B 2 or arrow B 3 direction, and the player shoots at the display of the boss character by operating the gun unit.
- the boss character 522 will move in the arrow B 4 or arrow B 5 direction so as to follow the moving virtual player 521 .
- the player is made to move a relatively large distance upon the response of the player detection sensors 51 to 54 (movement so as to move around the left or right side of the dinosaur, and the a different distance range such as 5 meters, 20 meters, etc. is set in accordance with the stage), and the mirror is rotated in accordance with the distance between the boss character and the virtual viewpoint as described above, or in accordance with the portion in the boss character is to make the attack.
- FIG. 24 is a diagram for explaining the detection of the position of player 300 (during the two player game with 1P player and 2P player) with the player detection sensors 51 to 54 with the second modified example of the shooting video game machine.
- FIG. 25 is an overall perspective view of the video game device.
- the video game device comprises a console type game housing 1000 having a rectangular parallelepiped shape for example, a display unit 1101 is disposed at the front upper part thereof, a CCD camera 1102 is provided to the front lower part thereof, and, although not shown, a speaker 1103 (c.f. FIG. 27) for yielding sound effects is provided to a suitable position in the housing, and a start button 1001 (c.f. FIG. 27) for indicating game start is provided to the approximately center right or left, for example.
- the display unit 1101 is formed of a CRT, LCD or the like, and an image of a sports stadium including a tennis court 1201 for example is displayed thereon, and an opponent character 1202 is displayed on the opponent's court side.
- the player P to play the game upon standing in the play area PE prepared in front of the game housing 1000 will play the competition game upon holding the controller 1300 simulating a tennis racket.
- the CCD camera 1102 corresponds to the CCD camera 6 in the previous embodiments, and is set to at least include the visual field of the controller 1300 to be swung by the player positioned in the play area PE.
- the setup position of the CCD camera 1102 is not limited to the position shown in FIG.
- the mounting position may be separate from the game housing 1000 , and, in such a case, it should be considered that the CCD camera 1102 is established on the game housing side from the relationship of signal processing.
- the purpose of this game is to repeat the motion of returning the tennis ball hit from the opponent back to the opponent's court via a game medium of a tennis ball (not shown in FIG. 26) with the opponent character (competition with the computer for example) within the game screen, and the game is played in accordance with the rules of a tennis game.
- FIG. 26 shows the front view of the controller 1300 simulating a tennis racket, and dotted light sources 1301 to 1305 such as LEDs structuring the light source unit are mounted to the face of the net portion (marker mounting section).
- the power source of LEDs may be supplied with a cable, or batteries may be built therein (inside the grip for instance).
- the dotted light sources 1301 to 1303 are disposed in equal intervals in the longitudinal direction, and the dotted light sources 1304 and 1305 are disposed in equal intervals in the width direction together with the dotted light source 1301 to be shared.
- Imaging of the controller 1300 with the CCD camera 1102 , the intersecting angle (direction) formed with the screen of the display unit 1101 of the net face of the controller 1300 , and the height and left/right positions with respect to the screen of the display unit 1101 are obtained by executing operational processing similar to the operation method in the previous embodiments.
- the CCD camera 1102 performs imaging operations at a prescribed cycle, ⁇ fraction (1/60) ⁇ seconds for example, and the operational processing for seeking the intersecting angle as well as the height and left/right positions is repeated.
- FIG. 27 is a block diagram of the video game device.
- the present device comprises a CPU 1400 as the control unit, a ROM 1501 storing game program data, image data required in the game (each image data may be structured with objects as virtual three-dimensional objects structured from polygons), sound data and other fixed data (e.g., three-dimensional position information and the like of the display unit 1101 with the CCD camera 1102 as the origin), and a RAM 1502 for temporarily storing data under processing.
- the CPU 1400 is for controlling the desired game progress by collectively or suitably reading necessary game program data or other data from the ROM 1501 , and comprises a controller position operation unit 1401 for computing the position of the controller; a controller direction operation unit 1402 for computing the direction of the controller; a collision judgment unit 1403 for judging the virtual collision of the ball character as the game medium and the controller 1300 ; a return processing unit 1404 for computing the return direction and speed when the ball character is returned with the controller 1300 ; an in/out judgment unit 1405 for judging whether the returned ball character is in the in area or out area of the opponent's court; an opponent character processing unit 1406 for performing the movement processing of the opponent character; a ball character processing unit 1407 for performing the positional computation of the ball character; a drawing processing unit 1408 for performing drawing processing to the display unit 1101 of the tennis court 1201 , opponent character 1202 and ball character; and an evaluation processing unit 1409 for managing the game score and victory/defeat.
- the controller position operation unit 1401 is for computing the direction and position with respect to the screen of the display unit 1101 by executing an operational processing similar to the operation method in the previous embodiments from the position information of the dotted light sources 1301 to 1305 of the controller images with the CCD camera 1102 .
- the controller direction operation unit 1402 is for computing the direction of the flat face of the net portion of the controller 1300 with respect to the screen of the display unit 1101 by performing processing similar to the previous embodiments.
- the collision judgment unit 1403 is for judging whether the ball character virtually hit the controller 1300 from the flight direction (virtual flight from the screen) of the ball character described later, and the position and direction information of the controller 1300 at the point when the ball character within the game image flies from within the virtual three-dimensional space and computationally coincides with the position on the screen of the display unit 1101 .
- the return processing unit 1404 is for computing the flight path of the ball character returned by the player from the swing speed sought with the position and direction of the controller 1300 and two times worth of consecutive computed positional information of the controller 1300 computed successively when it is deemed by the collision judgment unit 1403 that the ball character virtually hit the net of the controller.
- the in/out judgment unit 1405 is for judging whether the ball character in which the flight path thereof is computed with the return processing unit 1404 landed on the inside or outside of the opponent's court.
- the opponent character processing unit 1406 is for making the behavior of the opponent character existing within the game space and controlled with the CPU 1400 to follow the motion procedures by incorporating the ordinary motion in a tennis match into the game program, and produces the movement in the front/back/left/right directions within the opponent's court, serve motion, return motion and so on.
- the ball character processing unit 1407 is for performing the movement processing of the ball character moving to the screen side from the ball hitting motion of the opponent character, and to perform the movement control of the ball character virtually hit by the player, preferably in consideration of adding gravity, drive, cut, and other ball rotations.
- the drawing processing unit 1408 is for displaying information annunciating the game progress such as the tennis court 1201 , opponent character 1202 , ball character, scores, acquired sets and so on upon employing the image data read from the ROM 1501 on the screen of the display unit 1101 in accordance with the game program and behavior of the controller 1300 .
- the evaluation processing unit 1409 is for executing the processing for determining the score and victory/defeat in accordance with the rules of a tennis match.
- the game begins with the score at 0-0, and the serve motion by the opponent character 1202 is displayed.
- the flight patch of the ball character is computed based on the position of this serve motion within the virtual three-dimensional space and the direction and speed of the smash motion, and the movement of the ball character along such direction is displayed.
- the controller position operation unit 1401 and the controller direction operation unit 1402 compute the position and direction of the controller 1300 in prescribed cycles after the game is started, and judges whether the controller 1300 hit the ball character from the position, direction and swing speed of the controller 1300 at the time the ball character arrives at the screen.
- air shot processing (minus evaluation processing) is executed, and if it is a hit, the return direction and speed of the ball character is computed upon executing dynamic computation.
- the flight path of the ball character within the virtual three-dimensional space is sought based on the computation described above, and the ball character is displayed on the screen. Whether the returned ball character landed within the opponent's court is judged, and minus evaluation is made if outside the court, and, if inside the court, judgment is made on whether the opponent character is able to return the ball character from the landing position of the ball character (equivalent to the distance between the landing point and the position of the opponent player) and the speed (also upon reflecting the drive, cut or other ball rotations).
- the opponent character is made to operate for returning the ball character, and the flight computation of such ball character is further conducted.
- the score is renewed when either player misses the ball character.
- the victory/defeat is determined, and the game is over.
- the dotted light sources 1301 to 1305 are mounted so as to be exposed on both sides of the net portion, such that the illuminated light is emitted to both faces.
- three dotted light sources 1301 to 1303 and 1301 , 1304 , 1305 are provided respectively in each axis, the front/back judgment will become undefined in cases where the racket is turned in the normal line direction of the racket face.
- the net portion may be formed with plates having colors different from the dotted light sources on the front and back.
- the illuminated color of the dotted light sources 1301 , 1302 , 1303 may be made the same (blue for example), and at least one among the dotted light sources 1304 or 1305 may be made a color (green for example) differing from the foregoing color.
- distinction of the front and back will be realized in addition to facilitating the specification processing of the dotted light sources within the picture image and the judgment of the axis side, and the processing speed will improve thereby.
- a green light source will rotate 90° from the blue color and imaged on the front face in the clockwise direction of the dotted light source 1301 for example, and this will be the reverse color relationship on the back face.
- at least one on the specific same axis side other than the dotted light source 1301 may also be flash controlled.
- the size and shape of the dotted light source may be made to differ from the others.
- the dotted light source for judging the front and back may be made to have a different light-emitting form than the other dotted light sources.
- the dotted light source for judging the front and back is shared with one of the dotted light sources 1301 to 1305 , the number of dotted light sources may be reduced in comparison to cases of separately providing such dotted light source.
- a reverse T shape may be employed as the shape of the biaxial direction marker.
- the illuminant color of the dotted light sources 1311 to 1313 is made the same color (green for example) in order to distinguish the front and back, and the illuminant color of the dotted light source 1314 is made to be a different color (red for example), and/or the illuminant color of the dotted light source 1315 is made to be a different color (blue for example).
- the color of at least the dotted light source 1314 or the dotted light source 1315 needs to be a different color (green in this example).
- controller 1310 Since the controller 1310 is simulating a racket, the front and back thereof is switched by the racket being swung around the axis parallel to the axis of the dotted light sources 1311 to 1313 , and it will suffice to change the color of the dotted light source on the side sandwiching the rotational axis.
- FIGS. 29A, 29B and 29 C are diagrams show a simulated table tennis racket used as the controller 1320 when the video game device it used for playing a table tennis game. Since both sides of the table tennis racket may be used to hit the ball, it is desirable that dotted light sources capable of recognizing the front and back be disposed. In other words, as shown in FIG. 29A, FIG. 29B and FIG.
- dotted light sources 1321 to 1323 are disposed on the ball-hitting face of the racket on one side with respect to the grip axis and parallel to the axis, dotted light sources 1324 and 1325 are provided to the opposite side of the axis upon sharing the dotted light source 1321 , and light may therefore be emitted from either face upon exposing both the front and back sides.
- the recognition processing of the front and back may be simplified, and the rotational angle with respect to the rotational axis of the grip from the luminescent spot images corresponding to the dotted light sources 1321 and 1324 within the picture image; that is, the direction with respect to the screen of the display unit may be operated.
- the front and back judgment will also become possible with the imaging means recognizing a different color if the color of the ball-hitting face of the racket (ground color) is made to differ for the front and back.
- the setup positions of the CCD camera 6 and the marker 13 are switched in the shooting video game machine pertaining to the first embodiment.
- the marker 13 is disposed on the shooting video game machine main body side (screen 121 )
- the CCD camera 6 is disposed on the gun unit 10 .
- FIG. 30 and FIG. 31 are diagrams relating to the structure for projecting images
- FIG. 32 and FIG. 33 are diagrams relating to the structure for detecting the direction of the muzzle 216
- FIG. 34 is a diagram showing the mode of markers 26 to 29 and the structural diagram for mounting such markers to the screen.
- FIG. 30 is a diagram showing, the appearance of the present game machine
- FIG. 31 is a typical cross section for explaining the shifting of the projected image on the screen 2121 .
- the projected image 2124 projected from the projector 231 (FIG. 31) on the screen 2121 retained with the screen retention table 2120 shifts in the arrow A 26 direction, and the gun unit 210 and gun unit 220 are connected to the main body control unit 2100 (explained later at FIG. 35) via the gun cable 217 .
- the projected image 2124 contains a shooting target such as a dinosaur as described above, and the 1P player standing on the play area PE operates the gun unit 210 (or the 2P player operates the gun unit 220 ) to virtually shoot the shooting target, and points are scored in accordance with the skill of shooting such as the shooting position and shooting timing.
- the four player detection sensors 251 to 254 mounted on the front face of the base 2110 are for detecting the movement of the 1P player when it is a one player game (or 1P player and 2P player when it is a two player game) in the left and right directions, and side plates 2125 are provided for preventing the disturbance and the like upon detecting the muzzle direction (described later) with respect to the screen 2121 and displaying images on the screen 2121 .
- a speaker (top) 232 , speaker (left) 233 and speaker (right) 234 for outputting sounds in the middle and high ranges, and a woofer speaker 235 for outputting sounds in the low ranges are provided in order to output such sounds during the game.
- the speaker (top) 232 and speaker (left) 233 form one pair and the speaker (top) 232 and speaker (right) 234 form one pair in order to playback in stereo sound.
- a coin of a prescribed amount is inserted into the coin insertion slot 238 , the start button 236 is suitably pressed in accordance with the display on the screen 2121 , and a one player game with only the 1P player or a two player game with both the 1P player and 2P player is selectively started.
- the rectangular flat mirror 243 as shown in FIG. 31, has a mirror axis 245 extending in the perpendicular direction in the diagram, and both ends of the mirror axis 245 are rotatably retained with the mirror retention member 246 .
- the rotation of the stepping motor 241 connected to the control unit described later is transmitted to the mirror with the timing belt 244 , and the projected image 2124 shifts in the arrow A 26 direction on the screen by the mirror 243 being rotated in the direction of arrow A 27 .
- the reference viewpoint set at a prescribed height and position at the front of the present game machine is associated with the virtual viewpoint within the game space, and it is envisioned that a player (of an average height) is able to view the screen 2121 from this reference viewpoint position.
- FIG. 32 is a diagram showing the structure of the gun unit 210 (similar with the gun unit 220 ) as an example of the controller for accepting input operations from the player
- FIG. 33 is a diagram showing an example of the arrangement of the markers 26 to 29 for detecting the direction of the muzzle 216 with respect to the screen 2121 together with the CCD camera 213 in the gun unit 210 .
- FIG. 33A is a diagram showing the front view of the screen 2121 extended on the level plane
- FIG. 33B is a diagram showing the side view of the screen 2121 provided in the present game machine.
- the markers 26 to 29 have the same shape, and a prescribed number (four in this embodiment) is disposed in the vertical direction, preferably in equal intervals, at the center position of the surface of the screen 2121 .
- the mounting position information for each of the markers 26 to 29 with respect to the screen 2121 is stored in the likes of a ROM 2105 of the main body control unit 2100 shown in FIG. 35.
- the arrangement position of the markers may be set in accordance with the shape of the screen, and, in the present embodiment, markers are provided in the vicinity of the top or bottom of the screen 2121 and at two locations in which the space therebetween is divided in thirds. Moreover, the number of markers may be suitably set in accordance with the size of the screen and visual field angle of the CCD camera 213 .
- the gun unit 210 simulates a pump action gun, and has a trigger switch 211 as the micro switch that is turned on when the player pulls the trigger 214 in the direction of arrow A 28 , a pump trigger switch 212 as the micro switch that is turned on when the player slides the sliding unit 215 in the direction of arrow A 29 , and a CCD camera 213 having a visual field angle capable of imaging at least one, up to two in this embodiment, among the markers 26 to 29 for detecting the point where the direction of the muzzle with respect to the screen 2121 ; that is, the direction of the muzzle 216 (visual line vector) intersects with the screen 2121 .
- FIG. 33A Depending on the visual field 2431 of the CCD camera 213 , as shown in FIG. 33A, only a part of the screen 2121 may be imaged, and, as further shown in FIG. 33B, the distance between the CCD camera 213 (within the gun unit 210 ) and the screen 2121 is changed in accordance with the player's operation during the game progress, and the size of the portion of the screen 2121 to fit within the visual field 2431 of the CCD camera 213 will change.
- detected are the arrangement of the image and the rotational angle information of the one marker illuminating with the mounting position information of the markers 26 to 29 (as described later) within the CCD image corresponding to the visual field 2431 , and detected is which part of the screen 2121 the player is facing the muzzle 216 , and the intersecting point thereof.
- FIG. 34A shows the form of the markers
- FIG. 34B and FIG. 34C show the mounting structure to the screen 2121 . Since the markers 26 to 29 have the same shape, marker 26 will be explained here.
- LEDs 26 A to 26 D are adopted in the marker 26 as the spot light source (illuminator) for illuminating infrared light for preventing erroneous detection by outside light.
- LED 26 A to LED 26 C are disposed on a straight line (main axis) in prescribed equal intervals, LED 26 has the same interval as the foregoing prescribed interval from LED 26 A, and provided on the line (sub axis) intersecting with the main axis. Since the shape of the markers form an L shape, the expression “L shape” will be used in the second embodiment when referring to the marker shape.
- the mounting position information of the marker 26 is prescribed and stored for each LED, and the LED 26 A is the reference position in the present embodiment.
- the interval between LED 26 A to LED 26 D is preferably equal, and it not limited thereto.
- the disposition of LED 26 D at a position of intersecting with the sequence of LED 26 A to LED 26 C is preferably form the computational processing perspective to be performed based on the marker position and rotation angle within the picture image described later.
- FIG. 34B shows the mounting structure of the LED 26 D.
- the LED 26 D is mounted, for example, in an upright posture on the substrate 611 of a prescribed size to which is mounted an LED illuminating drive circuit or the like.
- Pores 2121 a from which the illumination unit of the LED 26 D is exposed are provided at prescribed positions on the substrate 611 .
- the pore 2121 a is formed in a conical shape (cone shape) broadening toward the front face of the screen 2121 , and the light emitted from the LED 26 D may be irradiated at a broad angle.
- a stud nut 613 having a prescribed height is welded at two places at the left and right sides of the thin metal plate 612 , or established by pressurization (to the pore not shown formed on the thin metal plate 612 ), and the substrate 611 and the thin metal plate 612 are integrally formed by tightening a bolt 614 from the opposite face upon mounting the substrate 611 on this nut 613 .
- a pore 612 a is further formed at both end positions of the thin metal plate 612 , and, although not shown, a triangular screw penetrates the cone shaped pore 2121 b corresponding to the screen 2121 in order to integrally form the screen 2121 and the thin metal plate 612 by tightening the bolt.
- FIG. 34C shows the mounting structure of LEDs 26 A to 26 C, and this is basically the same mounting structure as with LED 26 D.
- the LEDs 26 A to 26 C are mounted, for example, in an upright posture on the substrate 621 of a prescribed size.
- Three pores 2121 a from which the illumination unit of the LEDs 26 A to 26 C is exposed are provided at prescribed positions on the screen 2121 .
- the pores 2121 a are formed in a conical shape broadening toward the front face of the screen 2121 , and the light emitted from the LEDs 26 A to 26 C may be irradiated at a broad angle.
- the thin metal plate 622 is of a size capable of containing LEDs 26 A to 26 C (three LED worth), a stud nut 623 having a prescribed height is welded at three places, or established by pressurization (to the pore not shown formed on the thin metal plate 622 ), and the substrate 621 and the thin metal plate 622 are integrally formed by tightening a bolt from the opposite face upon mounting the substrate 621 on this nut 623 .
- Pores 622 a are further formed at suitable positions of the thin metal plate 622 , and, although not shown, a triangular screw penetrates the cone shaped pore 2121 b corresponding to the screen 2121 in order to integrally form the screen 2121 and the thin metal plate 622 by tightening the bolt.
- the structure for protecting the rotation and the like of the mirror 243 is the same as the first embodiment shown in FIG. 10 and FIG. 11, and the explanation thereof is omitted.
- FIG. 35 is a block diagram showing the hardware structure of the control unit of the present game machine
- FIG. 36 is a flowchart showing the procedure of the shooting game processing (shooting video game program) executed with the game control unit (CPU) 2103 .
- FIG. 35 connected to the (game control unit 2103 of the) main body control unit 2100 set within the base 2110 (FIG. 30) are the aforementioned trigger switches 211 , 221 ; pump trigger switches 212 , 222 ; CCD cameras 213 , 223 ; markers 26 to 29 ; player detection sensors 251 to 254 ; start button 236 ; projector 231 ; stepping motor 241 ; speakers 232 to 235 ; coin switch 237 for detecting the insertion of the coin from the coin insertion slot 238 ; and position sensor 242 for determining the rotational reference position of the mirror 243 with the semicircular plate mounted on the mirror axis (upon turning on the power), and the display position of the projected image 2124 on the screen 2121 (FIG. 31) is continuously designated by the game control unit 2103 designating the rotation angle from the rotational reference position.
- a ROM 2105 storing the program, image data and sound data for the shooting video game processing described later; a RAM 2106 for temporarily storing the program read from the ROM 2105 and data used in the program; a game control unit 2103 for controlling the overall progress of the game based on the program loaded on the RAM 2106 ; a drawing control unit (image drawing processor) 2101 for writing image data corresponding to the projected image of the projector 231 in the frame buffer 2102 while performing processing unique to the image such as polygon drawing and texture mapping in accordance with the coordinates of the object having a 3D shape within the game space; and a sound control unit (sound control processor) 2104 comprising an ADPCM sound source for reproducing sounds from the sound data.
- a sound control unit sound control processor
- a virtual life of the player is set and reduced in accordance with the time limit of the game and the attack by the enemy character, and the game is ended when the time is up during the game progress (YES at ST 26 ) or when the life runs out (NO at ST 27 ), and a screen indicated game over is displayed ST 213 ). If time still remains (NO at ST 26 ) and the life still remains (YES at ST 27 ), the game is continued at the game processing main body (ST 28 , to be described in detail later with reference to FIG. 38 and the like).
- FIG. 37 is a block diagram showing the structure of the principal parts of the game processing unit 2400 (part of the shooting video game program) for performing the processing with the game processing main body at ST 28 of FIG. 36
- FIG. 38 is a flowchart showing the detailed procedure of the processing with the game processing main body at ST 28
- FIG. 39 and FIG. 40 are diagrams for explaining the detection of the position of the player on the play area PE 2 (corresponds to player 300 of FIG. 1 and FIG. 5 in the first embodiment) with the player detection sensors 251 to 254 (in a one player game with only 1P player).
- the game processing unit 2400 has a light-up processing unit 2400 a for lighting one of the markers 26 to 29 corresponding to the screen 2121 position to which the projected image is displayed; a muzzle direction detection unit 2401 for detecting the position on the screen 2121 to which the muzzle is facing based on the image captured with the CCD camera 213 ; an I/O input unit 2402 for inputting the on-state of the pump trigger switch 212 and trigger switch 211 and the detection status of the player detection sensors 251 to 254 ; a bullet-loading processing unit 2403 for processing the loading of a prescribed number of virtual bullets when the pump trigger switch 212 is turned on; a bullet position computation unit 2404 for setting the coordinates so as to move the bullets in a direction according to the direction of the muzzle 216 from the vicinity of the virtual viewpoint within the game space when the trigger switch 211 is turned on; a
- the game processing unit 2400 has an enemy attack setting unit 2407 for generating the attack to the player when the enemy character is sufficiently close to the player (using random numbers, etc.); an enemy movement processing unit 2408 for moving the enemy character upon setting the enemy character coordinates so as to chase the player within the game space; and an enemy collision judgment unit 2409 for judging whether the virtual attack from the player hit the enemy.
- the game processing unit 400 further has an image processing unit 2410 for setting data which designates the drawing control unit 2101 so as to draw based on the setting of the enemy character coordinates and rotating the stepping motor 241 in accordance with where to display the projected image of the projector 231 on the screen 2121 , for example, whether to display the projected image on the upper part or lower part; and a sound processing unit 2411 for setting data which designates the sound control unit 2104 to selectively reproduce sounds (including music) according to the game progress.
- an image processing unit 2410 for setting data which designates the drawing control unit 2101 so as to draw based on the setting of the enemy character coordinates and rotating the stepping motor 241 in accordance with where to display the projected image of the projector 231 on the screen 2121 , for example, whether to display the projected image on the upper part or lower part
- a sound processing unit 2411 for setting data which designates the sound control unit 2104 to selectively reproduce sounds (including music) according to the game progress.
- the pump trigger switch 212 is responding (YES at ST 283 )
- the bullets are virtually loaded at the bullet-loading processing unit 2403 (ST 284 ).
- the trigger switch 211 is responding (YES at ST 285 )
- the coordinates representing the trajectory of the bullets within the game space are computed (ST 286 ) in accordance with the direction of the muzzle 216 with respect to the screed detected with the muzzle direction detection unit 2401 .
- the avoidance movement of the virtual viewpoint is set with the viewpoint position shifting unit 2405 (ST 288 ), and, if the response status of the player detection sensors 251 to 254 is not of a prescribed pattern (NO at ST 287 ), the normal movement of the virtual viewpoint is set (ST 289 ).
- the player detection sensors 251 to 254 are range sensors for detecting the distance to the obstacle with supersonic waves or infrared rays, and turning on the signal when the distance to the obstacles is less than a prescribed distance (distance corresponding to the player on the play area PE 2 ) (it is not necessary to measure the distance accurately).
- a prescribed distance distance corresponding to the player on the play area PE 2
- the virtual viewpoint coordinates are set within the game space deeming that the player has moved around to the left side of the dinosaur.
- the virtual viewpoint coordinates are set within the game space deeming that the player has moved around to the right side of the dinosaur.
- the reference position may be moved to the front of the player detection sensor 253 on the inner right side.
- the virtual viewpoint coordinates may be set within the game space deeming that the player has moved around to the right side of the dinosaur, and when it is detected that the player moved to the front of the player detection sensor 252 on the inner left side (or the player detection sensor 251 on the outer left side), the virtual viewpoint coordinates may be set within the game space deeming that the player has moved around to the left side of the dinosaur.
- FIG. 41 is a block diagram showing the principal parts of the marker light-up processing unit 2400 a (part of the shooting video game program) for performing the marker light-up processing at ST 280 of FIG. 38.
- the marker light-up processing unit 2400 a has a projected image position judgment unit 24001 for receiving the position information of the screen 2121 to which the projected image 2124 is displayed from the image processing unit for performing drawing processing and judging the current projected position; a corresponding marker determination unit 24002 for specifying (determining) a marker as described later among the markers contained in the projected range from this projected position information and the predetermined position information of the markers 26 to 29 ; and a corresponding marker light-up indication unit 24003 for performing the light-up indication to the four LEDs structuring the determined corresponding marker.
- the marker closer to the center of the display range of the projected image will be selected, and when the two markers are roughly the same distance from the center, the marker corresponding to the shifting direction of the projected image on the screen is selected (that is, position information from the image processing unit 2410 is stored over several occasions, and comparison is made with the present position information so as to decide the marker facing the center).
- FIG. 42 is a block diagram showing the structure of the principal parts of the muzzle direction detection unit 2401 for performing the muzzle direction detection processing at ST 281 of FIG. 38;
- FIG. 43 is a flowchart showing the detailed procedure of the muzzle direction detection processing at ST 281 ; and
- FIG. 44 is a diagram showing the detailed procedure of the extraction processing of the “L frame” at ST 2815 .
- the CCD image includes luminescent spots other than the LED; that is, noise, caused by infrared rays contained in the natural light and infrared rays contained in the fluorescent lights and discharge lamps. Therefore, the straight line judgment unit 4014 and the vicinity judgment unit 24015 endeavor to eliminate the noise by performing judgment processing for all combinations.
- the positions of the LED.A to D of the marker when the screen 2121 is flat is A 2 (0, 0), B 2 (1, 0), C 2 (2, 0), D 2 (0, 1), and when these are defined upon expanding to the three-dimensional space, the positions will become 0a (0, 0, 0), 0b (1, 0, 0), 0c (2, 0, 0), 0d (0, 1, 0) or 0d (0, ⁇ 1, 0).
- the coordinates will be represented as a value enjoining three-dimensional matrix such as Ca (tx 2 , ty 2 , tz 2 ), Cb (tx 2 +r 200 , ty 2 +r 201 , tz 2 +r 202 ), Cc (tx 2 +2 ⁇ r 200 , ty 2 +2 ⁇ r 201 , tz 2 +2 ⁇ r 202 ), Cd (tx 2 +r 210 , ty 2 +r 211 , tz 2 +r 212 ).
- the dimension ratio ph, pv in the vertical and horizontal directions of the visual field of the CCD camera 213 and the actual screen 2121 and the coordinates LED.A 2 (A 2 h, A 2 v), LED.B 2 (B 2 h, B 2 v), LED.C 2 (C 2 h, C 2 v), LED.D 2 (D 2 h, D 2 v) of the respective points in the CCD image are all publicly known.
- variables tx 2 , ty 2 , tz 2 , r 200 to r 212 can be computed from these publicly known data and the coordinates of the respective points viewed from the CDD camera 213 , and the elements of the normal line vector of the CCD camera 213 are thereby determined.
- the reason why the value contained in the two items of coordinates Cc was made to be double value against r 200 , r 201 , r 202 ; that is, to be in proportion is because the screen is represented as a plane (as a simulation).
- a three-dimensional matrix should be defined in consideration of the curvature of such curved surface against the respective coordinates.
- the game control unit 2103 further has a trajectory computation unit for computing the trajectory of bullets flying within the game space from impact position on the screen 2121 based on the information obtained with the intersecting point (H, V) computation unit 24018 and the information obtained with the normal line computation unit 24017 and the intersecting point (H, V) computation unit 24018 .
- image (CCD) data is foremost incorporated by activating the CCD camera 213 under trigger conditions such as vertical synchronization (V-sync, V-blank) at a prescribed cycle, ⁇ fraction (1/60) ⁇ seconds for example (ST 2811 ), and then the incorporated data is binarized with the binary processing unit 24012 in order to extract luminescent spots (ST 2812 ).
- V-sync, V-blank vertical synchronization
- ST 2811 ⁇ fraction (1/60) ⁇ seconds for example
- the incorporated data is binarized with the binary processing unit 24012 in order to extract luminescent spots (ST 2812 ).
- coordinates of the binary data to be treated as luminescent spots are incorporated, an identification symbol is added thereto (labeling), and appropriate grouping processing is performed (ST 2813 ) in a mode where the coordinate data exist dispersedly.
- the rough specification of the luminescent spots is conducted (ST 2814 ) based on the position data of luminescent spots, group information, and shape information (prepared as necessary).
- the luminescent spot group structuring the “L frame” is extracted from the luminescent position, and is encoded as A, B, C, D based on the arrangement status of the extracted luminescent spots (e.g., corresponds to LED 26 A, 26 B, 26 C, 26 D with the marker 26 ) (ST 2815 ).
- the coefficient corresponding to the imaged range with respect to the screen 2121 of the CCD camera 213 is multiplied to LED.
- a to D with one of the markers 26 to 29 (ST 2816 ).
- the distance from the CCD camera is successively differed (becoming farther) from the upper part to the lower part of the screen 21 , and, by multiplying a coefficient in accordance with the ratio of such difference in distance, the distance and correspondence (ratio) of the CCD image and on the actual screen 2121 is unified.
- coordinates tz 2 of the z component are computed with the “L frame” of the CCD camera 213 as the origin regarding the coordinate data of LED.
- A, B, C (ST 2817 ), x component tx 2 , y component ty 2 , r 200 , r 201 , r 202 are then computed from the camera coordinates tz 2 (ST 2818 ), r 210 , 2 r 11 , r 212 are thereafter computed based on the LED.
- D coordinate data tx 2 , ty 2 , tz 2 (ST 2819 ), and the intersecting point (H, V) of the cameral visual line vector when deeming the “L frame” to be flat is computed from tx 2 , ty 2 , tz 2 , r 200 , r 201 , r 202 , r 210 , r 211 , r 212 (ST 2820 ).
- the intersecting point (H, V) which is the computation result is forwarded to the CPU 2103 side, and utilized in the collision judgment processing of the shooting against the enemy character (may also be considered for impact presentation) and the like.
- the intersecting point (H, V) of the remaining “L frames” is similarly computed, and the suitable intersecting point data may be utilized.
- FIG. 44 is a detailed subroutine of ST 2815 , and the existing luminescent spot positions are foremost structured (formed) into a graph composed of the vector and distance (ST 2831 ).
- the luminescent spot position data within the graph is organized in accordance with the foregoing grouping or in a somewhat sorted state, thereby facilitating the data analysis.
- the vector is utilized to research whether the three luminescent spots are of a straight line relationship be operating the inner product of the adjacent two points for example (ST 2832 ). When a straight line relationship does not exist (NO at ST 2833 ), it is judged whether processing for all combinations has been completed (ST 2834 ), and the routine returns to ST 2832 when in the middle, and skips to ST 2821 when it has been completed.
- the routine returns to ST 2832 , and if it exists, the routine researches the relationship of the luminescent spot in the vicinity and the luminescent structuring the main axis, and the shape of the “L frame” is estimated thereby (ST 2839 ).
- the reason such luminescent spot is treated as LED. D depending on the conditions of the existence in the vicinity is because the relationship of the intersection and equal distance with the LED.A will not be established depending on the direction of the camera.
- A, B, C, D are encoded from the positional relationship of the respective luminescent spots in order to determine the arrangement thereof (ST 2840 ).
- the muzzle direction detection processing to which part of the screen 2121 the muzzle 216 is facing; that is, the position on the screen corresponding to the center of the CCD image, and the virtual trajectory position of the bullets fired toward the target object from the muzzle 216 within the game space from a position on the screen may be computed with the characteristics of the positional relationship of the image of the marker within the CCD image.
- FIG. 45 is a block diagram showing the structure of the principal parts of the image processing unit for performing the image display processing at ST 299 of FIG. 40
- FIG. 46 is a flowchart showing the detailed procedure of the image display processing at ST 299 .
- FIGS. 47A and 47B are diagrams showing the display of an image corrected with the present game machine
- FIGS. 48A and 48B are diagrams showing the display of an ordinary image
- FIGS. 49A, 49B and 49 C are diagrams for explaining the image correction parameter set in the present game machine.
- the image projected from the projector 231 is corrected prior to the projection as shown in FIG. 47A, and the player will view an undistorted image as shown in FIG. 47B. Further, since there is a difference in the distance from the reference point to the upper part and lower part of the projected image 2124 when the projected image 2124 is to be displayed at the lower part of the screen 2121 (corresponds to the solid line in FIG. 31) and when it is to be displayed at the upper part of the screen 2121 (corresponds to the dotted line in FIG. 31), the degree of correction will vary in accordance with the rotation angle of the mirror.
- the image containing the display target having a 3D shape within the game space captured with a virtual camera (virtual viewpoint) having a rectangular visual field is corrected such that the lower end of the image is inclined to approach the virtual camera in accordance with the rotation angle of the mirror, and the corrected image is projected on the projector 231 .
- the image processing unit 2410 for displaying images while performing such correction has a visual line elevation setting unit 24101 for setting the visual line elevation (angle inclining the visual line upward against the level surface, EYE_R of FIG.
- the object position data 2421 data representing the position of the shooting target object within the game space
- a mirror inclination control unit 24102 for designating the rotation angle of the mirror in accordance with the visual line elevation and controlling the stepping motor 241
- an image generation indication unit 24103 for referring to the image correction table 2422 (table associating the inclination angle CAM_R of the virtual camera, angle CAM_FT for designating the upper end of the image, angle CAM_FB for designating the lower end of the image with the visual line elevation EYE_R), reading and setting the image correction parameter corresponding to the visual line elevation, and designating the generation of images to the drawing control unit 2101 .
- the inclination angle CAM_R of the virtual camera, angle CAM_FT for designating the upper end of the image, and angle CAM_FB for designating the lower end of the image may be designated from the visual line elevation EYE_R, and the association thereof is stored in the image correction table 2422 .
- a gaze envisioned position VIEW_P is set in accordance with the distance between the player and dinosaur, and the portion of the dinosaur which will generate an attack against the player during approach.
- visual line elevation EYE_R as the angle of the straight line q 0 and the level plane (reference line) is set forth from the virtual viewpoint position EYE_P.
- the mirror rotation angle MIRROR_R is set forth such that the field angle EYE_FU to the upper part and the field angle EYE_FD to the lower part of the virtual camera become equal centered around the visual line elevation EYE_R in order to seek the upper end SCREEN_U and the lower end SCREEN_D of the projected image.
- the virtual camera has a rectangular imaging range, and the upper end SCREEN_U and lower end SCREEN_D correspond to the field angle of the vertical direction of the virtual camera.
- the field angle in the lateral direction may be suitably sought from the distance from the EYE_P to the SCREEN_D and the width of the projected image.
- the intersecting point of the straight line q 3 passing through the projected image upper end SCREEN_U and the projected image lower end SCREEN_D and the perpendicular line q 4 from the virtual viewpoint position EYE_P to this straight line q 3 is sought as CAM_VP, and the angle (elevation) between the straight line q 4 and the level plane is set as the inclination angle CAM_R of the virtual camera.
- the angle between the straight line q 4 and the straight line q 1 , for prescribing the upper end position of the projected image is set as CAM_FT
- the angle between the straight line q 1 , and the straight line q 2 for prescribing (together with the CAM_FT) the lower end position of the projected image is set as CAM_FB.
- the virtual camera inclination angles CAM_R, CAM_FT, CAM_FB as image correction parameters are computed in accordance with the visual line elevation EYE_P (or the mirror rotation angle MIRROR_R set in accordance therewith) set during the progress of the game.
- the computed and partially adjusted CAM_R, CAM_FT, CAM_FB are associated in accordance with the visual line elevation EYE_R at the image correction table 2422 , these correction parameters may also be associated with the mirror rotation angle MIRROR_R.
- the visual line elevation is set with the visual line elevation setting unit 24101 (in accordance with the dinosaur position with respect to the virtual viewpoint or the parts of the dinosaur which generate attacks during the approach) (ST 2991 ), the mirror rotation angle according to this visual line elevation is designated with the mirror inclination control unit 24102 (ST 2992 ), and the mirror 243 rotates as a result of the stepping motor 241 being controlled (ST 2993 ).
- image correction parameters (CAM_R, CAM_FT, CAM_FB, etc.) are designated with respect to the set visual line elevation (ST 2994 ), and drawing of the image captured from the prescribed virtual viewpoint is indicated with the drawing control unit 101 with respect to the set visual line elevation with the image generation indication unit 24104 (ST 2995 ), and this processing is returned to the beginning.
- image data corresponding to the 2D image inclined with respect to the visual line EYE_R is generated upon operating data relating to polygons within the (three-dimensional) game space, this image data is written in the frame buffer 2102 , and images are projected on the screen 2121 in accordance with the image data on the frame buffer 2102 .
- the image is suitable corrected in accordance with the position of the portion to be displayed on the screen having a curvature in the upward and downward directions, and the player is thereby able to enjoy a shooting video game while viewing an undistorted image.
- the present shooting video game machine enables the player to play the game while displaying images captured from a virtual viewpoint (virtual camera) in which the player's reference viewpoint position corresponds to the position in the game space.
- a mirror is rotated so as to shift the image projected from the projector via the mirror at least in the upward and downward directions in correspondence with the direction of the virtual viewpoint at a portion within the screen continuously curved from the lower part of the approximate front of the reference viewpoint position to the upper part of the approximately top of the reference viewpoint position.
- the player's visual line will shift from top to bottom pursuant to the game progress, the player will be able to enjoy a novel game not available conventionally, and this can be realized with a simple structure.
- the screen is curved inward in a conical shape, the projection distance is maintained approximately constant, and the size and focus of the projected image can be maintained approximately constant.
- the screen may be made to curve such that the distance from the reference viewpoint position to the upper part becomes shorter than the distance from the reference viewpoint position to the lower part. According to this structured, the player will feel that the image on the upper part of the screen is approaching him/her, and a unique sense of tension may be yielded.
- the player virtually shoots with a gun unit the dinosaur displayed on the screen and corresponding to the size of the screen when it is nearby, and the parts such as the mouth, arms and legs of the dinosaur to virtually attack the player are displayed on the screen.
- the player is able to enjoy a shooting game which effectively yields a novel and unique sense of nervousness.
- the mirror may be rotated such that a flying dinosaur (or a non-flying dinosaur) afar from the virtual viewpoint is displayed on the lower part of the screen and a flying dinosaur (or the upper part of the non-flying dinosaur) close to the virtual viewpoint is displayed on the upper part of the screen.
- the flying dinosaur (or a non-flying dinosaur) approaching the player from afar may be represented with much vigor and perspective.
- the virtual viewpoints are moved so as to surround the periphery of the dinosaur within the game space, and the player's movement to the left and right may be conveyed within the game space naturally, and the amusement of the game will be enhanced thereby.
- the input corresponding to the shooting of the dinosaur displayed on the screen is conducted with the operation of the trigger in the gun unit, the CCD image of the imaged range corresponding to a part of the screen is generated with the CCD camera in the vicinity of the muzzle of the gun unit, and, in the least, when the trigger is pulled, the image of one marker among the plurality of markers disposed on the screen so as to hold a prescribed positional relationship is identified within the generated CCD image, and the shooting position on the screen corresponding to the approximate center of the imaged range is computed from the image position and rotation angle of the marker.
- the shooting position is computed upon identifying which part of the screen is being imaged from the image position and angle relationship of the marker in the CCD image, the direction of the gun unit can be detected smoothly with respect to the screen (which does not fit within the CCD image).
- the detection of the gun unit direction is performed with respect to the screen curved inward and having a conical shape, an image to be the target of shooting is displayed at a portion of the top or bottom of the screen, and the image is shifted upward or downward in accordance with the direction of the virtual viewpoint.
- the present shooting video game machine enables the player to play the game while displaying images captured from a virtual viewpoint in which the player's reference viewpoint position corresponds to the position in the game space.
- a mirror is rotated so as to shift the image projected from the projector via the mirror at least in the upward and downward directions in correspondence with the direction of the virtual viewpoint at a portion within the screen continuously curved from the lower part of the approximate front of the reference viewpoint position to the upper part of the approximately top of the reference viewpoint position.
- the approximately vertical image that may be captured with the virtual viewpoint is corrected to become an image that may be obtain with a larger inclination the farther it is shifted upward on the screen when the lower side approaches the virtual viewpoint.
- this inclination angle may be made to be the same angle as the rotation angle of the projected image on the screen.
- FIG. 50 is a diagram for explaining the rotation control of the mirrors corresponding respectively to the two areas in which one stage is divided with the first modified example of the shooting video game machine.
- an area 2501 corresponding to the first half of the first stage and an area 2502 corresponding to the second half are assumed, and the player shoots small dinosaurs and flying dinosaurs (ordinary enemy characters) in the first half area 2501 and shoots the foregoing enormous dinosaurs (enemy character corresponding to the boss character) in the second half area 2502 .
- the virtual player In the area 2501 within the game space, the virtual player (virtual viewpoint) will move in the direction of arrow B 21 at a speed designated in advance.
- An enemy character appears when the virtual player passes through prescribed positions 2511 to 2514 , and the player virtually shoots at the display of such enemy character with the gun unit 210 .
- the player detection sensors 251 to 254 respond, the player is made to move a relatively small distance to the left or right within the game space just enough to avoid the attack from the enemy character, and the mirror for determining the position of the projected image on the screen is rotated based on the data designated in advance.
- the player avoids the attack of the boss character 2522 approaching the virtual player 2521 within the game space by making the player detection sensors 251 to 254 respond and moving in the arrow B 22 or arrow B 23 direction, and the player shoots at the display of the boss character by operating the gun unit.
- the boss character 2522 will move in the arrow B 24 or arrow B 25 direction so as to follow the moving virtual player 2521 .
- the player is made to move a relatively large distance upon the response of the player detection sensors 251 to 254 (movement so as to move around the left or right side of the dinosaur, and the a different distance range such as 5 meters, 20 meters, etc. is set in accordance with the stage), and the mirror is rotated in accordance with the distance between the boss character and the virtual viewpoint as described above, or in accordance with the portion in the boss character is to make the attack.
- FIG. 51 is a diagram for explaining the detection of the position of player (during the two player game with 1P player and 2P player) with the player detection sensors 251 to 254 with the second modified example of the shooting video game machine.
- FIG. 52 is a diagram shown the image correction parameter set in the shooting video game machine of the third modified example.
- the screen of the display unit displaying images is not limited to a projection screen, and may be employed in various display faces; for instance, television monitors, liquid crystal monitors, monitor screens of personal computers and so on. Further, in addition to the designation of the screen position and the like, this may also be employed in the operational designation of other various devices and equipment. For example, when employed in an operation button of a device, remote operational designation becomes possible by orienting such direction as the drive designation of the operation member.
- the dimensions and size of the marker are irrelevant in the present invention.
- a marker of various sizes may be adopted in consideration of the size of the controller to be employed.
- the shape and form of the marker are not limited to an aggregate of dotted bodies, and may be of a pole shape.
- a processing execution unit for specifying the position of both ends thereof will further become necessary.
- the pole shape continuously is recognized from the picture image, and the position data (address within image memory) may be specified by detecting both sides thereof.
- the dimension data of the respective dotted light sources (LEDs) of the marker is not considered.
- the luminescent spot distance data of the picture image (or the interval data of the LEDs when the CCD camera 213 is at a reference position) with the CCD camera 6 when the controller 10 is at a reference position is previously stored as reference data, computation processing will be enabled in the subsequent measurements with the comparison with the reference data.
- Minute fluorescent tubes may be employed as the pole shaped body, and various objects may be adopted in the case of a reflector. Further, the mode may use both a dotted body and a pole shaped body.
- a marker may be formed by taking two pole shaped bodies each with a prescribed dimension, preferably the same dimension, and making the mutual ends thereof coincide or adjacent and disposing them to be in an intersecting direction, and disposing at least one dotted body as an extension of the other end of such one pole shaped body a prescribed distance apart.
- the dotted body is not necessarily required.
- the recognizable position of the pole shaped body is the end and flection thereof, and is extracted from the picture image imaged with the CCD camera 6 (or CCD camera 213 ).
- the marker (or L frame) shown in the foregoing embodiments is not influenced by the shape or size of the game screen or display screen, and versatility is high since there is only one analyzing method.
- the shape of the reflector is of a semicircle or the like capable of generating reflected light at a desired width.
- the movable range of the controller is not restricted needlessly, and the operability of the controller may be improved thereby.
- the structure may also extend the reflection range by generating a diffused reflection with the surface processing with respect to the reflective surface.
- the light source is not limited to an infrared light, and light of a desired color may be employed.
- the color may be R (red), G (green) or B (blue), and may also be of another color.
- the disposition of the respective markers may be recognized.
- individual light-up control as described in the present embodiment will no longer be necessary, and there is an advantage in that the light may always be turned on. Needless to say, it is not necessary to simultaneously use three colors worth, and markers of desired colors may be adopted in accordance with the use thereof.
- the movement may be to duck below, or the lower right oblique direction or lower left oblique direction. This is because the player will not be able to avoid the attack by moving left and right when the attack of the enemy character is of a movement where the arm or tail is whipped in the lateral direction. For example, if the player detection sensor on the left outer side is turned on, the movement may be automatically switched in accordance with the scene such that the attack is avoided by ducking below.
- the parameters may be successively operated according to the procedure shown in FIG. 46.
- the whole or a part of the screen to which the image subject to correction is to be projected may incline upward or downward or curve or incline left and right or obliquely, or be made of a semicircle shape.
- the overall screen curving upon projecting to the overall screen curving (up/down, left/right, or in a semicircle), the overall screen may be divided in several areas and correction may be conducted as described above in accordance with the position of the respective areas.
- a front screen and at least two screens inclining obliquely may be disposed left/right or up/down so as to surround the player, and correction as described above may be conducted to the display of the two screens inclining obliquely upon continuously displaying on these three screens.
- the mirror axis for rotating the mirror was set to be a single axis in order to shift the projected image in the upward and downward directions on the screen, for example, two mirror axes may be provided in order to shift the projected image in the upward/downward as well as the leftward/rightward directions on the screen.
- Two types of L-shaped markers having a mirror surface relationship may be adopted as the marker capable of being employed in the second embodiment.
- these are individually distinguishable; that is, since it is possible to distinguish the arrangement position, individual light-up control as in the present embodiment is no longer required.
- four-types of L frames having a mirror surface relationship with respect to the vertical axis and a mirror surface relationship with respect to the horizontal axis may be employed, and, since these are individually distinguishable; that is, since it is possible to distinguish the arrangement position, individual light-up control as in the present embodiment is no longer required at all.
- enabled is a mode where the disposition of orientation detection markers of different types (2 types or 4 types) having a mode in which the other axis with respect to the one axis of the biaxial direction includes mutually reverse axis information on the target area surface (screen, etc.) with a prescribed positional relationship.
- differing orientation detection markers having a common basic form in which the main axis and sub axis intersect
- processing for individually identifying the same type of markers upon using the same will no longer be necessary.
- two types of L frames or markers when providing an example with the arrangement of the present embodiment (four locations in the vertical direction of the left, right and center of the screen), two types of L frames or markers (among the foregoing four types) having a mirror surface relationship with respect to the vertical axis may also be disposed at a symmetrical position on the left and right side of the screen.
- light-up control may be performed with three combination units; namely, the combination of the first row and second row, the combination of the second row and third row, and the combination of the third row and fourth row.
- this may be employed in cases when the three types of L frames or the four types of L frames of mutually different types are disposed adjacently in unit of the number of types of L frames.
- the markers are not limited to fixed types.
- one slit is provided in the vertical direction of the screen 2121 , markers are disposed so as to sandwich this slit, guide rails for sliding the markers along the slit are provided, and the markers are structured to be shiftable in the vertical direction while managing the position vertically with a drive means such as a motor.
- a drive means such as a motor.
- markers comprising the respective LEDs may be integrally mounted, or individual LEDs may be preferably mounted on the entire face through the pores penetrating the radial thickness of the screen, and light from the light-emitting unit of the LED may be structured so as to be capable of emitting to both the front and back faces of the screen (this is the same in the case of a reflector, and, for example, this may be mounted within the radial thickness such that the reflective surface exposes half of the spherical member on both sides.
- a game may be played upon using both the front and back faces of the screen, and, for instance, the image from the front of the dinosaur will be displayed on the front face and the image from the rear of the dinosaur will be displayed when moving toward the back face of the screen.
- the markers will be of the three shapes having a mirror surface relationship with respect to the vertical axis with the front face and back face of the screen, the front or back of the screen may be automatically detected merely be recognizing the image from the CCD camera, and it is not necessary to additionally provide a human body sensor for detecting the circular movement of the player.
- the present invention was devised in view of the foregoing problems, and the object thereof is to provide an orientation marker capable of remotely measuring the movement, particularly the orientation, of a controller having a simple structure, which may be employed in a more sophisticated game, and which is highly versatile; an orientation detection device for remotely measuring the orientation (posture) of the controller with such orientation detection marker; and a video game device employing the above.
- the orientation detection marker according to the present invention is provided in either one of the device main body and a controller for performing input operations as being pointed to a screen of a display unit provided to the device main body for displaying images, for detecting the orientation of the controller with respect to the screen, and which supplies information for computing said orientation to a picture image generated by imaging means provided in the other of the device main body and the controller, wherein said orientation detection marker comprises a light source having a mode including biaxial direction information.
- a picture image is generated with the imaging means provided to the device main body side and one of the controllers.
- An image of the orientation detection markers is contained in the picture image. Since the orientation detection marker includes biaxial direction information, in addition to the position information of the controller, and (rotation) inclination centered around the axis of orientation of the controller; that is, rotation angle information is also included in the picture image.
- the orientation of the controller with respect to the screen may be computed from this position information and rotation angle information.
- the two axes are orthogonal to each other. According to this, the computation will become simplified since it is no longer necessary to employ a trigonometric function for positional computation. According to the invention with the above features, the computation will become simplified since it is no longer necessary to employ a trigonometric function for positional computation and a positional information can be directly obtained thus the calculation can be simplified.
- the light source is formed of a plurality of dotted light sources.
- the orientation detection marker may be made simply and inexpensively by structuring it from a dotted light source capable of identifying biaxial direction information.
- the orientation detection marker may be made simply and inexpensively by structuring it from a dotted light source capable of identifying biaxial direction information and the positional information can be directly obtained, thus the calculation is made easy.
- the light source may emit light of a specific color.
- employed may be a marker capable of emitting light of a desired color in accordance with the purpose of use.
- employed may be a marker capable of emitting light of a desired color in accordance with the purpose of use.
- the plurality of dotted light sources may be formed by first and second light source units for specifying the first two points and second two points separated by a prescribed dimension on one axis and a third light source unit for specifying the third two points separated by a prescribed dimension on another axis being disposed on the orientation detection marker mounting section for mounting the orientation detection marker.
- detected will be the inclination of one axis in the axis periphery parallel at least to the other axis and the rotation angle against the reference angle position on the surface formed from the one axis and the other axis.
- the orientation of the controller may be computed from the picture image.
- detected will be the inclination of one axis in the axis periphery parallel at least to the other axis and the rotation angle with respect to the reference angle position on the surface formed from the one axis and the other axis, and the orientation of the controller will be computed thereby.
- the dimension between the first two points and the dimension between the second two points may be set to be equal. According to this, the computation for detecting the orientation of the controller may be simplified. According to the invention with the above features, the computation for detecting the orientation of the controller may be simplified.
- the first and second light source units may share the inner two dotted light sources on the axis. According to this, since the dotted light sources are shared, the number of dotted light sources may be reduced by one. According to the invention with the above features, since the dotted light sources are shared, the number of dotted light sources may be reduced by one.
- one of the dotted light sources may be provided for common use at the intersecting point of the two axes. According to this, since the dotted light source of the intersecting point of the two axes is shared, the number of dotted light sources may be reduced by one. According to the invention with the above features, since the dotted light source of the intersecting point of the two axes is shared, the number of dotted light sources may be reduced by one.
- disposed may be a fourth light source unit for specifying the fourth two points separated by a prescribed dimension on the other axis.
- the inclination of the axis periphery parallel to one axis of the controller may also be detected.
- the foregoing orientation may be computed with respect to every orientation.
- the inclination of the axis periphery parallel to one axis of the controller may also be detected.
- the foregoing orientation may be computed with respect to every orientation.
- the dimension between the third two points and the dimension between the fourth two points may be set to be equal. According to this, the computation is simplified since position information can be directly obtained. According to the invention with the above features, the computation is simplified since position information can be directly obtained.
- the third and fourth light source units may share the inner two dotted light sources on the axis. According to this, since the dotted light source is shared, the number of dotted light sources may be reduced by one.
- the number of dotted light sources may be reduced by one.
- the fourth light source unit may include a dotted light source at the fourth two points.
- the dotted light source may be an illuminator. According to this, regardless of the peripheral brightness, the dotted light source may be accurately imaged with the imaging means. According to the invention with the above features, regardless of the peripheral brightness, the dotted light source may be accurately imaged with the imaging means.
- the dotted light source may be a reflector capable of reflecting the incident light from the front. According to this, light is emitted with the likes of an illuminator from a prescribed position, and the light reflected (emitted) from the reflector may be received with the imaging means. It is therefore not necessary to wear the dotted light source, and it is no longer necessary to prepare wiring such as the power source line for the light source upon establishing the dotted light source. As a result, the structure of the device will become simplified, light, and the versatility will improve.
- the shape of the reflector is of a semicircle or the like capable of generating reflected light at a desired width. When employing this in a controller, the movable range of the controller is not restricted needlessly, and the operability of the controller may be improved thereby.
- the dotted light source may emit infrared light. According to this, erroneous detection or erroneous computation may be prevented since influence by disturbance light will become difficult. According to the invention with the above features, erroneous detection or erroneous computation may be prevented since influence by disturbance light will become difficult.
- orientation detection marker mounting section is formed with the dotted light source being exposed on both the front and back sides. According to this, also applied may be a mode of making the controller function upon employing both the front and back sides.
- a fifth light source for representing the front and back of the orientation detection marker.
- the addition of the fifth light source unit will enable the distinction even when there is a possibility of the front and back become uncertain due to the rotation angle or the like of the orientation detection marker.
- the addition of the fifth light source unit will enable the distinction even when there is a possibility of the front and back become uncertain due to the rotation angle or the like of the orientation detection marker.
- the fifth light source unit may be formed of one dotted light source. According to this, the mere addition of one dotted light source as the fifth light source unit will enable the judgment of front and back. According to the invention with the above features, the mere addition of one dotted light source as the fifth light source unit will enable the judgment of front and back.
- the dotted light source of the fifth light source unit is formed from one of the dotted light sources structuring the first through fourth light source units and has a light-emitting mode different from the other dotted light sources.
- one of the dotted light sources previously disposed may be shared as the fifth light source unit with its light-emitting mode being different from the others, and this will prevent the increase in the number of dotted light sources.
- this dotted light source of the intersecting point will not be the fifth light source unit.
- one of the dotted light sources previously disposed may be shared as the fifth light source unit with its light-emitting mode being different from the others, and this will prevent the increase in the number of dotted light sources.
- the different light-emitting mode may be a color difference.
- the display will be distinguishable from the existing position of the dotted light source of a different color.
- the display will be distinguishable from the existing position of the dotted light source of a different color.
- the different light-emitting mode may flash (blink). According to this, the display will be distinguishable from the existing position of the flashing dotted light source. According to the invention with the above features, the display will be distinguishable from the existing position of the flashing dotted light source.
- the orientation detection device comprises: imaging means that is provided in either one of a controller and the device main body comprising a display unit having a screen for displaying images and images an orientation detection marker; identification means for identifying an image of a mode containing the biaxial direction information included in the picture image imaged by the imaging means; and computing means for computing the orientation of the controller with respect to the screen of the display unit from the state of the image of the identified mode.
- the orientation with respect to the screen of the display unit of the controller may be sought though operation.
- the orientation of the controller is preferably computed based on the image position of the mode identified with the identification means and the rotation angle information of the axis. According to this, the position on the screen to which the controller is facing; that is, the intersecting point may be computed from the position information and rotation angle information.
- the position on the screen to which the controller is facing; that is, the intersecting point may be computed from the position information and rotation angle information.
- an orientation detection marker may be disposed on the controller, and imaging means may be disposed on the display unit. According to this, the picture image of the orientation detection marker may be obtained with the imaging means pursuant to the orientation movement of the screen by the controller. According to the invention with the above features, the picture image of the orientation detection marker may be obtained with the imaging means pursuant to the orientation movement of the screen by the controller.
- the computing means may continuously seek the orientation.
- the movement (distance and speed of movement) of the controller may be computed from a plurality of times worth of direction information and position information.
- the movement (distance and speed of movement) of the controller may be computed from a plurality of times worth of direction information and position information.
- the screen may be a screen to which is displayed images projected from a projector. According to this, a desired position on the screen may be designated.
- a desired position on the screen may be designated.
- an orientation detection marker may be disposed on the display unit and imaging means is disposed on the controller. According to this, the picture image of the orientation detection marker may be obtained with the imaging means pursuant to the orientation movement of the screen by the controller. According to the invention with the above features, the picture image of the orientation detection marker may be obtained with the imaging means pursuant to the orientation movement of the screen by the controller.
- the orientation detection marker may be capable of being disposed on the screen of the display unit. According to this, there is an advantage in that the operational expression will be simplified since this will be the same surface as the screen. According to the invention with the above features, there is an advantage in that the operational expression will be simplified since this will be the same surface as the screen.
- the orientation detection marker contains a different type of orientation detection marker having a mode including axis information in which the other axes are mutually reverse with respect to one of the two biaxial directions, and these different types of orientation detection markers are respectively disposed in a prescribed position relationship with respect to the display unit. According to this, by employing the different types of orientation detection markers sharing the basic mode, processing for individually identifying the same types of markers to be used will no longer be necessary.
- the orientation of the controller is computed based on the position information within the screen with respect to the center of the picture image based on the image of the light source unit and the rotation angle information of the axis.
- the center of the picture image that is, the intersecting point on the screen to which the controller is facing, may be computed from the position information and rotation angle information.
- the center of the picture image that is, the intersecting point on the screen to which the controller is facing, may be computed from the position information and rotation angle information.
- the computing means computes the visual line vector representing the direction of the screen of the imaging means based on the position information of the dotted light source, image of the light source unit within the picture image, and rotational angle information of the axis, and further computes the intersecting point of the visual line vector and the screen.
- the center of the picture image that is, the intersecting point on the screen to which the controller is facing, may be computed from the position information and rotation angle information even with a simple structure.
- the center of the picture image that is, the intersecting point on the screen to which the controller is facing, may be computed from the position information and rotation angle information even with a simple structure.
- the video game device comprises: the orientation detection device; image generation control means for generating game images containing at least a game character; image display means for displaying the generated game images on the screen of the display unit; and game progress control means for progressing the game by providing movement in accordance with prescribed game rules to the game character within the game space; wherein the game progress control means provides movement regarding the orientation of the controller to the game character based on the relationship between the orientation of the controller sough with the computing means and the display position on the screen of the display unit of the game character. According to this, it is possible to remotely provide a movement regarding the orientation of the controller to the game character based on the relationship between the direction of the controller and the display position of the game character on the screen of the display unit.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Aiming, Guidance, Guns With A Light Source, Armor, Camouflage, And Targets (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Description
- 1. Field of the Invention
- The present invention relates to an orientation detection device and orientation detection marker for detecting the orientation of a controller for performing input operations by orienting the screen of the display unit for displaying images.
- 2. Description of the Related Art
- Conventionally known is a video game machine wherein a game image (picture) is displayed on the screen in front of the player, and the player experiences virtual reality by using a simulated gun controller and shooting at the displayed target object (game character).
- As an example of such foregoing video game machine, there is the shooting video game machine described in Japanese Patent Publication No. 2961097, which images the two infrared emitting LEDs disposed at prescribed positions on the screen with the CCD camera provided near the muzzle of the simulated gun, and detects the center of the imaged range; that is, muzzle direction with respect to the center of the imaged range, from the positional relationship of the image of the two infrared emitting LEDs in within the CCD image.
- Also known is a type comprising a CCD camera on the game device side and which makes the player wear a plurality of detection subjects. By imaging the movement of the respective detection subjects with the CCD camera, the movement of the player; for instance, the extension of the arm, is detected and reflected in the game progress in the likes of a hand-to-hand combat game.
- Nevertheless, with the shooting video game machine employing the two infrared emitting LEDs for detection in the former, since the play area has a prescribed wideness on the horizontal surface, there is a limit in accurately detecting the muzzle direction when the simulated gun as the controller is able to move, or when the simulated gun may be rotationally operated. Further, with the later game device, there is a limit in versatility in terms of having to impose a complicated action of wearing a plurality of detection subjects, and, since the detection of the movement of the detection subjects can only be made to a degree of understanding the change in position, there is a limit in applying this to a more sophisticated game with such amount of information.
- The present invention was devised in view of the foregoing problems, and the object thereof is to provide an orientation marker capable of remotely measuring the movement, particularly the orientation, of a controller having a simple structure, which may be employed in a more sophisticated game, and which is highly versatile; an orientation detection device for remotely measuring the orientation (posture) of the controller with such orientation detection marker; and a video game device employing the above.
- In order to achieve the foregoing object, the orientation detection marker according to the present invention is provided in either one of the device main body and a controller for performing input operations as being pointed to a screen of a display unit provided to the device main body for displaying images, for detecting the orientation of the controller with respect to the screen, and which supplies information for computing said orientation to a picture image generated by imaging means provided in the other of the device main body and the controller, wherein said orientation detection marker comprises a light source having a mode including biaxial direction information.
- According to the foregoing structure, a picture image is generated with the imaging means provided to the device main body side and one of the controllers. An image of the orientation detection markers is contained in the picture image. Since the orientation detection marker includes biaxial direction information, in addition to the position information of the controller, and (rotation) inclination centered around the axis of orientation of the controller; that is, rotation angle information is also included in the picture image. Thus, the orientation of the controller with respect to the screen may be computed from this position information and rotation angle information.
- These and other objects, features, and advantages of the present invention will become more apparent upon reading the following detailed description along with the accompanying drawings
- FIGS. 1A and 1B are diagrams showing the shifting of the projected image on the screen of the shooting video game machine pertaining to the first and second embodiments of the present invention;
- FIG. 2 is a diagram showing the first example of the foregoing projected image;
- FIG. 3 is a diagram showing another example of the foregoing projected image;
- FIG. 4 is a diagram showing the second example of the foregoing projected image;
- FIG. 5 is a diagram showing the change in the displayed image accompanying the player's movement to the left and right;
- FIG. 6 is a diagram showing the appearance of the foregoing video game machine;
- FIG. 7 is a typical cross section for explaining the shifting of the projected image on the screen;
- FIGS. 8A, 8B and8C are diagrams showing the structure of the gun unit, and FIG. 8A is a partial cross section of the side view; FIG. 8B is the front view of the marker substrate; and FIG. 8C is a diagram showing an example of the marker image;
- FIG. 9 is a cross section showing an example of the marker mounting structure;
- FIG. 10 is a typical cross section showing the acrylic plate disposed for protecting the rotation of the mirror and projection of the image from the projector;
- FIG. 11A is a diagram showing the structure of the acrylic plate retention member and FIG. 11B is a diagram showing the structure of the acrylic plate;
- FIG. 12 is a block diagram showing the hardware structure of the control unit of the shooting video game machine pertaining to the first embodiment;
- FIG. 13 is a flowchart showing the procedure for the shooting video game processing executed with the game control unit (CPU);
- FIG. 14 is a block diagram showing the structure of the principal parts of the game processing unit for performing the processing with the game processing main body;
- FIG. 15 is a flowchart showing the detailed procedure of the processing with the game processing main body;
- FIG. 16 is the first diagram for explaining the detection of the player's position on the play area with the player detection sensor;
- FIG. 17 is the second diagram for explaining the detection of the player's position on the play area with the player detection sensor;
- FIG. 18 is a block diagram showing the structure of the principal parts of the muzzle direction detection unit for performing the muzzle direction detection processing at ST81;
- FIG. 19 is a flowchart showing the detailed procedure of the muzzle direction detection processing at ST81;
- FIG. 20 is a diagram showing the detailed subroutine of ST815;
- FIG. 21 is a block diagram showing the structure of the principal parts of the image processing unit for performing the image display processing at ST99;
- FIG. 22 is a flowchart showing the detailed procedure of the image display processing at ST99;
- FIG. 23 is a diagram for explaining the rotation control of the mirrors corresponding respectively to the two areas in which one stage is divided with the first modified example of the shooting video game machine;
- FIG. 24 is a diagram for explaining the detection of the player's position with the player detection sensor with the second modified example of the shooting video game machine;
- FIG. 25 is the overall perspective view for explaining the video game device, which is a modified mode of the shooting video game machine pertaining to the first embodiment;
- FIG. 26 is a front view of the controller simulating a tennis racket;
- FIG. 27 is a block diagram of the video game device;
- FIG. 28 is a structural diagram of the controller in which the shape of the marker is of a reverse T shape;
- FIGS. 29A, 29B and29C are structural diagrams of the controller in a case where the video game device is to be used for a table tennis game, and FIG. 29A is the front view, FIG. 29B is the side view, and FIG. 29C is the rear view;
- FIG. 30 is a diagram showing the appearance of the shooting video game machine pertaining to the second embodiment;
- FIG. 31 is a typical cross section for explaining the shifting of the projected image on the screen;
- FIG. 32 is a diagram showing the structure of the gun unit;
- FIGS. 33A and 33B are diagrams showing the marker arrangement for detecting the muzzle direction with respect to the screen together with the CCD camera in the gun unit;
- FIG. 34A is a diagram showing the form of markers, and FIGS. 34B and 34C represent the mounting structure to the screen;
- FIG. 35 is a block diagram showing the hardware structure of the control unit of the shooting video game machine pertaining to the second embodiment;
- FIG. 36 is a flowchart showing the procedure for the shooting video game processing executed with the game control unit (CPU);
- FIG. 37 is a block diagram showing the structure of the principal parts of the game processing unit for performing the processing with the game processing main body;
- FIG. 38 is a flowchart showing the detailed procedure of the processing with the game processing main body;
- FIG. 39 is the first diagram for explaining the detection of the player's position on the play area with the player detection sensor;
- FIG. 40 is the second diagram for explaining the detection of the player's position on the play area with the player detection sensor;
- FIG. 41 is a block diagram showing the structure of the principal parts of the marker light-up processing unit for performing the marker light-up processing at ST280;
- FIG. 42 is a block diagram showing the structure of the principal parts of the muzzle direction detection unit for performing the muzzle direction detection processing at ST281;
- FIG. 43 is a flowchart showing the detailed procedure of the muzzle direction detection processing at ST281;
- FIG. 44 is a diagram showing the detailed subroutine of ST2815;
- FIG. 45 is a block diagram showing the structure of the principal parts of the image processing unit for performing the image display processing at ST299;
- FIG. 46 is a flowchart showing the detailed procedure of the image display processing at ST299;
- FIGS. 47A and 47B are diagrams showing the display of the image corrected with the shooting video game machine pertaining to the second embodiment;
- FIGS. 48A and 48B are diagrams showing the display of an ordinary image;
- FIGS. 49A, 49B and49C are diagrams for explaining the image correction parameter set in the shooting video game machine pertaining to the second embodiment;
- FIG. 50 is a diagram for explaining the rotation control of the mirrors corresponding respectively to the two areas in which one stage is divided with the first modified example of the shooting video game machine in the second embodiment;
- FIG. 51 is a diagram for explaining the detection of the player's position with the player detection sensor with the second modified example of the shooting video game machine in the second embodiment; and
- FIG. 52 is a diagram showing the image correction parameter set in the shooting video game machine of third modified example in the second embodiment.
- (First Embodiment)
- The shooting video game machine pertaining to the first embodiment of the present invention is explained below. FIG. 1 is a diagram showing the shifting of the projected image on the
screen 121 of the shooting video game machine. FIG. 1A shows the display of the projectedimage 122 at the lower part of thescreen 121, and FIG. 1B shows the display of the projectedimage 123 at the upper part of thescreen 121. FIG. 5 is a diagram showing the change in the displayed image accompanying the movement of theplayer 300 to the left and right. FIG. 2 and FIG. 4 are diagrams showing an example of the projectedimage 122 at the lower part and FIG. 3 is a diagram showing an example of the projectedimage 123 at the upper part. - As shown in FIG. 1A and FIG. 1B, the
player 300 standing in the play area PE of a prescribed area set in front of the game machine operates thegun unit 10 and virtually shoots the dinosaur as the game character displayed in the projectedimages screen 121. The dinosaur having a 3D shape and which moves and shifts with the elapse in time within the game space (virtual three-dimensional space) is displayed in the projectedimage 122 as shown in FIG. 2 when existing afar as an image captured from the virtual viewpoint (which corresponds to the position of the reference viewpoint of theplayer 300 set in advance), and is displayed in the projectedimage 123 as shown in FIG. 3 or in the projectedimage 122 as shown in FIG. 4 when nearby. - Particularly, with the present game machine, the displayed contents of the projected image122 (FIG. 1A) displayed at the lower part of the
screen 121 changes to the projected image 123 (FIG. 1B) in accordance with the virtual viewpoint moving within the game space and position of the dinosaur while shifting continuously toward the arrow A1, and, pursuant to this type of shifting of the projected image on thescreen 121, the visual line of theplayer 300 changes naturally from the lower part of thescreen 121 to the upper part of the screen 121 (from the direction of arrow A2 of FIG. 1A to the direction of arrow A3 of FIG. 1B). - Further, with the present game machine, it is envisioned that the dinosaur within the game space is to attack the player, and displayed on the upper part of the
screen 121 is an image where the dinosaur is trying to bite the player on the play area PE from the state within the projectedimage 123 of FIG. 3, and an image where the dinosaur is trying to kick (or whipping its tail against) the player is displayed on the lower part of thescreen 121 from the state within the projectedimage 122 of FIG. 4. - The
player 300 may avoid these attacks by the dinosaur by moving to the left and right on the play area PE. When theplayer 300 who is shooting toward the head of the dinosaur as shown in FIG. 1B moves to the left and right (direction of arrow A4) on the play area as shown in FIG. 5 upon sensing that the dinosaur will begin its attack, with the present game machine, this movement is detected, the coordinates are set such that the virtual player (virtual viewpoint) moves away from the dinosaur within the game space, and a projectedimage 123 showing theplayer 300 moving away from the dinosaur (the dinosaur moves outward toward the direction of arrow A5) is displayed. - Although the upper and lower parts of the enormous dinosaur approaching the virtual viewpoint are displayed on the upper and lower parts of the
screen 121 in FIG. 3 and FIG. 4, a flying dinosaur (pterosaur) afar from the virtual viewpoint may be displayed on the lower part of thescreen 121, the displayed contents thereof may be continuously changed and continuously shifted in accordance with the flying dinosaur with respect to the virtual viewpoint in order to display the flying dinosaur approaching the virtual viewpoint on the upper part of thescreen 121. - FIGS.6 to 11 will now be explained in this order regarding the structure of the present game machine for performing the overall operation described above. FIG. 6 and FIG. 7 are diagrams relating to the structure for projecting images and performing imaging with the
gun unit 10, FIG. 8 and FIG. 9 are diagrams relating to the structure of the light source unit (marker) which is the detection subject for detecting themuzzle 16 direction, and FIG. 10 and FIG. 11 are diagrams relating to the structure for protecting the rotation and the like of themirror 43. - The structure for projecting images is now explained. FIG. 6 is a diagram showing the appearance of the present game machine, and FIG. 7 is a typical cross section for explaining the shifting of the projected image on the
screen 121. - With the present game machine, as shown in FIG. 6, the projected
image 124 projected from the projector 31 (FIG. 7) on thescreen 121 retained with the screen retention table 120 shifts in the arrow A6 direction, and thegun unit 10 andgun unit 20 are connected to the main body control unit 100 (explained later at FIG. 13) via thegun cable 17. The projectedimage 124 contains a shooting target such as a dinosaur as described above, and the 1P player standing on the play area PE operates the gun unit 10 (or the 2P player operates the gun unit 20) to virtually shoot the shooting target, and points are scored in accordance with the skill of shooting such as the shooting position and shooting timing. - The four
player detection sensors 51 to 54 mounted on the front face of the base 110 are for detecting the movement of the 1P player when it is a one player game (or 1P player and 2P player when it is a two player game) in the left and right directions, andside plates 125 are provided for preventing the disturbance and the like upon detecting the muzzle direction (described later) with respect to thescreen 121 and displaying images on thescreen 121. - Further, with the present game machine, music and the like is played in order to yield vigor, and a speaker (top)32, speaker (left) 33 and speaker (right) 34 for outputting sounds in the middle and high ranges, and a
woofer speaker 35 for outputting sounds in the low ranges are provided in order to output such sounds during the game. The speaker (top) 32 and speaker (left) 33 form one pair and the speaker (top) 32 and speaker (right) 34 form one pair in order to playback in stereo sound. - A coin of a prescribed amount is inserted into the
coin insertion slot 38, thestart button 36 is suitably pressed in accordance with the display on thescreen 121, and a one player game with only the 1P player or a two player game with both the 1P player and 2P player is selectively started. - The rectangular
flat mirror 43, as shown in FIG. 7, has amirror axis 45 extending in the perpendicular direction in the diagram, and both ends of themirror axis 45 are rotatably retained with themirror retention member 46. The rotation of the steppingmotor 41 connected to the control unit described later is transmitted to the mirror with thetiming belt 44, and the projectedimage 124 shifts in the arrow A6 direction on the screen by themirror 43 being rotated in the direction of arrow A7. - The reference viewpoint set at a prescribed height and position at the front of the present game machine is associated with the virtual viewpoint within the game space, and it is envisioned that a player (of an average height) is able to view the
screen 121 from this reference viewpoint position. - Next, explained is the structure for detecting the direction of the
muzzle 16. Preferably acolor CCD camera 6 as the imaging means is mounted in forward orientation at a prescribed height and position at the left, right and center of thescreen 121 shown in FIG. 7. TheCCD camera 6 is directed in the direction of θ so as to at least include the muzzle position in the game of thegun unit 10 operated by the player, and adopted are those which have a prescribed visual field width (solid angle of the range shown with the chain line). It is preferable that theCCD camera 6 be built in the likes of ahousing 61 for blocking light such that it will not receive the projected light from theprojector 31 to thescreen 121. - FIG. 8 is a diagram showing the structure of the gun unit10 (similar with the gun unit 20) as an example of the controller for accepting input operations from the player, and FIG. 9 is a diagram showing an example of the mounting structure of the marker provided to the
gun unit 10 for detecting the direction of themuzzle 16 with respect to thescreen 121. - The
gun unit 10, as shown in FIG. 8A, simulates a pump action gun, and has atrigger switch 11 as the micro switch that is turned on when the player pulls thetrigger 14 in the direction of arrow A8, apump trigger switch 12 as the micro switch that is turned on when the player slides the slidingunit 15 in the direction of arrow A9, and amarker 13 for detecting the point where the direction of the muzzle with respect to thescreen 121; that is, the direction of the muzzle 16 (visual line vector) intersects with thescreen 121. Signals from thetrigger switch 11 and thepump trigger switch 12 are transmitted to the mainbody control unit 100 via thegun cable 17, virtual shooting is designated by thetrigger switch 11 being turned on, and the loading of a prescribed number of virtual bullets is designated to thegun unit 10 when thepump trigger switch 12 is turned on. When themarker 13 is not of a reflective type and is rather a self-illuminating type, a power source supply line is included in the gun cable. - As shown in FIG. 8B, the
marker 13 mounted on the tip (marker mounting section) of themuzzle 16 of thegun unit 10 comprises a plate shapedsubstrate 130, and, for example,LEDs 131 to 135 as the five dotted light sources for emitting prescribed colors having the same shape in the present embodiment are disposed on such plate surface in prescribed intervals, preferably in prescribed equal intervals in the vertical and horizontal directions.LEDs 131 to 135 are structured such thatLED 131 is at the intersecting point position of the vertical and horizontal axes in the present embodiment,LEDs LED 131 andLED 132 structure the first light source unit,LED 132 andLED 133 structure the second light source unit, andLED 132 is shared in the present embodiment), andLEDs LED 131 andLED 134 structure the third light source unit,LED 134 andLED 135 structure the fourth light source unit, andLED 134 is shared in the present embodiment). Mounting position information on the respective plate surfaces ofLEDs 131 to 135 is, for example, stored in the likes of aROM 105 of the mainbody control unit 100 shown in FIG. 12 as position information withLED 131 as the reference. It is preferable that an illuminator capable of emitting infrared light be used as theLEDs 131 to 135 for preventing the erroneous detection by outside light. In a mode where theLED 131 is not shared and respectively divided in the vertical and horizontal directions, the number of LEDs will become six.LED 132 andLED 134 do not have to be shared either. Further, the color of thesubstrate 130 is adopted upon being colored to a color capable of being identified with theCCD camera 6 against the luminescent color of the LED, and, as described later, enabled is the measurement of the vertical and horizontal dimension of thesubstrate 130; that is, dimension of the distance to theCCD camera 6. Needless to say, a CCD camera capable of only receiving infrared light may also be used. - FIG. 8C is a diagram showing an example of the image imaged with the
CCD camera 6 and incorporated in the image memory, and, as illustrated therein, obtained are images of theluminescent spots 131 a to 135 a corresponding to theLEDs 131 to 135. Moreover, as shown in the diagram, the image is imaged in an oval as shown with the chain line around the substrate; that is, in a posture facing the oblique direction, and it is evident that theluminescent spots 131 a to 135 a are compress and mapped in the left and right directions. - FIG. 9 is a diagram showing an example of the mounting structure of the dotted light source. The
LEDs 131 to 135 as the dotted light source are mounted, for example, in an upright posture on thesubstrate 130 of a prescribed size to which is mounted an LED illuminating drive circuit or the like.Pores 130 a from which theillumination unit 6 of theLEDs 131 to 135 is exposed are provided at prescribed positions on thesubstrate 130. - When providing a description with
LED 131 as the example, thepore 130 a is formed in a conical shape (cone shape) broadening toward the front of the of thesubstrate 130, and the light emitted from the respective LEDs may be irradiated at a broad angle. Astud nut 130 c having a prescribed height is welded at two places at the left and right sides of thethin metal plate 130 b, or established by pressurization (to the pore not shown formed on thethin metal plate 130 c), and the mountingplate 130 d and thethin metal plate 130 b are integrally formed by mounting a mountingplate 130 d on thesenuts 130 c and tightening this with abolt 130 e from the opposite face. Thethin metal plate 130 b to thebolt 130 e form the LED supporting unit. Apore 130 f is further formed at both end positions of thethin metal plate 130 b, and, although not shown, a triangular screw penetrates the cone shaped pore formed on thesubstrate 130 in order to integrally form thesubstrate 130 and muzzle 16 by tightening the bolt via the LED supporting unit. - Next, explained is the structure for protecting the rotation and the like of the
mirror 43. FIG. 10 is a typical cross section showing theacrylic plate 142 established for protecting the projection of the image form theprojector 31, and FIG. 11 is a diagram showing the structure of the acrylic plate retention member 141 (FIG. 11A) and the acrylic plate 142 (FIG. 11B). - The acrylic plate142 (FIG. 11B) established so as to cover the
mirror 43,projector 31 and the like in a state of where the end thereof is passing through the acrylic plate guide groove 143 (FIG. 11A), as shown in FIG. 10, transmits the images from theprojector 31, and protects the inside which houses the likes of themirror 43 andprojector 31 from outside sources. Further, when the real image is projected on the upper part of thescreen 121, an inclination of roughly 10° is provided from the horizontal direction such that the virtual image is connected to the outside of thescreen 121 with the light reflected from the likes of theacrylic plate 143 andmirror 43. - The control of the present game machine structured as above is now explained with reference to FIGS.12 onward. FIG. 12 is a block diagram showing the hardware structure of the control unit of the present game machine, and FIG. 13 is a flowchart showing the procedure of the shooting game processing (shooting video game program) executed with the game control unit (CPU) 103.
- As shown in FIG. 12, connected to the (
game control unit 103 of the) mainbody control unit 100 set within the base 110 (FIG. 6) are theaforementioned CCD camera 6; trigger switches 11, 21; pump trigger switches 12, 22;player detection sensors 51 to 54;start button 36;projector 31; steppingmotor 41;speakers 32 to 35;coin switch 37 for detecting the insertion of the coin from thecoin insertion slot 38; andposition sensor 42 for determining the rotational reference position of the mirror with the semicircular plate mounted on the mirror axis (upon turning on the power), and the display position of the projectedimage 124 on the screen 121 (FIG. 7) is continuously designated by thegame control unit 103 designating the rotation angle from the rotational reference position. - Provided to the main
body control unit 100 are aROM 105 storing the program, image data and sound data for the shooting video game processing described later; aRAM 106 for temporarily storing the program read from theROM 105 and data used in the program; agame control unit 103 for controlling the overall progress of the game based on the program loaded on theRAM 106; a drawing control unit (image drawing processor) 101 for writing image data corresponding to the projected image of theprojector 31 in theframe buffer 102 while performing processing unique to the image such as polygon drawing and texture mapping in accordance with the coordinates of the object having a 3D shape within the game space; and a sound control unit (sound control processor) 104 comprising an ADPCM sound source for reproducing sounds from the sound data. - With the shooting video game processing to be executed at the
game control unit 103, as shown in FIG. 13, if the coin insertion is not detected with the coin switch 37 (NO at ST2), demo image data is read and a demo screen is displayed (ST1). - When the insertion of the coin is detected (YES at ST2), the start screen is displayed (ST3), (and when the pressing of the
start button 36 is further detected) the game start processing is executed (ST5) and the game is started after other game data is read (ST4) which characterizes the image data and sound data differing per stage, and the attack or movement of the enemy character (foregoing dinosaur or other shooting targets) and the movement of the player. - With the present game machine, similar to conventional hand-to-hand combat game machines, a virtual life of the player is set and reduced in accordance with the time limit of the game and the attack by the enemy character, and the game is ended when the time is up during the game progress (YES at ST6) or when the life runs out (NO at ST7), and a screen indicated game over is displayed (ST13). If time still remains (NO at ST6) and the life still remains (YES at ST7), the game is continued at the game processing main body (ST8, to be described in detail later with reference to FIG. 15 and the like).
- When a stage is cleared (YES at ST9) by defeating the enormous dinosaur shown in FIGS. 2 to 4, and the cleared stage is not the final stage (NO at ST10), processing from ST4 is repeated for the new stage.
- When the cleared stage is the final stage (YES at ST10), the
markers - FIG. 14 is a block diagram showing the structure of the principal parts of the game processing unit400 (part of the shooting video game program) for performing the processing with the game processing main body at
ST 8 of FIG. 13, and FIG. 15 is a flowchart showing the detailed procedure of the processing with the game processing main body at ST8. FIG. 16 and FIG. 17 are diagrams for explaining the detection of the position of theplayer 300 on the play area PE with theplayer detection sensors 51 to 54 (in a one player game with only 1P player). - As shown in FIG. 14, when taking the gun unit10 as an example as the processing unit for performing processing in relation to the player (virtual viewpoint, or virtual player within the game space), the game processing unit 400 has a light-up processing unit 400 a for lighting the marker during the game; a muzzle direction detection unit 401 for detecting the position on the screen 121 to which the muzzle is facing based on the image captured with the CCD camera 6; an I/O input unit 402 for inputting the on-state of the pump trigger switch 12 and trigger switch 11 and the detection status of the player detection sensors 51 to 54; a bullet-loading processing unit 403 for processing the loading of a prescribed number of virtual bullets when the pump trigger switch 12 is turned on; a bullet position computation unit 404 for setting the coordinates so as to move the bullets in a direction according to the direction of the muzzle 16 from the vicinity of the virtual viewpoint within the game space when the trigger switch 11 is turned on; a viewpoint position shifting unit 405 for ordinarily shifting the virtual viewpoint within the game space (at a shifting width designated in advance) and shifting the virtual viewpoint so as to avoid the dinosaur when the player detection sensors 51 to 54 detect the movement of the player on the player area PE; and a collision judgment unit 406 for judging whether the virtual attack from the enemy hit the player.
- Further, as the processing unit for performing processing relating to the enemy character, the
game processing unit 400 has an enemyattack setting unit 407 for generating the attack to the player when the enemy character is sufficiently close to the player (using random numbers, etc.); an enemymovement processing unit 408 for moving the enemy character upon setting the enemy character coordinates so as to chase the player within the game space; and an enemycollision judgment unit 409 for judging whether the virtual attack from the player hit the enemy. Thegame processing unit 400 further has animage processing unit 410 for setting data which designates thedrawing control unit 101 so as to draw based on the setting of the enemy character coordinates and rotating the steppingmotor 41 in accordance with where to display the projected image of theprojector 31 on thescreen 121, for example, whether to display the projected image on the upper part or lower part; and asound processing unit 411 for setting data which designates thesound control unit 104 to selectively reproduce sounds (including music) according to the game progress. - With the game processing main body executed at the
game processing unit 400 including each of the foregoing processing units, as shown in FIG. 15, light-up processing of themarker 13 is foremost conducted (ST80), the muzzle direction detection processing is then conducted with the muzzle direction detection unit 401 (ST81, described later in details with reference to FIG. 18 and the like), and the response status of thepump trigger switch 12,trigger switch 11 andplayer detection sensors 51 to 54 is obtained with the I/O input unit 402 (ST82). - If the
pump trigger switch 12 is responding (YES at ST83), the bullets are virtually loaded at the bullet-loading processing unit 403 (ST84). If thetrigger switch 11 is responding (YES at ST85), the coordinates representing the trajectory of the bullets within the game space are computed (ST86) in accordance with the direction of themuzzle 16 with respect to the screed detected with the muzzledirection detection unit 401. - If the response state of the
player detection sensors 51 to 54 is of a prescribed pattern showing the movement of theplayer 300 on the play area PE (YES at ST87), the avoidance movement of the virtual viewpoint is set with the viewpoint position shifting unit 405 (ST88), and, if the response status of theplayer detection sensors 51 to 54 is not of a prescribed pattern (NO at ST87), the normal movement of the virtual viewpoint is set (ST89). - In further detail, the
player detection sensors 51 to 54 are range sensors for detecting the distance to the obstacle with supersonic waves or infrared rays, and turning on the signal when the distance to the obstacles is less than a prescribed distance (distance corresponding to theplayer 300 on the play area PE) (it is not necessary to measure the distance accurately). As shown in FIG. 16 and FIG. 17, when it is detected that 1P player shifted from the reference position in front of theplayer detection sensor 52 on the inner left side to the front of theplayer detection sensor 51 on the outer left side during an ordinary case, the virtual viewpoint coordinates are set within the game space deeming that the player has moved around to the left side of the dinosaur. - Particularly, here, since the movement to the left side is detected with a combination of two player detection sensors, as shown in FIG. 17, it is possible to detect “a state where nobody is playing” and “a state of erroneously recognizing the gallery other than the player” in addition to the movement itself, and it is possible to detect the movement of the player with further accuracy.
- Further, regarding the 1P player's movement to the right side (FIG. 16), when it is detected that the player moved to the front of the
player detection sensor 53 on the inner right side (or theplayer detection sensor 54 on the outer right side), the virtual viewpoint coordinates are set within the game space deeming that the player has moved around to the right side of the dinosaur. - Moreover, the reference position may be moved to the front of the
player detection sensor 53 on the inner right side. Here, when it is detected that the player moved to the front of theplayer detection sensor 54 on the outer right side, the virtual viewpoint coordinates may be set within the game space deeming that the player has moved around to the right side of the dinosaur, and when it is detected that the player moved to the front of theplayer detection sensor 52 on the inner left side (or theplayer detection sensor 51 on the outer left side), the virtual viewpoint coordinates may be set within the game space deeming that the player has moved around to the left side of the dinosaur. - When the
collision judgment unit 406 judges that the attack from the enemy character hit the player (YES at ST90 of FIG. 15), the player's life is reduced, and the player's life gauge display (which represents the player's life value on the screen in a pole shape) is renewed (ST91). - When an attack from the enemy character to the player is generated in the enemy attack setting unit407 (YES at ST92), coordinates within the game space of the respective portions are set (ST93) such that the attack against the player is generated from the portions which the enemy character generates attacks such as the mouth, arms, legs and tail. When the enemy character movement is set in the enemy movement processing unit 408 (YES at ST94), enemy character coordinates within the game space are moved (ST95). Next, when the enemy
collision judgment unit 409 judges that the attack from the player hit the enemy character (YES at ST96), the enemy's life is reduced, and the enemy life gauge display is renewed (ST97). - It is possible to assume that one or two or more enemy characters exist in the game space, and while the target enemy character is being renewed, processing of ST92 to ST97 for all enemy characters is repeated (NO at ST98). When all processing of ST92 to ST 97 for all enemy characters is completed (YES at ST98), image display processing with the image processing unit 410 (ST99) and the sound output processing with the sound processing unit 411 (ST100) are conducted, and the processing of the game processing main body returns to the beginning.
- FIG. 18 is a block diagram showing the structure of the principal parts of the muzzle
direction detection unit 401 for performing the muzzle direction detection processing at ST81 of FIG. 15; FIG. 19 is a flowchart showing the detailed procedure of the muzzle direction detection processing at ST81; and FIG. 20 is a diagram showing the detailed procedure of the extraction processing of the dotted light source at ST815. - As shown in FIG. 18, the muzzle direction detection unit401 has an image processing unit 4011 for repeatedly incorporating in prescribed cycles the CCD image (data per pixel is stored in a prescribed area on the RAM 106) which is the picture image of the CCD camera 6; a binary processing unit 4012 for binarizing data per imaged pixel as a prescribed threshold and storing this in a prescribed area on the RAM 106 as luminescent spot data, or performing binary processing after temporarily storing the same; a coordinate data extraction unit 4013 for extracting coordinate data in which the binarized luminescent spot data exists and performing prescribed data arrangement; a straight line judgment unit 4014 for successively selecting the combination of the three spots from the extracted luminescent spot data and judging whether such three spots exist on the straight line and whether they are of equal intervals; a vicinity judgment unit 4015 for judging whether another luminescent spot exists in the vicinity of a luminescent spot on one end with respect to the three spots existing on the straight line (main axis); a dotted light source specification unit 4016 for associating the luminescent spot and the dotted light source with the judgment of both judgment units; a normal line computation unit 4017 for computing the direction of the muzzle 16 of the gun unit 10 (normal line direction of the substrate 130) from the position information of the associated luminescent spot and the dotted light source thereof; and an intersecting point (H, V) computation unit 4018 for computing the intersecting point (impact position) with the screen 121 of the computed normal line direction of the substrate 130. The CCD image includes luminescent spots other than the LED; that is, noise, caused by infrared rays contained in the natural light and infrared rays contained in the fluorescent lights and discharge lamps. Therefore, the straight
line judgment unit 4014 and thevicinity judgment unit 4015 endeavor to eliminate the noise by performing judgment processing for all combinations. - Here, the normal
line computation unit 4017 and intersecting point (H, V)computation unit 4018 will be explained in further detail. The positions of theLEDs 131 to 135 of the marker when thesubstrate 130 is flat is Pa (0, 0), Pb (1, 0), Pc (2, 0), Pd (0, 1), Pe (0, 2), and when these are defined upon expanding to the three-dimensional space, the positions will become 0a (0, 0, 0), 0b (1, 0, 0), 0c (2, 0, 0), 0d (0, 1, 0), 0e (0, 2, 0). Meanwhile, when these defined coordinates of the respective points are viewed from the CCD camera 6 (with theCCD camera 6 as the origin), the coordinates will be represented as a value enjoining three-dimensional matrix such as Ca (tx, ty, tz), Cb (tx+r00, ty+r01, tz+r02), Cc (tx+2×r00, ty+2×r01, tz+2×r02), Cd (tx+r10, ty+r11, tz+r12), Ce (tx+2×r10, ty+2×r11, tz+2×r12). Meanwhile, the dimension ratio ph, pv in the vertical and horizontal directions of the visual field of the CCD camera and the actual substrate 130 (may also be obtained from the imaging dimension of thesubstrate 130 with respect to the actual dimension) and the coordinates Ga (Ah, Av), Gb (Bh, Bv), Gc (Ch, Cv), Gd (Dh, Dv), Ge (Eh, Ev) of the respective points in the CCD image are all publicly known. Thus, variables tx, ty, tz, r00 to r12 can be computed from these publicly known data and the coordinates of the respective points viewed from theCDD camera 6, and the components (r20, r21, r22) of the normal line direction of thesubstrate 130 are thereby determined. Moreover, the reason why the value contained in the two items of coordinates Cc and Ce was made to be double value against r00, r01, r02, r10, r11, r12; that is, to be in proportion is because thesubstrate 130 is represented as a plane (as a simulation). In reality, when considering that thesubstrate 130 is of a curved surface, a three-dimensional matrix should be defined in consideration of the curvature of such curved surface with respect to the respective coordinates. By conducting the foregoing computation, although there may be cases where either theLED 131 orLED 133 is near or undefined in theCCD camera 6 depending the direction of themuzzle 16, it becomes possible to specify the direction by employing the dimension information ofLED 131,LED 132,LED 133 and the dimension information ofLED 131,LED 134,LED 135; that is, by employing the relationship of the dimension when themuzzle 16 is in the correct position and the ratio thereof. - The intersecting point (H, V) on the
screen 121 of the normal line of thesubstrate 130 is sought with (tx+tz·(r20/r22), ty+tz·(r21/r22)) from the obtained position of themarker 13, normal line direction information (r20, r21, r22) of thesubstrate 130, and surface position information of the screen with the preset (predefined)CCD camera 6 as the origin. Further, during this computation, since the position of themarker 13 has been computed, this position information may be adopted as necessary, and, for instance, a desired dynamic detection of thecontroller 10 becomes possible with continuous computation, and it will no longer be necessary to adopt the conventional structure such as the triangular ranging method. - Moreover, as described above, although
LED 131,LED 132,LED 133,LED 131,LED 134,LED 135 are not limited to being a fixed pitch, in this case also, they may be computed so as long as they have each pitch information. In addition, thegame control unit 103 further has a trajectory computation unit for computing the trajectory of bullets flying within the game space from impact position on thescreen 121 based on the information obtained with the intersecting point (H, V)computation unit 4018 and the information obtained with the normalline computation unit 4017 and the intersecting point (H, V)computation unit 4018. - In FIG. 19, image (CCD) data is foremost incorporated by activating the
CCD camera 6 under trigger conditions such as vertical synchronization (V-sync, V-blank) at a prescribed cycle, {fraction (1/60)} seconds for example (ST811), and then the incorporated data is binarized with thebinary processing unit 4012 in order to extract luminescent spots (ST812). Here, coordinates of the binary data to be treated as luminescent spots are incorporated, an identification symbol is added thereto (labeling), and appropriate grouping processing is performed (ST813) in a mode where the coordinate data exist dispersedly. Then, the rough specification of the luminescent spots is conducted (ST814) based on the position data of luminescent spots, group information, and shape information (prepared as necessary). Next, each luminescent spot specified at ST 814 is named A to E (ST815). - Thereafter, the coefficient of the dimension ratio ph, pv is multiplied against the position data of luminescent spots A to E (ST816). Next, coordinates tz of the z component are computed with the
marker 13 of theCCD camera 6 as the origin regarding the coordinate data of luminescent spots A, B, C (ST817), x component tx, y component ty, r00, r01, r02 are then computed from the camera coordinates tz (ST818), r10, r11, r12 are thereafter computed based on the coordinate data of luminescent spots D, E and tx, ty, tz (ST819), and the normal line vector (r20, r21, r22) of thesubstrate 130; that is, the intersecting point (H, V) of thegun unit 13 direction and thescreen 121 is then computed as described above (ST820). When the computation is complete, the intersecting point (H, V) which is the computation result is forwarded to theCPU 103 side, and utilized in the collision judgment processing of the shooting against the enemy character (may also be considered for impact presentation) and the like. Moreover, in a case where a plurality of markers are lit up for a two player game, the intersecting point (H, V) of the other markers is similarly computed, and the suitable intersecting point data may be utilized. - FIG. 20 is a detailed subroutine of ST815, and the existing luminescent spot positions are foremost structured (formed) into a graph composed of the vector and distance (ST831). The luminescent spot position data within the graph is organized in accordance with the foregoing grouping or in a somewhat sorted state, thereby facilitating the data analysis. Next, the vector is utilized to research whether the three luminescent spots are of a straight line relationship be operating the inner product of the adjacent two points for example (ST832). When a straight line relationship does not exist (NO at ST833), it is judged whether processing for all combinations has been completed (ST834), and the routine returns to ST832 when in the middle, and skips to ST821 when it has been completed. Meanwhile, if a straight line relationship exists at ST833, knowledge from the distance between the luminescent spots (arranged status) is confirmed; that is, whether the three spots on the main axis are aligned in approximately equal intervals is confirmed (ST835). If a combination of a substantially equal interval does not exist, the routine returns to ST832, and if it exists, the routine researches the luminescent spot in the vicinity of both ends of the three spots (distance in which the
LED 134 structuring the marker is deemed to exist) (ST837). Here, if a luminescent spot does not exist in the vicinity (NO at ST838), the routine returns to ST832, and if it exists, the routine researches the relationship of the luminescent spot in the vicinity and the luminescent structuring the main axis, and the shape of the marker is estimated thereby (ST839). The reason such luminescent spot is treated as D depending on the conditions of the existence in the vicinity is because the relationship of the intersection and equal distance with the LED.A will not be established depending on the direction of the camera. Next, A, B, C, D are encoded from the positional relationship of the respective luminescent spots in order to determine the arrangement thereof (ST840). - According to the
muzzle 16 direction detection processing as described above, to which part of thescreen 121 themuzzle 16 is ultimately facing, and the virtual trajectory position of the bullets fired toward the target object from themuzzle 16 within the game space from a position on the screen may be computed with the characteristics of the positional relationship of the image of the marker within the CCD image. - FIG. 21 is a block diagram showing the structure of the principal parts of the image processing unit for performing the image display processing at ST99 of FIG. 15, and FIG. 22 is a flowchart showing the detailed procedure of the image display processing at ST99.
- The
image processing unit 410 for displaying images while performing such correction, as shown in FIG. 21, has a visual lineelevation setting unit 4101 for setting the visual line elevation (angle inclining the visual line upward against the level surface) in accordance with the object position data 421 (data representing the position of the shooting target object within the game space); a mirrorinclination control unit 4102 for designating the rotation angle of the mirror in accordance with the visual line elevation and controlling the steppingmotor 41; and an imagegeneration indication unit 4103 for designating the generation of images to thedrawing control unit 101. - With the image display processing, as shown in FIG. 22, the visual line elevation is set with the visual line elevation setting unit4101 (in accordance with the dinosaur position or the parts of the dinosaur which generate attacks during the approach) (ST991), the mirror rotation angle according to this visual line elevation is designated with the mirror inclination control unit 4102 (ST992), and the
mirror 43 rotates as a result of the steppingmotor 41 being controlled (ST993). Next, drawing of the image captured from the prescribed virtual viewpoint is indicated with thedrawing control unit 101 against the set visual line elevation with the image generation indication unit 4104 (ST994), and this processing is returned to the beginning. In accordance with the indication of drawing, with thedrawing control unit 101, image data is generated upon operating data relating to polygons within the (three-dimensional) game space, this image data is written in theframe buffer 102, and images are projected on thescreen 121 in accordance with the image data on theframe buffer 102. - FIG. 23 is a diagram for explaining the rotation control of the mirrors corresponding respectively to the two areas in which one stage is divided with the first modified example of the shooting video game machine.
- With the game machine in the present modified example, an
area 501 corresponding to the first half of the first stage and anarea 502 corresponding to the second half are assumed, and the player shoots small dinosaurs and flying dinosaurs (ordinary enemy characters) in thefirst half area 501 and shoots the foregoing enormous dinosaurs (enemy character corresponding to the boss character) in thesecond half area 502. In thearea 501 within the game space, the virtual player (virtual viewpoint) will move in the direction of arrow B1 at a speed designated in advance. An enemy character appears when the virtual player passes through prescribedpositions 511 to 514, and the player virtually shoots at the display of such enemy character with thegun unit 10. When theplayer detection sensors 51 to 54 respond, the player is made to move a relatively small distance to the left or right within the game space just enough to avoid the attack from the enemy character, and the mirror for determining the position of the projected image on the screen is rotated based on the data designated in advance. - In the
area 502 within the game space, the player avoids the attack of theboss character 522 approaching thevirtual player 521 within the game space by making theplayer detection sensors 51 to 54 respond and moving in the arrow B2 or arrow B3 direction, and the player shoots at the display of the boss character by operating the gun unit. Theboss character 522 will move in the arrow B4 or arrow B5 direction so as to follow the movingvirtual player 521. - Here, the player is made to move a relatively large distance upon the response of the
player detection sensors 51 to 54 (movement so as to move around the left or right side of the dinosaur, and the a different distance range such as 5 meters, 20 meters, etc. is set in accordance with the stage), and the mirror is rotated in accordance with the distance between the boss character and the virtual viewpoint as described above, or in accordance with the portion in the boss character is to make the attack. - With the game machine of the present modified example, since the distance of movement upon the
player detection sensors 51 to 54 responding and the method of mirror rotation control is differed, the player is able to enjoy a shooting game abundant in changes and unwearying. - FIG. 24 is a diagram for explaining the detection of the position of player300 (during the two player game with 1P player and 2P player) with the
player detection sensors 51 to 54 with the second modified example of the shooting video game machine. - With the game machine of the present modified example, during a two player game, the two virtual players within the game space share the same fate, and move in the same direction. When it is detected that 1P player (left side player) moved from the reference position in front of the
player detection sensor 52 on the inner left side to the front of theplayer detection sensor 52 on the outer left side, this is deemed as the player moving around to the left side of the dinosaur, and the coordinates of the two virtual players are set within the game space. Moreover, when it is detected that 2P player (right side player) moved from the reference position in front of theplayer detection sensor 53 on the inner right side to the front of theplayer detection sensor 54 on the outer right side, this is deemed as the player moving around to the right side of the dinosaur, and the coordinates of the two virtual players are set within the game space. - With the shooting video game machine of the present modified example, since the coordinates of the virtual players are set in accordance with the movement of the two players, unique amusement in the game progress may be yielded upon the mutual cooperation of the players.
- Here, the video game device, which is a modified mode of the foregoing shooting video game machine, is explained.
- FIG. 25 is an overall perspective view of the video game device. As shown in FIG. 25, the video game device comprises a console
type game housing 1000 having a rectangular parallelepiped shape for example, adisplay unit 1101 is disposed at the front upper part thereof, aCCD camera 1102 is provided to the front lower part thereof, and, although not shown, a speaker 1103 (c.f. FIG. 27) for yielding sound effects is provided to a suitable position in the housing, and a start button 1001 (c.f. FIG. 27) for indicating game start is provided to the approximately center right or left, for example. Thedisplay unit 1101 is formed of a CRT, LCD or the like, and an image of a sports stadium including atennis court 1201 for example is displayed thereon, and anopponent character 1202 is displayed on the opponent's court side. The player P to play the game upon standing in the play area PE prepared in front of thegame housing 1000 will play the competition game upon holding thecontroller 1300 simulating a tennis racket. TheCCD camera 1102 corresponds to theCCD camera 6 in the previous embodiments, and is set to at least include the visual field of thecontroller 1300 to be swung by the player positioned in the play area PE. The setup position of theCCD camera 1102 is not limited to the position shown in FIG. 26, and may be immediately above thedisplay unit 1102, or the left or right side; in other words, it will suffice so as long as the position is able to observe the changes in the direction of the face of the simulated net of the simulated tennis racket to be swung by the player. In some cases, the mounting position may be separate from thegame housing 1000, and, in such a case, it should be considered that theCCD camera 1102 is established on the game housing side from the relationship of signal processing. The purpose of this game is to repeat the motion of returning the tennis ball hit from the opponent back to the opponent's court via a game medium of a tennis ball (not shown in FIG. 26) with the opponent character (competition with the computer for example) within the game screen, and the game is played in accordance with the rules of a tennis game. - FIG. 26 shows the front view of the
controller 1300 simulating a tennis racket, and dottedlight sources 1301 to 1305 such as LEDs structuring the light source unit are mounted to the face of the net portion (marker mounting section). The power source of LEDs may be supplied with a cable, or batteries may be built therein (inside the grip for instance). The dottedlight sources 1301 to 1303 are disposed in equal intervals in the longitudinal direction, and the dottedlight sources light source 1301 to be shared. Imaging of thecontroller 1300 with theCCD camera 1102, the intersecting angle (direction) formed with the screen of thedisplay unit 1101 of the net face of thecontroller 1300, and the height and left/right positions with respect to the screen of thedisplay unit 1101 are obtained by executing operational processing similar to the operation method in the previous embodiments. TheCCD camera 1102 performs imaging operations at a prescribed cycle, {fraction (1/60)} seconds for example, and the operational processing for seeking the intersecting angle as well as the height and left/right positions is repeated. - FIG. 27 is a block diagram of the video game device. The present device comprises a
CPU 1400 as the control unit, aROM 1501 storing game program data, image data required in the game (each image data may be structured with objects as virtual three-dimensional objects structured from polygons), sound data and other fixed data (e.g., three-dimensional position information and the like of thedisplay unit 1101 with theCCD camera 1102 as the origin), and aRAM 1502 for temporarily storing data under processing. - The
CPU 1400 is for controlling the desired game progress by collectively or suitably reading necessary game program data or other data from theROM 1501, and comprises a controllerposition operation unit 1401 for computing the position of the controller; a controllerdirection operation unit 1402 for computing the direction of the controller; acollision judgment unit 1403 for judging the virtual collision of the ball character as the game medium and thecontroller 1300; areturn processing unit 1404 for computing the return direction and speed when the ball character is returned with thecontroller 1300; an in/outjudgment unit 1405 for judging whether the returned ball character is in the in area or out area of the opponent's court; an opponentcharacter processing unit 1406 for performing the movement processing of the opponent character; a ballcharacter processing unit 1407 for performing the positional computation of the ball character; adrawing processing unit 1408 for performing drawing processing to thedisplay unit 1101 of thetennis court 1201,opponent character 1202 and ball character; and anevaluation processing unit 1409 for managing the game score and victory/defeat. - The controller
position operation unit 1401 is for computing the direction and position with respect to the screen of thedisplay unit 1101 by executing an operational processing similar to the operation method in the previous embodiments from the position information of the dottedlight sources 1301 to 1305 of the controller images with theCCD camera 1102. The controllerdirection operation unit 1402 is for computing the direction of the flat face of the net portion of thecontroller 1300 with respect to the screen of thedisplay unit 1101 by performing processing similar to the previous embodiments. - The
collision judgment unit 1403 is for judging whether the ball character virtually hit thecontroller 1300 from the flight direction (virtual flight from the screen) of the ball character described later, and the position and direction information of thecontroller 1300 at the point when the ball character within the game image flies from within the virtual three-dimensional space and computationally coincides with the position on the screen of thedisplay unit 1101. - The
return processing unit 1404 is for computing the flight path of the ball character returned by the player from the swing speed sought with the position and direction of thecontroller 1300 and two times worth of consecutive computed positional information of thecontroller 1300 computed successively when it is deemed by thecollision judgment unit 1403 that the ball character virtually hit the net of the controller. The in/outjudgment unit 1405 is for judging whether the ball character in which the flight path thereof is computed with thereturn processing unit 1404 landed on the inside or outside of the opponent's court. - The opponent
character processing unit 1406 is for making the behavior of the opponent character existing within the game space and controlled with theCPU 1400 to follow the motion procedures by incorporating the ordinary motion in a tennis match into the game program, and produces the movement in the front/back/left/right directions within the opponent's court, serve motion, return motion and so on. The ballcharacter processing unit 1407 is for performing the movement processing of the ball character moving to the screen side from the ball hitting motion of the opponent character, and to perform the movement control of the ball character virtually hit by the player, preferably in consideration of adding gravity, drive, cut, and other ball rotations. - The
drawing processing unit 1408 is for displaying information annunciating the game progress such as thetennis court 1201,opponent character 1202, ball character, scores, acquired sets and so on upon employing the image data read from theROM 1501 on the screen of thedisplay unit 1101 in accordance with the game program and behavior of thecontroller 1300. Theevaluation processing unit 1409 is for executing the processing for determining the score and victory/defeat in accordance with the rules of a tennis match. - When simply explaining the operational procedure of this tennis game, after the game is started upon the start button1001 being pushed, the game begins with the score at 0-0, and the serve motion by the
opponent character 1202 is displayed. The flight patch of the ball character is computed based on the position of this serve motion within the virtual three-dimensional space and the direction and speed of the smash motion, and the movement of the ball character along such direction is displayed. The controllerposition operation unit 1401 and the controllerdirection operation unit 1402 compute the position and direction of thecontroller 1300 in prescribed cycles after the game is started, and judges whether thecontroller 1300 hit the ball character from the position, direction and swing speed of thecontroller 1300 at the time the ball character arrives at the screen. If it is a miss, air shot processing (minus evaluation processing) is executed, and if it is a hit, the return direction and speed of the ball character is computed upon executing dynamic computation. The flight path of the ball character within the virtual three-dimensional space is sought based on the computation described above, and the ball character is displayed on the screen. Whether the returned ball character landed within the opponent's court is judged, and minus evaluation is made if outside the court, and, if inside the court, judgment is made on whether the opponent character is able to return the ball character from the landing position of the ball character (equivalent to the distance between the landing point and the position of the opponent player) and the speed (also upon reflecting the drive, cut or other ball rotations). If it is returnable as a result of such judgment, the opponent character is made to operate for returning the ball character, and the flight computation of such ball character is further conducted. By repeating the foregoing operation, the score is renewed when either player misses the ball character. When either player wins 6 set game a prescribed number of times in accordance with tennis rules, the victory/defeat is determined, and the game is over. - Further, since both faces of the racket may be used for hitting a ball in tennis and the like, it is preferable that the dotted
light sources 1301 to 1305 are mounted so as to be exposed on both sides of the net portion, such that the illuminated light is emitted to both faces. Here, since three dottedlight sources 1301 to 1303 and 1301, 1304, 1305 are provided respectively in each axis, the front/back judgment will become undefined in cases where the racket is turned in the normal line direction of the racket face. - Therefore, as the structure of the
controller 1300, as shown in FIG. 26, although one prescribed color may be used (when using only one face), the net portion may be formed with plates having colors different from the dotted light sources on the front and back. Or, the illuminated color of the dottedlight sources light sources light source 1301 for example, and this will be the reverse color relationship on the back face. Here, at least one on the specific same axis side other than the dottedlight source 1301 may also be flash controlled. Or, the size and shape of the dotted light source may be made to differ from the others. As described above, the dotted light source for judging the front and back may be made to have a different light-emitting form than the other dotted light sources. Moreover, since the dotted light source for judging the front and back is shared with one of the dottedlight sources 1301 to 1305, the number of dotted light sources may be reduced in comparison to cases of separately providing such dotted light source. - Further, as shown in FIG. 28, a reverse T shape may be employed as the shape of the biaxial direction marker. Here, the illuminant color of the dotted
light sources 1311 to 1313 is made the same color (green for example) in order to distinguish the front and back, and the illuminant color of the dottedlight source 1314 is made to be a different color (red for example), and/or the illuminant color of the dottedlight source 1315 is made to be a different color (blue for example). Thus, the color of at least the dottedlight source 1314 or the dottedlight source 1315 needs to be a different color (green in this example). Since thecontroller 1310 is simulating a racket, the front and back thereof is switched by the racket being swung around the axis parallel to the axis of the dottedlight sources 1311 to 1313, and it will suffice to change the color of the dotted light source on the side sandwiching the rotational axis. - Similarly, FIGS. 29A, 29B and29C are diagrams show a simulated table tennis racket used as the
controller 1320 when the video game device it used for playing a table tennis game. Since both sides of the table tennis racket may be used to hit the ball, it is desirable that dotted light sources capable of recognizing the front and back be disposed. In other words, as shown in FIG. 29A, FIG. 29B and FIG. 29C, three dottedlight sources 1321 to 1323 are disposed on the ball-hitting face of the racket on one side with respect to the grip axis and parallel to the axis, dottedlight sources light source 1321, and light may therefore be emitted from either face upon exposing both the front and back sides. Moreover, by differing the illuminant color of the dottedlight source light sources - (Second Embodiment)
- The shooting video game machine pertaining to the second embodiment of the present invention is explained below.
- With the shooting video game machine pertaining to the second embodiment, the setup positions of the
CCD camera 6 and themarker 13 are switched in the shooting video game machine pertaining to the first embodiment. In other words, themarker 13 is disposed on the shooting video game machine main body side (screen 121), and theCCD camera 6 is disposed on thegun unit 10. Thus, the description of FIGS. 1 to 5 in the first embodiment corresponds to the second embodiment. This shooting video game machine is now explained below. - FIG. 30 and FIG. 31 are diagrams relating to the structure for projecting images, FIG. 32 and FIG. 33 are diagrams relating to the structure for detecting the direction of the
muzzle 216, and FIG. 34 is a diagram showing the mode ofmarkers 26 to 29 and the structural diagram for mounting such markers to the screen. - The structure for projecting images is not explained. FIG. 30 is a diagram showing, the appearance of the present game machine, and FIG. 31 is a typical cross section for explaining the shifting of the projected image on the
screen 2121. - With the present game machine, as shown in FIG. 30, the projected
image 2124 projected from the projector 231 (FIG. 31) on thescreen 2121 retained with the screen retention table 2120 shifts in the arrow A26 direction, and thegun unit 210 andgun unit 220 are connected to the main body control unit 2100 (explained later at FIG. 35) via thegun cable 217. The projectedimage 2124 contains a shooting target such as a dinosaur as described above, and the 1P player standing on the play area PE operates the gun unit 210 (or the 2P player operates the gun unit 220) to virtually shoot the shooting target, and points are scored in accordance with the skill of shooting such as the shooting position and shooting timing. - The four
player detection sensors 251 to 254 mounted on the front face of thebase 2110 are for detecting the movement of the 1P player when it is a one player game (or 1P player and 2P player when it is a two player game) in the left and right directions, andside plates 2125 are provided for preventing the disturbance and the like upon detecting the muzzle direction (described later) with respect to thescreen 2121 and displaying images on thescreen 2121. - Further, with the present game machine, music and the like is played in order to yield vigor, and a speaker (top)232, speaker (left) 233 and speaker (right) 234 for outputting sounds in the middle and high ranges, and a
woofer speaker 235 for outputting sounds in the low ranges are provided in order to output such sounds during the game. The speaker (top) 232 and speaker (left) 233 form one pair and the speaker (top) 232 and speaker (right) 234 form one pair in order to playback in stereo sound. - A coin of a prescribed amount is inserted into the
coin insertion slot 238, thestart button 236 is suitably pressed in accordance with the display on thescreen 2121, and a one player game with only the 1P player or a two player game with both the 1P player and 2P player is selectively started. - The rectangular
flat mirror 243, as shown in FIG. 31, has amirror axis 245 extending in the perpendicular direction in the diagram, and both ends of themirror axis 245 are rotatably retained with themirror retention member 246. The rotation of the steppingmotor 241 connected to the control unit described later is transmitted to the mirror with thetiming belt 244, and the projectedimage 2124 shifts in the arrow A26 direction on the screen by themirror 243 being rotated in the direction of arrow A27. - The reference viewpoint set at a prescribed height and position at the front of the present game machine is associated with the virtual viewpoint within the game space, and it is envisioned that a player (of an average height) is able to view the
screen 2121 from this reference viewpoint position. - Next, explained is the structure for detecting the direction of the
muzzle 216. FIG. 32 is a diagram showing the structure of the gun unit 210 (similar with the gun unit 220) as an example of the controller for accepting input operations from the player, and FIG. 33 is a diagram showing an example of the arrangement of themarkers 26 to 29 for detecting the direction of themuzzle 216 with respect to thescreen 2121 together with theCCD camera 213 in thegun unit 210. - FIG. 33A is a diagram showing the front view of the
screen 2121 extended on the level plane, and FIG. 33B is a diagram showing the side view of thescreen 2121 provided in the present game machine. In FIG. 33, themarkers 26 to 29 have the same shape, and a prescribed number (four in this embodiment) is disposed in the vertical direction, preferably in equal intervals, at the center position of the surface of thescreen 2121. The mounting position information for each of themarkers 26 to 29 with respect to thescreen 2121 is stored in the likes of aROM 2105 of the mainbody control unit 2100 shown in FIG. 35. The arrangement position of the markers may be set in accordance with the shape of the screen, and, in the present embodiment, markers are provided in the vicinity of the top or bottom of thescreen 2121 and at two locations in which the space therebetween is divided in thirds. Moreover, the number of markers may be suitably set in accordance with the size of the screen and visual field angle of theCCD camera 213. - The
gun unit 210, as shown in FIG. 32, simulates a pump action gun, and has atrigger switch 211 as the micro switch that is turned on when the player pulls thetrigger 214 in the direction of arrow A28, apump trigger switch 212 as the micro switch that is turned on when the player slides the slidingunit 215 in the direction of arrow A29, and aCCD camera 213 having a visual field angle capable of imaging at least one, up to two in this embodiment, among themarkers 26 to 29 for detecting the point where the direction of the muzzle with respect to thescreen 2121; that is, the direction of the muzzle 216 (visual line vector) intersects with thescreen 2121. - Signals from the
trigger switch 211, thepump trigger switch 212 and theCCD camera 213 are transmitted to the mainbody control unit 2100 via thegun cable 217, virtual shooting is designated by thetrigger switch 211 being turned on, and the loading of a prescribed number of virtual bullets is designated to thegun unit 210 when thepump trigger switch 212 is turned on. - Depending on the
visual field 2431 of theCCD camera 213, as shown in FIG. 33A, only a part of thescreen 2121 may be imaged, and, as further shown in FIG. 33B, the distance between the CCD camera 213 (within the gun unit 210) and thescreen 2121 is changed in accordance with the player's operation during the game progress, and the size of the portion of thescreen 2121 to fit within thevisual field 2431 of theCCD camera 213 will change. - With the present game machine, detected are the arrangement of the image and the rotational angle information of the one marker illuminating with the mounting position information of the
markers 26 to 29 (as described later) within the CCD image corresponding to thevisual field 2431, and detected is which part of thescreen 2121 the player is facing themuzzle 216, and the intersecting point thereof. - FIG. 34A shows the form of the markers, and FIG. 34B and FIG. 34C show the mounting structure to the
screen 2121. Since themarkers 26 to 29 have the same shape,marker 26 will be explained here. FourLEDs 26A to 26D are adopted in themarker 26 as the spot light source (illuminator) for illuminating infrared light for preventing erroneous detection by outside light.LED 26A toLED 26C are disposed on a straight line (main axis) in prescribed equal intervals,LED 26 has the same interval as the foregoing prescribed interval fromLED 26A, and provided on the line (sub axis) intersecting with the main axis. Since the shape of the markers form an L shape, the expression “L shape” will be used in the second embodiment when referring to the marker shape. The mounting position information of themarker 26 is prescribed and stored for each LED, and theLED 26A is the reference position in the present embodiment. - The interval between
LED 26A toLED 26D is preferably equal, and it not limited thereto. The disposition ofLED 26D at a position of intersecting with the sequence ofLED 26A toLED 26C is preferably form the computational processing perspective to be performed based on the marker position and rotation angle within the picture image described later. - FIG. 34B shows the mounting structure of the
LED 26D. TheLED 26D is mounted, for example, in an upright posture on thesubstrate 611 of a prescribed size to which is mounted an LED illuminating drive circuit or the like.Pores 2121 a from which the illumination unit of theLED 26D is exposed are provided at prescribed positions on thesubstrate 611. Thepore 2121 a is formed in a conical shape (cone shape) broadening toward the front face of thescreen 2121, and the light emitted from theLED 26D may be irradiated at a broad angle. Astud nut 613 having a prescribed height is welded at two places at the left and right sides of thethin metal plate 612, or established by pressurization (to the pore not shown formed on the thin metal plate 612), and thesubstrate 611 and thethin metal plate 612 are integrally formed by tightening abolt 614 from the opposite face upon mounting thesubstrate 611 on thisnut 613. Apore 612 a is further formed at both end positions of thethin metal plate 612, and, although not shown, a triangular screw penetrates the cone shapedpore 2121 b corresponding to thescreen 2121 in order to integrally form thescreen 2121 and thethin metal plate 612 by tightening the bolt. - FIG. 34C shows the mounting structure of
LEDs 26A to 26C, and this is basically the same mounting structure as withLED 26D. In other words, theLEDs 26A to 26C are mounted, for example, in an upright posture on thesubstrate 621 of a prescribed size. Threepores 2121 a from which the illumination unit of theLEDs 26A to 26C is exposed are provided at prescribed positions on thescreen 2121. Thepores 2121 a are formed in a conical shape broadening toward the front face of thescreen 2121, and the light emitted from theLEDs 26A to 26C may be irradiated at a broad angle. Moreover, thethin metal plate 622 is of a size capable of containingLEDs 26A to 26C (three LED worth), a stud nut 623 having a prescribed height is welded at three places, or established by pressurization (to the pore not shown formed on the thin metal plate 622), and thesubstrate 621 and thethin metal plate 622 are integrally formed by tightening a bolt from the opposite face upon mounting thesubstrate 621 on this nut 623.Pores 622 a are further formed at suitable positions of thethin metal plate 622, and, although not shown, a triangular screw penetrates the cone shapedpore 2121 b corresponding to thescreen 2121 in order to integrally form thescreen 2121 and thethin metal plate 622 by tightening the bolt. - Further, the structure for protecting the rotation and the like of the
mirror 243 is the same as the first embodiment shown in FIG. 10 and FIG. 11, and the explanation thereof is omitted. - The control of the present game machine structured as above is now explained. FIG. 35 is a block diagram showing the hardware structure of the control unit of the present game machine, and FIG. 36 is a flowchart showing the procedure of the shooting game processing (shooting video game program) executed with the game control unit (CPU)2103.
- As shown in FIG. 35, connected to the (
game control unit 2103 of the) mainbody control unit 2100 set within the base 2110 (FIG. 30) are the aforementioned trigger switches 211, 221; pump trigger switches 212, 222;CCD cameras markers 26 to 29;player detection sensors 251 to 254;start button 236;projector 231; steppingmotor 241;speakers 232 to 235;coin switch 237 for detecting the insertion of the coin from thecoin insertion slot 238; andposition sensor 242 for determining the rotational reference position of themirror 243 with the semicircular plate mounted on the mirror axis (upon turning on the power), and the display position of the projectedimage 2124 on the screen 2121 (FIG. 31) is continuously designated by thegame control unit 2103 designating the rotation angle from the rotational reference position. - Provided to the main
body control unit 2100 are aROM 2105 storing the program, image data and sound data for the shooting video game processing described later; aRAM 2106 for temporarily storing the program read from theROM 2105 and data used in the program; agame control unit 2103 for controlling the overall progress of the game based on the program loaded on theRAM 2106; a drawing control unit (image drawing processor) 2101 for writing image data corresponding to the projected image of theprojector 231 in theframe buffer 2102 while performing processing unique to the image such as polygon drawing and texture mapping in accordance with the coordinates of the object having a 3D shape within the game space; and a sound control unit (sound control processor) 2104 comprising an ADPCM sound source for reproducing sounds from the sound data. - With the shooting video game processing to be executed at the
game control unit 2103, as shown in FIG. 36, if the coin insertion is not detected with the coin switch 237 (NO at ST22), demo image data is read and a demo screen is displayed (ST1). When the insertion of the coin is detected (YES at ST22), the start screen is displayed (ST23), (and when the pressing of thestart button 236 is further detected) the game start processing is executed (ST25) and the game is started after other game data is read (ST24) which characterizes the image data and sound data differing per stage, and the attack or movement of the enemy character (foregoing dinosaur or other shooting targets) and the movement of the player. - With the present game machine, similar to conventional hand-to-hand combat game machines, a virtual life of the player is set and reduced in accordance with the time limit of the game and the attack by the enemy character, and the game is ended when the time is up during the game progress (YES at ST26) or when the life runs out (NO at ST27), and a screen indicated game over is displayed ST213). If time still remains (NO at ST26) and the life still remains (YES at ST27), the game is continued at the game processing main body (ST28, to be described in detail later with reference to FIG. 38 and the like).
- When a stage is cleared (YES at ST29) by defeating the enormous dinosaur shown in FIGS. 2 to 4 of the first embodiment, and the cleared stage is not the final stage (NO at ST210), processing from ST24 is repeated for the new stage. When the cleared stage is the final stage (YES at ST210), the
markers 26 to 29 are turned off thereafter (ST211), the ending screen and game over screen are displayed (ST212, ST213), and the routine returns to the processing of ST21. - FIG. 37 is a block diagram showing the structure of the principal parts of the game processing unit2400 (part of the shooting video game program) for performing the processing with the game processing main body at ST28 of FIG. 36, and FIG. 38 is a flowchart showing the detailed procedure of the processing with the game processing main body at ST28. FIG. 39 and FIG. 40 are diagrams for explaining the detection of the position of the player on the play area PE2 (corresponds to
player 300 of FIG. 1 and FIG. 5 in the first embodiment) with theplayer detection sensors 251 to 254 (in a one player game with only 1P player). - As shown in FIG. 37, as the processing unit for performing processing in relation to the player (virtual viewpoint, or virtual player within the game space), the game processing unit2400 has a light-up processing unit 2400 a for lighting one of the markers 26 to 29 corresponding to the screen 2121 position to which the projected image is displayed; a muzzle direction detection unit 2401 for detecting the position on the screen 2121 to which the muzzle is facing based on the image captured with the CCD camera 213; an I/O input unit 2402 for inputting the on-state of the pump trigger switch 212 and trigger switch 211 and the detection status of the player detection sensors 251 to 254; a bullet-loading processing unit 2403 for processing the loading of a prescribed number of virtual bullets when the pump trigger switch 212 is turned on; a bullet position computation unit 2404 for setting the coordinates so as to move the bullets in a direction according to the direction of the muzzle 216 from the vicinity of the virtual viewpoint within the game space when the trigger switch 211 is turned on; a viewpoint position shifting unit 2405 for ordinarily shifting the virtual viewpoint within the game space (at a shifting width designated in advance) and shifting the virtual viewpoint so as to avoid the dinosaur when the player detection sensors 251 to 254 detect the movement of the player on the player area PE2; and a collision judgment unit 2406 for judging whether the virtual attack from the enemy hit the player.
- Further, as the processing unit for performing processing relating to the enemy character, the
game processing unit 2400 has an enemyattack setting unit 2407 for generating the attack to the player when the enemy character is sufficiently close to the player (using random numbers, etc.); an enemymovement processing unit 2408 for moving the enemy character upon setting the enemy character coordinates so as to chase the player within the game space; and an enemycollision judgment unit 2409 for judging whether the virtual attack from the player hit the enemy. Thegame processing unit 400 further has animage processing unit 2410 for setting data which designates thedrawing control unit 2101 so as to draw based on the setting of the enemy character coordinates and rotating the steppingmotor 241 in accordance with where to display the projected image of theprojector 231 on thescreen 2121, for example, whether to display the projected image on the upper part or lower part; and asound processing unit 2411 for setting data which designates thesound control unit 2104 to selectively reproduce sounds (including music) according to the game progress. - With the game processing main body executed at the
game processing unit 2400 including each of the foregoing processing units, as shown in FIG. 38, light-up processing of one of themarkers 26 to 29 corresponding to the position on thescreen 2121 to which the projectedimage 2124 is displayed is foremost conducted (ST280), the muzzle direction detection processing is then conducted with the muzzle direction detection unit 2401 (ST281, described later in details with reference to FIG. 44 and the like), and the response status of thepump trigger switch 212,trigger switch 211 andplayer detection sensors 251 to 254 is obtained with the I/O input unit 2402 (ST282). - If the
pump trigger switch 212 is responding (YES at ST283), the bullets are virtually loaded at the bullet-loading processing unit 2403 (ST284). If thetrigger switch 211 is responding (YES at ST285), the coordinates representing the trajectory of the bullets within the game space are computed (ST286) in accordance with the direction of themuzzle 216 with respect to the screed detected with the muzzledirection detection unit 2401. - If the response state of the
player detection sensors 251 to 254 is of a prescribed pattern showing the movement of the player on the play area PE2 (YES at ST287), the avoidance movement of the virtual viewpoint is set with the viewpoint position shifting unit 2405 (ST288), and, if the response status of theplayer detection sensors 251 to 254 is not of a prescribed pattern (NO at ST287), the normal movement of the virtual viewpoint is set (ST289). - In further detail, the
player detection sensors 251 to 254 are range sensors for detecting the distance to the obstacle with supersonic waves or infrared rays, and turning on the signal when the distance to the obstacles is less than a prescribed distance (distance corresponding to the player on the play area PE2) (it is not necessary to measure the distance accurately). As shown in FIG. 39 and FIG. 40, when it is detected that 1P player shifted from the reference position in front of theplayer detection sensor 252 on the inner left side to the front of theplayer detection sensor 251 on the outer left side during an ordinary case, the virtual viewpoint coordinates are set within the game space deeming that the player has moved around to the left side of the dinosaur. - Particularly, here, since the movement to the left side is detected with a combination of two player detection sensors, as shown in FIG. 40, it is possible to detect “a state where nobody is playing” and “a state of erroneously recognizing the gallery other than the player” in addition to the movement itself, and it is possible to detect the movement of the player with further accuracy.
- Further, regarding the 1P player's movement to the right side (FIG. 39), when it is detected that the player moved to the front of the
player detection sensor 253 on the inner right side (or theplayer detection sensor 254 on the outer right side), the virtual viewpoint coordinates are set within the game space deeming that the player has moved around to the right side of the dinosaur. - Moreover, the reference position may be moved to the front of the
player detection sensor 253 on the inner right side. Here, when it is detected that the player moved to the front of theplayer detection sensor 254 on the outer right side, the virtual viewpoint coordinates may be set within the game space deeming that the player has moved around to the right side of the dinosaur, and when it is detected that the player moved to the front of theplayer detection sensor 252 on the inner left side (or theplayer detection sensor 251 on the outer left side), the virtual viewpoint coordinates may be set within the game space deeming that the player has moved around to the left side of the dinosaur. - When the
collision judgment unit 2406 judges that the attack from the enemy character hit the player (YES at ST290 of FIG. 38), the player's life is reduced, and the player's life gauge display (which represents the player's life value on the screen in a pole shape) is renewed (ST291). - When an attack from the enemy character to the player is generated in the enemy attack setting unit2407 (YES at ST292), coordinates within the game space of the respective portions are set (ST293) such that the attack against the player is generated from the portions which the enemy character generates attacks such as the mouth, arms, legs and tail. When the enemy character movement is set in the enemy movement processing unit 2408 (YES at ST294), enemy character coordinates within the game space are moved (ST295). Next, when the enemy
collision judgment unit 2409 judges that the attack from the player hit the enemy character (YES at ST296), the enemy's life is reduced, and the enemy life gauge display is renewed (ST297). - It is possible to assume that one or two or more enemy characters exist in the game space, and while the target enemy character is being renewed, processing of ST292 to ST297 for all enemy characters is repeated (NO at ST298). When all processing of ST292 to ST 297 for all enemy characters is completed (YES at ST298), image display processing with the image processing unit 2410 (ST299) and the sound output processing with the sound processing unit 2411 (ST2100) are conducted, and the processing of the game processing main body returns to the beginning.
- FIG. 41 is a block diagram showing the principal parts of the marker light-
up processing unit 2400 a (part of the shooting video game program) for performing the marker light-up processing at ST 280 of FIG. 38. The marker light-up processing unit 2400 a has a projected imageposition judgment unit 24001 for receiving the position information of thescreen 2121 to which the projectedimage 2124 is displayed from the image processing unit for performing drawing processing and judging the current projected position; a correspondingmarker determination unit 24002 for specifying (determining) a marker as described later among the markers contained in the projected range from this projected position information and the predetermined position information of themarkers 26 to 29; and a corresponding marker light-upindication unit 24003 for performing the light-up indication to the four LEDs structuring the determined corresponding marker. Further, in a state where the display range of the projected image contains two markers, the marker closer to the center of the display range of the projected image will be selected, and when the two markers are roughly the same distance from the center, the marker corresponding to the shifting direction of the projected image on the screen is selected (that is, position information from theimage processing unit 2410 is stored over several occasions, and comparison is made with the present position information so as to decide the marker facing the center). - FIG. 42 is a block diagram showing the structure of the principal parts of the muzzle
direction detection unit 2401 for performing the muzzle direction detection processing at ST281 of FIG. 38; FIG. 43 is a flowchart showing the detailed procedure of the muzzle direction detection processing at ST281; and FIG. 44 is a diagram showing the detailed procedure of the extraction processing of the “L frame” at ST2815. - As shown in FIG. 42, the muzzle direction detection unit2401 has an image processing unit 24011 for repeatedly incorporating in prescribed cycles the CCD image (data per pixel is stored in a prescribed area on the RAM 2106) which is the picture image of the CCD camera 213; a binary processing unit 24012 for binarizing data per imaged pixel as a prescribed threshold and storing this in a prescribed area on the RAM 2106 as luminescent spot data, or performing binary processing after temporarily storing the same; a coordinate data extraction unit 24013 for extracting coordinate data in which the binarized luminescent spot data exists and performing prescribed data arrangement; a straight line judgment unit 24014 for successively selecting the combination of the three spots from the extracted luminescent spot data and judging whether such three spots exist on the straight line and whether they are of equal intervals; a vicinity judgment unit 24015 for judging whether another luminescent spot exists in the vicinity of a luminescent spot on one end with respect to the three spots existing on the straight line (main axis); an L frame specification unit 24016 for specifying the “L frame” with the judgment of both judgment units; a normal line computation unit 24017 for computing the direction of the camera from the specified L frame; that is, the normal line vector; and an intersecting point (H, V) computation unit 24018 for computing the intersecting point (impact position) with the screen 2121 of the computed normal line direction of the substrate 2130. The CCD image includes luminescent spots other than the LED; that is, noise, caused by infrared rays contained in the natural light and infrared rays contained in the fluorescent lights and discharge lamps. Therefore, the straight
line judgment unit 4014 and thevicinity judgment unit 24015 endeavor to eliminate the noise by performing judgment processing for all combinations. - Here, the normal
line computation unit 24017 and intersecting point (H, V)computation unit 24018 will be explained in further detail. The positions of the LED.A to D of the marker when thescreen 2121 is flat is A2 (0, 0), B2 (1, 0), C2 (2, 0), D2 (0, 1), and when these are defined upon expanding to the three-dimensional space, the positions will become 0a (0, 0, 0), 0b (1, 0, 0), 0c (2, 0, 0), 0d (0, 1, 0) or 0d (0, −1, 0). Meanwhile, when these defined coordinates of the respective points are viewed from theCCD camera 13, the coordinates will be represented as a value enjoining three-dimensional matrix such as Ca (tx2, ty2, tz2), Cb (tx2+r200, ty2+r201, tz2+r202), Cc (tx2+2×r200, ty2+2×r201, tz2+2×r202), Cd (tx2+r210, ty2+r211, tz2+r212). Meanwhile, the dimension ratio ph, pv in the vertical and horizontal directions of the visual field of theCCD camera 213 and theactual screen 2121 and the coordinates LED.A2 (A2h, A2v), LED.B2 (B2h, B2v), LED.C2 (C2h, C2v), LED.D2 (D2h, D2v) of the respective points in the CCD image are all publicly known. Thus, variables tx2, ty2, tz2, r200 to r212 can be computed from these publicly known data and the coordinates of the respective points viewed from theCDD camera 213, and the elements of the normal line vector of theCCD camera 213 are thereby determined. Moreover, the reason why the value contained in the two items of coordinates Cc was made to be double value against r200, r201, r202; that is, to be in proportion is because the screen is represented as a plane (as a simulation). In reality, when considering that thescreen 2121 is of a curved surface, a three-dimensional matrix should be defined in consideration of the curvature of such curved surface against the respective coordinates. Then, from the elements of the obtained visual line vector, for example, the visual line vector det and the intersecting point (H, V) may be sought with det=r200×r211−r201×r210, H=(r211×(−tx)−r201×(−ty))×det, V=(−r210×tx−r200×(−ty))×det. - Moreover, as described above, although
LED 26A,LED 26B,LED 26C are not limited to being a fixed pitch, in this case also, they may be computed so as long as they have each pitch information. In addition, thegame control unit 2103 further has a trajectory computation unit for computing the trajectory of bullets flying within the game space from impact position on thescreen 2121 based on the information obtained with the intersecting point (H, V)computation unit 24018 and the information obtained with the normalline computation unit 24017 and the intersecting point (H, V)computation unit 24018. - In FIG. 43, image (CCD) data is foremost incorporated by activating the
CCD camera 213 under trigger conditions such as vertical synchronization (V-sync, V-blank) at a prescribed cycle, {fraction (1/60)} seconds for example (ST2811), and then the incorporated data is binarized with thebinary processing unit 24012 in order to extract luminescent spots (ST2812). Here, coordinates of the binary data to be treated as luminescent spots are incorporated, an identification symbol is added thereto (labeling), and appropriate grouping processing is performed (ST2813) in a mode where the coordinate data exist dispersedly. Then, the rough specification of the luminescent spots is conducted (ST2814) based on the position data of luminescent spots, group information, and shape information (prepared as necessary). Next, the luminescent spot group structuring the “L frame” is extracted from the luminescent position, and is encoded as A, B, C, D based on the arrangement status of the extracted luminescent spots (e.g., corresponds toLED - Thereafter, the coefficient corresponding to the imaged range with respect to the
screen 2121 of theCCD camera 213 is multiplied to LED. A to D with one of themarkers 26 to 29 (ST2816). In the present embodiment, as described above, the distance from the CCD camera is successively differed (becoming farther) from the upper part to the lower part of thescreen 21, and, by multiplying a coefficient in accordance with the ratio of such difference in distance, the distance and correspondence (ratio) of the CCD image and on theactual screen 2121 is unified. Next, coordinates tz2 of the z component are computed with the “L frame” of theCCD camera 213 as the origin regarding the coordinate data of LED. A, B, C (ST2817), x component tx2, y component ty2, r200, r201, r202 are then computed from the camera coordinates tz2 (ST2818), r210, 2r11, r212 are thereafter computed based on the LED. D coordinate data tx2, ty2, tz2 (ST2819), and the intersecting point (H, V) of the cameral visual line vector when deeming the “L frame” to be flat is computed from tx2, ty2, tz2, r200, r201, r202, r210, r211, r212 (ST2820). When the computation is complete, the intersecting point (H, V) which is the computation result is forwarded to theCPU 2103 side, and utilized in the collision judgment processing of the shooting against the enemy character (may also be considered for impact presentation) and the like. Moreover, in a case where a plurality of markers are lit up for a two player game, the intersecting point (H, V) of the remaining “L frames” is similarly computed, and the suitable intersecting point data may be utilized. - FIG. 44 is a detailed subroutine of ST2815, and the existing luminescent spot positions are foremost structured (formed) into a graph composed of the vector and distance (ST2831). The luminescent spot position data within the graph is organized in accordance with the foregoing grouping or in a somewhat sorted state, thereby facilitating the data analysis. Next, the vector is utilized to research whether the three luminescent spots are of a straight line relationship be operating the inner product of the adjacent two points for example (ST2832). When a straight line relationship does not exist (NO at ST2833), it is judged whether processing for all combinations has been completed (ST2834), and the routine returns to ST2832 when in the middle, and skips to ST2821 when it has been completed. Meanwhile, if a straight line relationship exists at ST2833, knowledge from the distance between the luminescent spots (arranged status) is confirmed; that is, whether the three spots on the main axis are aligned in approximately equal intervals is confirmed (ST2835). If a combination of a substantially equal interval does not exist, the routine returns to ST2832, and if it exists, the routine researches the luminescent spot in the vicinity of both ends of the three spots (distance in which the LED. D structuring the L frame is deemed to exist) (ST2837). Here, if a luminescent spot does not exist in the vicinity (NO at ST2838), the routine returns to ST2832, and if it exists, the routine researches the relationship of the luminescent spot in the vicinity and the luminescent structuring the main axis, and the shape of the “L frame” is estimated thereby (ST2839). The reason such luminescent spot is treated as LED. D depending on the conditions of the existence in the vicinity is because the relationship of the intersection and equal distance with the LED.A will not be established depending on the direction of the camera. Next, A, B, C, D are encoded from the positional relationship of the respective luminescent spots in order to determine the arrangement thereof (ST2840).
- According to the muzzle direction detection processing as described above, to which part of the
screen 2121 themuzzle 216 is facing; that is, the position on the screen corresponding to the center of the CCD image, and the virtual trajectory position of the bullets fired toward the target object from themuzzle 216 within the game space from a position on the screen may be computed with the characteristics of the positional relationship of the image of the marker within the CCD image. - FIG. 45 is a block diagram showing the structure of the principal parts of the image processing unit for performing the image display processing at ST299 of FIG. 40, and FIG. 46 is a flowchart showing the detailed procedure of the image display processing at ST299.
- Moreover, FIGS. 47A and 47B are diagrams showing the display of an image corrected with the present game machine, FIGS. 48A and 48B are diagrams showing the display of an ordinary image, and FIGS. 49A, 49B and49C are diagrams for explaining the image correction parameter set in the present game machine.
- When an ordinary image is projected from the projector231 (FIG. 31) as shown in FIG. 48A, the player will view the image as shown in FIG. 48B since the distance from the reference viewpoint of the player on the play area PE2 in front of the present game machine will differ between the upper part and lower part of the projected
image 2124 due to the curvature of thescreen 2121. - With the present game machine, the image projected from the
projector 231 is corrected prior to the projection as shown in FIG. 47A, and the player will view an undistorted image as shown in FIG. 47B. Further, since there is a difference in the distance from the reference point to the upper part and lower part of the projectedimage 2124 when the projectedimage 2124 is to be displayed at the lower part of the screen 2121 (corresponds to the solid line in FIG. 31) and when it is to be displayed at the upper part of the screen 2121 (corresponds to the dotted line in FIG. 31), the degree of correction will vary in accordance with the rotation angle of the mirror. - In the present image display processing, the image containing the display target having a 3D shape within the game space captured with a virtual camera (virtual viewpoint) having a rectangular visual field is corrected such that the lower end of the image is inclined to approach the virtual camera in accordance with the rotation angle of the mirror, and the corrected image is projected on the
projector 231. - The
image processing unit 2410 for displaying images while performing such correction, as shown in FIG. 45, has a visual lineelevation setting unit 24101 for setting the visual line elevation (angle inclining the visual line upward against the level surface, EYE_R of FIG. 49 described later) in accordance with the object position data 2421 (data representing the position of the shooting target object within the game space); a mirrorinclination control unit 24102 for designating the rotation angle of the mirror in accordance with the visual line elevation and controlling the steppingmotor 241; and an imagegeneration indication unit 24103 for referring to the image correction table 2422 (table associating the inclination angle CAM_R of the virtual camera, angle CAM_FT for designating the upper end of the image, angle CAM_FB for designating the lower end of the image with the visual line elevation EYE_R), reading and setting the image correction parameter corresponding to the visual line elevation, and designating the generation of images to thedrawing control unit 2101. - In reality, with the procedure shown in FIGS. 49A, 49B and49C below, the inclination angle CAM_R of the virtual camera, angle CAM_FT for designating the upper end of the image, and angle CAM_FB for designating the lower end of the image may be designated from the visual line elevation EYE_R, and the association thereof is stored in the image correction table 2422.
- With the present game machine, a gaze envisioned position VIEW_P is set in accordance with the distance between the player and dinosaur, and the portion of the dinosaur which will generate an attack against the player during approach. As shown in FIG. 49A, in accordance with this gaze envisioned position VIEW_P, visual line elevation EYE_R as the angle of the straight line q0 and the level plane (reference line) is set forth from the virtual viewpoint position EYE_P.
- Next, as shown in FIG. 49B, in consideration of the position, inclination angle and projection angle of the
projector 231, and the position of themirror 243, the mirror rotation angle MIRROR_R is set forth such that the field angle EYE_FU to the upper part and the field angle EYE_FD to the lower part of the virtual camera become equal centered around the visual line elevation EYE_R in order to seek the upper end SCREEN_U and the lower end SCREEN_D of the projected image. (The virtual camera has a rectangular imaging range, and the upper end SCREEN_U and lower end SCREEN_D correspond to the field angle of the vertical direction of the virtual camera. The field angle in the lateral direction may be suitably sought from the distance from the EYE_P to the SCREEN_D and the width of the projected image.) - As shown in FIG. 49C, the intersecting point of the straight line q3 passing through the projected image upper end SCREEN_U and the projected image lower end SCREEN_D and the perpendicular line q4 from the virtual viewpoint position EYE_P to this straight line q3 is sought as CAM_VP, and the angle (elevation) between the straight line q4 and the level plane is set as the inclination angle CAM_R of the virtual camera. In addition, the angle between the straight line q4 and the straight line q1, for prescribing the upper end position of the projected image is set as CAM_FT, and the angle between the straight line q1, and the straight line q2 for prescribing (together with the CAM_FT) the lower end position of the projected image is set as CAM_FB.
- According to the foregoing procedures, the virtual camera inclination angles CAM_R, CAM_FT, CAM_FB as image correction parameters are computed in accordance with the visual line elevation EYE_P (or the mirror rotation angle MIRROR_R set in accordance therewith) set during the progress of the game. Here, although the computed and partially adjusted CAM_R, CAM_FT, CAM_FB are associated in accordance with the visual line elevation EYE_R at the image correction table2422, these correction parameters may also be associated with the mirror rotation angle MIRROR_R.
- In the image display processing employing these image correction parameters, as shown in FIG. 46, the visual line elevation is set with the visual line elevation setting unit24101 (in accordance with the dinosaur position with respect to the virtual viewpoint or the parts of the dinosaur which generate attacks during the approach) (ST2991), the mirror rotation angle according to this visual line elevation is designated with the mirror inclination control unit 24102 (ST2992), and the
mirror 243 rotates as a result of the steppingmotor 241 being controlled (ST2993). - Next, image correction parameters (CAM_R, CAM_FT, CAM_FB, etc.) are designated with respect to the set visual line elevation (ST2994), and drawing of the image captured from the prescribed virtual viewpoint is indicated with the
drawing control unit 101 with respect to the set visual line elevation with the image generation indication unit 24104 (ST2995), and this processing is returned to the beginning. In accordance with the indication of drawing, with thedrawing control unit 2101, image data corresponding to the 2D image inclined with respect to the visual line EYE_R is generated upon operating data relating to polygons within the (three-dimensional) game space, this image data is written in theframe buffer 2102, and images are projected on thescreen 2121 in accordance with the image data on theframe buffer 2102. - According to the present image display processing, the image is suitable corrected in accordance with the position of the portion to be displayed on the screen having a curvature in the upward and downward directions, and the player is thereby able to enjoy a shooting video game while viewing an undistorted image.
- The overall structure of the foregoing shooting video game machine and the advantages yielded from the structure thereof may be summarized as follows.
- The present shooting video game machine enables the player to play the game while displaying images captured from a virtual viewpoint (virtual camera) in which the player's reference viewpoint position corresponds to the position in the game space. With the present game machine, a mirror is rotated so as to shift the image projected from the projector via the mirror at least in the upward and downward directions in correspondence with the direction of the virtual viewpoint at a portion within the screen continuously curved from the lower part of the approximate front of the reference viewpoint position to the upper part of the approximately top of the reference viewpoint position.
- According to the present game machine, since the player's visual line will shift from top to bottom pursuant to the game progress, the player will be able to enjoy a novel game not available conventionally, and this can be realized with a simple structure. Further, since the screen is curved inward in a conical shape, the projection distance is maintained approximately constant, and the size and focus of the projected image can be maintained approximately constant.
- Particularly, the screen may be made to curve such that the distance from the reference viewpoint position to the upper part becomes shorter than the distance from the reference viewpoint position to the lower part. According to this structured, the player will feel that the image on the upper part of the screen is approaching him/her, and a unique sense of tension may be yielded.
- Further, the player virtually shoots with a gun unit the dinosaur displayed on the screen and corresponding to the size of the screen when it is nearby, and the parts such as the mouth, arms and legs of the dinosaur to virtually attack the player are displayed on the screen. Thus, the player is able to enjoy a shooting game which effectively yields a novel and unique sense of nervousness.
- Moreover, since the mirror may be rotated such that a flying dinosaur (or a non-flying dinosaur) afar from the virtual viewpoint is displayed on the lower part of the screen and a flying dinosaur (or the upper part of the non-flying dinosaur) close to the virtual viewpoint is displayed on the upper part of the screen. Thereby, the flying dinosaur (or a non-flying dinosaur) approaching the player from afar may be represented with much vigor and perspective.
- With the present game machine, since the acrylic plate for protecting the mirror rotation and the like is inclined and provided such that the virtual image is transmitted toward outside the screen when the real image is projected on the upper part of the screen, the player will not be distracted with the virtual image needlessly appearing on the screen.
- In addition, when the player detection sensor becomes a prescribed detection state, the virtual viewpoints are moved so as to surround the periphery of the dinosaur within the game space, and the player's movement to the left and right may be conveyed within the game space naturally, and the amusement of the game will be enhanced thereby.
- Further, particularly in relation to the detection of the muzzle direction, the structure and effect of the foregoing video game machine may be summarized as follows.
- With the present shooting video game machine, the input corresponding to the shooting of the dinosaur displayed on the screen is conducted with the operation of the trigger in the gun unit, the CCD image of the imaged range corresponding to a part of the screen is generated with the CCD camera in the vicinity of the muzzle of the gun unit, and, in the least, when the trigger is pulled, the image of one marker among the plurality of markers disposed on the screen so as to hold a prescribed positional relationship is identified within the generated CCD image, and the shooting position on the screen corresponding to the approximate center of the imaged range is computed from the image position and rotation angle of the marker.
- According to the present game machine, since the shooting position is computed upon identifying which part of the screen is being imaged from the image position and angle relationship of the marker in the CCD image, the direction of the gun unit can be detected smoothly with respect to the screen (which does not fit within the CCD image).
- The detection of the gun unit direction is performed with respect to the screen curved inward and having a conical shape, an image to be the target of shooting is displayed at a portion of the top or bottom of the screen, and the image is shifted upward or downward in accordance with the direction of the virtual viewpoint. Thus, realized is a shooting game abundant in amusement and vigor.
- Further, particularly in relation to the correction of images, the structure and effect of the foregoing shooting video game machine may be summarized as follows.
- The present shooting video game machine enables the player to play the game while displaying images captured from a virtual viewpoint in which the player's reference viewpoint position corresponds to the position in the game space. With the present game machine, a mirror is rotated so as to shift the image projected from the projector via the mirror at least in the upward and downward directions in correspondence with the direction of the virtual viewpoint at a portion within the screen continuously curved from the lower part of the approximate front of the reference viewpoint position to the upper part of the approximately top of the reference viewpoint position. Further, the approximately vertical image that may be captured with the virtual viewpoint is corrected to become an image that may be obtain with a larger inclination the farther it is shifted upward on the screen when the lower side approaches the virtual viewpoint.
- Particularly, this inclination angle may be made to be the same angle as the rotation angle of the projected image on the screen.
- According to the present game machine, since appropriate correction is conducted in accordance with the mirror rotation, the image projected on the screen will not be distorted when viewed by the player.
- Moreover, by setting an image correction parameter for designating the virtual camera rotation in accordance with the mirror rotation (or the visual line elevation set during the game progress) to the image drawing processor, the effective correction of images may be realized with a simple control.
- A modified example of the shooting video game machine pertaining to the second embodiment is described below.
- FIG. 50 is a diagram for explaining the rotation control of the mirrors corresponding respectively to the two areas in which one stage is divided with the first modified example of the shooting video game machine.
- In this game machine of the modified example, an
area 2501 corresponding to the first half of the first stage and anarea 2502 corresponding to the second half are assumed, and the player shoots small dinosaurs and flying dinosaurs (ordinary enemy characters) in thefirst half area 2501 and shoots the foregoing enormous dinosaurs (enemy character corresponding to the boss character) in thesecond half area 2502. - In the
area 2501 within the game space, the virtual player (virtual viewpoint) will move in the direction of arrow B21 at a speed designated in advance. An enemy character appears when the virtual player passes through prescribedpositions 2511 to 2514, and the player virtually shoots at the display of such enemy character with thegun unit 210. When theplayer detection sensors 251 to 254 respond, the player is made to move a relatively small distance to the left or right within the game space just enough to avoid the attack from the enemy character, and the mirror for determining the position of the projected image on the screen is rotated based on the data designated in advance. - In the
area 2502 within the game space, the player avoids the attack of theboss character 2522 approaching thevirtual player 2521 within the game space by making theplayer detection sensors 251 to 254 respond and moving in the arrow B22 or arrow B23 direction, and the player shoots at the display of the boss character by operating the gun unit. Theboss character 2522 will move in the arrow B24 or arrow B25 direction so as to follow the movingvirtual player 2521. - Here, the player is made to move a relatively large distance upon the response of the
player detection sensors 251 to 254 (movement so as to move around the left or right side of the dinosaur, and the a different distance range such as 5 meters, 20 meters, etc. is set in accordance with the stage), and the mirror is rotated in accordance with the distance between the boss character and the virtual viewpoint as described above, or in accordance with the portion in the boss character is to make the attack. - With the game machine of the present modified example, since the distance of movement upon the
player detection sensors 251 to 254 responding and the method of mirror rotation control is differed, the player is able to enjoy a shooting game abundant in changes and unwearying. - FIG. 51 is a diagram for explaining the detection of the position of player (during the two player game with 1P player and 2P player) with the
player detection sensors 251 to 254 with the second modified example of the shooting video game machine. - With the game machine of the present modified example, during a two player game, the two virtual players within the game space share the same fate, and move in the same direction. When it is detected that 1P player (left side player) moved from the reference position in front of the
player detection sensor 252 on the inner left side to the front of theplayer detection sensor 252 on the outer left side, this is deemed as the player moving around to the left side of the dinosaur, and the coordinates of the two virtual players are set within the game space. Moreover, when it is detected that 2P player (right side player) moved from the reference position in front of theplayer detection sensor 253 on the inner right side to the front of theplayer detection sensor 254 on the outer right side, this is deemed as the player moving around to the right side of the dinosaur, and the coordinates of the two virtual players are set within the game space. - With the shooting video game machine of the present modified example, since the coordinates of the virtual players are set in accordance with the movement of the two players, unique amusement in the game progress may be yielded upon the mutual cooperation of the players.
- FIG. 52 is a diagram shown the image correction parameter set in the shooting video game machine of the third modified example.
- With the game machine of the present modification, SCREEN_U' is set on the extension of q1, shown in FIG. 49C, and CAM_VP is set forth on the straight line q5 passing through SCREEN_D and SCREEN_U', CAM_R will become even smaller. By suitably adjusting the size of CAM_R to make CAM_R smaller or larger as described above, a natural image matching the player's reference viewpoint position may be generated, and an image yielding further vigor may be generated.
- In addition to each of the foregoing embodiments, the present invention may be adopted in the following modified examples.
- (1) With the shooting video game machine in each of the foregoing embodiments, images from the projector are projected on the screen upon being reflected with a mirror. Nevertheless, without using a mirror, images from the projector may be directly displayed on the screen upon changing the inclination angle of the projector, and it could be said that this offers an even simpler structure.
- (2) Although each of the foregoing embodiments showed examples employed in a shooting game machine, the present invention is not limited thereto, and, for example, may assist in the bi-directional information communication by designating the subject on the screen with images (including text images). Notwithstanding the image display surface, this may also be employed in a mode of designating the desired position of the face of the area to become the designation. Here, in addition to being employed as a simulated gun, the controller may be adopted in other modes in accordance with the purpose thereof.
- (3) The screen of the display unit displaying images is not limited to a projection screen, and may be employed in various display faces; for instance, television monitors, liquid crystal monitors, monitor screens of personal computers and so on. Further, in addition to the designation of the screen position and the like, this may also be employed in the operational designation of other various devices and equipment. For example, when employed in an operation button of a device, remote operational designation becomes possible by orienting such direction as the drive designation of the operation member.
- (4) The dimensions and size of the marker are irrelevant in the present invention. A marker of various sizes may be adopted in consideration of the size of the controller to be employed. Moreover, the shape and form of the marker are not limited to an aggregate of dotted bodies, and may be of a pole shape. In the case of such pole shape, a processing execution unit for specifying the position of both ends thereof will further become necessary. In other words, the pole shape (continuity) is recognized from the picture image, and the position data (address within image memory) may be specified by detecting both sides thereof.
- In addition, particularly, the dimension data of the respective dotted light sources (LEDs) of the marker is not considered. In other words, if the luminescent spot distance data of the picture image (or the interval data of the LEDs when the
CCD camera 213 is at a reference position) with theCCD camera 6 when thecontroller 10 is at a reference position is previously stored as reference data, computation processing will be enabled in the subsequent measurements with the comparison with the reference data. Minute fluorescent tubes may be employed as the pole shaped body, and various objects may be adopted in the case of a reflector. Further, the mode may use both a dotted body and a pole shaped body. With respect to the marker (or an L frame), a marker (or L frame) may be formed by taking two pole shaped bodies each with a prescribed dimension, preferably the same dimension, and making the mutual ends thereof coincide or adjacent and disposing them to be in an intersecting direction, and disposing at least one dotted body as an extension of the other end of such one pole shaped body a prescribed distance apart. With the foregoing case, in a mode where two pole shaped bodies are disposed such that the mutual one ends are made to be adjacent; that is, apart from each other in a prescribed distance, the dotted body is not necessarily required. The recognizable position of the pole shaped body is the end and flection thereof, and is extracted from the picture image imaged with the CCD camera 6 (or CCD camera 213). Moreover, when a color CCD is used as the CCD camera 6 (or CCD camera 213) in a case where two pole shaped bodies are disposed such that the mutual one ends thereof are made to coincide, if a pole shaped body which emits a different color in the middle as the pole shaped body of one of the axes is connected and adopted, the four points of the two ends, the flection and the portion having differing luminescent colors may be recognized, which is effective as the marker (L frame). - (5) The marker (or L frame) shown in the foregoing embodiments is not influenced by the shape or size of the game screen or display screen, and versatility is high since there is only one analyzing method.
- (6) In each of the foregoing embodiments, although an LED was employed as the illuminator as the light source, a reflector capable of reflecting the incident light from the front may be adopted instead. This structure offers a mode in which the likes of an illuminator (mounted at a prescribed position or on the
controller 10 andscreen 212, respectively) reflects the light from the front of the controller 10 (or the screen 2121) to which a reflector is provided, and the light reflected (emitted) from the reflector is received with the imaging means. Thereby, since it is no longer necessary to directly mount an illuminator to the controller 10 (or the screen 2121), the structure becomes simple and the versatility high. Preferably, the shape of the reflector is of a semicircle or the like capable of generating reflected light at a desired width. When employing this in a controller, the movable range of the controller is not restricted needlessly, and the operability of the controller may be improved thereby. The structure may also extend the reflection range by generating a diffused reflection with the surface processing with respect to the reflective surface. - (7) The light source (illuminator, reflector) is not limited to an infrared light, and light of a desired color may be employed. For example, the color may be R (red), G (green) or B (blue), and may also be of another color. When using three markers, in addition to using markers with different colors, when a color CCD capable of receiving light of the respective colors is used as the CCD camera, the disposition of the respective markers may be recognized. As a result, individual light-up control as described in the present embodiment will no longer be necessary, and there is an advantage in that the light may always be turned on. Needless to say, it is not necessary to simultaneously use three colors worth, and markers of desired colors may be adopted in accordance with the use thereof.
- (8) Further, although various shapes for markers may be considered, those basically containing the element of dotted light source is included in the concept of dotted light source.
- (9) Moreover, in each of the foregoing embodiments, although the facilitation of computation was sought by intersecting the vertical and horizontal axes (one axis and other axis), this is not limited such intersection, and a desired intersecting angle may be set in accordance with the type of controller10 (or screen 2121).
- (10) With the shooting video game machine pertaining to each of the foregoing embodiments, although two player detection sensors were provided to the left and right, one each or three or more may also be provided. Upon advancing to the next stage after clearing the respective stages, when a player is to select one route among a plurality of routes (having different settings of the dinosaur or background) set in advance, the selection may be input with these player detection sensors.
- (11) Further, regarding the avoidance movement with the player detection sensor, in addition to the movement to the left and right, the movement may be to duck below, or the lower right oblique direction or lower left oblique direction. This is because the player will not be able to avoid the attack by moving left and right when the attack of the enemy character is of a movement where the arm or tail is whipped in the lateral direction. For example, if the player detection sensor on the left outer side is turned on, the movement may be automatically switched in accordance with the scene such that the attack is avoided by ducking below.
- (12) When the screen of the shooting video game machine of each of the foregoing embodiments is extended to the upper part of the player on the play area and disposed so as to cover the player, the player will be of a posture of looking up at the image when viewing the image on the upper part, and this will yield a further feeling of tension. In addition to the curvature portion, a straight line portion may be included in the screen.
- (13) Moreover, although the inclination angle of the acrylic plate of the shooting video game machine of each of the foregoing embodiments was set to roughly 10°, this may be suitably adjusted such that the virtual image is projected outside the screen in accordance with the position of the mirror, projector and screen.
- (14) With the shooting video game machine of the second embodiment, although the mirror rotation angle with respect to the visual line elevation was associated in advance upon displaying images and the image correction parameter was stored in advance, the parameters may be successively operated according to the procedure shown in FIG. 46. In addition, the whole or a part of the screen to which the image subject to correction is to be projected may incline upward or downward or curve or incline left and right or obliquely, or be made of a semicircle shape. Additionally, upon projecting to the overall screen curving (up/down, left/right, or in a semicircle), the overall screen may be divided in several areas and correction may be conducted as described above in accordance with the position of the respective areas. Further, a front screen and at least two screens inclining obliquely (when viewed from the player) may be disposed left/right or up/down so as to surround the player, and correction as described above may be conducted to the display of the two screens inclining obliquely upon continuously displaying on these three screens.
- (15) Further, with the shooting video game machine of each of the foregoing embodiments, although only a portion of the dinosaur to make the attack was partially displayed upon approaching the virtual viewpoint, a location to which the player should pay attention during the game progress may be displayed while facing the direction of the virtual viewpoint within the game space.
- (16) Moreover, with the shooting video game machine of each of the foregoing embodiments, although the mirror axis for rotating the mirror was set to be a single axis in order to shift the projected image in the upward and downward directions on the screen, for example, two mirror axes may be provided in order to shift the projected image in the upward/downward as well as the leftward/rightward directions on the screen.
- (17) As shown in each of the foregoing embodiments, provided is a highly versatile orientation detection device enabling two-player games and the simultaneous computation of directions even in cases where there are a plurality of controllers.
- (18) Since the structure is such that analysis is conducted with a three-dimensional matrix, this may be sufficiently employed in a mode of the controller shifting in a three-dimensional space. Thus, the applicable range may be broadened.
- (19) With the second embodiment, although four
markers 26 to 29 were disposed on thescreen 2121, the disposition of one or two markers will suffice depending on the screen size and visual field of theCCD camera 213, and it is not necessary to dispose them in equal spacing. - (20) Two types of L-shaped markers having a mirror surface relationship (vertical axis or horizontal axis) may be adopted as the marker capable of being employed in the second embodiment. Here, since these are individually distinguishable; that is, since it is possible to distinguish the arrangement position, individual light-up control as in the present embodiment is no longer required. In addition, in a mode where the rotational range of the controller is 180° or less, four-types of L frames having a mirror surface relationship with respect to the vertical axis and a mirror surface relationship with respect to the horizontal axis may be employed, and, since these are individually distinguishable; that is, since it is possible to distinguish the arrangement position, individual light-up control as in the present embodiment is no longer required at all. In other words, enabled is a mode where the disposition of orientation detection markers of different types (2 types or 4 types) having a mode in which the other axis with respect to the one axis of the biaxial direction includes mutually reverse axis information on the target area surface (screen, etc.) with a prescribed positional relationship. According to this, by employing differing orientation detection markers having a common basic form (in which the main axis and sub axis intersect), processing for individually identifying the same type of markers upon using the same will no longer be necessary.
- Further, as another arrangement mode of markers, when providing an example with the arrangement of the present embodiment (four locations in the vertical direction of the left, right and center of the screen), two types of L frames or markers (among the foregoing four types) having a mirror surface relationship with respect to the vertical axis may also be disposed at a symmetrical position on the left and right side of the screen. In addition, since the two rows worth of markers adjacent in the upward and downward direction are mutually different types of markers, light-up control may be performed with three combination units; namely, the combination of the first row and second row, the combination of the second row and third row, and the combination of the third row and fourth row. Similarly, this may be employed in cases when the three types of L frames or the four types of L frames of mutually different types are disposed adjacently in unit of the number of types of L frames.
- (21) The markers are not limited to fixed types. For example, in the present embodiment, one slit is provided in the vertical direction of the
screen 2121, markers are disposed so as to sandwich this slit, guide rails for sliding the markers along the slit are provided, and the markers are structured to be shiftable in the vertical direction while managing the position vertically with a drive means such as a motor. Thus, if the motor is driven so as to follow the position of the projected image, a single marker will realize the four markers in the present embodiment, and this may be treated as though existing in more numerous positions. Thus, the number of markers used may be reduced. - (22) In the second embodiment, although the projected image was drawn on the front face of the
screen 2121, a mode is also possible to draw the game image in which the image from the projector is projected on both the front and back faces depending on the shape of the screen. Here, in order to concurrently use the markers on both the front and back faces of the screen and enable the imaging with the CCD camera, for example, markers comprising the respective LEDs may be integrally mounted, or individual LEDs may be preferably mounted on the entire face through the pores penetrating the radial thickness of the screen, and light from the light-emitting unit of the LED may be structured so as to be capable of emitting to both the front and back faces of the screen (this is the same in the case of a reflector, and, for example, this may be mounted within the radial thickness such that the reflective surface exposes half of the spherical member on both sides. According to this structure, a game may be played upon using both the front and back faces of the screen, and, for instance, the image from the front of the dinosaur will be displayed on the front face and the image from the rear of the dinosaur will be displayed when moving toward the back face of the screen. Thus, provided is a highly amusing game with realism. In addition, since the markers will be of the three shapes having a mirror surface relationship with respect to the vertical axis with the front face and back face of the screen, the front or back of the screen may be automatically detected merely be recognizing the image from the CCD camera, and it is not necessary to additionally provide a human body sensor for detecting the circular movement of the player. - (23) Moreover, although various shapes for markers may be considered, those basically containing the element of dotted light source is included in the concept of dotted light source.
- In summary, the present invention was devised in view of the foregoing problems, and the object thereof is to provide an orientation marker capable of remotely measuring the movement, particularly the orientation, of a controller having a simple structure, which may be employed in a more sophisticated game, and which is highly versatile; an orientation detection device for remotely measuring the orientation (posture) of the controller with such orientation detection marker; and a video game device employing the above.
- In order to achieve the foregoing object, the orientation detection marker according to the present invention is provided in either one of the device main body and a controller for performing input operations as being pointed to a screen of a display unit provided to the device main body for displaying images, for detecting the orientation of the controller with respect to the screen, and which supplies information for computing said orientation to a picture image generated by imaging means provided in the other of the device main body and the controller, wherein said orientation detection marker comprises a light source having a mode including biaxial direction information.
- According to the foregoing structure, a picture image is generated with the imaging means provided to the device main body side and one of the controllers. An image of the orientation detection markers is contained in the picture image. Since the orientation detection marker includes biaxial direction information, in addition to the position information of the controller, and (rotation) inclination centered around the axis of orientation of the controller; that is, rotation angle information is also included in the picture image. Thus, the orientation of the controller with respect to the screen may be computed from this position information and rotation angle information.
- Further, it is preferable that the two axes are orthogonal to each other. According to this, the computation will become simplified since it is no longer necessary to employ a trigonometric function for positional computation. According to the invention with the above features, the computation will become simplified since it is no longer necessary to employ a trigonometric function for positional computation and a positional information can be directly obtained thus the calculation can be simplified.
- Moreover, it is preferable that the light source is formed of a plurality of dotted light sources. According to this, the orientation detection marker may be made simply and inexpensively by structuring it from a dotted light source capable of identifying biaxial direction information.
- According to the invention with the above feature, the orientation detection marker may be made simply and inexpensively by structuring it from a dotted light source capable of identifying biaxial direction information and the positional information can be directly obtained, thus the calculation is made easy.
- In addition, the light source may emit light of a specific color. According to this, employed may be a marker capable of emitting light of a desired color in accordance with the purpose of use. According to the invention with the above features, employed may be a marker capable of emitting light of a desired color in accordance with the purpose of use.
- Further, the plurality of dotted light sources may be formed by first and second light source units for specifying the first two points and second two points separated by a prescribed dimension on one axis and a third light source unit for specifying the third two points separated by a prescribed dimension on another axis being disposed on the orientation detection marker mounting section for mounting the orientation detection marker.
- According to this, regarding the first to third light source units, since two will be in one axis direction and one will be in the other axis direction, specified are the respective positions of the first two points and the second two points of the first and second light source units from the image corresponding within the picture image as the mapping images with the imaging means and the position of the third two points of the third light source. Thus, detected will be the inclination of one axis in the axis periphery parallel at least to the other axis and the rotation angle against the reference angle position on the surface formed from the one axis and the other axis. If the arrangement position of the imaging means and the position of the device main body with respect to the imaging means is associated in advance, in the least, the orientation of the controller may be computed from the picture image. According to the invention claimed in claim 5, specified are the respective positions of the first two points and the second two points of the first and second light source units and the position of the third two points of the third light source from the image corresponding within the picture image. Thus, detected will be the inclination of one axis in the axis periphery parallel at least to the other axis and the rotation angle with respect to the reference angle position on the surface formed from the one axis and the other axis, and the orientation of the controller will be computed thereby.
- Moreover, the dimension between the first two points and the dimension between the second two points may be set to be equal. According to this, the computation for detecting the orientation of the controller may be simplified. According to the invention with the above features, the computation for detecting the orientation of the controller may be simplified.
- In addition, the first and second light source units may share the inner two dotted light sources on the axis. According to this, since the dotted light sources are shared, the number of dotted light sources may be reduced by one. According to the invention with the above features, since the dotted light sources are shared, the number of dotted light sources may be reduced by one.
- Further, one of the dotted light sources may be provided for common use at the intersecting point of the two axes. According to this, since the dotted light source of the intersecting point of the two axes is shared, the number of dotted light sources may be reduced by one. According to the invention with the above features, since the dotted light source of the intersecting point of the two axes is shared, the number of dotted light sources may be reduced by one.
- Moreover, disposed may be a fourth light source unit for specifying the fourth two points separated by a prescribed dimension on the other axis. According to this, by adding the fourth two points, the inclination of the axis periphery parallel to one axis of the controller may also be detected. As a result, even when the controller is of a structure capable of being rotationally operated with respect to both the one axis and other axis; that is, in a synthesized direction, the foregoing orientation may be computed with respect to every orientation. According to the invention with the above features, by adding the fourth two points, the inclination of the axis periphery parallel to one axis of the controller may also be detected. As a result, even when the controller is of a structure capable of being rotationally operated with respect to both the one axis and other axis; that is, in a synthesized direction, the foregoing orientation may be computed with respect to every orientation.
- In addition, the dimension between the third two points and the dimension between the fourth two points may be set to be equal. According to this, the computation is simplified since position information can be directly obtained. According to the invention with the above features, the computation is simplified since position information can be directly obtained.
- Further, the third and fourth light source units may share the inner two dotted light sources on the axis. According to this, since the dotted light source is shared, the number of dotted light sources may be reduced by one.
- According to the invention with the above features, since the dotted light source is shared, the number of dotted light sources may be reduced by one.
- Furthermore, the fourth light source unit may include a dotted light source at the fourth two points. With this feature, the orientation detection marker can be easily and inexpensively made and the positional information can be directly obtained thus the calculation can be made easy.
- Moreover, the dotted light source may be an illuminator. According to this, regardless of the peripheral brightness, the dotted light source may be accurately imaged with the imaging means. According to the invention with the above features, regardless of the peripheral brightness, the dotted light source may be accurately imaged with the imaging means.
- In addition, the dotted light source may be a reflector capable of reflecting the incident light from the front. According to this, light is emitted with the likes of an illuminator from a prescribed position, and the light reflected (emitted) from the reflector may be received with the imaging means. It is therefore not necessary to wear the dotted light source, and it is no longer necessary to prepare wiring such as the power source line for the light source upon establishing the dotted light source. As a result, the structure of the device will become simplified, light, and the versatility will improve. Preferably, the shape of the reflector is of a semicircle or the like capable of generating reflected light at a desired width. When employing this in a controller, the movable range of the controller is not restricted needlessly, and the operability of the controller may be improved thereby.
- According to the invention with the above features, light is emitted with the likes of an illuminator from a prescribed position, and the light reflected (emitted) from the reflector may be received with the imaging means. It is therefore not necessary to wear the dotted light source, and it is no longer necessary to prepare wiring such as the power source line for the light source upon establishing the dotted light source. As a result, the structure of the device will become simplified, light, and the versatility will improve.
- Further, the dotted light source may emit infrared light. According to this, erroneous detection or erroneous computation may be prevented since influence by disturbance light will become difficult. According to the invention with the above features, erroneous detection or erroneous computation may be prevented since influence by disturbance light will become difficult.
- Moreover, the orientation detection marker mounting section is formed with the dotted light source being exposed on both the front and back sides. According to this, also applied may be a mode of making the controller function upon employing both the front and back sides.
- According to the invention with the above features, also applied may be a mode of making the controller function upon employing both the front and back sides.
- In addition, provided may be a fifth light source for representing the front and back of the orientation detection marker. According to this, although the relationship of the respective light source units will become the mirror face position relationship at the front and back sides of the orientation detection marker, the addition of the fifth light source unit will enable the distinction even when there is a possibility of the front and back become uncertain due to the rotation angle or the like of the orientation detection marker. According to the invention with the above features, although the relationship of the respective light source units will become the mirror face position relationship at the front and back sides of the orientation detection marker, the addition of the fifth light source unit will enable the distinction even when there is a possibility of the front and back become uncertain due to the rotation angle or the like of the orientation detection marker.
- Further, the fifth light source unit may be formed of one dotted light source. According to this, the mere addition of one dotted light source as the fifth light source unit will enable the judgment of front and back. According to the invention with the above features, the mere addition of one dotted light source as the fifth light source unit will enable the judgment of front and back.
- Moreover, the dotted light source of the fifth light source unit is formed from one of the dotted light sources structuring the first through fourth light source units and has a light-emitting mode different from the other dotted light sources. According to this, one of the dotted light sources previously disposed may be shared as the fifth light source unit with its light-emitting mode being different from the others, and this will prevent the increase in the number of dotted light sources. In a mode where the dotted light source is disposed at the intersecting point of the one axis and other axis, this dotted light source of the intersecting point will not be the fifth light source unit. According to the invention with the above features, one of the dotted light sources previously disposed may be shared as the fifth light source unit with its light-emitting mode being different from the others, and this will prevent the increase in the number of dotted light sources.
- In addition, the different light-emitting mode may be a color difference. According to this, the display will be distinguishable from the existing position of the dotted light source of a different color. According to the invention with the above features, the display will be distinguishable from the existing position of the dotted light source of a different color.
- Further, the different light-emitting mode may flash (blink). According to this, the display will be distinguishable from the existing position of the flashing dotted light source. According to the invention with the above features, the display will be distinguishable from the existing position of the flashing dotted light source.
- 21 Moreover, the orientation detection device according to the present invention comprises: imaging means that is provided in either one of a controller and the device main body comprising a display unit having a screen for displaying images and images an orientation detection marker; identification means for identifying an image of a mode containing the biaxial direction information included in the picture image imaged by the imaging means; and computing means for computing the orientation of the controller with respect to the screen of the display unit from the state of the image of the identified mode.
- According to the invention claimed in
claim 21, the orientation with respect to the screen of the display unit of the controller may be sought though operation. - 22 In addition, the orientation of the controller is preferably computed based on the image position of the mode identified with the identification means and the rotation angle information of the axis. According to this, the position on the screen to which the controller is facing; that is, the intersecting point may be computed from the position information and rotation angle information.
- According to the invention claimed in
claim 22, the position on the screen to which the controller is facing; that is, the intersecting point may be computed from the position information and rotation angle information. - Further, an orientation detection marker may be disposed on the controller, and imaging means may be disposed on the display unit. According to this, the picture image of the orientation detection marker may be obtained with the imaging means pursuant to the orientation movement of the screen by the controller. According to the invention with the above features, the picture image of the orientation detection marker may be obtained with the imaging means pursuant to the orientation movement of the screen by the controller.
- Moreover, the computing means may continuously seek the orientation. According to this, the movement (distance and speed of movement) of the controller may be computed from a plurality of times worth of direction information and position information. According to the invention with the above features, the movement (distance and speed of movement) of the controller may be computed from a plurality of times worth of direction information and position information.
- In addition, the screen may be a screen to which is displayed images projected from a projector. According to this, a desired position on the screen may be designated.
- According to the invention with the above features, a desired position on the screen may be designated.
- Further, an orientation detection marker may be disposed on the display unit and imaging means is disposed on the controller. According to this, the picture image of the orientation detection marker may be obtained with the imaging means pursuant to the orientation movement of the screen by the controller. According to the invention with the above features, the picture image of the orientation detection marker may be obtained with the imaging means pursuant to the orientation movement of the screen by the controller.
- Moreover, the orientation detection marker may be capable of being disposed on the screen of the display unit. According to this, there is an advantage in that the operational expression will be simplified since this will be the same surface as the screen. According to the invention with the above features, there is an advantage in that the operational expression will be simplified since this will be the same surface as the screen.
- In addition, the orientation detection marker contains a different type of orientation detection marker having a mode including axis information in which the other axes are mutually reverse with respect to one of the two biaxial directions, and these different types of orientation detection markers are respectively disposed in a prescribed position relationship with respect to the display unit. According to this, by employing the different types of orientation detection markers sharing the basic mode, processing for individually identifying the same types of markers to be used will no longer be necessary.
- According to the invention with the above features, by employing the different types of orientation detection markers sharing the basic mode, processing for individually identifying the same types of markers to be used will no longer be necessary.
- Further, the orientation of the controller is computed based on the position information within the screen with respect to the center of the picture image based on the image of the light source unit and the rotation angle information of the axis. According to this, the center of the picture image; that is, the intersecting point on the screen to which the controller is facing, may be computed from the position information and rotation angle information. According to the invention with the above features, the center of the picture image; that is, the intersecting point on the screen to which the controller is facing, may be computed from the position information and rotation angle information.
- Moreover, the computing means computes the visual line vector representing the direction of the screen of the imaging means based on the position information of the dotted light source, image of the light source unit within the picture image, and rotational angle information of the axis, and further computes the intersecting point of the visual line vector and the screen. According to this, the center of the picture image; that is, the intersecting point on the screen to which the controller is facing, may be computed from the position information and rotation angle information even with a simple structure.
- According to the invention with the above features, the center of the picture image; that is, the intersecting point on the screen to which the controller is facing, may be computed from the position information and rotation angle information even with a simple structure.
- The video game device according to the present invention comprises: the orientation detection device; image generation control means for generating game images containing at least a game character; image display means for displaying the generated game images on the screen of the display unit; and game progress control means for progressing the game by providing movement in accordance with prescribed game rules to the game character within the game space; wherein the game progress control means provides movement regarding the orientation of the controller to the game character based on the relationship between the orientation of the controller sough with the computing means and the display position on the screen of the display unit of the game character. According to this, it is possible to remotely provide a movement regarding the orientation of the controller to the game character based on the relationship between the direction of the controller and the display position of the game character on the screen of the display unit.
- According to the invention with the above features, it is possible to remotely provide a movement regarding the orientation of the controller to the game character based on the relationship between the direction of the controller and the display position of the game character on the screen of the display unit.
- This application is based on Japanese patent applications serial Nos. 2001-242819 and 2002-036791, filed in Japan Patent Office on Aug. 9, 2001 and Feb. 14, 2002, respectively, the contents of which are hereby incorporated by reference.
- Although the present invention has been fully described by way of example with reference to the accompanying drawings, it is to be understood that various changes and modifications will be apparent to those skilled in the art. Therefore, unless otherwise such changes and modifications depart from the scope of the present invention hereinafter defined, they should be construed as being included therein.
Claims (32)
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2001242819A JP3626711B2 (en) | 2001-08-09 | 2001-08-09 | Marker for directional position detection, directional position detection apparatus, and shooting game apparatus |
JP2001-242819 | 2001-08-09 | ||
JP2002-36791 | 2002-02-14 | ||
JP2002036791A JP3470119B2 (en) | 2002-02-14 | 2002-02-14 | Controller, controller attitude telemetry device, and video game device |
Publications (2)
Publication Number | Publication Date |
---|---|
US20030032478A1 true US20030032478A1 (en) | 2003-02-13 |
US7084888B2 US7084888B2 (en) | 2006-08-01 |
Family
ID=26620313
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/213,248 Expired - Lifetime US7084888B2 (en) | 2001-08-09 | 2002-08-05 | Orientation detection marker, orientation detection device and video game device |
Country Status (2)
Country | Link |
---|---|
US (1) | US7084888B2 (en) |
EP (1) | EP1287864A3 (en) |
Cited By (102)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040029636A1 (en) * | 2002-08-06 | 2004-02-12 | William Wells | Gaming device having a three dimensional display device |
US20040053688A1 (en) * | 2002-06-28 | 2004-03-18 | Toshiyuki Hosaka | Display method, display apparatus for game machine, and game machine |
US20040266528A1 (en) * | 2003-06-27 | 2004-12-30 | Xiaoling Wang | Apparatus and a method for more realistic video games on computers or similar devices using visible or invisible light and a light sensing device |
US20050153775A1 (en) * | 2004-01-12 | 2005-07-14 | Griswold Chauncey W. | Multiple-state display for a gaming apparatus |
US20050255900A1 (en) * | 2004-05-10 | 2005-11-17 | Nintendo Co., Ltd. | Storage medium storing game program and game apparatus |
US20050272506A1 (en) * | 2004-03-31 | 2005-12-08 | Masayuki Sumi | Image generation device, image display method and program product |
US20070004513A1 (en) * | 2002-08-06 | 2007-01-04 | Igt | Gaming machine with layered displays |
US20070010325A1 (en) * | 2005-07-06 | 2007-01-11 | Yu Suzuki | Video game control program and video game device |
US20070072665A1 (en) * | 2001-09-28 | 2007-03-29 | Igt, A Nevada Corporation | Methods, Apparatuses And Systems for Multilayer Gaming |
US20070155469A1 (en) * | 2003-10-20 | 2007-07-05 | Sam Johnson | Automatic funding of paragames on electronic gaming platform |
US20070207856A1 (en) * | 2006-03-06 | 2007-09-06 | Nintendo Co., Ltd. | Recording medium recording game program, and game system |
US20070218994A1 (en) * | 2006-03-14 | 2007-09-20 | Sony Computer Entertainment Inc. | Game Controller |
US20070218993A1 (en) * | 2004-09-22 | 2007-09-20 | Konami Digital Entertainment Co., Ltd. | Game Machine, Game Machine Control Method, Information Recording Medium, and Program |
US20070243934A1 (en) * | 2006-04-13 | 2007-10-18 | Igt | Remote content management and resource sharing on a gaming machine and method of implementing same |
US20070243928A1 (en) * | 2006-04-13 | 2007-10-18 | Igt | Casino gaming incentives using game themes, game types, paytables, denominations |
US20070293313A1 (en) * | 2004-05-10 | 2007-12-20 | Toru Shimizu | Electronic Game Machine, Data Processing Method in Electronic Game Machine, Program and Storage Medium for the Same |
WO2008010906A2 (en) | 2006-06-30 | 2008-01-24 | Microsoft Corporation | Generating position information using a video camera |
US20080064497A1 (en) * | 2004-01-12 | 2008-03-13 | Igt | Method and apparatus for using a light valve to reduce the visibility of an object within a gaming apparatus |
US20080113747A1 (en) * | 2006-11-13 | 2008-05-15 | Igt | Mechanical reel hardware simulation using multiple layer displays |
US20080113775A1 (en) * | 2006-11-13 | 2008-05-15 | Igt | Three-dimensional paylines for gaming machines |
US20080113745A1 (en) * | 2006-11-13 | 2008-05-15 | Igt | Separable game graphics on a gaming machine |
US20080113746A1 (en) * | 2006-11-13 | 2008-05-15 | Igt | Realistic video reels |
US20080113748A1 (en) * | 2006-11-13 | 2008-05-15 | Igt | Simulated reel imperfections |
US20080113756A1 (en) * | 2006-11-13 | 2008-05-15 | Igt | Presentation of wheels on gaming machines having multi-layer displays |
US20080125219A1 (en) * | 2006-04-13 | 2008-05-29 | Igt | Multi-layer display 3D server based portals |
US20080136741A1 (en) * | 2006-11-13 | 2008-06-12 | Igt | Single plane spanning mode across independently driven displays |
US20090036208A1 (en) * | 2002-08-06 | 2009-02-05 | Igt | Reel and video combination machine |
US20090061984A1 (en) * | 2007-08-31 | 2009-03-05 | Igt | Reel symbol resizing for reel based gaming machines |
US20090079667A1 (en) * | 2007-09-20 | 2009-03-26 | Igt | Auto-blanking screen for devices having multi-layer displays |
US20090082083A1 (en) * | 2007-09-21 | 2009-03-26 | Igt | Reel blur for gaming machines having simulated rotating reels |
US20090088249A1 (en) * | 2007-06-14 | 2009-04-02 | Robert Kay | Systems and methods for altering a video game experience based on a controller type |
US20090096768A1 (en) * | 2007-10-10 | 2009-04-16 | Masakazu Ohira | Display system and method for detecting pointed position |
US20090098943A1 (en) * | 2006-11-10 | 2009-04-16 | Igt | Gaming Machine with Externally Controlled Content Display |
US20090104954A1 (en) * | 2006-04-13 | 2009-04-23 | Igt | Methods and systems for tracking an event of an externally controlled interface |
US20090104989A1 (en) * | 2007-10-23 | 2009-04-23 | Igt | Separable backlighting system |
US20090111578A1 (en) * | 2004-11-05 | 2009-04-30 | Igt | Single source visual image display distribution on a gaming machine |
US20090111577A1 (en) * | 2007-10-29 | 2009-04-30 | Igt | Gaming system having display device with changeable wheel |
US20090124383A1 (en) * | 2007-11-09 | 2009-05-14 | Igt | Apparatus for use with interactive table games and methods of use |
US20090156303A1 (en) * | 2006-11-10 | 2009-06-18 | Igt | Bonusing Architectures in a Gaming Environment |
WO2009133412A1 (en) * | 2008-05-02 | 2009-11-05 | University Of Teesside | Computer input device |
US20090310027A1 (en) * | 2008-06-16 | 2009-12-17 | James Fleming | Systems and methods for separate audio and video lag calibration in a video game |
US20090325686A1 (en) * | 2006-12-19 | 2009-12-31 | Igt | Distributed Side Wagering Methods and Systems |
US20100029386A1 (en) * | 2007-06-14 | 2010-02-04 | Harmonix Music Systems, Inc. | Systems and methods for asynchronous band interaction in a rhythm action game |
US20100105454A1 (en) * | 2006-04-13 | 2010-04-29 | Igt | Methods and systems for interfacing with a third-party application |
US20100105453A1 (en) * | 2004-06-17 | 2010-04-29 | Fabrice Madigou | Game system with variable action controls |
US20100304812A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems , Inc. | Displaying song lyrics and vocal cues |
US20100304863A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Biasing a musical performance input to a part |
US20110197263A1 (en) * | 2010-02-11 | 2011-08-11 | Verizon Patent And Licensing, Inc. | Systems and methods for providing a spatial-input-based multi-user shared display experience |
US20120129603A1 (en) * | 2010-11-19 | 2012-05-24 | Song Byung-Youn | Game controller, game machine, and game system using the game controller |
US8298081B1 (en) | 2011-06-16 | 2012-10-30 | Igt | Gaming system, gaming device and method for providing multiple display event indicators |
US20120313974A1 (en) * | 2010-02-24 | 2012-12-13 | Kyocera Corporation | Mobile electronic device, image projecting method and projection system |
US8360847B2 (en) | 2006-11-13 | 2013-01-29 | Igt | Multimedia emulation of physical reel hardware in processor-based gaming machines |
US20130082926A1 (en) * | 2007-01-31 | 2013-04-04 | Pixart Imaging Inc. | Image display |
US8425316B2 (en) | 2010-08-03 | 2013-04-23 | Igt | Methods and systems for improving play of a bonus game on a gaming machine and improving security within a gaming establishment |
US8444464B2 (en) | 2010-06-11 | 2013-05-21 | Harmonix Music Systems, Inc. | Prompting a player of a dance game |
US8550908B2 (en) | 2010-03-16 | 2013-10-08 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US8593402B2 (en) | 2010-04-30 | 2013-11-26 | Verizon Patent And Licensing Inc. | Spatial-input-based cursor projection systems and methods |
US8605114B2 (en) | 2012-02-17 | 2013-12-10 | Igt | Gaming system having reduced appearance of parallax artifacts on display devices including multiple display screens |
US8663013B2 (en) | 2008-07-08 | 2014-03-04 | Harmonix Music Systems, Inc. | Systems and methods for simulating a rock band experience |
US8686269B2 (en) | 2006-03-29 | 2014-04-01 | Harmonix Music Systems, Inc. | Providing realistic interaction to a player of a music-based video game |
US8702485B2 (en) | 2010-06-11 | 2014-04-22 | Harmonix Music Systems, Inc. | Dance game and tutorial |
US8777737B2 (en) | 2006-04-13 | 2014-07-15 | Igt | Method and apparatus for integrating remotely-hosted and locally rendered content on a gaming device |
US8957856B2 (en) | 2010-10-21 | 2015-02-17 | Verizon Patent And Licensing Inc. | Systems, methods, and apparatuses for spatial input associated with a display |
US20150087416A1 (en) * | 2012-05-08 | 2015-03-26 | Capcom Co., Ltd. | Game program, game apparatus and game system |
US9024166B2 (en) | 2010-09-09 | 2015-05-05 | Harmonix Music Systems, Inc. | Preventing subtractive track separation |
US9028329B2 (en) | 2006-04-13 | 2015-05-12 | Igt | Integrating remotely-hosted and locally rendered content on a gaming device |
US9129469B2 (en) | 2012-09-11 | 2015-09-08 | Igt | Player driven game download to a gaming machine |
US20150273334A1 (en) * | 2014-03-31 | 2015-10-01 | Bandai Namco Games Inc. | Game device and information storage medium |
US9167289B2 (en) | 2010-09-02 | 2015-10-20 | Verizon Patent And Licensing Inc. | Perspective display systems and methods |
US9358456B1 (en) | 2010-06-11 | 2016-06-07 | Harmonix Music Systems, Inc. | Dance competition game |
US9401065B2 (en) | 2011-09-30 | 2016-07-26 | Igt | System and method for remote rendering of content on an electronic gaming machine |
US9564004B2 (en) | 2003-10-20 | 2017-02-07 | Igt | Closed-loop system for providing additional event participation to electronic video game customers |
US9566500B2 (en) | 2013-07-22 | 2017-02-14 | Igt | Gaming table system permitting play of a shared player hand by multiple players |
US9595159B2 (en) | 2013-10-01 | 2017-03-14 | Igt | System and method for multi-game, multi-play of live dealer games |
US20170080976A1 (en) * | 2015-09-21 | 2017-03-23 | Hyundai Motor Company | Parking guidance apparatus and method of vehicle |
US9613491B2 (en) | 2004-12-16 | 2017-04-04 | Igt | Video gaming device having a system and method for completing wagers and purchases during the cash out process |
US9659433B2 (en) | 2005-01-24 | 2017-05-23 | Igt | System and method for providing remote wagering games in a live table game system |
US9666024B2 (en) | 2013-09-03 | 2017-05-30 | Igt | Remote live table gaming terminals and systems |
US20170168556A1 (en) * | 2015-12-11 | 2017-06-15 | Disney Enterprises, Inc. | Launching virtual objects using a rail device |
US9710995B2 (en) | 2005-01-24 | 2017-07-18 | Igt | Methods and systems for playing Sic Bo jackpot |
US9824536B2 (en) | 2011-09-30 | 2017-11-21 | Igt | Gaming system, gaming device and method for utilizing mobile devices at a gaming establishment |
US20180017362A1 (en) * | 2016-07-12 | 2018-01-18 | Paul Rahmanian | Target carrier with virtual targets |
US9916735B2 (en) | 2015-07-22 | 2018-03-13 | Igt | Remote gaming cash voucher printing system |
US9940777B2 (en) | 2005-01-24 | 2018-04-10 | Igt | Betting terminal and system |
US9940778B2 (en) | 2005-01-24 | 2018-04-10 | Igt | System for monitoring and playing a plurality of live casino table games |
US9958934B1 (en) * | 2006-05-01 | 2018-05-01 | Jeffrey D. Mullen | Home and portable augmented reality and virtual reality video game consoles |
US9981193B2 (en) | 2009-10-27 | 2018-05-29 | Harmonix Music Systems, Inc. | Movement based recognition and evaluation |
US10026255B2 (en) | 2006-04-13 | 2018-07-17 | Igt | Presentation of remotely-hosted and locally rendered content for gaming systems |
US10055930B2 (en) | 2015-08-11 | 2018-08-21 | Igt | Gaming system and method for placing and redeeming sports bets |
US10147279B2 (en) | 2005-08-05 | 2018-12-04 | Igt | Methods and systems for playing baccarat jackpot with an option for insurance betting |
US10198893B2 (en) | 2005-01-24 | 2019-02-05 | Igt | Methods and systems for playing baccarat jackpot |
US10198898B2 (en) | 2005-01-24 | 2019-02-05 | Igt | Gaming center allowing switching between games based upon historical results |
CN109806595A (en) * | 2019-02-22 | 2019-05-28 | 网易(杭州)网络有限公司 | Labeling method, device, storage medium, processor and the terminal in orientation |
US10357714B2 (en) | 2009-10-27 | 2019-07-23 | Harmonix Music Systems, Inc. | Gesture-based user interface for navigating a menu |
CN110460794A (en) * | 2019-09-09 | 2019-11-15 | 北京西山居互动娱乐科技有限公司 | A kind of method and device of video record |
US10681337B2 (en) * | 2017-04-14 | 2020-06-09 | Fujitsu Limited | Method, apparatus, and non-transitory computer-readable storage medium for view point selection assistance in free viewpoint video generation |
US10702763B2 (en) | 2005-01-24 | 2020-07-07 | Igt | Methods and systems for playing baccarat jackpot |
US20210102781A1 (en) * | 2018-03-26 | 2021-04-08 | Korea Military Academy R&Db Foundation | Point-of-impact analysis apparatus for improving accuracy of ballistic trajectory and point of impact by applying shooting environment of real personal firearm to virtual reality, and virtual shooting training simulation using same |
WO2021178330A1 (en) * | 2020-03-02 | 2021-09-10 | Universal City Studios Llc | Handheld object characteristic assessment system and method |
US20210286986A1 (en) * | 2020-03-11 | 2021-09-16 | Universal City Studios Llc | Orientation tag for providing orientation information |
WO2022192493A1 (en) * | 2021-03-10 | 2022-09-15 | Bungie, Inc. | Markup free ledge grab |
CN116585710A (en) * | 2023-07-19 | 2023-08-15 | 深圳市微克科技有限公司 | Marble control method and system based on intelligent wearable device and readable storage medium |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060105842A1 (en) * | 2002-07-25 | 2006-05-18 | Yong-Hwan Kim | Shooting game machine and method for performing it |
JP3762750B2 (en) * | 2003-01-07 | 2006-04-05 | コナミ株式会社 | Image display control program |
JP4179162B2 (en) | 2003-12-26 | 2008-11-12 | 株式会社セガ | Information processing device, game device, image generation method, and game image generation method |
US7248270B1 (en) * | 2004-01-22 | 2007-07-24 | Pacific Data Images Llc | Stroke-based posing of three-dimensional models |
GB2425356B (en) * | 2005-04-20 | 2010-01-06 | Richard Bruce Welch | Sports game apparatus and method |
JP4485991B2 (en) * | 2005-05-13 | 2010-06-23 | 株式会社ソニー・コンピュータエンタテインメント | Image processing apparatus, image processing method, and program |
JP4794957B2 (en) * | 2005-09-14 | 2011-10-19 | 任天堂株式会社 | GAME PROGRAM, GAME DEVICE, GAME SYSTEM, AND GAME PROCESSING METHOD |
JP4684147B2 (en) * | 2006-03-28 | 2011-05-18 | 任天堂株式会社 | Inclination calculation device, inclination calculation program, game device, and game program |
JP2008073184A (en) * | 2006-09-20 | 2008-04-03 | Namco Bandai Games Inc | Program, information storage medium and game device |
JP4171039B2 (en) * | 2006-12-22 | 2008-10-22 | 株式会社コナミデジタルエンタテインメント | GAME DEVICE, GAME DEVICE CONTROL METHOD, AND PROGRAM |
US20080188277A1 (en) * | 2007-02-01 | 2008-08-07 | Ritter Janice E | Electronic Game Device And Method Of Using The Same |
JP5251202B2 (en) * | 2008-03-27 | 2013-07-31 | セイコーエプソン株式会社 | Distortion correction method for projected image of projector and projector |
EP2325725A4 (en) * | 2008-06-24 | 2012-04-18 | Oleg Stanilasvovich Rurin | Method for producing an effect on virtual objects |
US20100311512A1 (en) * | 2009-06-04 | 2010-12-09 | Timothy James Lock | Simulator with enhanced depth perception |
US8647198B2 (en) * | 2009-09-10 | 2014-02-11 | Nintendo Co., Ltd. | Image display system, illumination system, information processing device, and storage medium having control program stored therein |
US8532675B1 (en) | 2012-06-27 | 2013-09-10 | Blackberry Limited | Mobile communication device user interface for manipulation of data items in a physical space |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4910503A (en) * | 1987-06-15 | 1990-03-20 | Brodsky Stephen L | Multi-function input device and system |
US5366229A (en) * | 1992-05-22 | 1994-11-22 | Namco Ltd. | Shooting game machine |
US5616078A (en) * | 1993-12-28 | 1997-04-01 | Konami Co., Ltd. | Motion-controlled video entertainment system |
US5936619A (en) * | 1992-09-11 | 1999-08-10 | Canon Kabushiki Kaisha | Information processor |
US5995112A (en) * | 1997-06-19 | 1999-11-30 | Vlsi Technology, Inc. | Color signature detection of objects on a computer display |
US6110039A (en) * | 1995-02-21 | 2000-08-29 | Konami Co., Ltd. | Shooting game machine |
US6670952B2 (en) * | 1998-08-24 | 2003-12-30 | Intertact Corporation | Circuit control devices utilizing electronic display screen light |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3422383B2 (en) | 1994-09-05 | 2003-06-30 | 株式会社タイトー | Method and apparatus for detecting relative position between video screen and gun in shooting game machine |
JPH10165642A (en) | 1996-12-13 | 1998-06-23 | Konami Co Ltd | Dummy gun for shooting game machine |
TW357101B (en) | 1996-12-17 | 1999-05-01 | Konami Co Ltd | Shooting video game machine and shooting result presentation method |
US6146278A (en) | 1997-01-10 | 2000-11-14 | Konami Co., Ltd. | Shooting video game machine |
IL120186A (en) | 1997-02-09 | 2000-06-01 | Raviv Roni | Display pointing device and method |
JPH11305935A (en) | 1998-04-24 | 1999-11-05 | Image Tec Kk | Position detection system |
JP2000189671A (en) | 1998-12-28 | 2000-07-11 | Namco Ltd | Shooting game device |
JP3413127B2 (en) | 1999-06-11 | 2003-06-03 | キヤノン株式会社 | Mixed reality device and mixed reality presentation method |
JP2001009154A (en) | 1999-06-30 | 2001-01-16 | Namco Ltd | Shooting game device |
JP2001062149A (en) | 1999-08-26 | 2001-03-13 | Namco Ltd | Spotlight position detection system, and simulator |
JP3515721B2 (en) | 1999-12-28 | 2004-04-05 | 松下電器産業株式会社 | Interference signal elimination apparatus and interference signal elimination method |
JP3374175B2 (en) | 2000-01-27 | 2003-02-04 | 名古屋大学長 | Data transmission device with data transmission function for position display |
JP2002306846A (en) | 2001-04-12 | 2002-10-22 | Saibuaasu:Kk | Controller for game machine |
-
2002
- 2002-08-05 US US10/213,248 patent/US7084888B2/en not_active Expired - Lifetime
- 2002-08-07 EP EP02017810A patent/EP1287864A3/en not_active Withdrawn
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4910503A (en) * | 1987-06-15 | 1990-03-20 | Brodsky Stephen L | Multi-function input device and system |
US5366229A (en) * | 1992-05-22 | 1994-11-22 | Namco Ltd. | Shooting game machine |
US5936619A (en) * | 1992-09-11 | 1999-08-10 | Canon Kabushiki Kaisha | Information processor |
US5616078A (en) * | 1993-12-28 | 1997-04-01 | Konami Co., Ltd. | Motion-controlled video entertainment system |
US6110039A (en) * | 1995-02-21 | 2000-08-29 | Konami Co., Ltd. | Shooting game machine |
US5995112A (en) * | 1997-06-19 | 1999-11-30 | Vlsi Technology, Inc. | Color signature detection of objects on a computer display |
US6670952B2 (en) * | 1998-08-24 | 2003-12-30 | Intertact Corporation | Circuit control devices utilizing electronic display screen light |
Cited By (199)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070072665A1 (en) * | 2001-09-28 | 2007-03-29 | Igt, A Nevada Corporation | Methods, Apparatuses And Systems for Multilayer Gaming |
US20040053688A1 (en) * | 2002-06-28 | 2004-03-18 | Toshiyuki Hosaka | Display method, display apparatus for game machine, and game machine |
US7381135B2 (en) * | 2002-06-28 | 2008-06-03 | Seiko Epson Corporation | Display method, display apparatus for game machine, and game machine |
US7841944B2 (en) * | 2002-08-06 | 2010-11-30 | Igt | Gaming device having a three dimensional display device |
US8715058B2 (en) | 2002-08-06 | 2014-05-06 | Igt | Reel and video combination machine |
US20090036208A1 (en) * | 2002-08-06 | 2009-02-05 | Igt | Reel and video combination machine |
US20080020840A1 (en) * | 2002-08-06 | 2008-01-24 | Igt | Gaming machine with layered displays |
US20070004513A1 (en) * | 2002-08-06 | 2007-01-04 | Igt | Gaming machine with layered displays |
US20040029636A1 (en) * | 2002-08-06 | 2004-02-12 | William Wells | Gaming device having a three dimensional display device |
US20080020841A1 (en) * | 2002-08-06 | 2008-01-24 | Igt | Gaming machine with layered displays |
US7951001B2 (en) | 2002-08-06 | 2011-05-31 | Igt | Gaming device having a three dimensional display device |
US20050255908A1 (en) * | 2002-08-06 | 2005-11-17 | William Wells | Gaming device having a three dimensional display device |
US20040266528A1 (en) * | 2003-06-27 | 2004-12-30 | Xiaoling Wang | Apparatus and a method for more realistic video games on computers or similar devices using visible or invisible light and a light sensing device |
US9564004B2 (en) | 2003-10-20 | 2017-02-07 | Igt | Closed-loop system for providing additional event participation to electronic video game customers |
US20070155469A1 (en) * | 2003-10-20 | 2007-07-05 | Sam Johnson | Automatic funding of paragames on electronic gaming platform |
US20080064497A1 (en) * | 2004-01-12 | 2008-03-13 | Igt | Method and apparatus for using a light valve to reduce the visibility of an object within a gaming apparatus |
US20050153775A1 (en) * | 2004-01-12 | 2005-07-14 | Griswold Chauncey W. | Multiple-state display for a gaming apparatus |
US8118670B2 (en) | 2004-01-12 | 2012-02-21 | Igt | Method and apparatus for using a light valve to reduce the visibility of an object within a gaming apparatus |
US20080020816A1 (en) * | 2004-01-12 | 2008-01-24 | Igt | Multiple-state display for a gaming apparatus |
US7722465B2 (en) * | 2004-03-31 | 2010-05-25 | Kabushiki Kaisha Sega | Image generation device, image display method and program product |
US20050272506A1 (en) * | 2004-03-31 | 2005-12-08 | Masayuki Sumi | Image generation device, image display method and program product |
US20070293313A1 (en) * | 2004-05-10 | 2007-12-20 | Toru Shimizu | Electronic Game Machine, Data Processing Method in Electronic Game Machine, Program and Storage Medium for the Same |
US7850525B2 (en) * | 2004-05-10 | 2010-12-14 | Sega Corporation | Mechanism of generating a sound radar image in a video game device |
US8123600B2 (en) * | 2004-05-10 | 2012-02-28 | Nintendo Co., Ltd. | Storage medium storing game program and game apparatus |
US20050255900A1 (en) * | 2004-05-10 | 2005-11-17 | Nintendo Co., Ltd. | Storage medium storing game program and game apparatus |
US20100105453A1 (en) * | 2004-06-17 | 2010-04-29 | Fabrice Madigou | Game system with variable action controls |
US8128497B2 (en) * | 2004-09-22 | 2012-03-06 | Konami Digital Entertainment Co., Ltd. | Game machine, game machine control method, information recording medium, and program |
US20070218993A1 (en) * | 2004-09-22 | 2007-09-20 | Konami Digital Entertainment Co., Ltd. | Game Machine, Game Machine Control Method, Information Recording Medium, and Program |
US20090111578A1 (en) * | 2004-11-05 | 2009-04-30 | Igt | Single source visual image display distribution on a gaming machine |
US8303407B2 (en) | 2004-11-05 | 2012-11-06 | Igt | Single source visual image display distribution on a gaming machine |
US9613491B2 (en) | 2004-12-16 | 2017-04-04 | Igt | Video gaming device having a system and method for completing wagers and purchases during the cash out process |
US10275984B2 (en) | 2004-12-16 | 2019-04-30 | Igt | Video gaming device having a system and method for completing wagers |
US10198893B2 (en) | 2005-01-24 | 2019-02-05 | Igt | Methods and systems for playing baccarat jackpot |
US10198898B2 (en) | 2005-01-24 | 2019-02-05 | Igt | Gaming center allowing switching between games based upon historical results |
US9710995B2 (en) | 2005-01-24 | 2017-07-18 | Igt | Methods and systems for playing Sic Bo jackpot |
US10702763B2 (en) | 2005-01-24 | 2020-07-07 | Igt | Methods and systems for playing baccarat jackpot |
US10013848B2 (en) | 2005-01-24 | 2018-07-03 | Igt | System and method for providing remote wagering games in a live table game system |
US9659433B2 (en) | 2005-01-24 | 2017-05-23 | Igt | System and method for providing remote wagering games in a live table game system |
US10204475B2 (en) | 2005-01-24 | 2019-02-12 | Igt | Methods and systems for playing for a jackpot |
US9940778B2 (en) | 2005-01-24 | 2018-04-10 | Igt | System for monitoring and playing a plurality of live casino table games |
US9940777B2 (en) | 2005-01-24 | 2018-04-10 | Igt | Betting terminal and system |
US10467848B2 (en) | 2005-01-24 | 2019-11-05 | Igt | System for monitoring and playing a plurality of live casino table games |
US7713126B2 (en) * | 2005-07-06 | 2010-05-11 | Sega Corporation | Video game control program and video game device |
US20070010325A1 (en) * | 2005-07-06 | 2007-01-11 | Yu Suzuki | Video game control program and video game device |
US10147279B2 (en) | 2005-08-05 | 2018-12-04 | Igt | Methods and systems for playing baccarat jackpot with an option for insurance betting |
US8038531B2 (en) * | 2006-03-06 | 2011-10-18 | Nintendo Co., Ltd. | Recording medium recording game program, and game system |
US20070207856A1 (en) * | 2006-03-06 | 2007-09-06 | Nintendo Co., Ltd. | Recording medium recording game program, and game system |
US8613665B2 (en) | 2006-03-14 | 2013-12-24 | Sony Corporation | Game controller |
US20070218994A1 (en) * | 2006-03-14 | 2007-09-20 | Sony Computer Entertainment Inc. | Game Controller |
US8292737B2 (en) | 2006-03-14 | 2012-10-23 | Sony Computer Entertainment Inc. | Entertainment system |
US20100062854A1 (en) * | 2006-03-14 | 2010-03-11 | Sony Computer Entertainment Inc. | Entertainment System |
US9084934B2 (en) | 2006-03-14 | 2015-07-21 | Sony Corporation | Game controller with pulse width modulation position detection |
US9566507B2 (en) | 2006-03-14 | 2017-02-14 | Sony Corporation | Game controller using a plurality of light-emitting elements |
US8686269B2 (en) | 2006-03-29 | 2014-04-01 | Harmonix Music Systems, Inc. | Providing realistic interaction to a player of a music-based video game |
US9028329B2 (en) | 2006-04-13 | 2015-05-12 | Igt | Integrating remotely-hosted and locally rendered content on a gaming device |
US8777737B2 (en) | 2006-04-13 | 2014-07-15 | Igt | Method and apparatus for integrating remotely-hosted and locally rendered content on a gaming device |
US9959702B2 (en) | 2006-04-13 | 2018-05-01 | Igt | Remote content management and resource sharing on a gaming machine and method of implementing same |
US20100105454A1 (en) * | 2006-04-13 | 2010-04-29 | Igt | Methods and systems for interfacing with a third-party application |
US10026255B2 (en) | 2006-04-13 | 2018-07-17 | Igt | Presentation of remotely-hosted and locally rendered content for gaming systems |
US8512139B2 (en) | 2006-04-13 | 2013-08-20 | Igt | Multi-layer display 3D server based portals |
US10607437B2 (en) | 2006-04-13 | 2020-03-31 | Igt | Remote content management and resource sharing on a gaming machine and method of implementing same |
US10497204B2 (en) | 2006-04-13 | 2019-12-03 | Igt | Methods and systems for tracking an event of an externally controlled interface |
US8992304B2 (en) | 2006-04-13 | 2015-03-31 | Igt | Methods and systems for tracking an event of an externally controlled interface |
US8968077B2 (en) | 2006-04-13 | 2015-03-03 | Idt | Methods and systems for interfacing with a third-party application |
US20090104954A1 (en) * | 2006-04-13 | 2009-04-23 | Igt | Methods and systems for tracking an event of an externally controlled interface |
US8784196B2 (en) | 2006-04-13 | 2014-07-22 | Igt | Remote content management and resource sharing on a gaming machine and method of implementing same |
US10169950B2 (en) | 2006-04-13 | 2019-01-01 | Igt | Remote content management and resource sharing on a gaming machine and method of implementing same |
US20070243928A1 (en) * | 2006-04-13 | 2007-10-18 | Igt | Casino gaming incentives using game themes, game types, paytables, denominations |
US20070243934A1 (en) * | 2006-04-13 | 2007-10-18 | Igt | Remote content management and resource sharing on a gaming machine and method of implementing same |
US9685034B2 (en) | 2006-04-13 | 2017-06-20 | Igt | Methods and systems for interfacing with a third-party application |
US9881453B2 (en) | 2006-04-13 | 2018-01-30 | Igt | Integrating remotely-hosted and locally rendered content on a gaming device |
US9342955B2 (en) | 2006-04-13 | 2016-05-17 | Igt | Methods and systems for tracking an event of an externally controlled interface |
US10706660B2 (en) | 2006-04-13 | 2020-07-07 | Igt | Presentation of remotely-hosted and locally rendered content for gaming systems |
US20080125219A1 (en) * | 2006-04-13 | 2008-05-29 | Igt | Multi-layer display 3D server based portals |
US9958934B1 (en) * | 2006-05-01 | 2018-05-01 | Jeffrey D. Mullen | Home and portable augmented reality and virtual reality video game consoles |
US10838485B2 (en) | 2006-05-01 | 2020-11-17 | Jeffrey D. Mullen | Home and portable augmented reality and virtual reality game consoles |
EP3550406A1 (en) * | 2006-06-30 | 2019-10-09 | Microsoft Technology Licensing, LLC | Generating position information using a video camera |
WO2008010906A2 (en) | 2006-06-30 | 2008-01-24 | Microsoft Corporation | Generating position information using a video camera |
EP2038733A4 (en) * | 2006-06-30 | 2016-03-09 | Microsoft Technology Licensing Llc | Generating position information using a video camera |
US20090156303A1 (en) * | 2006-11-10 | 2009-06-18 | Igt | Bonusing Architectures in a Gaming Environment |
US11087592B2 (en) | 2006-11-10 | 2021-08-10 | Igt | Gaming machine with externally controlled content display |
US10152846B2 (en) | 2006-11-10 | 2018-12-11 | Igt | Bonusing architectures in a gaming environment |
US9311774B2 (en) | 2006-11-10 | 2016-04-12 | Igt | Gaming machine with externally controlled content display |
US20090098943A1 (en) * | 2006-11-10 | 2009-04-16 | Igt | Gaming Machine with Externally Controlled Content Display |
US10229556B2 (en) | 2006-11-10 | 2019-03-12 | Igt | Gaming machine with externally controlled content display |
US8210922B2 (en) | 2006-11-13 | 2012-07-03 | Igt | Separable game graphics on a gaming machine |
US8199068B2 (en) | 2006-11-13 | 2012-06-12 | Igt | Single plane spanning mode across independently driven displays |
US20080136741A1 (en) * | 2006-11-13 | 2008-06-12 | Igt | Single plane spanning mode across independently driven displays |
US8142273B2 (en) | 2006-11-13 | 2012-03-27 | Igt | Presentation of wheels on gaming machines having multi-layer displays |
US20080113747A1 (en) * | 2006-11-13 | 2008-05-15 | Igt | Mechanical reel hardware simulation using multiple layer displays |
US8727855B2 (en) | 2006-11-13 | 2014-05-20 | Igt | Three-dimensional paylines for gaming machines |
US20080113775A1 (en) * | 2006-11-13 | 2008-05-15 | Igt | Three-dimensional paylines for gaming machines |
US8360847B2 (en) | 2006-11-13 | 2013-01-29 | Igt | Multimedia emulation of physical reel hardware in processor-based gaming machines |
US20080113745A1 (en) * | 2006-11-13 | 2008-05-15 | Igt | Separable game graphics on a gaming machine |
US20080113746A1 (en) * | 2006-11-13 | 2008-05-15 | Igt | Realistic video reels |
US8357033B2 (en) | 2006-11-13 | 2013-01-22 | Igt | Realistic video reels |
US20080113748A1 (en) * | 2006-11-13 | 2008-05-15 | Igt | Simulated reel imperfections |
US8192281B2 (en) | 2006-11-13 | 2012-06-05 | Igt | Simulated reel imperfections |
US20080113756A1 (en) * | 2006-11-13 | 2008-05-15 | Igt | Presentation of wheels on gaming machines having multi-layer displays |
US20090325686A1 (en) * | 2006-12-19 | 2009-12-31 | Igt | Distributed Side Wagering Methods and Systems |
US9292996B2 (en) | 2006-12-19 | 2016-03-22 | Igt | Distributed side wagering methods and systems |
US9972169B2 (en) | 2006-12-19 | 2018-05-15 | Igt | Distributed side wagering methods and systems |
US11514753B2 (en) | 2006-12-19 | 2022-11-29 | Igt | Distributed side wagering methods and systems |
US20130082926A1 (en) * | 2007-01-31 | 2013-04-04 | Pixart Imaging Inc. | Image display |
US20090088249A1 (en) * | 2007-06-14 | 2009-04-02 | Robert Kay | Systems and methods for altering a video game experience based on a controller type |
US8678895B2 (en) | 2007-06-14 | 2014-03-25 | Harmonix Music Systems, Inc. | Systems and methods for online band matching in a rhythm action game |
US8690670B2 (en) | 2007-06-14 | 2014-04-08 | Harmonix Music Systems, Inc. | Systems and methods for simulating a rock band experience |
US8678896B2 (en) | 2007-06-14 | 2014-03-25 | Harmonix Music Systems, Inc. | Systems and methods for asynchronous band interaction in a rhythm action game |
US8439733B2 (en) | 2007-06-14 | 2013-05-14 | Harmonix Music Systems, Inc. | Systems and methods for reinstating a player within a rhythm-action game |
US20090104956A1 (en) * | 2007-06-14 | 2009-04-23 | Robert Kay | Systems and methods for simulating a rock band experience |
US20090098918A1 (en) * | 2007-06-14 | 2009-04-16 | Daniel Charles Teasdale | Systems and methods for online band matching in a rhythm action game |
US20100029386A1 (en) * | 2007-06-14 | 2010-02-04 | Harmonix Music Systems, Inc. | Systems and methods for asynchronous band interaction in a rhythm action game |
US8444486B2 (en) | 2007-06-14 | 2013-05-21 | Harmonix Music Systems, Inc. | Systems and methods for indicating input actions in a rhythm-action game |
US20100041477A1 (en) * | 2007-06-14 | 2010-02-18 | Harmonix Music Systems, Inc. | Systems and Methods for Indicating Input Actions in a Rhythm-Action Game |
US8616953B2 (en) | 2007-08-31 | 2013-12-31 | Igt | Reel symbol resizing for reel based gaming machines |
US20090061984A1 (en) * | 2007-08-31 | 2009-03-05 | Igt | Reel symbol resizing for reel based gaming machines |
US8115700B2 (en) | 2007-09-20 | 2012-02-14 | Igt | Auto-blanking screen for devices having multi-layer displays |
US20090079667A1 (en) * | 2007-09-20 | 2009-03-26 | Igt | Auto-blanking screen for devices having multi-layer displays |
US8348746B2 (en) | 2007-09-21 | 2013-01-08 | Igt | Reel blur for gaming machines having simulated rotating reels |
US20090082083A1 (en) * | 2007-09-21 | 2009-03-26 | Igt | Reel blur for gaming machines having simulated rotating reels |
US8012010B2 (en) | 2007-09-21 | 2011-09-06 | Igt | Reel blur for gaming machines having simulated rotating reels |
US20090096768A1 (en) * | 2007-10-10 | 2009-04-16 | Masakazu Ohira | Display system and method for detecting pointed position |
US8154513B2 (en) | 2007-10-10 | 2012-04-10 | Sharp Kabushiki Kaisha | Display system and method for detecting pointed position |
US20090104989A1 (en) * | 2007-10-23 | 2009-04-23 | Igt | Separable backlighting system |
US8758144B2 (en) | 2007-10-23 | 2014-06-24 | Igt | Separable backlighting system |
US8210944B2 (en) | 2007-10-29 | 2012-07-03 | Igt | Gaming system having display device with changeable wheel |
US8460098B2 (en) | 2007-10-29 | 2013-06-11 | Igt | Gaming system having display device with changeable wheel |
US20090111577A1 (en) * | 2007-10-29 | 2009-04-30 | Igt | Gaming system having display device with changeable wheel |
US20090124383A1 (en) * | 2007-11-09 | 2009-05-14 | Igt | Apparatus for use with interactive table games and methods of use |
US20110043446A1 (en) * | 2008-05-02 | 2011-02-24 | University Of Teesside | Computer input device |
WO2009133412A1 (en) * | 2008-05-02 | 2009-11-05 | University Of Teesside | Computer input device |
US20090310027A1 (en) * | 2008-06-16 | 2009-12-17 | James Fleming | Systems and methods for separate audio and video lag calibration in a video game |
US8663013B2 (en) | 2008-07-08 | 2014-03-04 | Harmonix Music Systems, Inc. | Systems and methods for simulating a rock band experience |
US8449360B2 (en) | 2009-05-29 | 2013-05-28 | Harmonix Music Systems, Inc. | Displaying song lyrics and vocal cues |
US20100304812A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems , Inc. | Displaying song lyrics and vocal cues |
US20100304863A1 (en) * | 2009-05-29 | 2010-12-02 | Harmonix Music Systems, Inc. | Biasing a musical performance input to a part |
US8465366B2 (en) | 2009-05-29 | 2013-06-18 | Harmonix Music Systems, Inc. | Biasing a musical performance input to a part |
US10357714B2 (en) | 2009-10-27 | 2019-07-23 | Harmonix Music Systems, Inc. | Gesture-based user interface for navigating a menu |
US9981193B2 (en) | 2009-10-27 | 2018-05-29 | Harmonix Music Systems, Inc. | Movement based recognition and evaluation |
US10421013B2 (en) | 2009-10-27 | 2019-09-24 | Harmonix Music Systems, Inc. | Gesture-based user interface |
US8522308B2 (en) | 2010-02-11 | 2013-08-27 | Verizon Patent And Licensing Inc. | Systems and methods for providing a spatial-input-based multi-user shared display experience |
US20110197263A1 (en) * | 2010-02-11 | 2011-08-11 | Verizon Patent And Licensing, Inc. | Systems and methods for providing a spatial-input-based multi-user shared display experience |
US9319502B2 (en) * | 2010-02-24 | 2016-04-19 | Kyocera Corporation | Mobile electronic device, image projecting method and projection system |
US20120313974A1 (en) * | 2010-02-24 | 2012-12-13 | Kyocera Corporation | Mobile electronic device, image projecting method and projection system |
US8874243B2 (en) | 2010-03-16 | 2014-10-28 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US8550908B2 (en) | 2010-03-16 | 2013-10-08 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US8568234B2 (en) | 2010-03-16 | 2013-10-29 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US8636572B2 (en) | 2010-03-16 | 2014-01-28 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US9278286B2 (en) | 2010-03-16 | 2016-03-08 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US8593402B2 (en) | 2010-04-30 | 2013-11-26 | Verizon Patent And Licensing Inc. | Spatial-input-based cursor projection systems and methods |
US8702485B2 (en) | 2010-06-11 | 2014-04-22 | Harmonix Music Systems, Inc. | Dance game and tutorial |
US9358456B1 (en) | 2010-06-11 | 2016-06-07 | Harmonix Music Systems, Inc. | Dance competition game |
US8444464B2 (en) | 2010-06-11 | 2013-05-21 | Harmonix Music Systems, Inc. | Prompting a player of a dance game |
US8562403B2 (en) | 2010-06-11 | 2013-10-22 | Harmonix Music Systems, Inc. | Prompting a player of a dance game |
US8425316B2 (en) | 2010-08-03 | 2013-04-23 | Igt | Methods and systems for improving play of a bonus game on a gaming machine and improving security within a gaming establishment |
US9167289B2 (en) | 2010-09-02 | 2015-10-20 | Verizon Patent And Licensing Inc. | Perspective display systems and methods |
US9024166B2 (en) | 2010-09-09 | 2015-05-05 | Harmonix Music Systems, Inc. | Preventing subtractive track separation |
US8957856B2 (en) | 2010-10-21 | 2015-02-17 | Verizon Patent And Licensing Inc. | Systems, methods, and apparatuses for spatial input associated with a display |
US8409018B2 (en) * | 2010-11-19 | 2013-04-02 | Toshiba Samsung Storage Technology Korea Corporation | Game controller and method for harvesting user energy expended while playing a game |
US20120129603A1 (en) * | 2010-11-19 | 2012-05-24 | Song Byung-Youn | Game controller, game machine, and game system using the game controller |
US8298081B1 (en) | 2011-06-16 | 2012-10-30 | Igt | Gaming system, gaming device and method for providing multiple display event indicators |
US10515513B2 (en) | 2011-09-30 | 2019-12-24 | Igt | Gaming system, gaming device and method for utilizing mobile devices at a gaming establishment |
US9824536B2 (en) | 2011-09-30 | 2017-11-21 | Igt | Gaming system, gaming device and method for utilizing mobile devices at a gaming establishment |
US10204481B2 (en) | 2011-09-30 | 2019-02-12 | Igt | System and method for remote rendering of content on an electronic gaming machine |
US9466173B2 (en) | 2011-09-30 | 2016-10-11 | Igt | System and method for remote rendering of content on an electronic gaming machine |
US9401065B2 (en) | 2011-09-30 | 2016-07-26 | Igt | System and method for remote rendering of content on an electronic gaming machine |
US8605114B2 (en) | 2012-02-17 | 2013-12-10 | Igt | Gaming system having reduced appearance of parallax artifacts on display devices including multiple display screens |
US8749582B2 (en) | 2012-02-17 | 2014-06-10 | Igt | Gaming system having reduced appearance of parallax artifacts on display devices including multiple display screens |
US20150087416A1 (en) * | 2012-05-08 | 2015-03-26 | Capcom Co., Ltd. | Game program, game apparatus and game system |
US9569921B2 (en) | 2012-09-11 | 2017-02-14 | Igt | Player driven game download to a gaming machine |
US9129469B2 (en) | 2012-09-11 | 2015-09-08 | Igt | Player driven game download to a gaming machine |
US10629025B2 (en) | 2013-07-22 | 2020-04-21 | Igt | Gaming table system permitting play of a shared player hand by multiple players |
US10438439B2 (en) | 2013-07-22 | 2019-10-08 | Igt | Gaming table system permitting play of a shared player hand by multiple players |
US9566500B2 (en) | 2013-07-22 | 2017-02-14 | Igt | Gaming table system permitting play of a shared player hand by multiple players |
US9666024B2 (en) | 2013-09-03 | 2017-05-30 | Igt | Remote live table gaming terminals and systems |
US10497207B2 (en) | 2013-09-03 | 2019-12-03 | Igt | Remote live table gaming terminals and systems |
US9595159B2 (en) | 2013-10-01 | 2017-03-14 | Igt | System and method for multi-game, multi-play of live dealer games |
US9734658B2 (en) | 2013-10-01 | 2017-08-15 | Igt | System and method for multi-game, multi-play of live dealer games |
US9962613B2 (en) * | 2014-03-31 | 2018-05-08 | Bandai Namco Entertainment Inc. | Game device and information storage medium |
US20150273334A1 (en) * | 2014-03-31 | 2015-10-01 | Bandai Namco Games Inc. | Game device and information storage medium |
US9916735B2 (en) | 2015-07-22 | 2018-03-13 | Igt | Remote gaming cash voucher printing system |
US11769365B2 (en) | 2015-08-11 | 2023-09-26 | Igt | Gaming system and method for placing and redeeming sports bets |
US10055930B2 (en) | 2015-08-11 | 2018-08-21 | Igt | Gaming system and method for placing and redeeming sports bets |
US20170080976A1 (en) * | 2015-09-21 | 2017-03-23 | Hyundai Motor Company | Parking guidance apparatus and method of vehicle |
US9950742B2 (en) * | 2015-09-21 | 2018-04-24 | Hyundai Motor Company | Parking guidance apparatus and method of vehicle |
US9904357B2 (en) * | 2015-12-11 | 2018-02-27 | Disney Enterprises, Inc. | Launching virtual objects using a rail device |
US20170168556A1 (en) * | 2015-12-11 | 2017-06-15 | Disney Enterprises, Inc. | Launching virtual objects using a rail device |
US10048043B2 (en) * | 2016-07-12 | 2018-08-14 | Paul Rahmanian | Target carrier with virtual targets |
US20180017362A1 (en) * | 2016-07-12 | 2018-01-18 | Paul Rahmanian | Target carrier with virtual targets |
US10681337B2 (en) * | 2017-04-14 | 2020-06-09 | Fujitsu Limited | Method, apparatus, and non-transitory computer-readable storage medium for view point selection assistance in free viewpoint video generation |
US20210102781A1 (en) * | 2018-03-26 | 2021-04-08 | Korea Military Academy R&Db Foundation | Point-of-impact analysis apparatus for improving accuracy of ballistic trajectory and point of impact by applying shooting environment of real personal firearm to virtual reality, and virtual shooting training simulation using same |
CN109806595A (en) * | 2019-02-22 | 2019-05-28 | 网易(杭州)网络有限公司 | Labeling method, device, storage medium, processor and the terminal in orientation |
CN110460794A (en) * | 2019-09-09 | 2019-11-15 | 北京西山居互动娱乐科技有限公司 | A kind of method and device of video record |
US11311805B2 (en) * | 2020-03-02 | 2022-04-26 | Universal City Studios Llc | Handheld object characteristic assessment system and method |
WO2021178330A1 (en) * | 2020-03-02 | 2021-09-10 | Universal City Studios Llc | Handheld object characteristic assessment system and method |
US20210286986A1 (en) * | 2020-03-11 | 2021-09-16 | Universal City Studios Llc | Orientation tag for providing orientation information |
US11538265B2 (en) * | 2020-03-11 | 2022-12-27 | Universal City Studios Llc | Orientation tag for providing orientation information |
WO2022192493A1 (en) * | 2021-03-10 | 2022-09-15 | Bungie, Inc. | Markup free ledge grab |
CN116585710A (en) * | 2023-07-19 | 2023-08-15 | 深圳市微克科技有限公司 | Marble control method and system based on intelligent wearable device and readable storage medium |
Also Published As
Publication number | Publication date |
---|---|
US7084888B2 (en) | 2006-08-01 |
EP1287864A2 (en) | 2003-03-05 |
EP1287864A3 (en) | 2003-04-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7084888B2 (en) | Orientation detection marker, orientation detection device and video game device | |
JP3470119B2 (en) | Controller, controller attitude telemetry device, and video game device | |
JP3626711B2 (en) | Marker for directional position detection, directional position detection apparatus, and shooting game apparatus | |
CA2647956C (en) | Sports simulation system | |
US10099144B2 (en) | Sports simulation system | |
US9381398B2 (en) | Sports simulation system | |
US6929548B2 (en) | Apparatus and a method for more realistic shooting video games on computers or similar devices | |
US20040063481A1 (en) | Apparatus and a method for more realistic interactive video games on computers or similar devices using visible or invisible light and an input computing device | |
JP2002292123A (en) | Game device, game method, game program, and game system | |
KR102513743B1 (en) | Immersive and Responsive Gameplay Range, Systems, and Methods | |
TW201941807A (en) | Device for putting guide, virtual golf simulation apparatus using the same and control method of the same | |
US20120083340A1 (en) | Storage medium, game apparatus, game system and game controlling method | |
JPH08229238A (en) | Three-dimensional shooting game machine | |
US20220370884A1 (en) | Multiplayer, multisport indoor game system and method | |
JP3068487B2 (en) | Shooting video game equipment | |
AU2020334148A1 (en) | Multiplayer, multisport indoor game system and method | |
JP3828920B2 (en) | Baseball pitching system | |
JP3994014B2 (en) | game machine | |
JP3577065B2 (en) | Controller, controller attitude telemetry device, and video game device | |
JP2002331165A (en) | Marker color change device for game machine, and infomration storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: KONAMI CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TAKAHAMA, HAJIME;HONDA, HIROKI;REEL/FRAME:013188/0249 Effective date: 20020730 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: KONAMI DIGITAL ENTERTAINMENT CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KONAMI CORPORATION (ALSO KNOWN AS KONAMI CO., LTD.);REEL/FRAME:021861/0372 Effective date: 20081024 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553) Year of fee payment: 12 |