JP4900914B2 - Program, information storage medium, and image generation system - Google Patents

Description

  The present invention relates to a program, an information storage medium, and an image generation system.

  Conventionally, a game in a field called a gun game that enjoys shooting a target object on a screen using a gun-type controller (a shooting device in a broad sense, and a pointing device in a broader sense) has gained popularity. In this gun game, when the player (operator) pulls the trigger of the gun-type controller, the shot landing position (indicated position in a broad sense) is optically determined using a camera (imaging means) built in the gun-type controller. Detected. Then, when the target (target) object exists at the detected landing position, it is determined that it is a hit, and when there is no target object, it is determined that it is off. By playing such a gun game, the player can virtually experience shooting in the real world.

  In such a gun game, two infrared light spots, which are invisible light, are projected at predetermined positions in the game screen, and these are photographed by infrared imaging means built in the gun-type controller. In this case, the landing position is detected based on the positions of two infrared light spots included in.

  As a conventional technique for detecting such a landing position, for example, there is one described in Japanese Patent Application Laid-Open No. 8-226793.

  However, in such a conventional technique, if there is another noise light source that emits infrared light around the display screen, or if the noise light source is reflected on the display unit, it will hinder the detection of the landing position. There was a problem.

In particular, when such a gun game is performed indoors, a blinking light source or pseudo-vibration light source that blinks at a predetermined cycle, such as a fluorescent lamp or various lighting fixtures, serves as the noise light source, which hinders detection of the landing position.
JP-A-8-226793

  The present invention has been made in view of such a problem, and an object of the present invention is to provide at least one of a blinking light source and a pseudo-vibration light source as a noise light source that hinders the specification of the indicated position on the display unit by the pointing device. Even in such a case, an object of the present invention is to provide an image generation system, a program, and an information storage medium capable of generating an image for a game that appropriately reflects an indicated position by detecting the noise light source in the game process.

(1) The present invention is an image generation system for generating an image for a game,
In order to specify the indicated position on the display unit by a pointing device having an imaging unit capable of imaging using a light source that emits invisible light as a light spot, the position of the light spot included in the captured image captured by the imaging unit is An identifier position detector that detects the positions of a plurality of identifiers that emit invisible light and are associated with the display unit;
An indicated position specifying unit that performs a position specifying process for specifying an indicated position of the pointing device on the display unit based on the detected positions of the plurality of identifiers;
And generating a game image reflecting the specified indicated position,
The identifier position detection unit
By identifying at least one of a blinking light source and a pseudo-vibration light source as a noise light source from among the light spots included in the captured image, the light sources of the plurality of identification bodies are identified from the light spots included in the captured image. The present invention relates to an image generation system including an identification body light source identification unit that performs identification body light source identification processing.

  The present invention also relates to a program that causes a computer to function as each of the above-described units. The present invention also relates to a computer-readable information storage medium that stores (records) a program that causes a computer to function as each unit.

The present invention also provides an image generation system for generating an image for a game,
In order to specify the indicated position on the display unit by the pointing device having an imaging unit capable of imaging the electromagnetic wave generation source, the electromagnetic wave generation source is associated with the display unit from the position of the electromagnetic wave generation source included in the captured image captured by the imaging unit. A discriminator position detector for detecting the positions of a plurality of discriminators that emit the arranged electromagnetic waves;
An indicated position specifying unit that performs a position specifying process for specifying an indicated position of the pointing device on the display unit based on the detected positions of the plurality of identifiers;
And generating a game image reflecting the specified indicated position,
The identifier position detection unit
By identifying at least one of the blinking electromagnetic wave generation source and the pseudo vibration electromagnetic wave generation source from among the electromagnetic wave generation sources included in the captured image as a noise source, the plurality of identifications among the electromagnetic wave generation sources included in the captured image The present invention relates to an image generation system including an identification object specifying unit that performs identification object specifying processing for specifying an electromagnetic wave generation source of a body.

  The present invention also relates to a program that causes a computer to function as each of the above-described units. The present invention also relates to a computer-readable information storage medium that stores (records) a program that causes a computer to function as each unit.

  Here, the plurality of identifiers that emit invisible light may be displayed so as to be included in the screen displayed on the display unit, or may be configured to be arranged outside the display unit.

  As the plurality of identification bodies that emit invisible light, for example, a light source that emits infrared light may be used as the identification body. Further, instead of the plurality of identification bodies that emit invisible light, a plurality of identification bodies that emit electromagnetic waves may be used.

  The present invention makes it possible to designate a desired position of a display unit on which a game screen is displayed using a pointing device. At this time, the specified position is specified based on the captured image data output from the imaging means capable of capturing the invisible light provided in the pointing device. When a plurality of identification bodies that emit electromagnetic waves are used, an imaging unit that can capture an electromagnetic wave generation source corresponds to an imaging unit that can capture invisible light.

  The discriminator position detection unit detects the positions of the plurality of discriminators as the positions of light spots of a light source that emits invisible light included in the captured image. Since the plurality of identifiers are arranged in association with the display unit, the pointing position specifying unit determines the pointing position of the pointing device on the display unit from the detected positions of the plurality of identifiers by the position specifying process. It is possible to specify, and it is possible to generate an image for a game reflecting the specified support position. In addition, when using a plurality of identification bodies that emit electromagnetic waves, the positions of the plurality of identification bodies that emit electromagnetic waves arranged in association with the display unit are detected from the positions of the electromagnetic wave generation sources included in the captured image, and detection is performed. The pointing position of the pointing device on the display unit is specified by the position specifying process from the positions of the plurality of discriminators.

  Here, when a noise light source is present in addition to the light source of the identifier, the light source of the identifier and the noise light source are included as light spots in the captured image captured by the imaging unit. The indicated position cannot be detected accurately. Therefore, in the present invention, even when a noise light source exists in addition to the light sources of the plurality of identification objects, the identification object position detection unit identifies the light sources of the plurality of identification objects from the light spots included in the captured image. Possible discriminator light source identification part. Further, when using a plurality of discriminating bodies that emit electromagnetic waves, even if the discriminating body specifying unit corresponding to the discriminating body light source specifying unit includes a noise source in addition to the electromagnetic wave generation sources of the plurality of discriminating bodies, the captured image The identification body specifying process for specifying the electromagnetic wave generation sources of the plurality of identification bodies from among the electromagnetic wave generation sources included in is performed.

  Specifically, the discriminator light source specifying unit specifies at least one of the blinking light source and the pseudo vibration light source as a noise light source from the light spots included in the captured image, and is specified as the flashing light source and the pseudo vibration light source. A discriminator light source specifying process for specifying a light spot other than the light spot as a light source of a plurality of discriminators is performed. In addition, when using a plurality of identification bodies that emit electromagnetic waves, the blinking electromagnetic wave generation source corresponds to the blinking light source, the pseudo vibration electromagnetic wave generation source corresponds to the pseudo vibration light source, and the electromagnetic wave generation source included in the captured image Identification object specifying process for specifying the electromagnetic wave generation sources of the plurality of identification objects from among the electromagnetic wave generation sources included in the captured image by specifying at least one of the blinking electromagnetic wave generation source and the pseudo vibration electromagnetic wave generation source as a noise source Corresponds to the identification object light source identification process.

  In the present invention, the blinking light source refers to a light source that blinks at a predetermined cycle, such as a fluorescent lamp or neon.

  In the present invention, the pseudo-vibration light source has the same blinking cycle, but when there is a set of blinking light sources having different blinking timings, when one light source emits light, the other light source emits light. When one light source does not emit light, the other light source emits light. Therefore, the light source is recognized as if the one light source is moving between the blinking light sources at high speed in accordance with the light emission timing of the blinking light source. .

  Thus, according to the present invention, even if there are a blinking light source and a pseudo vibration light source that hinder the specification of the pointing position using the pointing device, it can be specified as a noise light source. As a result, the light sources of a plurality of discriminating bodies can be detected from the light spots included in the captured image, and the pointing position on the display unit by the pointing device is specified based on the detected positions of the discriminating bodies. It is possible to generate and display a game image reflecting the designated position.

  In particular, according to the present invention, even when a game is played in an environment where a flashing light source and a pseudo-vibration light source exist as a plurality of noise light sources in the surroundings, it is favorable without being affected by these noise light sources. It is possible to prepare a simple game execution environment and enjoy the game.

  In addition, since it is possible to prevent the noise light source from being mistakenly recognized as the light source of the discriminating body, the noise light source is identified even when the pointing device is swung and the imaging unit is imaging the noise light source instead of the discriminating body. It is possible to prevent the erroneous indication position from being displayed on the display unit by being erroneously recognized as the light source of the body.

  In the present invention, the noise light source is a light source that emits noise light itself, a light source that reflects and emits noise light from other light sources, noise light from other light sources reflected on the display unit, and other noise light. This means a wide range of noise sources, including self-luminous types and reflected light types, such as parts that emit light.

(2) In the program, information storage medium, and image generation system of the present invention,
The identifier light source specifying unit is
A configuration may be adopted in which the captured image is acquired a plurality of times within one frame from the imaging unit, and the identification body light source specifying process is performed.

  According to the present invention, the discriminator light source specifying unit blinks at a period similar to or shorter than the frame period in order to acquire a captured image a plurality of times in one frame from an imaging unit, for example, a CCD camera. And it becomes possible to acquire the captured image which can discriminate | determine the pseudo-oscillation light source and the light source of an identification body.

  In addition, the discriminator light source specifying unit performs the discriminator light source specifying process every time the captured image is acquired from the image pickup means, and therefore discriminates the blinking light source, the pseudo vibration light source, and the light source of the discriminator with higher accuracy. Is possible.

  Examples of the blinking light source that blinks at a period similar to the frame period include a fluorescent lamp that uses a commercial power source (supplied at 50 Hz to 60 Hz) as a power source. In general, the fluorescent lamps are often arranged side by side, and if the light emission timings of the respective fluorescent lamps are different, they also serve as a pseudo vibration light source.

  In the present embodiment, the imaging means is set to acquire a captured image about 4 to 5 times in one frame. In general, a fluorescent lamp blinks at 50 Hz to 60 Hz. If a captured image is acquired about 4 to 5 times in one frame, there is a captured image in which the blinking light source of the fluorescent lamp is included in the image as a light spot. There is also a captured image in which the blinking light source is not included in the image as a light spot.

  Therefore, it is possible to specify the blinking light source from the presence or absence of blinking of the light spot obtained from each acquired captured image data, and it is possible to determine the blinking light source and the light source of the identifier. The discriminator light source specifying unit can derive the correspondence of the light spot for each captured image by tracking the light spot position of each captured image.

  In addition, the pseudo-vibration light source can be identified from the presence or absence of blinking of the light spot obtained from each acquired captured image data, the movement mode, and the like, and the pseudo-oscillation light source and the light source of the identifier can be discriminated.

  As described above, it is possible to improve the accuracy of discriminating between the blinking light source, the pseudo vibration light source, and the light source of the identification object by determining the acquisition timing and the number of times of the captured image in consideration of the blinking cycle of the flashing light source and the pseudo vibration light source. It becomes possible.

(3) In the program, information storage medium, and image generation system of the present invention,
The identifier light source specifying unit is
Each time the captured image is acquired from the imaging means, a survival time calculating unit for obtaining a light spot survival time of a light spot included in the captured image,
In the identifier light source specifying process,
A configuration is adopted in which the light source of the plurality of discriminators is specified from among the light spots included in the captured image by specifying a light spot whose light spot lifetime has not reached a predetermined time as the blinking light source. It may be.

  In the present invention, the blinking light source is a light source that repeats blinking at a predetermined cycle, and therefore is not displayed as a light spot in the captured image when no light is emitted. Therefore, the blinking light source cannot be displayed as the same light spot in the captured image for a predetermined time or longer.

  Due to the characteristics of this blinking light source, in the present invention, the light spot whose light spot lifetime has not reached the predetermined time is identified as the blinking light source, so that the plurality of identifiers can be selected from the light spots included in the captured image. The light source can be specified.

(4) In the program, information storage medium, and image generation system of the present invention,
The identifier light source specifying unit is
Each time the captured image is acquired from the imaging means, an acceleration change amount calculation unit that calculates the change amount of the acceleration of the light spot included in the captured image,
In the identifier light source specifying process,
The light source of the plurality of discriminators is specified from the light spots included in the captured image by specifying a light spot having a high number of times that the acceleration change amount of the light spot exceeds a threshold as the pseudo-vibration light source. You may make it employ | adopt a structure.

  In the present invention, the pseudo-vibration light source is a light source that is recognized as one light source moving at a high speed between the blinking light sources in accordance with the light emission timing of the blinking light source. The number of rapid changes increases.

  Due to the characteristics of the pseudo-vibration light source, in the present invention, a light spot having a high number of times the amount of change in acceleration of the light spot exceeds a threshold is specified as the pseudo-vibration light source, so that among the light spots included in the captured image. The light sources of the plurality of identifiers can be specified.

(5) In the program, information storage medium, and image generation system of the present invention,
The acceleration change amount calculation unit
A light spot information history unit that records information including at least the position of the light spot included in the captured image as light spot information each time the captured image is acquired from the imaging unit;
You may make it employ | adopt the structure which calculates | requires the variation | change_quantity of the acceleration of the said light spot based on the log | history of the said light spot information.

  Thereby, the change amount of the acceleration of the light spot in the imaging time unit can be obtained from the historical position information of the light spot.

(6) In the program, information storage medium, and image generation system of the present invention,
The light spot information history part is
A configuration may be adopted in which the light spot information stored in the light spot history buffer is updated every time the captured image is acquired from the imaging means.

(7) In the program, information storage medium, and image generation system of the present invention,
The identifier position detection unit
You may make it employ | adopt the structure which detects the position of the said several identification body installed in the exterior of the said display part from the position of the said light spot contained in the said captured image.

(8) In the program, information storage medium, and image generation system of the present invention,
The pointing device is formed as a shooting device;
The indicated position specifying unit
You may make it employ | adopt the structure which makes the said indication position the aiming position of a shooting device.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. Hereinafter, a case where the present invention is applied to a gun game (shooting game) using a gun-type controller will be described as an example. However, the present invention is not limited to this and can be applied to various games. Further, the present embodiment described below does not unduly limit the contents of the present invention described in the claims. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Configuration FIG. 1 shows an example in which the present embodiment is applied to a home game system.

  The game system according to the embodiment includes a home game machine 2 and a gun-type game controller 10 simulating a television 4 and a gun (shooting device in a broad sense, and pointing device in the broader sense as well). Including.

  The home game machine 2 is set with an information storage medium 180 in which an image generation program and a shooting game program using the program are stored, and a game calculation for the shooting game is performed using the program or the like. The game screen is generated and displayed on the display unit 190 of the television 4.

  The player uses the gun-type controller 10 and pulls the trigger 14 aiming at a target object displayed on the game screen of the display unit 190.

  Then, an image in the barrel direction is picked up by a camera (image pickup means) built in the gun-type controller 10, and the indicated position 30 of the gun-type controller 10 is detected based on the picked-up image data. This designated position 30 represents the aiming position of the gun-type controller 10 in the present embodiment.

Then, when the designated position 30 detected at the timing when the player pulls the trigger 14 matches the display position of the target object displayed on the screen, it is determined to be hit, and when it does not match, it is determined to be off. .

  In the present embodiment, a plurality of discriminators 8a and 8b are detachably attached to the outside of the display unit 190, and a pair of discriminators are located at positions to be pointed across the center position of the display unit 190. 8a and 8b are attached. Each of these identifiers 8a and 8b may be formed so as to be identifiable by a camera built in the controller. In the present embodiment, a light source that emits infrared light that is invisible light is used as the identifiers 8a and 8b. Use.

  Here, the discriminators 8 a and 8 b are arranged such that the intermediate point thereof coincides with the central portion of the display unit 190.

  This makes it possible to detect the positions of the identification bodies 8a and 8b as the positions of the light spots of the light source that emits invisible light included in the captured image of the CCD camera 18 incorporated in the controller 10, and both detected identifications. An intermediate position between the bodies 8a and 8b is specified as the center position of the display unit 190. Therefore, by specifying the position of each identifier 8a, 8b as the position of the light spot included in the captured image, the indicated position 30 on the display unit 190 indicated by the gun-type controller 10 can be specified.

  FIG. 2 shows a block diagram of the image generation system (game system, position detection system) of the present embodiment. Note that the image generation system of this embodiment may have a configuration in which some of the components (each unit) in FIG. 2 are omitted.

  The gun-type controller 10 includes a pointing device 12 (casing) formed to resemble the shape of a gun, a trigger 14 provided at a grip portion of the pointing device 12, and a lens 16 built in the vicinity of the muzzle of the pointing device 12. (Optical system) and a CCD camera 18.

  The CCD camera 18 is configured by arranging CCD sensor elements capable of detecting invisible light emitted from the discriminators 8a and 8b in a matrix, and in this embodiment, sufficient light in the infrared region is provided. CCD sensor elements that can be detected with sensitivity are arranged in a matrix.

  The CCD camera 18 is installed so that the normal line at the center of the light receiving surface faces the muzzle direction of the pointing device, and images in the muzzle direction are displayed at a predetermined cycle, preferably a 1/300 second cycle (one frame). It can be obtained in about 5 times.

  The gun-type controller 10 includes a processing unit 20 that controls the entire controller, and a communication unit 22 that functions as an interface with the consumer game machine.

  The main device 90 of the consumer game machine 2 includes a processing unit 100, a storage unit 170, and a communication unit 196. Further, the display unit 190 and the sound output unit 192 are connected to the main device 90. ing.

  In this embodiment, the display unit 190 and the sound output unit 192 are integrally provided as the television 4 shown in FIG.

  The processing unit 100 functions as a game calculation unit 110, an image generation unit 120, and a sound generation unit 130.

The game calculation unit 110 is configured to perform game processing, image generation processing, and the like based on programs and data stored in the information storage medium 180 and communication information (captured image information, trigger operation information, etc.) with the gun-type controller 10. Alternatively, various processes such as a sound generation process are performed. In this case, the processing unit 100 performs various processes using the storage unit 170 as a work area.

  The processing performed by the game calculation unit 110 includes various mode setting processing, game progress processing, selection screen setting processing, position and rotation angle of an object (one or a plurality of primitives) (rotation angle around X, Y, or Z axes) ) Processing for moving objects (motion processing), processing for controlling virtual cameras (processing for determining the position and rotation angle of virtual cameras), processing for placing objects such as maps and buildings in the object space, hit check There are processing, processing for calculating game results (results, results), processing for a plurality of players to play in a common game space, or game over processing.

  The storage unit 170 serves as a work area of the processing unit 100, and its function can be realized by a RAM (VRAM) or the like.

  The information storage medium 180 (computer-readable medium) stores programs, data, and the like, and functions as an optical disk (CD, DVD), hard disk, memory card, memory cassette, magnetic disk, or memory ( ROM) or the like. The processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, the information storage medium 180 stores a program for causing a computer to function as each unit of the present embodiment (a program for causing a computer to execute processing of each unit).

  The display unit 190 outputs an image generated according to this embodiment, and its function can be realized by a television, a CRT, or the like.

  The sound output unit 192 outputs the sound generated by the present embodiment, and its function can be realized by a speaker, headphones, or the like.

  Note that a program (data) for causing a computer to function as each unit of this embodiment is distributed from the information storage medium of the host device (server) to the information storage medium 180 (storage unit 170) via the network and communication unit 196. May be. Use of the information storage medium of such a host device (server) can also be included in the scope of the present invention.

  The game calculation unit 110 functions as an identification body position detection unit 112 and an indicated position specification unit 114.

  The identification object position detection unit 112 performs processing of reading captured image data for game processing from the CCD camera 18 at a cycle of 1 frame (1/60), for example, and writing it into the captured image memory 176 of the storage unit 170. The captured image data stored in the captured image memory 176 is sequentially updated each time captured image data is output from the CCD camera 18.

  In the present embodiment, a CCD camera 18 having high sensitivity in the infrared region is used. For example, as shown in FIG. 3, the pair of identification bodies 8a and 8b are displayed as light spots La and Lb in the captured image. The

  Then, the identification object position detection unit 112 detects the positions of the identification objects 8 a and 8 b from the positions of the light spots La and Lb included in the captured image of the CCD camera 18.

  In the present embodiment, the identification object position detection unit 112 specifies the light source of each of the identification objects 8a and 8b from these light sources even when there is a noise light source in addition to the light sources of the identification objects 8a and 8b. The discriminator light source specifying unit 116 is included.

  The identifier light source specifying unit 116 specifies at least one of the blinking light source and the pseudo-vibration light source as a noise light source from among the light spots included in the captured image, thereby identifying each identifier from the light spots included in the captured image. The identification body light source specifying process for specifying the light sources 8a and 8b is performed.

  The discriminator light source specifying unit 116 reads captured image data for specifying the light source of the discriminator from the CCD camera 18 a plurality of times in one frame, and performs discriminator light source specifying processing each time. In the present embodiment, the captured image data read by the identifying object light source specifying unit 116 is also stored in the captured image memory 176 of the storage unit 170, but the captured image read by the identifying object position detecting unit 112. You may make it memorize | store data and the picked-up image data which the identification body light source specific | specification part 116 reads in a separate memory (memory | storage part).

  In the present embodiment, since the identification body light source specifying unit 116 reads the captured image from the CCD camera 18 at a 1/300 second period (about 5 times in one frame), for example, Captured image data capable of discriminating between the blinking light source, the pseudo-vibration light source, and the light source of the discriminating body blinking at a shorter cycle can be acquired.

  The identifier light source specifying unit 116 includes a lifetime calculation unit 116a that specifies a blinking light source from the captured image data and an acceleration change amount calculation unit 116b that specifies a pseudo-flashing light source from the captured image data.

  In the present embodiment, the blinking light source is a light source that repeats blinking at a predetermined cycle, and therefore is not displayed as a light spot in the captured image when no light is emitted. Therefore, the blinking light source cannot be displayed as the same light spot in the captured image for a predetermined time or longer.

  Due to the characteristics of the blinking light source, the lifetime calculation unit 116a identifies the light spot whose light spot survival time has not reached the predetermined time as the blinking light source, so that the plurality of light spots included in the captured image are selected. Identify the light source of the identifier.

  In the present embodiment, the pseudo-vibration light source is a light source that is recognized as if one light source is moving between a plurality of blinking light sources at a high speed in accordance with the light emission timing of the blinking light source. In comparison with, the number of times the acceleration changes rapidly increases.

  Based on the characteristics of the pseudo-vibration light source, the acceleration change amount calculation unit 116b identifies a light spot having a high number of times the amount of change in the acceleration of the light spot exceeds a threshold value as the pseudo-vibration light source, thereby being included in the captured image. The light sources of the plurality of identifiers are specified from the light spots.

  Further, the acceleration change amount calculation unit 116b includes a light spot information history unit 117 that records information including at least the position of the light spot included in the captured image as light spot information.

  The light spot information history unit 117 performs a process of writing the light spot information to the light spot information storage unit 178 of the storage unit 170 every time the discriminator light source specifying unit 116 acquires captured image data. Updated.

  Thereby, the change amount of the acceleration of the light spot in the imaging time unit can be obtained based on the history of the light spot information including the position information.

  The designated position specifying unit 114 performs position specifying processing based on the light spots La and Lb included in the captured image. When the designated position 30 is identified, for example, a given specific object indicating the designated position 30 such as a cursor is displayed on the screen as a calculation process for generating an image reflecting the identified designated position. To perform the process.

  The image generation unit 120 performs image processing based on the results of various processes performed by the processing unit 100, generates a game image, and outputs the game image to the display unit 190. For example, when generating an image of a so-called three-dimensional game, first, geometric processing such as coordinate transformation, clipping processing, perspective transformation, or light source calculation is performed. Based on the processing result, drawing data (primitive surface Position coordinates, texture coordinates, color (brightness) data, normal vectors, α values, etc.) given to the vertices (composition points) are created. Based on the drawing data (primitive surface data), the image of the object (one or a plurality of primitive surfaces) after the geometry processing can be stored as image data in units of pixels such as a drawing buffer 172 (frame buffer, work buffer, etc.). ) Is drawn. Thereby, an image that can be seen from the virtual camera (given viewpoint) in the object space is generated. Note that the image generated according to the present embodiment and displayed on the display unit 190 may be a three-dimensional image or a two-dimensional image.

  The image generation unit 120 performs processing for mapping a texture (texel value) stored in the texture storage unit 174 to an object. Specifically, the texture (surface properties such as color and α value) is read from the texture storage unit 174 using the texture coordinates set (given) at the vertices of the object (primitive surface). Then, a texture that is a two-dimensional image or pattern is mapped to the object. In this case, processing for associating pixels and texels, bilinear interpolation (texel interpolation), and the like are performed.

  The sound generation unit 130 performs sound processing based on the results of various processes performed by the processing unit 100, generates game sounds such as BGM, sound effects, and sounds, and outputs them to the sound output unit 192 (speaker). .

  In addition, the image generation system according to the present embodiment may be a system dedicated to the single player mode in which only one player can play, or not only the single player mode but also a multiplayer mode in which a plurality of players can play. The system may also be provided.

  Further, when a plurality of players play, game images and game sounds to be provided to the plurality of players may be generated using one terminal, or connected via a network (transmission line, communication line) or the like. Alternatively, it may be generated using a plurality of terminals (game machine, mobile phone).

2. Method of this embodiment 2-1: Association between identification object position and indication position on display unit A plurality of identification objects 8a and 8b are installed outside the display unit 190 on which a game screen is displayed prior to the start of the game. In the present embodiment, as shown in FIG. 1, two identifiers 8 a and 8 b are arranged above and below the display unit 190 so as to be point-symmetric with respect to the center of the display unit 190.

  Accordingly, the center position of the line connecting the two identifiers 8a and 8b matches the center position of the display unit 190. In this embodiment, the case where two identifiers 8a and 8b are arranged around the display unit 190 will be described as an example. However, if necessary, three or more identifiers may be arranged around the display unit 190. May be.

  As described above, each of the identification bodies 8a and 8b is formed as a light source that emits infrared light that is invisible light. When the gun-type controller 10 is directed toward the display unit 190, each identification is performed as shown in FIG. Light spots La and Lb corresponding to the bodies 8a and 8b are included in the captured image.

  In the game system of the present embodiment, the initial setting screen 50 shown in FIG. 4A is displayed on the display unit 190 in order to match the barrel direction of the gun-type controller 10 with the indicated position on the display unit 190. .

  On this initial setting screen 50, a message A1 “initializing aiming” and a message A2 “move the marker to the reference position and pull the trigger” are displayed.

  Further, light spots La and Lb corresponding to the respective identification bodies 8a and 8b are displayed in the captured image 52 as markers Ma and Mb.

  In the captured image 52, target markers Ta and Tb representing the reference positions of the markers Ma and Mb are also displayed at point-symmetric positions with the center point in between.

  Then, the player adjusts the direction of the gun-type controller 10 so that the markers Ma and Mb overlap the target markers Ta and Tb according to the message A2, and operates the trigger 14 at the timing when these overlap.

  Thereby, in the present state, the pointing position specifying unit 114 recognizes that the pointing position 30 of the gun-type controller 10 points to the center position of the display unit 190, and the setting of the initial condition for specifying the pointing position is completed.

That is, when the markers Ma and Mb overlap the target markers Ta and Tb, as shown in FIG. 4B, the origin O of the x and y coordinates of the image captured by the CCD camera 18 is displayed on the display unit 1.
It coincides with the center position of 90, and at this time, the markers Ma and Mb are initially set on the y-axis of the captured image. Thereby, the position of the markers Ma and Mb in the captured image can be associated with each position on the display unit 190.

2-2: Specifying the indicated position 30 In FIG. 5, the indicated position 30 (represented by p in FIG. 5) of the gun-type controller 10 is specified based on the positions of the light spots La and Lb included in the captured image 52. The process to do is shown.

  FIG. 5A shows a flowchart showing the procedure of the processing, and FIGS. 5B1 to 5B3 are explanatory diagrams of processing for specifying the designated position (P) using the captured image 52. It is shown.

  First, when the captured image 52 shown in FIG. 3 is obtained, as shown in FIG. 5 (A), the center positions q1 and q2 of the light spots La and Lb included in the captured image 52 (x, y) A process for obtaining coordinates and then obtaining an inclination θ of the straight line connecting the gravity center positions q1 and q2 with respect to the y-axis is performed.

  FIG. 5 (B1) shows a specific example of the processing.

  Next, on the basis of the xy coordinates of the center of gravity positions q1 and q2 and the inclination θ obtained in this way, in steps S12 and S14, processing for specifying the indicated position 30 of the gun-type controller 10 is performed.

  That is, in step S12, as shown in FIG. 5B2, as a process of correcting the inclination of the barrel of the gun-type controller 10, a straight line connecting the gravity center positions q1 and q2 included in the captured image 52 is set with the origin O as the center. A process of obtaining θ new center-of-gravity positions q1 ′ and q2 ′ by performing θ rotation conversion is performed.

  Next, in step S14, the xy coordinates of the midpoint h of the straight line connecting the new barycentric positions q1 ′ and q2 ′ are obtained, and the midpoint h and point symmetric position P are displayed on the display unit 190 via the origin O. The process of specifying as the designated position 30 is performed.

  As described above, according to the present embodiment, the indicated position 30 of the gun-type controller 10 can be specified based on the positions of the light spots La and Lb included in the captured image 52.

  Therefore, a game calculation process reflecting the specified position 30 is performed, and a game screen can be generated.

2-3: Tracking of Light Spots FIG. 6 shows a conceptual diagram of a light spot tracking process for deriving a correspondence relationship of light spots for each captured image.

  FIG. 6B is a diagram illustrating the position of a light spot in a newly captured image. FIG. 6A shows the position of the light spot in the previously captured image, that is, in this embodiment, the CCD camera 18 captures the captured image every 1/300 seconds. It is a figure showing the light spot position in the time of.

  The light spot α displayed in FIG. 6B is obtained by moving the light spot α ′ displayed in FIG. 6A, and the light spot β displayed in FIG. ), And the light spot γ displayed in FIG. 6 (A) disappears at the time of FIG. 6 (B). Hereinafter, a method for discriminating the movement, generation, and disappearance of these light spots will be described.

  In the present embodiment, the distance that the light spot can move until the next imaging (1/300 second) is defined in advance as 80 dots, for example. Therefore, an area drawn by a circle with a radius of 80 dots around the position of the light spot is a movable area.

  Then, a movable area is set around the light spot position of the light spot existing at the time of previous imaging, and it is determined whether or not the newly imaged light spot exists in the movable area. As a result, if a newly imaged light spot exists in the movable area, it means movement of the light spot, and if there is no newly imaged light spot in the movable area, it means extinction of the light spot, A newly imaged light spot that does not exist in the movable area means the generation of a light spot.

  More specifically, referring to FIG. 6C, which is a diagram in which FIG. 6B and FIG. 6A are combined, the light spot α ′ existing at the time of previous imaging is represented by a hatched line. The area Aα ′ thus obtained is a movable area of the light spot α ′, and the area Aγ represented by hatching around the light spot γ is a movable area of the light spot γ.

  Since the newly imaged light spot α exists in the area Aα ′, it can be seen that the light spot α ′ has moved to the position of the light spot α. Therefore, the light spot α ′ in FIG. 6A and the light spot α in FIG. 6B are the same light spot, and ID0 is assigned at any time.

  In addition, since there is no newly picked up light spot in the area Aγ, it can be seen that the light spot γ has disappeared by the time of the new image pickup. Therefore, although ID1 is allocated to the light spot γ at the time of FIG. 6A, no ID is allocated at the time of FIG. 6A.

  It can also be seen that the newly imaged light spot β that does not exist in any of the areas Aα ′ and Aγ is a newly generated light spot. Therefore, ID is not allocated at the time of FIG. 6A, but ID2 is allocated to the light spot β at the time of FIG. 6B.

  In the present embodiment, after performing the light spot tracking process for deriving the correspondence between the light spots for each captured image, the light spot lifetime for discriminating between the blinking light source and the discriminator light source, the pseudo vibration light source And the change amount of the acceleration of the light spot for discriminating the discriminator light source.

  FIG. 7 shows a storage example of the light spot information for each captured image of the light spot associated with the ID. In the present embodiment, the light spot position coordinates and the light spot size are stored as the light spot information. The light spot size means the area of the light spot, but may be expressed as the diameter or radius of the light spot.

2-4: Discrimination between discriminator and flashing light source FIG. 8 is a captured image obtained by capturing the light sources and flashing light sources of the discriminating bodies 8a and 8b in a 1/300 second cycle with the gun-type controller 10 fixed. 8A to 8E are taken in the order of (A) → (E).

  The light spot La and the light spot Lb included in the captured image indicate the light sources of the discriminators 8a and 8b, and the light spot BL indicates a blinking light source such as a fluorescent lamp. A light spot BL indicated by a solid line represents a state where the blinking light source emits light, and a light spot BL ′ indicated by a broken line represents a state where the blinking light source does not emit light.

  The light spot La and the light spot Lb, which are the light sources of the discriminator, are imaged as light spots of a certain size at any time point in FIGS. 8A to 8E. On the other hand, the light spot BL and the light spot BL ′ are captured as light spots at the time points of FIGS. 8A, 8D, and 8E, but at the time points of FIGS. 8B and 8C. It is not imaged as a light spot.

  Thus, since the blinking light source that blinks at 50 Hz to 60 Hz, such as a fluorescent lamp, can emit light continuously is a period of one frame or less, the present invention uses the characteristics of the blinking light source to identify the identification object. Discriminate between light source and flashing light source.

  Specifically, every time a captured image is acquired, the time existing in the captured image as the same light spot is counted as the light spot survival time. Then, by specifying a light spot that has not reached the minimum lifetime of the preset light spot as a blinking light source, the light sources of the plurality of identifiers are specified from the light spots included in the captured image.

2-5: Discrimination between discriminator and pseudo-vibration light source FIG. 9 is a captured image obtained by capturing the light sources and pseudo-vibration light sources of the discriminators 8a and 8b in a 1/300 second period with the gun-type controller 10 fixed. 9A to 9E are captured in the order of (A) → (E) during one frame.

  The light spot La and the light spot Lb included in the captured image indicate the light sources of the discriminators 8a and 8b, and the light spot VLa and the light spot VLb are light emission timings of two fluorescent lamps arranged adjacent to each other. Are different flashing light sources. Therefore, the set of flashing light sources becomes a pseudo vibration light source. In addition, the light spot VLa and the light spot VLb indicated by the solid lines indicate the state where the blinking light source emits light, and the light spot VLa ′ and the light spot VLb ′ indicated by the broken lines do not emit light. Represents a state.

  The light spot La and the light spot Lb, which are light sources of the discriminating body, are imaged as light spots of a certain size at any time point in FIGS. 9A to 9E. On the other hand, the light spot VLa and the light spot VLa ′ are imaged as light spots at the time points of FIGS. 9A, 9D, and 9E, but at the time points of FIGS. 9B and 9C. It is not imaged as a light spot. The light spot VLb and the light spot VLb ′ are captured as light spots at the time points of FIGS. 9B and 9C, but at the time points of FIGS. 9A, 9D, and 9E. It is not imaged as a light spot.

  Therefore, in this embodiment, the light spot VLa and the light spot VLb emit light at the position of the light spot VLa at the time of FIGS. 9A, 9D, and 9E, and FIGS. Is detected as one light source that emits light at the position of the light spot VLb.

  FIG. 10 shows the light source movement path LR and the pseudo vibration light source movement path VLR when the gun-type controller 10 is actually swung. Note that GR represents a movement path of the gun-type controller 10, and VLR-1 and VLR-2 represent movement paths of a set of blinking light sources having different light emission timings.

  Thereby, it can be seen that the light source of the identification body moves in the direction in which the gun-type controller 10 is swung. It can also be seen that the pseudo-vibration light source moves in the direction in which the gun-type controller 10 is swung while vibrating.

  FIG. 11 shows the coordinate positions in the x-coordinate axis direction of the discriminator light source and the pseudo vibration light source with respect to the time axis when the gun-type controller 10 is swung. FIG. 11A shows the pseudo vibration light source. (B) represents the light source of the discriminator.

  The pseudo-vibration light source of FIG. 11A is compared with the light source of the identification body of FIG. Then, in FIG. 11A, there are a total of three locations A1 to A3 where acceleration changes from acceleration to deceleration and from deceleration to acceleration, whereas in FIG. 11B there is only one location B1. I understand that there is no.

  Although not shown, the same result is obtained in the y-coordinate axis direction.

  In this way, the pseudo-vibration light source is recognized as moving at a high speed between a pair of flashing light sources in accordance with the timing of light emission of the flashing light sources, so that the acceleration of the light spot relative to the light source of a normal identifier The amount of change increases.

  Therefore, in the present invention, the pseudo vibration light source and the blinking light source are discriminated using the characteristics of the pseudo vibration light source.

  Specifically, each time a captured image is acquired, the number of times the amount of change in acceleration of a light spot existing in the captured image as the same light spot exceeds a threshold value is counted for each light spot. And the light spot with many frequency | counts exceeding the threshold value is specified as a pseudo vibration light source, and the light source of the said several identification body is specified from the light spots contained in the said captured image.

3. Processing of this Embodiment Next, a detailed processing example of this embodiment will be described using the flowcharts shown in FIGS.

3-1: Game Calculation Processing A specific procedure of game calculation processing in the present embodiment will be described with reference to the flowchart of FIG.

  First, in step S100, a process for initializing various data used in the game calculation process is performed.

  Subsequently, in step S200, a blinking light source determination process detailed in FIG. 13 is performed, and in step S300, a pseudo vibration light source determination process detailed in FIG. 14 is performed. In the present embodiment, since these processes are performed about five times within one frame, the processes in steps S200 and S300 are performed at a cycle of 1/300 seconds.

  Subsequently, in step S400, a process for determining whether or not to perform a game process is performed. Here, the game process is performed for each frame, unlike the blinking light source determination process and the pseudo vibration light source determination process. Therefore, when performing a game process, it transfers to step S500, and when not performing a game process, it transfers to step S200.

  Finally, in step S500, a process for calculating the coordinates of the designated point is performed based on the detected position of the identifier, and in step S600, a game process such as generation of a game image reflecting the identified designated position is performed. . The details of the coordinate calculation processing of the indication point in step S500 have been described with reference to the flowchart shown in FIG. In this embodiment, since these processes are performed in accordance with the frame period, the processes in steps S500 and S600 are performed in a 1/60 second period (every frame).

  Such a series of processes is repeated until the game is over (step S700).

3-2: Discrimination Processing Based on Light Point Survival Time Processing for discriminating the discriminator and the blinking light source based on the light spot survival time will be described with reference to the flowchart of FIG.

  First, in step S210, the light spot data of the light spot imaged by the CCD camera 18 is buffered with a buffer p [0]. . . The process of storing in p [N−1] is performed. The light spot data in the present embodiment includes an x coordinate component, a y coordinate component, and a light spot size indicating the position information of the light spot.

  Subsequently, in steps S212 to S228, the lifetime of the light spot stored in the buffer p is calculated, and a process for discriminating the discriminating body and the blinking light source is performed.

  Specifically, in step S212, a process of initializing the counter variable i used for the loop process with 0 is performed.

  In step S214, processing for determining whether or not the light spot size is larger than 0 is performed in order to check whether or not the light spot exists. If it is greater than 0, a process of incrementing the value of the buffer t [i] in which the lifetime of the light spot is stored is performed in step S216. If it is smaller than 0, a process of initializing the value of the buffer t [i] to 0 is performed in step S218. At the start of the game, the buffer t [0]. . . t [N−1] (N represents the maximum number of light spots to be tracked and in this embodiment N = 4) is initialized (step 100 in FIG. 12).

  Next, in step S220, the value of the buffer t [i] in which the light spot survival time is stored is the minimum light spot survival time T (T = 5 in the present embodiment. To be precise, the imaging cycle (1/300 seconds). ) Multiplied by T is the minimum survival time for the light spot. If it is greater than T, a process of storing 1 representing an effective light spot (identifier) in the buffer f [i] is performed in step S222. If it is smaller than T, in step S224, a process of storing 0 indicating an invalid light spot (noise light source) in the buffer f [i] is performed.

  In step S226, a process of incrementing the counter variable i used for the loop process is performed, and in step S228, a process of determining whether or not the incremented counter variable i is larger than N representing the number of light spots to be tracked is performed. Then, the processes in steps S214 to S228 are repeated until the value of the counter variable i becomes larger than N. That is, the processing from step S214 to step S228 is performed for all the light spots to be tracked.

  Finally, in step S230, among the light spots stored in the buffer p [n] (n = 0... N-1), the corresponding light spot of f [n] = 1 is used as the light spot of the light source of the identifier. As a priority.

  In the present embodiment, the presence or absence of the light spot is determined using the light spot size, but these may be determined only from the position information of the light spot.

3-3: Discriminating process based on change in acceleration of light spot A process for discriminating the discriminator and the pseudo-vibration light source based on the change in acceleration of the light spot will be described with reference to the flowchart of FIG.

  First, in step S310 to step S314, the light spot data is stored in the history buffer, and the change amount of the light spot acceleration is obtained from the history light spot data.

  Specifically, in step S310, each time the light spot data is acquired at a 1/300 second period, the history buffer p [0] [0]. . . From p [N−1] [M−1] (N is the maximum number of light spots to be tracked, M is the number of light spot data histories, and N = 4 and M = 16 in this embodiment), the latest light spot data. To store the oldest light spot data and shift the history buffer. At the start of the game, the history buffer p [0] [0]. . . p [N-1] [M-1] has been initialized (step 100 in FIG. 12).

  In step S312, the latest light spot data imaged by the CCD camera 18 is stored in the buffers p [0] [M−1]. . . The process of storing in p [N-1] [M-1] is performed. The light spot data in the present embodiment includes an x-coordinate component and a y-coordinate component indicating the position information of the light spot. The light spot data may include the light spot size.

  In step S314, the history buffer p [0] [0]. . . The amount of change in the acceleration of the light spot is obtained from the light spot data stored in p [N-1] [M-1].

  Here, the absolute value of the time change of the acceleration vector is obtained by differentiating the position vector three times.

また、微分式は離散近似を行うことによって以下のように近似することができる。

The differential equation can be approximated as follows by performing discrete approximation.

  Therefore, the acceleration change amount b per unit time can be approximated to b [n] [m] = | a [n] [m] −a [n] [m−1] |. The acceleration a can be approximated to a [n] [m] = v [n] [m] −v [n] [m−1], and the velocity v per unit time is v [n] [m] = p [n] [m] −p [n] [m−1] can be approximated.

  From the above, the calculation formula for determining the amount of change in acceleration per unit time is b [n] [m] = | p [n] [m] −3p [n] [m−1] + 3p [n] [m− 2] −p [n] [m−3] |.

  Subsequently, in Steps S316 to S330, the number of times the change amount of the acceleration of the obtained light spot exceeds the threshold is obtained for all the tracked light spots. It should be noted that the number of times that the amount of change in acceleration exceeds the threshold value in one tracked light spot is determined in the processing of step S318 to step S326.

  Specifically, in step S316, a process of initializing the counter variable i used for the loop process with 0 is performed.

  In step S318, the counter variable j used for the loop processing is initialized with 3, and the buffer d [i] for storing the number of times the acceleration change amount exceeds the threshold for each light spot to be tracked is initialized with 0. Process.

  In step S320, it is determined whether or not the obtained change amount of acceleration exceeds a threshold value. If the threshold value is exceeded, the value of the buffer d [i] is incremented in step S322.

  In step S324, the counter variable j used for the loop process is incremented.

  In step S326, it is determined whether or not the counter variable j incremented in step S324 is larger than M representing the number of light spot data histories. Then, the processes in steps S320 to S326 are repeated until the value of the counter variable j becomes larger than M. That is, the processing of step S320 to step S326 is performed for all the light spot data that has been recorded in the tracked one light spot.

  In step S328, the counter variable i used for the loop process is incremented.

  In step S330, it is determined whether or not the counter variable i incremented in step S328 is larger than N representing the number of light spots to be tracked. Then, the processes in steps S318 to S330 are repeated until the value of the counter variable i becomes larger than N. That is, the processing from step S318 to step S330 is performed for all the light spots to be tracked.

  Finally, in step S332, in the effective light spot data, the identifiers are sorted in ascending order of the number of times the acceleration change amount exceeds the threshold (d [0]... D [N-1] in ascending order). Preferentially adopted as the light spot of the light source.

4). Hardware Configuration FIG. 12 shows an example of a hardware configuration capable of realizing this embodiment. The main processor 900 operates based on a program stored in a DVD 982 (information storage medium, which may be a CD), a program downloaded via the communication interface 990, a program stored in the ROM 950, or the like. Perform processing, sound processing, etc. The coprocessor 902 assists the processing of the main processor 900, and executes matrix operation (vector operation) at high speed. For example, when a matrix calculation process is required for a physical simulation for moving or moving an object, a program operating on the main processor 900 instructs (requests) the process to the coprocessor 902.

  The geometry processor 904 performs geometry processing such as coordinate conversion, perspective conversion, light source calculation, and curved surface generation based on an instruction from a program operating on the main processor 900, and executes matrix calculation at high speed. The data decompression processor 906 performs decoding processing of the compressed image data and sound data and accelerates the decoding processing of the main processor 900. Thereby, a moving image compressed by the MPEG method or the like can be displayed on the opening screen or the game screen.

  The drawing processor 910 executes drawing (rendering) processing of an object composed of primitive surfaces such as polygons and curved surfaces. At the time of drawing an object, the main processor 900 uses the DMA controller 970 to pass drawing data (vertex data and other parameters) to the drawing processor 910 and, if necessary, the texture to the texture storage unit 924. Forward. Then, the drawing processor 910 draws the object in the frame buffer 922 while performing hidden surface removal using a Z buffer or the like based on the drawing data and texture. The drawing processor 910 also performs α blending (translucent processing), depth cueing, mip mapping, fog processing, bilinear filtering, trilinear filtering, anti-aliasing, shading processing, and the like.

  The sound processor 930 includes a multi-channel ADPCM sound source and the like, generates game sounds such as BGM, sound effects, and sounds, and outputs them through the speaker 932. Data from the game controller 942 and the memory card 944 is input via the serial interface 940.

The ROM 950 stores system programs and the like. In the case of an arcade game system, the ROM 950 functions as an information storage medium, and various programs are stored in the ROM 950. A hard disk may be used instead of the ROM 950. The RAM 960 is a work area for various processors. The DMA controller 970 controls DMA transfer between the processor and the memory. The DVD drive 980 (may be a CD drive) accesses a DVD 982 (may be a CD) in which programs, image data, sound data, and the like are stored. The communication interface 990 performs data transfer with the outside via a network (communication line, high-speed serial bus).

  Note that the processing of each unit (each unit) of the present embodiment may be realized entirely by hardware, or by a program stored in an information storage medium or a program distributed via a communication interface. May be. Alternatively, it may be realized by both hardware and a program.

  When the processing of each unit of the present embodiment is realized by both hardware and a program, a program for causing the hardware (computer) to function as each unit of the present embodiment is stored in the information storage medium. Is done. More specifically, the program instructs the processors 902, 904, 906, 910, and 930, which are hardware, and passes data if necessary. Each processor 902, 904, 906, 910, 930 realizes the processing of each unit of the present invention based on the instruction and the passed data.

  As described above, the present invention is not limited to those described in the present embodiment, and techniques equivalent to these are also included in the scope of the present invention.

  The present invention can also be applied to various games (such as fighting games, shooting games, robot fighting games, sports games, competitive games, role playing games, music playing games, dance games, etc.). Further, the present invention can be applied to various image generation systems such as a business game system, a home game system, a large attraction system in which a large number of players participate, a simulator, a multimedia terminal, and a system board for generating game images.

  In the present embodiment, the case where the gun-type controller 10 is used for detecting the aiming position in a shooting game has been described as an example. However, the present invention is not limited to this and can be applied to various other uses. For example, depending on the type of game, it is also possible to adopt a configuration in which the moving direction of the player object and various items are indicated using the pointing device and a game image reflecting the indicated position is generated. is there.

  In addition to simply indicating the position on the display unit 190, a plurality of the identification bodies 8a and 8b are provided, so that the controller can also be used to detect rotation and tilt of the display unit.

  Further, in the present embodiment, the case where two identification bodies 8a and 8b are used has been described as an example. However, in order to detect a designated position with a higher system, a configuration using three or more identification bodies is employed. May be.

  In this embodiment, the identification body is provided around the display unit. However, a plurality of identification bodies may be arranged at a desired position unrelated to the display unit. Even in this case, by associating the positions of the markers Ma and Mb with the respective positions of the display unit in the captured image obtained by capturing the identification bodies with the imaging unit of the pointing device, the desired position of the display unit can be determined by the pointing device. Can be directed.

Further, in the present embodiment, the case where a light source that emits infrared light is used as an identifier has been described as an example, but the present invention is not limited to this, for example, an identifier that emits other invisible light, An identification body that emits electromagnetic waves, an identification body that emits sound waves, or the like may be used. Further, in the present invention in which the influence of the noise light source can be suppressed to a minimum, an identification body that emits visible light may be used in consideration of the point visually recognized by the player. In particular, when a plurality of identifiers are arranged at a desired position not related to the display unit, the influence on the game is small even when viewed by the player.

  In the present embodiment, the fluorescent lamp is used as the flashing light source. However, the present invention is not limited to this, and a flashing light source is a light source that flashes at a predetermined cycle.

  In the present embodiment, processing is performed on two fluorescent lamps that are adjacently disposed as pseudo-vibration light sources. However, the present invention is not limited thereto, and three or more fluorescent lamps are adjacently disposed. Even if it is used, it becomes a pseudo vibration light source.

  In the present embodiment, the discrimination between the pseudo-vibration light source and the light source of the identification body is performed based on the number of changes in acceleration. However, the present invention is not limited to this, for example, the relative speed with respect to the moving speed of the pointing device. Or the like. Since the light source of the identifier is recognized as moving in the moving direction of the pointing device, the pseudo-vibrating light source is recognized as moving in the moving direction of the pointing device while vibrating. The method can also discriminate between the light source of the discriminator and the pseudo vibration light source.

The example at the time of applying this Embodiment to a home game system. 1 is a block diagram example of an image generation system according to an embodiment. Explanatory drawing which shows an example of a captured image. Explanatory drawing which shows an example of an initial setting screen. Explanatory drawing of the process which detects an instruction | indication position using a captured image. Explanatory drawing of the light spot tracking process of this Embodiment. Explanatory drawing which shows the example of storage of the light spot information for every captured image. Explanatory drawing which shows an example of a blinking light source. Explanatory drawing which shows an example of a pseudo vibration light source. Explanatory drawing which shows an example of the movement path | route of a pseudo vibration light source. Explanatory drawing which shows the coordinate position in the x-coordinate axis direction of the light source of an identification body with respect to a time axis, and a pseudo vibration light source. The flowchart figure of the specific process of this Embodiment. The flowchart figure of the process which discriminate | determines the blinking light source in this Embodiment, and the light source of an identification body. The flowchart figure of the process which discriminate | determines the pseudo | simulation vibration light source and light source of an identification body in this Embodiment. The figure which shows an example of the hardware constitutions which can implement | achieve this Embodiment.

Explanation of symbols

2 Household game machine 4 Television 8a, 8b Discriminator 10 Gun type controller 12 Pointing device (casing)
14 Trigger 16 Lens 18 Camera 20 Processing unit 22 Communication unit 30 Instructed position 50 Initial setting screen 52 Captured image 90 Main device 100 Processing unit 110 Game computing unit 112 Discriminator position detecting unit 114 Instructing position specifying unit 116 Discriminating body light source specifying unit 116a Survival time calculation unit 116b Acceleration change amount calculation unit 117 Light point information history unit 120 Image generation unit 130 Sound generation unit 170 Storage unit 172 Drawing buffer 174 Texture storage unit 176 Captured image memory 178 Light point information storage unit 180 Information storage medium 190 Display unit 192 Sound output unit 196 Communication unit La, Lb Light spot Ma, Mb marker Ta, Tb Target marker BL, BL ′ indicating light source of discriminator Light spot VLa, VLa ′, VLb, VLb ′ indicating flashing light source Pseudo vibration Light spot GR indicating light source Moving path LR of gun type controller Discriminator Moving path VLR movement path of the pseudo vibration source of the light source

Claims (11)

A program for generating an image for a game,
In order to specify the indicated position on the display unit by a pointing device having an imaging unit capable of imaging using a light source that emits invisible light as a light spot, the position of the light spot included in the captured image captured by the imaging unit is An identifier position detector that detects the positions of a plurality of identifiers that emit invisible light and are associated with the display unit;
An indicated position specifying unit that performs a position specifying process for specifying an indicated position of the pointing device on the display unit based on the detected positions of the plurality of identifiers;
And causing the computer to function, and generating a game image reflecting the specified pointing position,
The identifier position detection unit
By identifying at least one of a blinking light source and a pseudo-vibration light source as a noise light source from among the light spots included in the captured image, the light sources of the plurality of identification bodies are identified from the light spots included in the captured image. A program comprising an identification body light source identification section for performing identification body light source identification processing. In claim 1,
The identifier light source specifying unit is
A program characterized in that the captured image is acquired a plurality of times within one frame from the imaging means, and the identification light source specifying process is performed. In claim 2,
The identifier light source specifying unit is
Each time the captured image is acquired from the imaging means, a survival time calculating unit for obtaining a light spot survival time of a light spot included in the captured image,
In the identifier light source specifying process,
The light source of the plurality of identifiers is specified from the light spots included in the captured image by specifying a light spot that has not reached the predetermined time as the flashing light source. program. In any one of Claims 2 and 3,
The identifier light source specifying unit is
Each time the captured image is acquired from the imaging means, an acceleration change amount calculation unit that calculates the change amount of the acceleration of the light spot included in the captured image,
In the identifier light source specifying process,
The light source of the plurality of discriminators is specified from the light spots included in the captured image by specifying a light spot having a high number of times that the acceleration change amount of the light spot exceeds a threshold as the pseudo-vibration light source. A program characterized by that. In claim 4,
The acceleration change amount calculation unit
A light spot information history unit that records information including at least the position of the light spot included in the captured image as light spot information each time the captured image is acquired from the imaging unit;
A program for obtaining a change amount of acceleration of the light spot based on a history of the light spot information. In claim 5,
The light spot information history part is
The program updates the light spot information stored in the light spot history buffer every time the captured image is acquired from the imaging means. In any one of Claims 1-6,
The identifier position detection unit
A program for detecting the positions of the plurality of identification bodies installed outside the display unit from the positions of the light spots included in the captured image. In any one of Claims 1-7,
The pointing device is formed as a shooting device;
The indicated position specifying unit
A program characterized in that the designated position is an aiming position of a shooting device. A program for generating an image for a game,
In order to specify the indicated position on the display unit by the pointing device having an imaging unit capable of imaging the electromagnetic wave generation source, the electromagnetic wave generation source is associated with the display unit from the position of the electromagnetic wave generation source included in the captured image captured by the imaging unit. A discriminator position detector for detecting the positions of a plurality of discriminators that emit the arranged electromagnetic waves;
An indicated position specifying unit that performs a position specifying process for specifying an indicated position of the pointing device on the display unit based on the detected positions of the plurality of identifiers;
And causing the computer to function, and generating a game image reflecting the specified pointing position,
The identifier position detection unit
By identifying at least one of the blinking electromagnetic wave generation source and the pseudo vibration electromagnetic wave generation source from among the electromagnetic wave generation sources included in the captured image as a noise source, the plurality of identifications among the electromagnetic wave generation sources included in the captured image A program comprising an identification object specifying unit for performing an identification object specifying process for specifying an electromagnetic wave generation source of a body.   An information storage medium storing the program according to claim 1. An image generation system for generating an image for a game,
In order to specify the indicated position on the display unit by a pointing device having an imaging unit capable of imaging using a light source that emits invisible light as a light spot, the position of the light spot included in the captured image captured by the imaging unit is An identifier position detector that detects the positions of a plurality of identifiers that emit invisible light and are associated with the display unit;
An indicated position specifying unit that performs a position specifying process for specifying an indicated position of the pointing device on the display unit based on the detected positions of the plurality of identifiers;
And generating a game image reflecting the specified indicated position,
The identifier position detection unit
By identifying at least one of a blinking light source and a pseudo-vibration light source as a noise light source from among the light spots included in the captured image, the light sources of the plurality of identification bodies are identified from the light spots included in the captured image. An image generation system comprising: an identification body light source identification section that performs identification body light source identification processing.

Images