JP5103657B2 - Information processing apparatus, information processing system, and computer program provided with input system using stroboscope - Google Patents

Description

  The present invention relates to an information processing apparatus including an input system using a stroboscope, and more particularly to an information processing apparatus that processes a video signal of an object irradiated with a stroboscope. The present invention further relates to an entertainment device such as a game machine having an input system using a stroboscope. The present invention further relates to a man-machine interface system including an input system using a stroboscope.

  The applicant of the present application in Japanese Patent Application Laid-Open No. H10-260, etc. proposes a sensory game device that uses a piezoelectric buzzer to detect a change in acceleration of a bat or a racket in real space and use it as a game input. In such a bodily sensation game device, when the change in acceleration is greater than or equal to a predetermined value, it is determined that the game player has operated (shook) the object (in the above example, a bat or a racket) in real space. ing.

JP 2001-104636 A Japanese Patent Laid-Open No. 2002-231489 JP 7-141101 A

  However, depending on the type of game, not only whether the object was operated, that is, whether acceleration was given to the object, but also at which position, at what speed, and in which direction it was operated. Sometimes you want information to show. The input device as disclosed in Patent Document 1 cannot satisfy such a requirement.

  On the other hand, for example, if an object is photographed using a stroboscope as disclosed in Patent Document 2, the position and speed of the object as described above can be grasped by analyzing the video signal. . However, this Patent Document 2 only discloses a stroboscope, and a specific technique for photographing an object using the stroboscope and analyzing a video signal obtained thereby in real time is disclosed in this Patent Document. I don't know from 2.

  Patent Document 3 discloses that an object is extracted from a captured video signal, the position of the object is obtained, and the position information is input to a game device or a computer. Although it works well in a specific use environment, it is quite difficult to obtain accurate position information in a room of a general household where a game machine is used. This is because the presence of indoor lighting, windows, objects of various colors, and moving objects other than the game player all affect the detection accuracy as noise and disturbance. A high-speed computer is required to accurately detect the object position while suppressing the influence of such noise and disturbance, which is not practical in a low-cost information processing apparatus in which the processing capability of the processor is limited.

  SUMMARY OF THE INVENTION Therefore, a main object of the present invention is to provide a novel information processing apparatus, entertainment apparatus, and man-machine interface system capable of giving a real-time input to a computer or game machine using a stroboscope.

  The invention according to claim 1 is an information processing apparatus including an input system using a stroboscope, which shoots an object when the stroboscope and the stroboscope emit light and does not emit light, and emits a video signal and when no light is emitted. Image pickup means for outputting video signals, part of information on the position, size, speed, acceleration, and motion trajectory pattern of an object based on the difference between each of a plurality of light emitting video signals and a plurality of non-light emitting video signals Alternatively, the information processing apparatus includes a first unit that calculates all and a second unit that performs information processing based on the information calculated by the first unit.

  According to the first aspect of the present invention, the stroboscope (42, 52: reference numerals of elements or components corresponding to the embodiments; hereinafter the same) illuminates the object (14, 94, 112) brightly, thereby obtaining an imaging result. The contrast between the object and the object other than the object is increased to facilitate the detection of the object. Further, the first means (52, S59, S129, FIG. 35: S61, FIG. 22, FIG. 25, FIG. 33) calculates respective differences between the plurality of light emitting video signals and the plurality of non-light emitting video signals. As a result, the position, size, speed, acceleration, and motion trajectory pattern of the target object can be accurately and easily processed by suppressing the effects of noise components such as still images and fixed light sources other than the target object that is a moving object. It becomes possible to detect. Based on the information thus calculated, the second means (52, S63) performs predetermined information processing.

  And by separating the information processing for calculating these information and the information processing on the application side, the information processing on the application side becomes simple, and when replacing the information processing on the application side with another processing, The processing relating to the calculation of the position, size, speed, acceleration, and motion trajectory pattern of the object can be used without change.

  A second aspect is an information processing apparatus according to the first aspect, wherein the first means includes a determination means for determining whether or not the information meets a predetermined condition.

  In the invention of claim 2, the determination means (52, S61, FIG. 22, FIG. 25, FIG. 33) determines whether or not the position, size, speed, acceleration, motion trajectory pattern, etc. of the object meets a predetermined condition. In the information processing on the application side, it is possible to perform simple application processing by referring to the determination result and not receiving the calculated information unless the predetermined condition is met.

  Claim 3 is dependent on claim 2, wherein the first means detects only valid information from the information based on the determination result of the determination means, and notifies the second means that a valid input has been made. An information processing apparatus including effective input detecting means for performing the processing.

  In the invention of claim 3, the effective input detection means (52, FIG. 22, FIG. 25, FIG. 33) included in the first means performs selection of information based on the determination result from the determination means, Only valid input is transmitted to the information processing on the application side. Therefore, simple application processing is possible.

  A fourth aspect is dependent on any one of the first to third aspects, wherein the first means includes a distance calculating means for calculating a distance between the object and the imaging means from information indicating the size of the object. Device.

  In the invention of claim 4, the distance calculating means (52, S111, S113) included in the first means calculates the size of the object from the imaging result, and captures the object and the image from the information of the calculated size. The distance of the means is calculated. Thereby, the position, velocity, acceleration, and motion trajectory pattern of the object in the three-dimensional space can be obtained from the two-dimensional imaging result.

  A fifth aspect is dependent on any one of the first to fourth aspects, wherein the first means analyzes the information obtained from the difference between the video signal at the time of light emission and the video signal at the time of non-light emission and extracts the shape of the object. The information processing apparatus includes an analysis unit and an angle calculation unit that calculates an angle between the object and the imaging unit from the shape.

  In the invention of claim 5, the first means includes analysis means (52, FIG. 24: S159-S167) and angle calculation means (52, S169), and by analyzing the shape of the object from the imaging result, As an imaging result, it is possible to obtain an angle formed by an object projected on a two-dimensional image and an imaging unit.

  A sixth aspect is dependent on the fifth aspect, wherein the analysis by the analyzing means extracts two predetermined points in the object, and the angle calculation by the angle calculating means is a line segment connecting the two predetermined points. And an information processing apparatus that calculates an angle between the coordinate axis and a predetermined coordinate axis.

  In the invention of claim 6, the analysis means performs an analysis (S166) for extracting two predetermined points in the object, and the angle calculation means calculates the angle by a line segment connecting the two predetermined points and a predetermined coordinate axis. Is calculated (S169).

  A seventh aspect is an information processing apparatus according to any one of the first to sixth aspects, wherein the stroboscopic light emission time interval can be freely set.

  An eighth aspect is an information processing apparatus according to any one of the first to sixth aspects, wherein the length of the light emission period and the length of the non-light emission period of the stroboscope can be freely set.

  A ninth aspect is an information processing apparatus according to any one of the first to sixth aspects, wherein the exposure period of the imaging means can be freely set.

  For example, as shown in FIG. 6 of the embodiment, the processor controls lighting / extinguishing of the infrared light emitting diodes, so that the invention of claim 7, the invention of claim 8 or the invention of claim 9 can perform at a necessary time interval. In addition, it is possible to emit light from the strobe light source and to perform exposure with the image pickup means only at a necessary timing, and it is possible to reduce power consumption.

  A tenth aspect is an information processing apparatus according to any one of the first to ninth aspects, wherein the object includes a reflector.

  If the object includes a reflector (50, 50A, 100, 116) as in the invention of claim 10, the contrast between the object and another image is further enhanced, so that the detection accuracy is improved with an inexpensive configuration. It becomes possible.

  An eleventh aspect is an information processing apparatus according to any one of the first to tenth aspects, wherein the stroboscope includes a light source that outputs light in a specific wavelength region, and the imaging unit responds only to the specific wavelength region. .

  An information processing apparatus according to claim 12 is dependent on claim 11, and the imaging means includes a filter that transmits only light in a specific wavelength region, and an image sensor that captures an image formed by the light transmitted through the filter. It is.

  A thirteenth aspect is the information processing apparatus according to the eleventh aspect, wherein the image pickup means includes an image pickup device that takes only an image formed by light of a specific wavelength region.

  In the invention of claim 11, the invention of claim 12, or the invention of claim 13, the stroboscope includes a light source (for example, an infrared light emitting diode 42) that outputs light in a specific wavelength region, and the imaging means is, for example, an infrared filter. Is used to respond only to a specific wavelength region. For this reason, light in a wavelength region not included in a moving light source and blinking light source (such as a fluorescent lamp) other than the object to be detected is used as a stroboscopic light source, and the imaging means responds only to light in this wavelength region. Thus, it becomes possible to remove these noise light sources.

  A fourteenth aspect is an information processing apparatus according to any one of the first to thirteenth aspects, wherein each of the first means and the second means is a process processed by a single processor or a plurality of processors.

  In the invention of claim 14, the first means and the second means are processes processed by a single processor or a plurality of processors (processors processing 52 and / or S63), respectively. In this way, a system that is inexpensive and has a high degree of freedom can be constructed by using the first and second means as processes that are processed as processor software. However, it is further desirable that both the first and second means processes be performed in a single processor.

  A fifteenth aspect is the entertainment device according to any one of the first to fourteenth aspects, wherein the information processing performed by the second means is an entertainment process such as a game.

  The invention of claim 15 is an entertainment device in which the information processing performed by the second means is an entertainment process such as a game.

  16. A man-machine interface system having an input system using a stroboscope, wherein the stroboscope and the stroboscope are photographed when the stroboscope and the stroboscope emit light and when the stroboscope emits light, respectively. Imaging means for outputting a signal, a part of information on the position, size, speed, acceleration, motion trajectory pattern of the object based on the difference between each of the plurality of light emitting video signals and the plurality of non-light emitting video signals or A man-machine interface system comprising first means for calculating all and second means for performing information processing based on information calculated by the first means.

  Even if the system of the invention of claim 16 is used as a man-machine interface for personal computers, workstations, game machines, educational equipment, medical equipment, etc., an inexpensive and highly accurate input system can be constructed.

  According to these inventions, the imaging result of the object irradiated by the stroboscope is digitally analyzed, and information such as the position, moving speed, acceleration, and motion trajectory of the object is processed by an information processing apparatus such as a personal computer or a video game machine. Can be treated as input to

  In addition, it is possible to detect with high accuracy by suppressing the influence of noise and disturbance with only simple information processing, so it is easy even on systems where the performance of the processor is limited by conditions such as cost and allowable power consumption. Can be achieved.

  The above object, other objects, features, and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

FIG. 1 is an illustrative view showing an example of a strobe image photographed with a stroboscope. FIG. 2 is an illustrative view showing an overall configuration of a golf game system according to one embodiment of the present invention. FIG. 3 is an illustrative view showing one example of a photographing unit of FIG. 2 embodiment. FIG. 4 is an illustrative view showing one example of a golf club type input device of FIG. 2 embodiment. FIG. 5 is a block diagram showing the embodiment of FIG. FIG. 6 is a circuit diagram showing a configuration and an LED driving circuit for fetching pixel data from the image sensor to the game processor in the embodiment of FIG. FIG. 7 is a timing chart showing the operation of the embodiment of FIG. FIG. 8 is an enlarged timing diagram showing a part of FIG. FIG. 9 is an illustrative view showing a state or state transition of FIG. 2 embodiment. FIG. 10 is a flowchart showing the overall operation of the FIG. 2 embodiment. FIG. 11 is a flowchart showing a sensor initialization setting process operation as an example of the initialization process of FIG. 10 embodiment. FIG. 12 is a flowchart showing the command transmission processing operation of FIG. FIG. 13 is a flowchart showing the register setting processing operation of FIG. FIG. 14 is a timing chart showing the register setting processing operation shown in FIG. FIG. 15 is a flowchart showing the operation of the game processor in the embodiment of FIG. FIG. 16 is a flowchart showing the stroboscope photographing operation in the embodiment of FIG. FIG. 17 is a flowchart showing the pixel data acquisition processing operation in the embodiment of FIG. FIG. 18 is a flowchart showing the attention point extraction processing operation in the embodiment of FIG. FIG. 19 is an illustrative view showing the principle of adopting difference data in the embodiment. FIG. 20 is a flowchart showing the speed vector calculation processing operation in the embodiment of FIG. FIG. 21 is an illustrative view showing each coordinate position in the velocity vector calculation operation of FIG. FIG. 22 is a flowchart showing the determination processing operation in the embodiment of FIG. It is an illustration figure which shows the modification of the golf club type | mold input device used for a golf game system. FIG. 24 is a flowchart showing the attention point extraction processing operation in the embodiment of FIG. 15 when the golf club type input device of FIG. 23 is used. FIG. 25 is a flowchart showing the determination processing operation in the embodiment of FIG. 15 when the golf club type input device of FIG. 23 is used. FIG. 26 is an illustrative view showing angles in the determination processing operation of FIG. FIG. 27 is an illustrative view showing an entire configuration of a bowling game system according to another embodiment of the present invention. 28 is a cross-sectional view taken along line XXVIII-XXVIII in FIG. 27 showing the internal structure of the ball-type input device shown in FIG. FIG. 29 is an illustrative view showing one example of a game screen displayed on the television monitor in FIG. 27 embodiment. FIG. 30 is an illustrative view showing one example of a score sheet displayed on the television monitor in FIG. 27 embodiment. FIG. 31 is a block diagram showing the embodiment of FIG. FIG. 32 is a flowchart showing the overall operation of the embodiment of FIG. FIG. 33 is a flowchart showing the determination processing operation in the FIG. 15 embodiment of the boring system of FIG. FIG. 34 is an illustrative view showing one example of a glove-type input device. FIG. 35 is a flowchart showing the motion detection processing operation shown in FIG. 15 when the glove type input device of FIG. 34 is used. FIG. 36 is a flowchart showing the pixel data array acquisition processing operation in the embodiment of FIG.

  Referring to FIG. 2, a golf game system 10 according to an embodiment of the present invention includes a game machine 12 and a golf club type input device 14, which is played on the game machine 12 by a game player. It is shaken by. Note that the game machine 12 is driven by a DC power source such as an AC adapter (not shown) or a battery. The game machine 12 is further connected to an AV terminal (not shown) of a television monitor (not shown) through the AV cable 16.

  The game machine 12 also includes a housing 18, on which a power switch 20 is provided, and a direction button 22, a determination key 24, and a cancel key 26 are provided. The direction buttons 22 have individual buttons in four directions (up, down, left and right), and are used, for example, to move a cursor for selecting a menu or a game mode on a display screen of a television monitor.

The decision key 24 is used to decide an input to the game machine 12. The cancel key 26 is used to cancel the input to the game machine 12.

  An imaging unit 28 shown in detail in FIG. 3 is housed inside the housing 16 of the game machine 12. The imaging unit 28 includes a unit base 30 formed by plastic molding, for example, and a support cylinder 32 is attached in the unit base 30. A trumpet-shaped opening 34 whose inner surface has an inverted conical shape is formed on the upper surface of the support cylinder 32, and a concave lens 36 formed by molding a transparent plastic, for example, is formed inside the cylindrical part below the opening 34. An optical system including a convex lens 38 is provided, and an image sensor 40 as an image sensor is fixed below the convex lens 38. Therefore, the image sensor 40 can capture an image corresponding to light incident from the opening 34 through the lenses 36 and 38.

  The image sensor 40 is a low-resolution CMOS image sensor (for example, 32 × 32 pixels: gray scale). However, the image sensor 40 may have a larger number of pixels or may be composed of other elements such as a CCD.

  The unit base 30 is attached with a plurality of (four in this embodiment) infrared light emitting diodes 42 whose light emission directions are all upward. The infrared light emitting diode 42 irradiates infrared light in a range determined by lines 44 a and 44 b shown in FIG. 3 above the imaging unit 28. An infrared filter (a filter that transmits only infrared rays) is attached above the unit base 30 so as to cover the opening 34. The infrared light emitting diode 42 functions as an infrared stroboscope because it is continuously turned on / off as described later. However, “stroboscope” is a general term for devices that illuminate a moving body intermittently.

Therefore, the image sensor 40 photographs an object that moves within the photographing range indicated by the lines 44a and 44b, that is, the reflector 50 (see FIG. 4) provided in the golf club type input device 14 in this embodiment. .

  The golf club type input device 14 is entirely formed by plastic molding, for example, and includes a club shaft 46 and a club head 48 attached to the tip of the club shaft 46, as shown in FIG. A circular reflector 50 made of a retroreflective sheet is provided. Therefore, as shown in FIG. 2, if the game player holds the club shaft 46 of the input device 14 and swings it above the game machine 12 in the same manner as in normal golf, the bottom surface of the head 48 is reflected. The light reflected by the body 50 is photographed by the image sensor 40. At this time, since the infrared light emitting diode 42 irradiates infrared light intermittently as described above, as a result, the reflector 50 is intermittently photographed as shown in FIG. In the golf game system 10 of this embodiment, as will be described later, the speed that is input to the game machine 12 is calculated by processing the strobe image of such a reflector.

  Referring to FIG. 5, as described above, club-type input device 14 is irradiated with the light emitted from infrared light emitting diode 42, and the infrared light is reflected by reflector 50. The reflected light from the reflector 50 is photographed by the image sensor 40, and thus the image signal of the reflector 50 is output from the image sensor 40. The analog video signal from the image sensor 40 is converted into digital data by an A / D converter (not shown) built in the game processor 52.

  The game processor 52 blinks the infrared light emitting diode 42 intermittently for the above-described flash photography.

  As such a game processor 52, any kind of processor can be used. In this embodiment, a high-speed processor developed by the applicant of the present invention and already filed for a patent is used. This high-speed processor is disclosed in detail, for example, in Japanese Patent Laid-Open No. 10-307790 [G06F13 / 36, 15/78] and US Pat. No. 6,070,205 corresponding thereto.

  Although not shown, the game processor 52 includes various processors such as an arithmetic processor, a graphic processor, a sound processor, and a DMA processor, and the above-described A / D converter, key operation signal, and infrared signal used for capturing an analog signal. And an input / output control circuit for receiving an input signal and supplying an output signal to an external device. Therefore, an input signal from the operation keys 22-26 is given to the arithmetic processor through this input / output control circuit. The arithmetic processor executes necessary arithmetic according to the input signal and gives the result to the graphic processor or the like. Therefore, the graphic processor and the sound processor execute image processing and sound processing according to the calculation result.

  The processor 52 is provided with an internal memory (not shown), and this internal memory includes ROM or RAM (SRAM and / or DRAM). The RAM is used as a temporary memory, a working memory or a counter or register area (temporary data area) and a flag area. A ROM 54 is connected to the processor 52 through an external bus. A game program as will be described later is preset in the ROM 54.

  The processor 52 detects the movement of the golf club type input device 14 by processing the digital video signal input from the image sensor 40 through the A / D converter, and calculates according to the input signal from the operation keys 22-26. Performs graphic processing, sound processing, etc., and outputs video and audio signals. The video signal is an image signal for displaying a game screen, and the audio signal is a game music or sound effect signal. Therefore, the video signal is displayed on the screen of a television monitor (not shown) and the necessary sound is displayed. (Sound effect, game music) is output from the speaker.

  Here, with reference to FIGS. 6 to 8, a configuration for taking pixel data from the CMOS image sensor 40 into the game processor 52 will be described in detail. As shown in FIG. 6, the CMOS image sensor 40 of the embodiment is of a type that outputs a pixel signal (pixel signal) as an analog signal, so that the pixel signal is input to an analog input port of the game processor 52. . The analog input port is connected to an A / D converter (not shown) in the game processor 52. Therefore, the game processor 52 receives a pixel signal (pixel data) converted from the A / D converter into digital data. Get inside.

  The midpoint of the analog pixel signal described above is determined by the reference voltage applied to the reference voltage terminal Vref of the CMOS image sensor 40. Therefore, in this embodiment, a reference voltage generation circuit 56 composed of, for example, a resistance voltage dividing circuit is provided in association with the image sensor 40, and a reference voltage having a constant magnitude is always applied from the circuit 56 to the reference voltage terminal Vref. .

  Each digital signal for controlling the CMOS image sensor 40 is supplied to or output from the I / O port of the game processor 52. Each of these I / O ports is a digital port capable of controlling input / output, and is connected to an input / output control circuit (not shown) in the game processor 52.

  More specifically, a reset signal for resetting the image sensor 40 is output from the output port of the game processor 52 and applied to the image sensor 40. Further, the image sensor 40 outputs a pixel data strobe signal and a frame status flag signal, and these signals are given to the input port of the game processor 52. The pixel data strobe signal is a strobe signal as shown in FIG. 7B for reading each pixel signal described above. The frame status flag signal is a flag signal indicating the state of the image sensor 40, and defines the exposure period of the image sensor as shown in FIG. That is, the low level shown in FIG. 7A of the frame status flag signal indicates the exposure period, and the high level shown in FIG. 7A indicates the non-exposure period.

  The game processor 52 outputs a command (or command + data) to be set in a control register (not shown) in the CMOS image sensor 40 from the I / O port as register data, and outputs, for example, a high level and a low level. The register setting clock to be repeated is output and supplied to the image sensor 40.

  In this embodiment, as the infrared light emitting diode 42, four infrared light emitting diodes 42a, 42b, 42c and 42d connected in parallel as shown in FIG. 6 are used. As described above, the four infrared light emitting diodes 42a to 42d irradiate infrared light in the same direction as the viewpoint direction of the image sensor 40 so as to illuminate the object (golf club type input device 14). So as to surround the image sensor 40. However, these individual infrared light-emitting diodes 42a to 42d are simply referred to as infrared light-emitting diodes 42 unless it is particularly necessary to distinguish them. The infrared light emitting diode 42 is turned on or off (not lit) by the LED drive circuit 58. The LED drive circuit 58 receives the above-described frame status flag signal from the image sensor 40, and this flag signal is given to the base of the PNP transistor 68 through the differentiation circuit 60 including the resistor 62 and the capacitor 64. A pull-up resistor 66 is further connected to the PNP transistor 68, and the base of the PNP transistor 68 is normally pulled up to a high level. When the frame status signal becomes low level, the low level is input to the base via the differentiation circuit 60, so that the PNP transistor 68 is turned on only when the flag signal is low level.

  The emitter of the PNP transistor 68 is grounded via resistors 70 and 72. The connection point between the emitter resistors 70 and 72 is connected to the base of the NPN transistor 74. The collector of the NPN transistor 74 is commonly connected to the anodes of the infrared light emitting diodes 42a to 42d. The emitter of NPN transistor 74 is connected directly to the base of another NPN transistor 76. The collector of the NPN transistor 74 is commonly connected to the cathodes of the infrared light emitting diodes 42a to 42d, and the emitter is grounded.

  In this LED drive circuit 58, the LED control signal (corresponding to the second signal) output from the I / O port of the game processor 52 is active (high level) and the frame status flag signal from the image sensor 40 is low. The infrared light emitting diode 42 is turned on only during a period of level. As shown in FIG. 7A, when the frame status flag signal becomes low level, the PNP transistor 68 is turned on during the low level period (actually, there is a delay due to the time constant of the differentiation circuit 60). Accordingly, when the LED control signal shown in FIG. 7D is output from the game processor 52 at a high level, the base of the NPN transistor 74 becomes a low level and the transistor 68 is turned off. When transistor 68 is turned off, transistor 74 is turned on. Therefore, a current flows from the power source (indicated by small white circles in FIG. 6) through the infrared light emitting diodes 42a to 42d and the transistor 76. Accordingly, as shown in FIG. 7E, the infrared light emitting diodes 42a to 42d Illuminated.

  Thus, in the LED drive circuit 58 of the embodiment, the infrared light emitting diode 42 is only in a period in which the LED control signal in FIG. 7D is active and the frame status flag signal in FIG. Therefore, the infrared light emitting diode 42 is turned on only during the exposure period of the image sensor 40 (see FIG. 7F). Therefore, according to this embodiment, wasteful power consumption can be suppressed. Furthermore, since the frame status flag signal is coupled by the capacitor 64, even if the flag signal is stopped at a low level due to the runaway of the image sensor 40, the transistor 68 is always turned off after a certain time, The infrared light emitting diode 42 is also always turned off after a certain time.

  Thus, in this embodiment, the exposure time of the image sensor 40 can be set or changed arbitrarily and freely by changing the duration of the frame status signal.

  Furthermore, by changing the duration and period of the frame status signal and the LED control signal, the light emitting period, non-light emitting period, light emitting / non-light emitting period, etc. of the infrared light emitting diode 42, that is, the stroboscope can be changed arbitrarily and freely. Can be set.

  As described above, when the reflector 50 of the golf club type input device 14 is irradiated with the infrared light from the infrared light emitting diode 42, the image sensor 40 is exposed with the reflected light from the reflector 50. In response, the image sensor 40 outputs the pixel signal described above. More specifically, the CMOS image sensor 40 changes to the pixel data strobe shown in FIG. 7B during a period when the frame status flag signal shown in FIG. 7A is at a high level (non-lighting period of the infrared light emitting diode 42). In synchronism, an analog pixel signal is output as shown in FIG. The game processor 52 acquires digital pixel data through the A / D converter while monitoring the frame status flag signal and the pixel data strobe.

  However, in the embodiment, pixel data (pixel signal) is output in the order of row 0, row 1,... Row 31 as shown in FIG. However, as will be described later, the first pixel of each row is dummy data.

  Here, with reference to FIG. 9 and FIG. 10, schematic operation | movement of the golf game system 10 of FIG. 2 Example is demonstrated. The power switch 20 shown in FIG. 2 is turned on to start the game, but the game processor 52 shown in FIG. 5 first executes an initialization process in step S1. Specifically, the system and each variable are initialized.

  The initialization process in step S1 includes a data setting process to the control register in the image sensor 40, and specifically, is executed according to the flowcharts shown in FIGS. 11 to 13 and at the timing shown in FIG. .

  In the first step S11 of FIG. 11, the game processor 52 sets a command “CONF” as setting data. However, the command “CONF” is a command for notifying the image sensor 40 that the setting mode for transmitting the command from the game processor 52 is entered. Then, in the next step S13, command transmission processing shown in detail in FIG. 12 is executed.

  In the first step S31 of the command transmission process, the processor 52 sets the setting data (command “CONF” in the case of step S13) to the register data (I / O port), and in the next step S33, the register setting clock (I / O port) is set to low level. Thereafter, after waiting for a specified time in step S35, the register setting clock is set to a high level in step S37. Further, after waiting for the specified time in step S39, the register setting clock is set to the low level again in step S41. In this way, as shown in FIG. 14, the command (command or command + data) transmission process is performed by setting the register setting clock to low level, high level, and low level while waiting for a specified time. Is called.

  In step S15 (FIG. 11), the pixel mode is set and the exposure time is set. In this embodiment, since the image sensor 40 is, for example, a 32 × 32 CMOS sensor as described above, “0h” indicating 32 × 32 pixels is set in the pixel mode register of the setting address “0”. Set. In the next step S17, the game processor 52 executes a register setting process shown in detail in FIG.

  In the first step S43 of the register setting process, the processor 52 sets the command “MOV” + address as the setting data, and in the next step S45, executes the command transmission process described above with reference to FIG. Send. Next, in step S47, the processor 52 sets the command “LD” + data as the setting data, executes command transmission processing in the next step S49, and transmits it. In step S51, the processor 52 sets the command “SET” as setting data, and transmits it in the next step S53. Note that the command “MOV” is a command indicating that the address of the control register is transmitted, the command “LD” is a command indicating that the data is transmitted, and the command “SET” is for actually setting the data to the address. Command. This process is repeatedly executed when there are a plurality of control registers to be set.

  Returning to FIG. 11, in the next step S19, the setting address is set to “1” (indicating the address of the exposure time setting register), and the FFh data “Fh” indicating the maximum exposure time is set. Set as power data. In step S21, the register setting process of FIG. 13 is executed. Similarly, in step S23, the setting address is set to “2” (indicating the high nibble address of the exposure time setting register), and the high nibble data “Fh” of “FFh” indicating the maximum exposure time is set as data to be set. In step S25, register setting processing is executed.

Thereafter, a command “RUN” is set in step S27 to indicate the end of setting and to cause the image sensor 40 to start outputting data, and is transmitted in step S29. In this way, the initial setting operation in step S1 shown in FIG. 10 is executed. However, the specific examples shown in FIGS. 11 to 14 can be changed as appropriate according to the specifications of the image sensor used.

  After step S1 of FIG. 10, the game processor 52 updates the image displayed in the monitor (not shown) by updating the image signal in step S2. However, this display image update is executed for each frame (television frame or video frame).

  And the game processor 52 performs the process according to a state (state). However, the first process is to select a game mode. In this game mode selection, the user or game player selects a game mode such as a one-player mode or a two-player mode by operating the selection key 22 shown in FIG. Set the difficulty level.

  In an actual golf game, it is necessary to roll the golf ball on the game screen by swinging the golf club. In the golf game system 10 of the embodiment, as described above, the golf club type input device 14 is used. The golf club swings in real space. Therefore, the game processor 52 executes a swing motion determination process in step S4 to determine whether or not the swing motion has been performed. If a swing motion has been performed, then in step S5, when the ball is flying or rolling in the game screen, the trajectory of the ball is calculated, and when the ball stops, step S6. In step S5, score calculation and result determination processing are executed as a result of the trajectory calculation processing in step S5.

  Thereafter, if there is an interruption due to the video synchronization signal, the image update in step S2 (FIG. 10) is executed. The voice processing in step S7 is executed when a voice interruption occurs, thereby outputting a sound effect such as game music or a golf club hitting ball.

  With reference to FIGS. 15-22, the concrete whole operation | movement of such a golf game system 10 is demonstrated. In the first step S55 of FIG. 15, the game processor 52 executes stroboscopic photography for detecting the movement position of the golf club type input device.

  Details of the stroboscope photographing process are shown in FIG. In the first step 67 of FIG. 16, the game processor 52 assigns “1” to the number N of the number register (not shown) in an appropriate area of the internal memory (not shown). In subsequent step S69, the game processor 52 turns on the infrared light emitting diode 42 for stroboscopic photography. Specifically, the LED control signal shown in FIG. 7 is set to a high level. Thereafter, a pixel data array acquisition process is executed in step S71.

  In the first step S301 of FIG. 36, the game processor 52 sets “−1” for X and “0” for Y as the element number of the pixel data array. The pixel data array in this embodiment is a two-dimensional array with X = 0 to 31 and Y = 0 to 31, but since dummy data is output as the data of the first pixel in each row as described above, the initial value of X “−1” is set as the value. In a succeeding step S303, the pixel data acquisition process of the element [Y] [X] shown in FIG. 17 is executed.

  In the first step S83 of FIG. 17, the game processor 52 checks the frame status flag signal from the image sensor 40 and determines whether or not the rising edge (from low level to high level) has occurred in step S85. When the rising edge of the flag signal is detected in step S85, in the next step S87, the game processor 52 starts conversion of the analog pixel signal input to the internal A / D converter into digital data. Instruct. Thereafter, the pixel strobe from the image sensor 40 is checked in step S89, and it is determined in step S91 whether a rising edge from the low level to the high level of the strobe signal has occurred.

  If “YES” is determined in the step S91, the game processor 52 subsequently determines whether or not X = −1, that is, whether or not it is the first pixel in a step S93. As described above, since the first pixel of each row is set as a dummy pixel, if “YES” is determined in step S93, the pixel data at that time is not acquired in the next step S95. In S97, the element number X is incremented.

  If “NO” is determined in step S93, the pixel data is the second and subsequent pixel data in the row. Therefore, the pixel data at that time is acquired in steps S99 and S101, and the pixel is stored in a temporary register (not shown). Store the data. Thereafter, the process returns to step S305 in FIG.

  In step S305, the pixel data stored in the temporary register is stored as elements [Y] [X] of the pixel data array.

  In the subsequent step S309, X is incremented. When X is less than 32, the processes from S303 to S307 are repeated. When X is 32, that is, when the acquisition of pixel data has reached the end of the row, “−1” is set in subsequent step S311X, Y is incremented in step S313, and the pixel data from the beginning of the next row Repeat the acquisition process.

  If Y is 32 in step S315, that is, if the acquisition of pixel data has reached the end of the pixel data array, the process returns to step S73 in FIG.

  In step S73, the pixel data array is stored as acquired data at the Nth lighting, for example, in a working area of the internal RAM.

  In subsequent step S75, the game processor 52 turns off the infrared light emitting diode 42 by setting the LED control signal to a low level, for example. Thereafter, in step S76, in the same manner as in step S71, the pixel data array when the infrared light emitting diode 42 is turned off is obtained according to the subroutines of FIGS. 17 and 35, and in step S77, as in step S73. And stored in the working area of the internal RAM.

  In step S79, the number register N is incremented. In step S81, it is determined whether the number N has reached a specified value. If “YES” is determined in the step S81, the process returns to the step S57 (attention point extraction process) in FIG. 15 as it is. However, if "NO", the process returns to the previous step S69.

  Details of the attention point extraction processing are shown in FIG. In the first step S103 of FIG. 18, the game processor 52 assigns “1” to the number N of the number register (not shown) in the internal memory (not shown). Then, in the next step S105, a difference data array is calculated from the difference between the on-time acquired data and the off-time acquired data obtained in steps S73 and S77 of FIG.

  That is, in this embodiment, as described above, the reflector 50 of the golf club type input device 14 is irradiated with infrared light, and an image is captured by the reflected infrared light incident on the image sensor 40 through the infrared filter. is doing. When the golf club type input device 14 is photographed with a stroboscope using a general light source in a general indoor environment, the image sensor (corresponding to the image sensor 40 of the embodiment) is shown in FIG. As shown in FIG. 4, in addition to the image by the reflector, not only a light source such as a fluorescent light source, an incandescent light source, and sunlight (window), but also all images of everything in the room appear. Therefore, to process only the image of the reflector by processing the image of FIG. 19A requires a fairly high speed computer or processor. However, such a high-performance computer cannot be used in a game device that is inexpensive. Therefore, it is conceivable to reduce the burden by performing various processes.

  FIG. 19B is a video signal when the level of the video signal of FIG. 19A is discriminated by a certain threshold value. Such level discrimination processing can be executed either by a dedicated hardware circuit or by software. However, if any method is used to execute level discrimination that cuts pixel data with a light amount below a certain level, a reflector is used. And low luminance images other than the light source can be removed. In the image of FIG. 19B, processing of an image other than the reflector and the light source in the room can be omitted, and thus the burden on the computer can be reduced. However, a high-intensity image including the light source image is still captured. It is difficult to separate the reflector from other light sources.

  Therefore, in the embodiment, as shown in FIG. 3, the infrared filter 44 is used to prevent the image sensor 40 from capturing an image other than the infrared image. Thereby, as shown in FIG. 19C, an image of a fluorescent lamp light source that hardly contains infrared light can be removed. However, sunlight and incandescent lamps are still included in the video signal. Therefore, in order to further reduce the burden, the difference between the pixel data when the infrared stroboscope is turned on and the pixel data when the infrared stroboscope is turned off is calculated.

  Therefore, the difference between the pixel data of the video signal when turned on in FIG. 19C and the pixel data of the video signal when turned off in FIG. 19D was calculated. Then, as shown in FIG. 19E, an image of only the difference can be acquired. The video based on the difference data includes only the image obtained by the reflector of the golf club type input device 14 as is clear from comparison with FIG. Therefore, even if the performance of the game processor 52 is not so high, the movement locus of the reflector 50, that is, the club head 48 (FIG. 4) due to the swing of the golf club type input device 14 can be acquired.

  For this reason, in this embodiment, for example, the difference data array shown in FIG. 19E is calculated in step S105 of FIG. After obtaining the difference data array in step S105, the coordinates of the pixel having the largest value (the pixel having the maximum luminance) are acquired in step S107, and in step S109, it is determined whether the luminance of the pixel at that coordinate exceeds the specified value. To do.

  If “YES” is determined in this step S109, in the following step S111, it is sequentially determined whether the pixel in contact with the pixel of the coordinate acquired in step S107 and further the pixel in contact with the pixel exceed the above specified value. The diameter Φ [N] of the part (in the embodiment, the image of the reflector) is calculated. The diameter (or size) of the target portion is calculated in order to acquire the height (Z coordinate) of the reflector 50 in step S113 and to specify the center coordinates of the reflector in step S115. Because.

  As shown in FIG. 3, the imaging unit 28 of this embodiment uses a single-focus optical system. Therefore, when the distance between the reflector 50 and the image sensor, that is, the image sensor 40 matches the focal point of the optical system, the “blur” of the image is the smallest and the diameter is the largest. On the other hand, the larger the difference between the in-focus distance and the reflector-image sensor distance, the smaller the image itself. In the example of FIG. 19E and FIG. 21 described later, the size (diameter) of the image changes depending on the distance between the reflector and the image sensor. Thus, the distance between the reflector and the image sensor, that is, the height (Z coordinate) of the reflector 50 can be obtained based on the diameter (size) of the reflector image. Although the Z coordinate is not used in the golf game system of this embodiment, a different game input can be given by using the Z coordinate as necessary.

  In this way, the Z coordinate is obtained in step S113, and the center coordinate (X, Y or X, Y, Z) of the reflector 50 is stored in step S115.

  Thereafter, in step S117, the N value of the number register is incremented, and in step S119, it is determined whether the number N has exceeded a specified value. If “YES” is determined in the step S119, the process directly returns to the step S59 in FIG. However, if “NO” is determined, the process returns to the previous step S105 to repeatedly execute the steps after step S105.

  If “NO” is determined in step S109, that is, if it is determined that the luminance of the pixel having the maximum luminance does not exceed the specified value, whether or not the result is that all the specified number of data are searched in the next step S121. to decide. If “YES” is determined in step S121, that is, if all the prescribed number of pixels have been searched, the search result is stored in step S123 as if there is no attention point. However, if “NO” is determined in the step S121, the coordinate data of the next highest luminance pixel is acquired in a step S125, and the process returns to the step S107.

  After performing the attention point extraction process in this manner in step S57, a motion calculation process such as calculating a velocity vector is executed in the next step S59.

  FIG. 20 shows a detailed example of the velocity vector calculation process which is an example of the motion calculation process. In step S127 of FIG. 20, “1” is substituted into the number register N as described above. Thereafter, in step S129, the N-1th point of interest coordinates (PX [N-1], PY [N-1]) from the Nth point of interest coordinates (PX [N], PY [N]: FIG. 21). Is subtracted to calculate the Nth velocity vector (VX [N], VY [N]) and stored in the internal memory.

  FIG. 21 shows an image of a first attention area having a diameter Φ [1]. The center coordinates of the first attention area are (PX [1], PY [1]) and the diameter Φ The center coordinates of the second attention area having [2] are (PX [2], PY [2]). Similarly, the third and fourth attention areas have diameters Φ [3] and Φ [4], respectively, and their center coordinates are (PX [3], PY [3]) and (PX, respectively. [4], PY [4]).

  If the second region of interest is the Nth, the N-1th region is the first region of interest. Accordingly, in step S129, in this case, the velocity vector VX [2] in the X direction is given by (PX [2] −PX [1]), and the velocity vector VY [2] in the Y direction is (PY [2] − PY [1]). When N = 1, since there is no coordinate data of N−1, the previous final result data is used, or if there is no final result data, the velocity vector is calculated using the specified value.

  FIG. 21 also shows the amount of change ΔX, ΔY for each image of the target point region (reflector) of each strobe image. Therefore, if necessary, the change or displacement speed can be calculated using this amount of change.

  After calculating the velocity vector in step S129, the number N is incremented in step S131, and it is determined whether or not N has reached the specified value in the subsequent step S133. If “NO” in the step S or 133, the process returns to the previous step S129, and the step S129 is repeatedly executed.

  After step S59, in the next step S61, the determination process shown in detail in FIG. 22 is executed. In this determination process, it is determined whether or not the golf club type input device 14 has been swung. In the first step S135 of FIG. 22, “1” is substituted for N, and then in step S137, the velocity V [N] (scalar value) from the Nth velocity vector (VX [N], VY [N]). ) Is calculated. Then, in the next step S139, it is determined whether or not the speed V [N] thus calculated exceeds the first threshold value. If “YES” in this step S139, it is immediately determined that “swing has been performed” in a step S141, and in step S143, an initial velocity vector of the golf ball at the time of hitting is obtained from the N-th velocity vector. Therefore, in the case of the golf game system of the embodiment, the flight distance of the ball can be calculated from the initial velocity vector, the wind direction, the wind strength, and the terrain data.

  When “NO” is determined in step S139, that is, when the swing speed of the golf club falls below the first threshold value, in the next step S145, a line segment connecting the Nth point and the N−1th point. Determines whether or not intersects the specified area. If “YES” is obtained in step S147 as a result of this determination, in the next step S149, it is determined whether or not the N-th speed (scalar value) exceeds the second threshold value. However, the second threshold value is naturally smaller than the first threshold value.

  If “YES” in the step S149, the process proceeds to the previous step S141. If “NO”, the process proceeds to a step S151 as in the case of “NO” in a step S147, and the N value is incremented. Then, it is determined whether N> the specified value. If “NO”, the process returns to the previous step S137 and the subsequent steps are repeatedly executed. However, if “NO” is determined in step S153, that is, if the line segment in step S145 does not intersect with the predetermined region or if it intersects, the speed is smaller than the predetermined value, step S155. In the end, it is determined that “the swing is not performed”.

  When the determination process of FIG. 22 is completed, the process returns to step S63 of FIG. 15. In this step S63, a process according to an application such as a game is performed ”, and whether or not the process is completed in step S65 (game In the case of (1), it is determined whether or not the game is finished), and if “YES”, the process is finished.

  In the above-described embodiment, it is assumed that the golf club type input device 14 is provided with the circular reflector 50, the initial velocity vector is obtained from the movement locus, and the golf ball is launched with the initial velocity vector. The flight distance was calculated. In other words, the rotation given to the ball was ignored. This is because the orientation of the golf club type input device 14 cannot be specified with a circular reflector. Therefore, in the next embodiment, the orientation of the golf club type input device 14 can also be calculated.

  Therefore, in the next embodiment, a golf club type input device 14 shown in FIG. 23 is used. In this embodiment, the golf club type input device of FIG. 4 used a circular reflector, but an elliptical or longitudinal reflector 50A is used.

  Then, after obtaining each pixel data when the light emitting diode 42 is turned on and off in step S55 of FIG. 15, the attention point extraction process shown in FIG. 24 is executed. However, steps S157-S163 are the same as steps S103-S109 in FIG.

  Then, in the next step S165, it is sequentially determined whether or not the pixel in contact with the pixel of the coordinate acquired in step S161 and further the pixel in contact with the pixel exceed a specified value, and the attention portion (in the embodiment, the image of the reflector) ) Are extracted. In step S166, two pixels Pa (Xa, Ya) and Pb (Xb, Yb) that are most distant from each other are extracted from all the pixels in the target portion. As shown in FIG. 26, these two points indicate both end positions in the longitudinal direction of the oval reflector 50A. There is no point where the distance between two points is farthest apart from both ends in the longitudinal direction.

  In step S167, the midpoint coordinates of the two points Pa and Pb are stored in the memory as the Nth point coordinates (PX [N], PY [N]). In step S169, the inclination between the two points Pa and Pb shown in FIG. 26 is calculated and stored as angle data θ [N]. However, the inclination θ [N] can be calculated with an arc tangent of (Xb−Xa) / (Ya−Yb) as shown in step S169.

  In this way, the orientation of the golf club type input device 14 with respect to the image sensor is obtained as the angle data θ [N].

  Steps S171 to S179 in FIG. 24 are the same as the corresponding steps S117 to S125 in FIG. In the next determination process, the steps shown in FIG. 25 are executed. Steps S181 to S189 and S191 to S201 in FIG. 25 are the same as the corresponding steps S135 to S143 and S145 to S155 in FIG.

  In step S203 of FIG. 25, the angle θj (FIG. 26) is calculated based on the coordinates of the Nth point and the N−1th point obtained in step S169 of FIG. This angle θj can be calculated by an arc tangent of (PY [N] −PY [N−1]) / (PX [N] −PX [N−1]) as shown in step S203. The direction of the swing of the club type input device is shown. In step S205, the inclination θk (= θ [N] −θj) of the golf club type input device 14 with respect to the swing direction of the golf club type input device 14 is calculated according to the equation shown in step S205, and the ball is hit from θk. Calculate hourly hook / slice parameters. In this way, by determining the hook / slice parameters, not only a simple flight distance but also a change in the flight direction due to the spin of the sphere can be taken into account. Interestingness can be given.

  Referring to FIG. 27, a bowling game system 78 according to another embodiment of the present invention includes a game machine 80. This game machine 80 is similar to the game machine 12 of the system 10 of FIG. The battery is driven and connected to an AV terminal (not shown) of a television monitor (not shown) through the AV cable 16.

  The game machine 78 also includes a housing 82, a power switch 84 is provided on the housing 82, and a direction button 86, an enter key 88 and a cancel key 90 are provided. These buttons and operation keys have the same functions as the corresponding ones in FIG.

  A portion of the housing 82 of the game machine 80 is cut out, and a movable body 92 is pivotally supported by the portion so as to be rotatable in the elevation direction. The side of the movable body 92 will be described with reference to FIG. Therefore, the movable body 92 is provided with the same image sensor 40 as the previous one. An infrared light-emitting diode 42 that is lifted up and down integrally with the image sensor 40 is provided on the side surface of the movable body 92 and in the vicinity of the image sensor 40, and constitutes a stroboscopic cove imaging means.

  In the embodiment, the movable body 92 is supported so as to have a certain degree of freedom in the elevation direction. However, instead of the elevation direction or in combination with the elevation direction, the degree of freedom in the turning direction may be provided. That is, the movable body 92, that is, the image sensor 40 and the infrared light emitting diode 42 are provided so as to be displaceable in an arbitrary direction.

  However, if the lens of the image sensor 40 (concave lens or convex lens shown in FIG. 4) is a wider angle lens, the image sensor 40 does not need to be movable, and the image sensor 40 may be fixedly attached. Good.

  The ball-type input device 94 has holes 94a, 94b and 94c for inserting three fingers of the user's hand, that is, the thumb, middle finger and ring finger, respectively, as in the actual bowling game. A wide hole 94d into which a book or a plurality of fingers can be inserted is further formed. A strap 96 is provided, and the game player is secured by wearing the strap 96 on his / her arm (upper arm or forearm). That is, since the ball-type input device 94 is connected to his / her arm by the strap 96, the ball-type input device 94 can be located anywhere even if the game player accidentally releases the ball-type input device 94 like an actual bowling game. There will be no accidents such as flying over and hitting yourself or others.

  Further, as shown in FIG. 28, the ball-type input device 94 of this embodiment forms a housing of the ball-type input device 94 by connecting transparent or translucent hemispherical outer shells 98A and 98B with bosses. In the outer shells 98A and 98B, hemispherical inner shells 100A and 100B which are similarly connected by bosses are fixed. And a reflector is formed by sticking a reflective sheet on the surface of each hemispherical inner shell 100A and 100B. That is, the inner shell becomes a reflector. Therefore, in this embodiment, the reflector 100 is used.

  Further, in the bowling game system 78 of this embodiment, as described above, the movement of the ball-type input device 94 is detected by the stroboscope, thereby the position of the bowling ball 104 on the game screen 102 shown in FIG. To control. The game screen 102 is displayed as a projected image viewed from the viewpoint of the user or player. That is, on the game screen 102, a bowling lane 106 and a pin 108 arranged at the position in the depth direction are displayed, and the bowling ball 104 moves on the lane 106 on the game screen 102, and the arrival position of the ball 104, Depending on the strength, the pin is knocked down as in an actual bowling game. However, for example, if an image obtained by enlarging the pin portion immediately before the bowling ball 104 hits the pin 108 is displayed as a window (not shown) in the center of the screen, a greater sense of realism can be given to the player.

  Each time the player's pitching operation is completed, the game screen 102 shown in FIG. 29 and the score sheet 110 shown in FIG. 30 are switched and displayed. When a plurality of game players play, each person's score is displayed simultaneously. The example of FIG. 30 shows an example of a score sheet when four game players are simultaneously participating in a bowling game.

  In this bowling game system 78, when the player actually performs a pitching motion in the real space using the ball type input device 94, the game processor 52 (FIG. 31) intermittently lights the infrared light emitting diode 42, The position of the ball-type input device 94 is intermittently detected by analyzing or processing the image of the CMOS image sensor 40 every time it is turned on and off. Then, the movement of the bowling ball 104 is controlled in accordance with the position (coordinates) of the ball type input device 94, thereby defeating zero or one or more pins.

  Referring to FIG. 31, as described above, ball-type input device 94 is irradiated with the light emitted from infrared light emitting diode 42, and the infrared light is reflected by reflector 100. The reflected light from the reflector 100 is photographed by the CMOS image sensor 40, and thus the video signal of the reflector 100 is output from the CMOS image sensor 40. However, the other parts are the same as those of the golf game system 10 shown in FIG.

  Here, with reference to FIG. 32, the general operation of the bowling game system 78 of the embodiment will be described. The power switch 84 shown in FIG. 27 is turned on to start the game. The game processor 52 shown in FIG. 31 first executes initialization processing in step S1. Specifically, the system and each variable are initialized. However, the specific method of initialization is as described above.

  Then, after step S1 in FIG. 32, the game processor 52 updates the image displayed on the monitor 20 by updating the image signal in step S2. However, this display image update is executed for each frame (television frame or video frame).

  And the game processor 52 performs the process according to a state (state). However, the first process is to select a game mode. In this game mode selection, the user or game player operates the selection key 86 shown in FIG. 27 to select a game mode such as a one-player mode or a two-player mode in step S3 in FIG. Set the difficulty level.

  In an actual bowling game, it is necessary to roll the ball on the lane. However, in the bowling game system 10 of the embodiment, as described above, a pitching operation is performed using the ball type input device 94. Therefore, the game processor 52 executes a pitching motion determination process in step S4 to determine whether or not the pitching motion has been performed. If a pitching operation has been performed, then in step S5, when the ball 104 is moving on the lane 106 (both in FIG. 30), the trajectory of the ball is calculated, and the pin 108 ( The collision determination process for FIG. 30) is executed. When the ball 104 reaches the end of the lane 106, in step S6, score calculation and result determination processing are executed as a result of the pin collision determination processing in step S5.

  In the bowling game system 78 of this embodiment, it is the same as in the previous embodiment that a game input is made by photographing the reflector 100 with a stroboscope. Therefore, the determination processing step S61 of FIG. 15 is different from the previous embodiment.

  The determination processing steps are illustrated in detail in FIG. 33, and each initial step S207 sets the N value as “1”. In step S209, it is determined whether the Y component (vertical component) VY [N] (FIG. 21) of the velocity vector exceeds a specified value. If “YES” in the step S209, the process proceeds to a step S211 to increment a counter formed in the internal memory, for example. Then, in the next step S213, it is determined whether or not the count value of the counter has reached a specified constant C (for example, “3”). If “YES”, it is determined in step S215 that “the pitching operation has been performed”, and in step S217, the X coordinate PX [N] of the Nth point is set as the X coordinate of the pitching position, and in step S219, the N point The initial velocity of the ball at the time of pitching is obtained from the eye velocity vector (VX [N], VY [N]). Then, the game process is executed on the assumption that the bowling ball has been thrown according to the initial speed.

  If “NO” is determined in the step S209, the above-described counter is reset in a step S221. Therefore, for example, if the Y component of the velocity vector does not exceed a specified value for three consecutive times, it is not determined that there has been a pitching operation. This prevents unwanted movement of the game player from being reflected in the game.

  After step S221, the N value is incremented in step S223, and it is determined whether or not the N has reached a predetermined value in step S225. If “YES” is determined, it is determined in step S227 that “throwing has not been performed yet”. Then, in the same manner as after step S219, the process returns to step S63 in FIG.

  FIG. 34 shows another embodiment of an input device using a stroboscope, and the input device 112 of this embodiment is a glove-type input device. The glove-type input device 112 includes gloves 114L and 114R worn on both the left and right hands of the game player or user. And 116R are provided. The reflectors 116L and 116R may be formed as a part of the gloves 114L and 114R, respectively, but may be attached to the gloves 114L and 114R.

  In order to give an input signal, the user puts gloves 114L and 114R on both hands, and moves both hands on the photographing unit 28 (FIG. 3) of the game machine 80 as shown in FIG. Then, according to step S55 of FIG. 15 already described, that is, FIG. 16, the reflectors 116L and 116R are both photographed by the image sensor 40 with or without being illuminated by the infrared light emitting diode 42. Then, in step S57 of FIG. 15, that is, in FIG. 18, a point of interest (in this example, there are two points of interest because there are two reflectors 116) is extracted. Thereafter, step S59 of FIG. 15 is applied to execute motion calculation or detection processing. However, when the glove-type input device 112 of FIG. 34 is used, step S59 is modified as shown in FIG.

  In the flow diagram shown in FIG. 35, input is obtained by detecting or calculating a moving average. More specifically, in the first step S207, “specified value−M” is set in the number register N. Next, in step S209, “0” is set in each of the variables ΣX and ΣY.

  In step S211, the Nth coordinate (PX [N], PY [N]: FIG. 21) is acquired. At this time, however, if N <1, coordinate data is acquired from the previous coordinate information. In the next step S213, the coordinates acquired in step S211 are added to the variables ΣX and ΣY initialized in step S209, respectively, and ΣX and ΣY are updated. This is repeatedly executed until it is detected in step S217 that the number of times N incremented in step S215 has reached a specified value. Therefore, the game processor 52 stores the variables ΣX and ΣY obtained by adding M coordinates at this time. In step S219, the moving average (AX, AY) is calculated by dividing ΣX, ΣY by the number M. Using the moving averages AX and AY, the game processor 52 changes the position of the movable body that can be operated by the player on the game screen, for example.

  In addition to the embodiment described above, the present invention can have the following embodiments or modifications.

  For example, in the embodiment shown in FIG. 2, a golf club type input device 14 is used for input, but a baseball bat type input device and / or a baseball ball type input device is used using a similar system. Many variations such as a baseball game device, a table tennis game using a table tennis racket type input device, and a tennis game using a tennis racket type input device are conceivable.

  Further, a variation such as a soccer game device in which an input device including a reflector is attached to the lower leg or ankle and the player's foot position, speed, and motion trajectory pattern are handled as input signals is also conceivable.

  Further, in the embodiment using the glove-type input device shown in FIG. 34, the moving average value calculated in the flowchart of FIG. 35 is used as the input signal, but the position, moving speed, and movement locus of the glove-type input device are determined. Many variations such as a fighting game apparatus and a dance game apparatus that calculate and handle these as input signals are conceivable. In these modified examples, the same effect as that of the glove-type input device can be expected by using a wristband-shaped input device wound around the wrist instead of the glove-type input device.

  Further, by using the input device attached to the above-mentioned foot in combination with the glove-type input device shown in FIG. 34 or the wristband-shaped input device, many variations such as a dance game device using limbs are conceivable.

  Further, like the golf club type input device 14 shown in FIG. 23, an elongated reflector 50A is attached to an input device having a sword shape, and the sword angle, position, moving speed, and moving locus are handled as input signals. Many variations are possible, such as a sword fighting game device.

  In the present invention, an object is photographed using a stroboscope and an imaging means, and the position, size, speed, and acceleration of the object are determined based on respective differences between a plurality of light emitting video signals and a plurality of non-light emitting video signals. Then, a part or all of the information of the motion trajectory pattern is calculated. The information processing apparatus and the entertainment apparatus execute information processing, games, and other entertainment processes using the information.

  However, in the above example, all the information processing is executed by one game processor, but it is naturally possible to share the entire processing using two or more processors and computers.

DESCRIPTION OF SYMBOLS 10 ... Golf game system, 78 ... Bowling game system, 12, 80 ... Game machine, 14 ... Golf club type input device, 28 ... Shooting unit, 40 ... Image sensor, 42 ... Infrared light emitting diode, 50, 50A, 100 ... Reflector 52 ... Game processor 94 ... Ball type input device 112 112 Glove type input device

Claims (18)

An information processing apparatus having an input system using a stroboscope,
A stroboscope including a light source that outputs light in a specific wavelength region,
Unit base,
A filter that transmits only light in the specific wavelength region,
An imaging means for photographing a first object including a first retroreflector and generating a light-emitting video signal and a non-light-emitting video signal when the stroboscope emits light and does not emit light, respectively, and the light-emitting video signal And a non-light-emitting video signal to detect a first target portion corresponding to the first retroreflector, and information on the position, size, speed, acceleration, and motion trajectory pattern of the first object. Processing means for calculating a part or all,
The unit base is
A support cylinder having an opening;
A lens provided below the opening and provided in the support cylinder,
The filter is disposed so as to cover the opening of the support cylinder,
The imaging means is disposed in the unit base and below the lens,
The information processing device, wherein the light source is disposed in the vicinity of the filter so as to illuminate the first object.   The information processing apparatus according to claim 1, further comprising: a moving body control unit that controls movement of the moving body on the screen based on the information calculated based on the difference by the processing unit. The processing means includes determination means for determining whether the information based on the difference meets a predetermined condition,
The information processing apparatus according to claim 2, wherein the moving body control unit changes the moving body on the screen when the determination unit determines that the information based on the difference matches the predetermined condition. .   The processing means extracts the first attention part from the difference, and calculates a distance between the first object and the imaging means based on information indicating the size of the first attention part. The information processing apparatus according to claim 1, comprising means. The processing means indicates an analysis means for extracting a shape of the first target portion from the difference between the video signal at the time of light emission and the video signal at the time of non-light emission, and an inclination of the shape corresponding to the first object. The information processing apparatus according to claim 1, further comprising an angle calculation unit that calculates an angle. The analyzing means is for extracting two predetermined points in the first target portion;
6. The information processing apparatus according to claim 5, wherein the calculation of the angle by the angle calculation means calculates an angle between a line segment connecting the predetermined two points and a predetermined coordinate axis. It further comprises a movable body that can be rotated in the elevation direction and / or the turning direction,
The information processing apparatus according to claim 1, wherein the imaging unit, the unit base, and the light source are housed in the movable body. The first retroreflector has an elongated shape;
The processing means detects the first target portion from the difference and calculates an angle, a position, a moving speed, or a moving locus of the object,
The information processing apparatus includes:
Angle of the first object to said processing means to calculate the position, moving speed, or, on the basis of the movement locus information processing apparatus according to any one of claim 1, further comprising means for performing Ken闘game 7 . The imaging means photographs the second object including the first object and the second retroreflector at the time of light emission and non-light emission of the stroboscope, and outputs a video signal at the time of light emission and a video signal at the time of non-light emission. Generate
The processing means determines the first target portion corresponding to the first retroreflector and the second target portion corresponding to the second retroreflector from the difference between the video signal during light emission and the video signal during non-light emission. The information processing apparatus according to claim 1, wherein the information processing apparatus detects and calculates part or all of information on a position, a size, a speed, an acceleration, and a motion trajectory pattern of each of the first object and the second object.   An information processing system having an input system using a stroboscope,
  A first object including a first retroreflector;
  A stroboscope including a light source that outputs light in a specific wavelength region,
  Unit base,
  A filter that transmits only light in the specific wavelength region,
  Imaging means for photographing the first object and generating a video signal at the time of light emission and a video signal at the time of non-light emission, respectively, at the time of light emission and non-light emission of the strobe scope;
  The first target portion corresponding to the first retroreflector is detected from the difference between the video signal at the time of light emission and the video signal at the time of non-light emission, and the position, size, speed, acceleration, motion locus of the first object is detected. Processing means for calculating part or all of the pattern information,
  The unit base is
  A support cylinder having an opening;
  A lens provided below the opening and provided in the support cylinder,
  The filter is disposed so as to cover the opening of the support cylinder,
  The imaging means is disposed in the unit base and below the lens,
  The information processing system, wherein the light source is disposed in the vicinity of the filter so as to illuminate the first object. The information processing system according to claim 10 , wherein the first object is provided with a strap. The information processing system according to claim 10 , wherein the first object has a band shape. Wherein the first object is attached to the lower leg or the ankle of the player, the information processing system according to any of claims 10 to 12. Wherein the first retroreflector is provided a transparent or a translucent housing, the information processing system according to any of claims 10 13. The information processing system according to claim 10 , wherein the first object is a glove type.   A second object including a second retroreflector;
  The imaging means shoots the first object and the second object at the time of light emission and non-light emission of the stroboscope to generate a light emission video signal and a non-light emission video signal,
  The processing means determines the first target portion corresponding to the first retroreflector and the second target portion corresponding to the second retroreflector from the difference between the video signal during light emission and the video signal during non-light emission. The information processing system according to claim 10, wherein the information processing system detects and calculates part or all of information on a position, a size, a speed, an acceleration, and a motion trajectory pattern of each of the first object and the second object. The first object is attached to or held by a player's hand or wrist,
The information processing system according to claim 16 , wherein the second object is attached to a lower leg portion or an ankle of the player. A stroboscope including a light source that outputs light in a specific wavelength region, a unit base, a filter that transmits only light in the specific wavelength region, and a retroreflector when the stroboscope emits light and when it does not emit light, respectively. An imaging means for photographing a target object to generate a video signal for light emission and a video signal for non-light emission; and the unit base includes a support cylinder having an opening, and a lower part of the opening, the support cylinder A lens provided inside the filter, wherein the filter is disposed so as to cover the opening of the support cylinder, and the imaging means is disposed in the unit base and below the lens, and the light source Illuminates the object and in response to input from a man-machine interface system disposed in the vicinity of the filter,
Detecting a target portion corresponding to the retroreflector from a difference between the video signal at the time of light emission and the video signal at the time of non-light emission;
A computer program for causing a computer to execute a step of calculating part or all of information on the position, size, speed, acceleration, and motion trajectory pattern of the target portion.

Images