JPH1142366A - Game machine - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a game machine by which users can healthfully play using the whole body. SOLUTION: This machine is provided with an infrared LED panel 3 emitting infrared rays to the rear surface side of an opaque surface 2, a CCD camera 4 picking up the image of the infrared rays entering from the side of the surface 2, and a projector 5 projecting and displaying a picture (not including the infrared rays) to the surface 2. As the reflected light quantity of infrared rays varies when a user operates on the front surface side of the surface 2, a controller 6 detects the variation of the reflected light quantity based on the image pickup signal of the camera 4 as detected picture information and the input operation of the game machine 1 is performed by operation information obtained based on this picture information. Thereby, various games using a computer by which the users can healthfully play using the whole body are provided.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a game apparatus using a display system capable of interactive input and output.

[0002]

2. Description of the Related Art For example, in a computer device, there are various games that can be played under various programs and applications. Generally, such a game can be enjoyed by a user operating an input device such as a mouse, a keyboard, or a dedicated joystick while watching a monitor screen of a computer device.

[0003]

However, since a game using the above-described computer device is generally performed indoors while staring at a monitor screen of a relatively small computer device, the game is performed for a long time. In such a case, there is a disadvantage that a burden is imposed on the user's eyes. Further, the input operation is not healthy because there is not much opportunity to move the body because the input device such as the mouse, the keyboard or the joystick described above is operated only by the fingertip.

Accordingly, the present invention provides a game apparatus which uses a monitor device having a relatively large screen that does not impose a burden on the user's eyes and that allows the user to move the whole body in a healthy manner. It is intended to provide a simple configuration.

[0005]

SUMMARY OF THE INVENTION In view of the above-mentioned problems, the present invention has an image pickup means for capturing only a translucent surface and light or electromagnetic waves of a predetermined wavelength band incident from the direction of the translucent surface as an image. And generating, based on the imaging signal input from the imaging means, detection image information reflecting the operation given to the translucent surface, and generating the operation information identified based on the detection image information. Control processing means for performing a required control process based on the image processing means, and projection display means provided to be capable of projecting and displaying an image of visible light that does not include the wavelength band of light or electromagnetic waves to be imaged on a translucent surface The control processing means is configured to be able to execute display control on the projection display means for projecting and displaying a game image whose display form changes according to a predetermined rule based on the operation information.

In the above configuration, for example, the state of light or electromagnetic waves incident on the image pickup means changes depending on a physical object approaching a translucent surface. In the present invention, such a change in the state of light or electromagnetic waves is imaged. It will be caught as information. The imaging information thus obtained is used as operation information. That is, operation information can be provided by moving or moving some physical object near the translucent surface. Further, an image can be projected and displayed from the projection display means on the translucent surface.

[0007]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a game device according to an embodiment of the present invention will be described. The following description will be made in the following order. <1, Detection Operation of Game Device Configuration and Operation Information><2, Ball Rally Game><3, Shooting Game (First Example)><4, Shooting Game (Second Example)><5. Configuration of game device as embodiment>

<1. Configuration of Game Apparatus and Operation of Detecting Operation Information> First, referring to FIGS. 1 to 6, a configuration example of a game apparatus according to an embodiment of the present invention and detection of basic operation information will be described. The operation will be described. FIG. 1 conceptually shows a configuration example of a game device according to the present embodiment. The game device 1 shown in FIG. 1 has a translucent surface 2 and an infrared light emitting diode (LED).
A) a panel 3, a CCD (Charge Coupled Device) camera 4, a projector 5, and a control device 6. The infrared LED panel 3, the CCD camera 4, and the projector 5 are provided on the back side of the translucent surface 2.

As the translucent surface 2, for example, a translucent film such as tracing paper is attached to a transparent glass plate, or a translucent material such as ground glass is used. The game device 1 has both functions of an operation panel and a display panel as described later. The infrared LED panel 3 includes, for example, a large number of infrared LEDs on a panel surface.
Are collectively arranged, and provided so that infrared light emitted and output from the infrared LED is applied to the entire back surface of the translucent surface. The infrared LED is driven by the control device 6 so as to constantly emit infrared light. It should be noted that the infrared LED panel 3 may be provided with a sufficient number of infrared LEDs to emit the emitted infrared light to the entire translucent surface 2. Further, as described later, image information reflected from the translucent surface 2 side is obtained based on the difference between the current infrared image and the initial infrared image. There is no need for the amount of infrared light to be irradiated to be uniform. Therefore, the size of the infrared LED panel 3 can be much smaller than that of the translucent surface 2.

The CCD camera 4 has a CCD as an image pickup device.
In this case, the translucent surface 2
It is provided to recognize an operation performed on the translucent surface 2 as image information by capturing only an infrared light component as image light reflected on the image. For this reason, an infrared transmission filter 4a that transmits only the wavelength band in the infrared region is provided for a portion of the optical system of the CCD camera 4.
In addition, the arrangement position is set so that the whole of the translucent surface 2 is included as an angle photographed by the CCD camera 4.

The projector 5 projects and displays image light of visible light on the back surface of the translucent surface 2 based on the image information supplied from the control device 6. For example, the user can observe the image of the projector 5 projected and displayed on the translucent surface 2 from the front side of the translucent surface 2. here,
The optical system of the projector 5 is provided with an infrared cutoff filter 5a that cuts off wavelengths in the infrared region. Is the projected image of C
Invisible from the CD camera 4.

The control device 6 includes, for example, a microcomputer, and obtains image information (video data) from an image pickup signal supplied from the CCD camera 4, and further obtains operation information based on the image information. Then, based on the operation information, for example, display control relating to an image to be displayed on the translucent surface 2 by the projector 5 is performed, and various necessary control processes are performed. Further, the infrared LED of the infrared LED panel 3 is driven to emit light. In addition, the infrared LED
The arrangement positions of the panel 3, the CCD camera 4, and the projector 5 may be set in consideration of the role that each should play.

FIG. 2 is a block diagram showing an example of the internal configuration of the control device 6. In the control device 6 shown in this figure, the LED driving unit 10 is a circuit part for driving the emission of a plurality of infrared LEDs provided on the infrared LED panel 3. The image input unit 11 generates a video signal by performing required signal processing on the imaging signal supplied from the CCD camera 4 and supplies the video signal to the input image processing unit 12. That is, in the image input unit 11, C
The infrared light incident via the CD camera 4 is output as video information.

The input image processing section 12 converts, for example, a video signal supplied from the image input section 11 into video signal data of a digital signal. The input image processing unit 12 performs a required analysis process or the like using “image information (eg, video data in units of frames)” obtained based on the video signal data, so that the translucent surface 2 The information of the operation performed is obtained. Here, as the operation information obtained based on the image information, for example, the position (coordinates) on the image of the operating tool operating the translucent surface 2 and the signal level of the image are used. This operation information is transmitted to the database driving unit 14. Further, the video signal data can be supplied to the image synthesizing unit 17.

The threshold control unit 13 includes the input image processing unit 1
A threshold necessary for the processing related to the operation information executed in step 2 is set and transmitted to the input image processing unit 12. The input image processing unit 12 obtains operation information by executing required processing such as analyzing image information using a threshold value set by the threshold value control unit 13. In the present embodiment, the current image state (detected image information) of the translucent surface 2 is obtained by calculating the frame difference of the input image data as described later. It is also assumed that information such as a reference value (reference image input level) to be used is stored in the threshold control unit 13 as described later.

The database driving unit 14 takes in the operation information obtained by the input image processing unit 12, and executes necessary processing as appropriate based on the operation information. At this time, the program data necessary for the control process to be executed by the database driving unit 14 is stored in the database memory 15, and the database driving unit 14 performs the required control based on the program data stored in the database memory 15. Processing will be executed. In particular, in the present embodiment, a game program for executing processing of various games described later is stored in the database memory 15.

The image generating unit 16 includes the database driving unit 1
Under the control of (4), necessary image data (video signal data by digital signal) is generated and output to the image synthesizing unit 17. In the image synthesizing unit 17, if necessary, the video signal data supplied from the image generating unit 16 is
The video signal data supplied from the input image processing unit 12 is synthesized and output to the RGB signal generation unit 18. RGB
The signal generating unit 18 converts the video signal data supplied from the image
The signal is converted into a B signal and output to the projector 5. As a result, the image light of the video in response to the operation performed on the translucent surface 2 is output from the projector 5.
Is output.

As described above, in the game device according to the present embodiment, the translucent surface 2 functions as an input operation unit. Therefore, first, a description will be given of a method of detecting basic input operation information in game device 1 of the present embodiment having the above configuration. The entirety of the translucent surface 2 shown in FIG. 1 is irradiated with infrared light from the back by the infrared LED panel 3.
Is translucent, so that all infrared light is translucent
Rather than passing through the translucent surface 2
Will be reflected by the action of In the present embodiment, under the condition that no operation is performed on the translucent surface 2, the infrared light reflected by the translucent surface 2 is imaged by the CCD camera 4. The initial level of the video signal data obtained by this is stored as "reference input image level". The reference input image level may be determined, for example, by detecting the signal level of each pixel in one frame based on the input video signal data. This detection processing is performed by the input image processing unit 12. The information on the reference input image level detected in this way is transmitted to the threshold value detection unit 13 and is held here.

The process of detecting the reference input image level is, for example, as shown in the flowchart of FIG. As shown in this figure, first, in the input image processing unit 12, step S
At 101, a signal level is detected for each pixel as described above based on one frame of image data obtained from a video signal supplied from the CCD camera 4 via the image input unit 11, and the detection result is obtained. Obtained as the reference input image level Lint. Specifically, it is conceivable to detect the level of the luminance signal component for each pixel and use this as the reference input image level Lint. Input image processing unit 12
Performs a process to transmit the reference input image level Lint to the threshold control unit 13 and store it in the subsequent step S102.

The process of detecting the reference input image level Lint and storing it in the threshold value control unit 13 (the processing operation shown in FIG. 3) can be executed, for example, when the power of the game apparatus 1 is turned on. Alternatively, a configuration may be considered in which the reference input image level Lint is updated when necessary by an instruction of a user.

As described above, the reference input image level Li
Under the state where the information of nt is held, the image information treated as the operation information is obtained as follows.
FIG. 4 shows image information serving as a source of operation information (hereinafter, this “image information” is particularly referred to as “detected image information”).
5 is a flowchart illustrating a processing operation of the input image processing unit 12 for obtaining the image data. In this case, the input image processing unit 12
First, in step S201, the current input image level L
A process for detecting prs is executed. The input image level Lprs here is frame-by-frame data of an image of the translucent surface 2 based on infrared light, which is currently captured by the CCD camera 4, and is a signal level for each pixel in the frame-based image data. This is information obtained by detecting.

Subsequently, the input image processing section 12 executes step S
In 202, the difference between the reference input image level Lint and the current input image level Lprs is calculated (L = L
prs-Lint) to obtain the difference input image level L
Is calculated. Specifically, the reference input image level Lint
And the data value obtained as the input image level Lprs is obtained for each pixel at the same position to obtain a difference input image level L. Therefore, the difference input image level L is always set to the reference input image level L
The signal level difference from int to the current input image level Lprs is obtained for each pixel. Then, the input image processing unit 12 proceeds to step S203, and generates current detected image information (video data in a format having level information for each pixel on a frame basis) based on the difference input image level L. Is done.

The detecting operation of the detected image information as described above
This will be described together with the actual movement of the user on the front side of the translucent surface 2. For example, the user performs an operation on the front side of the translucent surface 2 using some object that can reflect infrared rays on the front side of the translucent surface 2. The user's own finger or body is used. Here, for example, when the user is far away from the translucent surface 2 on the front side of the translucent surface 2 as shown in FIG. Since the amount of infrared light is small, most of the light does not return from the front to the back of the translucent surface 2. At this time, the above-described reference input image level Lint is equal to the current input image level Lprs, and the input image processing unit 12 detects that the difference input image level L is almost 0. That is, as the detected image information generated based on the difference input image level L, a state in which there is no change similar to the initial state is obtained.

Here, for example, if the user gradually approaches the translucent surface 2 from the above-described state, of the infrared light that passes through the translucent surface 2 and is reflected on the user's body, the translucent surface 2, the amount of light reaching the back side gradually increases. When viewed from the input image processing unit 12, this state is regarded as a state where the level of the current input image level Lprs with respect to the reference input image level Lint of the image portion corresponding to the user's body gradually increases. In response to this, the user's appearance approaching the translucent surface 2 is gradually captured according to the difference input image level L calculated as the detected image information.

When the user's body is very close to the translucent surface 2 (for example, within 30 cm from the translucent surface 2 depending on the setting of the threshold value), the infrared light reflected on the human body Almost passes through the translucent surface 2 and reaches the back side, so that the detected image information in a state where the body shape is clearer is generated.

Here, it is assumed that the user places his body at a certain distance from the translucent surface 2 and, for example, places his or her own finger toward the user and places the body very close to the translucent surface 2. In this case, since the user's finger near the translucent surface 2 reflects more infrared light than other body parts, the image information obtained in the input image processing unit 12 includes an image at a position corresponding to the user's finger. The level of the area is strong, and the level of the image area at the position corresponding to the body part of the user in the background becomes weaker according to the distance from the translucent surface 2. Then, for example, in this state, if a predetermined threshold value set by the threshold value control unit 13 is compared with the detected image information, the image of only the portion corresponding to the user's finger can be easily separated from the background. Similarly, depending on the setting of the threshold value, it is also possible to obtain image information in which only the body part of the user located at a distance from the translucent surface 2 is extracted. As described above, the threshold value is set in the threshold value control unit 13 in accordance with the actually required condition as described above.

As described above, by adopting a configuration in which the state of the front side of the translucent surface 2 is detected as an image based on infrared light, in the present embodiment, the translucent surface 2 is used, for example, for an interactive interface. The following advantages can be obtained by functioning as an input operation unit. First, in the present embodiment, operation information is obtained based on an image obtained by the amount of reflected infrared light from the translucent surface 2 side. Therefore, a special pointing device is particularly used as an operation body for performing an operation. Any kind of object that does not need it and reflects infrared rays can be used. That is, as described above, the whole or a part of the human body or any other object can be used without any problem as the operation body.

For example, in the case of a touch panel or the like, it is necessary to bring an operating body such as a finger into contact with the operation panel surface. In the case of the present embodiment, the position and movement of the operating body are detected as reflection of infrared light. Therefore, there is no need to bring the operating tool into contact with the translucent surface 2, and a method of performing an operation in the space in front of the operating tool can be adopted.

Further, as described above, since the amount of reflected infrared light changes in accordance with the distance of the operating tool to the translucent surface 2, for example, the distance of the operating tool from the translucent surface 2 is used as operation information. Is also conceivable.

Further, as described above, the translucent surface 2 is formed by a simple method such as combining a transparent glass plate or the like with a translucent thin film such as tracing paper, or using a material such as ground glass. Since it can be configured by means and a driving circuit or the like unique to the panel is not required, the size can be easily increased at low cost, and in this point, it is greatly different from a touch panel or the like which is difficult to increase in size. Then, by obtaining operation information based on an image obtained by reflected light of infrared rays from the translucent surface 2 side, if image recognition is possible, a plurality of operation bodies can be simultaneously recognized and required control can be executed. Is possible. In other words, it is possible to perform simultaneous operations on a plurality of different operation targets. Particularly when the translucent surface 2 is configured as a large screen, different types of operations are performed using various regions on the translucent surface 2. Can be performed at the same time, which is very effective.

Since the translucent surface 2 also has a function as an image display panel, for example, after displaying a menu screen to be operated as will be described later, the user can display the menu screen on the menu screen. It is also possible to easily realize a direct operation such as an operation with a finger or the like. As described above, since the game apparatus 1 according to the present embodiment uses the interactive display system, there are many possibilities for inputting the operation information, and the interactive apparatus has not been provided before. A simple input / output environment can be easily constructed.

In the game device 1 according to the present embodiment,
For example, various games are executed by displaying a menu screen and performing necessary operations as appropriate.
FIG. 5 shows a case where the user performs a menu operation in game device 1 of the present embodiment. The operations related to the menu screen, which will be described below, form the basis of the mode of operation on the translucent surface 2 according to the present embodiment and the accompanying display control on the translucent surface 2. FIG. 5 shows a state in which the translucent surface 2 is viewed from the front side.

For example, as shown in FIG. 5, when the user approaches the front of the translucent surface 2, first, the control device 6
Then, the position on the translucent surface 2 to which the user has approached is recognized based on the detected image information obtained at this time. And
Display control is performed so that a menu screen M is displayed as shown in FIG. 5 at a position on the translucent surface 2 where the user is recognized as approaching. The menu screen M is an image projected on the translucent surface 2 from the projector 5 as a matter of course.

Then, in a state where the menu screen M is displayed on the translucent surface 2 near where the user himself is located, for example, the user uses his / her finger to make the menu screen M
It is assumed that the user designates an arbitrary area in which the operation item is displayed. At this time, the user's fingertip is located at a distance within a range of about 3 cm to 30 cm from the translucent surface 2.

Thus, for example, on the menu screen M, any instruction display indicating that the area of the operation item pointed to by the user has been selected (for example, display of a cursor with respect to the selected area or highlighting in a predetermined form).
Will be performed. The display control for the highlighting is realized by detecting the coordinates of the area indicated by the user's finger based on the detected image information.

Here, it is assumed that the enter operation has been performed when a predetermined time (for example, about several seconds) has elapsed from the state where the instruction display was started as described above. Then, if the user performs an enter operation, that is, if a state where a specific operation item is highlighted is maintained for a predetermined time or more, a required control operation according to the specified operation item is executed. For example, a menu screen of another level is displayed according to the designated operation item, or a desired operation is performed on the game device 1. Alternatively, if the game apparatus 1 is configured to be able to control some external device, and the menu screen M is for controlling the operation of the operation of the external device, the external device may be controlled in accordance with the designated operation item. This will control the operation of the device. In addition, if the user sets the translucent
If the user moves away from the front of the user and there is a certain distance or more between the user and the translucent surface 2, the menu screen M that has been displayed up to that point is automatically deleted.

FIG. 6 shows a flowchart of an example of the processing operation of the control device 6 when the menu operation shown in FIG. 5 is performed. In the processing operation shown in FIG. 6, the input image processing unit 12 in the control device 6 mainly recognizes the operation information based on the detected image information, and the database driving unit 14
Is realized by appropriately executing a processing operation in accordance with a program stored in the database memory 15.

First, in step S301, it is determined whether an "approaching object" is detected from the current detected image information. Here, the “approaching body” is any operating body (FIG. 5) that has approached the translucent surface 2 to a predetermined distance range.
Is the user's own body). The detection of the “approaching body” is performed by, for example, the input image processing unit 1.
2 compares the detected image information with a threshold value (set by the threshold value control unit 13) set to detect an approaching object, and, for example, in a certain area of the detected image information, If a value is obtained, it is detected as "approaching object", and if there is no area where a value equal to or greater than the threshold is obtained,
"No approaching body" will be detected. The threshold value for detecting the approaching body is usually set based on the image level of the human body part obtained as the detection image information when the human body (user) approaches the translucent surface 2 to some extent (for example, several tens of cm). Good.

If no approaching object is detected in step S301, the flow advances to step S308 to determine whether or not the menu screen M is currently being displayed, and the menu screen M is not displayed. If the menu screen M is being displayed, the process returns to step S301.
Proceeding to 9, the control processing for deleting the menu screen M is executed. The process of deleting the menu screen M is realized, for example, by the database driving unit 14 stopping the process of generating the image data of the menu screen M for the image generating unit 16.

On the other hand, if an approaching object is detected in step S301, the process proceeds to step S302, where the position of the approaching object on the translucent surface 2 is detected. This processing can be performed, for example, by detecting the coordinates of the area occupied by the approaching object portion in the detected image information. In this case, the coordinates to be detected may be a predetermined single point in the area of the approaching object, or a plurality of points determined according to a predetermined rule, and may be arbitrarily set according to the actual use environment and the like. good.

In the following step S303, control for displaying the menu screen M in the area of the translucent surface 2 corresponding to the position of the approaching object detected in the above step S302 is executed. This control processing is performed so that the image data of the menu screen M of the required document is created in the image generation unit 16 based on the menu screen display program stored in the database memory 15 by the database driving unit 14, for example. Control will be performed. At this time, the database driving unit 14 creates display image data by mapping, for example, the image data of the menu screen M to the display area corresponding to the position of the approaching object detected in step S302. As a result, as the image finally projected from the projector 5, the menu screen M is displayed at a position on the translucent surface 2 where the user approaches.

Next, in step S304, it is determined whether or not an "operating object" has been detected in a display area that is an operation item of the currently displayed menu screen M. Here, the “operation body” is a close distance (3 cm to 3 cm depending on the setting of the threshold) in front of the translucent surface 2.
(About 30 cm).
That is, in FIG. 5, the finger pointing to the menu screen M is targeted. The detection process of the “detection object” is performed by first comparing the threshold value set by the threshold value control unit 13 with the image level of the detected image information for the operation object detection. The presence or absence is detected. The threshold value set at this time is set to a value larger than the approaching object detection threshold value because it is necessary to detect an object at a close distance in front of the translucent surface 2 separately from the background. . Then, for example, if the operation tool is detected as a result of comparison with the threshold value, the coordinate position on the detected image information where the operation tool is detected is detected, and the detected position and the menu screen M are displayed. By determining whether or not the positions on the image information match, it is possible to detect the presence or absence of the operating tool in the display area of the currently displayed menu screen.

If the operation tool is not detected in the display area of the menu screen M as the operation item in step S304, it means that the operation tool has not been detected on the detected image information, or the operation tool has not been detected on the detected image information. Even if the body is detected, it is determined that the detected position of the operation body is not in the area on the image information corresponding to the display area of the menu screen M, and in this case, the process returns to step S301.

On the other hand, if it is determined in step S304 that an operation tool has been detected in the display area of the menu screen M which is an operation item, the process proceeds to step S304.
Proceeding to 305, control is performed such that an instruction is displayed for an operation item on the menu screen M corresponding to the position where the operating tool is detected, and the flow proceeds to step S306.

In step S306, step S
It is determined whether or not the detection state of the operating tool detected in 304 is maintained for a predetermined time or more.
This detection process is performed by monitoring the state transition of the current detected image in the input image processing unit 12. Then, for example, the operating tool is no longer detected from the current detected image information, or the detected position of the operating tool on the detected image information is displayed in the display area where the operation item of the menu screen M detected in step S304 is used. If it is detected that the deviation has occurred, the process returns to step S301.

If it is determined in step S306 that the detection state of the operating tool detected in step S304 has been maintained for a predetermined time or longer, it is determined that an enter operation has been performed, and the flow advances to step S307. In step S307, a required control process according to the operation item at the position where the operation tool is detected on the menu screen M is executed. This processing is executed by the database driving unit 14 according to the program stored in the database memory 15.

<2. Ball Rally Game> Various games that can be executed by the game apparatus 1 according to the present embodiment based on the configuration of the game apparatus 1 and the method of detecting operation information described above. A specific example will be described.

FIG. 7 shows an example of a display screen displayed on the translucent surface 2 when a ball rally game is executed by the game apparatus 1 according to the present embodiment. Here, the state seen from the front side of the translucent surface 2 is shown. Such a ball rally game is displayed on the translucent surface 2 when the user selects a predetermined item from the menu screen M displayed on the translucent surface 2, for example.

The ball rally game shown in FIG. 7 moves at a predetermined speed, for example, displayed in a game area on the translucent surface 2 (the entire translucent surface 2 is a game area in the present embodiment). By performing an operation of hitting the ball 21 by one or more users using, for example, some operation tool (for example, the user's own arm or the like) capable of reflecting infrared rays in front of the translucent surface 2,
The moving direction of the ball 21 displayed in the game area is changed as if the ball 21 was hit back with the user's arm or the like.

The way the ball 21 moves in this case is
For example, the collision surface between the user's arm and the ball 21 at the coordinate position in the detected image information in which it is considered that the ball 21 has collided with the user's arm, that is, the user's arm collides with the ball 21 as shown in FIG. The movement direction is changed as if the tangent S of the ball 21 at the coordinate position considered to have been reflected was reflected as a reflection surface.

The ball 2 displayed on the translucent surface 2
1 is, of course, a semi-transparent surface 2
Is an image projected to. In addition, the user's arm or the like when hitting the ball 21 may be located at a distance within a range of, for example, about 3 cm to 30 cm from the translucent surface 2. What is necessary is just to be comprised so that an arm may be detected as operation information.

This ball rally game is a game in which a plurality of users hit back the ball 21 displayed on the translucent surface 2, for example, when the ball 21 is dropped on the apparent ground, the game is over. . When the ball 21 has moved to a position protruding from the outside of the game area, for example, when the ball 21 has moved to the upper end face or the left and right end face positions of the game area, the ball 2
The moving direction is changed so that 1 is reflected on the upper end face or the left and right end faces. Then, when the ball 21 moves to a position protruding from the lower end face of the game area, that is, when the ball 21 is apparently dropped on the ground, the game is over. In the present embodiment, for the sake of simplicity, the moving speed of the ball 21 moves at a preset speed.
For example, the speed of the ball 21 is gradually increased,
It is also conceivable to vary the speed of the ball 21 according to the speed of the user's arm or the like when 1 is considered to have touched the user's arm or the like.

FIG. 8 is a flowchart showing an example of the processing operation of the control device 6 when the above-described ball rally game is executed. The processing operation shown in FIG. 8 is, for example, operation information supplied from the input image processing unit 12 of the control device 6 when an item of the ball rally game is selected from the menu screen M in the processing operation shown in FIG. The database drive unit 14 is based on the
Is executed by appropriately executing processing operations in accordance with the ball rally game program stored in the game.

In this case, first, in step S400, it is determined whether a predetermined operation for executing the ball rally game has been performed. That is, for example, it is determined whether or not the item of the ball rally game has been selected from the menu screen M shown in FIG. And step S
If it is determined in 400 that the item of the ball rally game has been selected, the process proceeds to step S401, and various setting values of the ball 21 displayed as a game screen in the game area on the translucent surface 2 are set to initial values. This step S
The set value of the ball 21 set in 401 is, for example, the coordinate position, the moving direction, and the moving speed of the ball 21 to be displayed first in the game area. Note that these set values may be predetermined values, or may be values set randomly each time the ball rally game is executed.

After the process of step S401 is executed, in step S402, the game area on the translucent surface 2 is set on the basis of the set value previously set in step S401 (in this case, the coordinate position of the ball 21). And ball 2
The display control for displaying 1 is executed. Then, in step S403, it is determined whether or not the ball 21 is within the game area, that is, whether or not the coordinate position of the ball 21 is within the game area. Here, the ball 21
If it is determined that the coordinate position of is not within the game area, the process proceeds to step S408, a required display indicating that the game is over is performed, and the control process ends.

On the other hand, if it is determined in step S403 that the coordinate position of the ball 21 is within the game area, the process proceeds to step S404. In step S404, it is determined whether or not an operating tool such as a user's arm has been detected in the game area.
Here, for example, when an operating tool is detected in the game area, the process proceeds to step S405, and it is determined whether or not the coordinate position of the operating tool detected in step S404 matches the coordinate position of the ball 21. You. The coordinate position of the operating tool is determined based on operation information supplied from the input image processing unit 12 to the database driving unit 14 based on the detected image information detected by the input image processing unit 12. Become.

In this case, since the detected image information detected by the input image processing section 12 is obtained by the reflected light of the infrared ray from the translucent surface 2 side as described above, a plurality of operating objects are provided in the game area. Can be recognized at the same time, even if exists. That is, even if a plurality of users are simultaneously participating in the game, it is possible to simultaneously recognize the operation information of the operation performed by each user.

If it is determined in step S405 that the coordinate position of a certain operating tool coincides with the coordinates of, for example, the outer shape of the ball 21, the flow advances to step S406 to determine the tangent S of the ball 21 at that coordinate position. Assuming that the tangent line S is assumed to be a reflection surface and is reflected, the ball 21
Will be changed. The set value of the ball 21 changed at this time is, for example, a value in the moving direction of the ball 21. That is, if it is determined that the coordinate position of the operating tool and the coordinate position of the ball 21 match, the above-described FIG.
The tangent S obtained from the ball 21 and the operating tool as shown in FIG.
It is considered that the ball 21 has been reflected at the time, and the set value of the moving direction of the ball 21 previously set is newly changed to the set value after the reflection.

In step S407, a new coordinate position for displaying the ball 21 is calculated based on the set value changed in step S406. If the operation tool is not detected in the game area in step S404, or if the coordinate position of the operation tool does not match the coordinate position of the ball 21 in step S405, the set value of the ball 21 is changed. Instead, the coordinate position of the ball 21 is calculated based on the previously set value.

When the coordinate positions of the new ball 21 are calculated in step S407, if the new coordinate position of the ball 21 matches the coordinates of the upper end surface or the left and right end surfaces of the game area, the ball end position is calculated by using these end surfaces. Assuming that the ball 21 is reflected, the set value of the moving direction of the ball 21 previously set is changed.

In step S407, the ball 2
After calculating one new coordinate position, the process returns to step S402, and the processing operation from step S402 is executed again. Thereby, the control processing of the ball rally game as shown in FIG. 7 is realized.

<3. Shooting Game (First Example)> FIG. 9 shows a display screen displayed on the translucent surface 2 when the shooting game is executed by the game apparatus 1 according to the present embodiment. An example is shown. Note that such a shooting game is also displayed, for example, by selecting a predetermined item from the menu screen M shown in FIG.

In the shooting game shown in FIG. 9, the entire semi-transparent surface 2 is used as a game area, for example, similarly to the ball rally game described above with reference to FIG. A game screen 22 of a person with the target 23 placed overhead is displayed. Then, the user looks at the target 23 and enjoys throwing, for example, an arrow 24 having a suction cup or the like attached to the tip.

For example, when the arrow 24 does not hit the target 23 and hits another game area, the game is over. When the arrow 24 hits the target 23, the game is over.
Is displayed, indicating that the player has hit the target 23, and the game is over.

FIG. 10 is a flowchart showing an example of the processing operation of the control device 6 when the shooting game as described above is executed. The processing operation shown in FIG. 10 also includes, for example, an operation supplied from the input image processing unit 12 of the control device 6 when an item of the shooting game is selected from the menu screen M in the processing operation shown in FIG. This is realized by the database driving unit 14 appropriately executing a processing operation in accordance with a shooting game program stored in the database memory 15 based on the information.

In this case, first, in step S500, it is determined whether or not a predetermined operation for executing the shooting game has been performed. If it is determined in step S500 that a predetermined operation for executing the shooting game has been performed, for example, if it is determined that the shooting game item has been previously selected from the menu screen M shown in FIG. Proceed to. In step S501, display control for displaying the game screen 22 of the shooting game in the game area is executed. This display control is also realized by the database drive unit 14 performing display control based on the shooting game program as described above.

In step S502, it is determined whether an operating tool such as an arrow 24 has been detected in the game area. If an arrow 24 has been detected in the game area, the flow advances to step S503. Step S502
Is detected until the arrow 24 is detected.

In the following step S503, it is determined whether or not the coordinate position of the arrow 24 detected in step S502 matches the coordinate position of the target 23 displayed as the game screen 22. Then, step S50
In 3, if it is determined that the coordinate position of the arrow 24 does not match the coordinate position of the target 23, a control process for making the game over is executed.

In step S503, the arrow 24
If it is determined that the coordinate position of the target 23 coincides with the coordinate position of the target 23, the process proceeds to step S504, and the arrow 24 indicates the target 23.
After the display control of some display screen indicating that the game has hit is executed, a control process for game over is executed.

<4. Shooting Game (Second Example)> FIG.
Further, an example of a display screen when a shooting game is executed by the game apparatus 1 according to the present embodiment is shown. Note that such a shooting game is also displayed by selecting a predetermined item from the menu screen M displayed on the translucent surface 2.

In the shooting game shown in FIG. 11 as well, similarly to the ball rally game and the shooting game (first example) described above, for example, the entire semi-transparent surface 2 is used as a game area. For example, a game screen 25 having a plurality of targets 26 is displayed therein. Then, similarly to the shooting game shown in FIG. 9 (first example), the target 26 is defeated by throwing any operation tool (the ball 27 in this case) toward the target 26 displayed as the game screen 25. And enjoy it. Also in this case, the target 26 as a game screen displayed in the game area on the translucent surface 2 is an image projected from the projector 5 onto the translucent surface 2. Further, when the ball 27 hits the target 26, the hit target 26 is erased, and finally all the targets 26 are destroyed and erased from the game screen, whereby the game is over.

When such a shooting game is executed, the operation supplied from the input image processing unit 12 of the control device 6 when the shooting game (second example) item is selected from the menu screen M is also performed. This is realized by the database driving unit 14 appropriately executing a processing operation in accordance with the shooting game program stored in the database memory 15 based on the information. The processing operation of the control device 6 in this case is described in FIG.
Since the processing operation is based on the processing operation of the shooting game (first example) shown in FIG. 0, it will be described with reference to the flowchart shown in FIG. Also in this case, as shown in step S500, for example, when it is determined that the item of the shooting game is selected from the menu screen M displayed on the translucent surface 2, the game screen is displayed in the game area on the translucent surface 2. The display control to display the number 25 is executed (S501).

Then, as shown in step S502, it is determined whether or not the ball 27 which is the operating body is detected in the game area. If it is determined that the ball 27 is detected in the game area, the ball 27 is detected. It is determined whether the coordinate position of the target 26 matches the coordinate position of the target 26 (S50).
3). Then, if the coordinate position of the ball 27 matches the coordinate position of the target 26, display control is executed to delete the image of the target 26 displayed at the coordinate position. When it is determined that all the targets 26 displayed in the game area have been deleted, for example, after performing some display control indicating that all the targets 26 have been destroyed, a display for game over is executed. What is necessary is just to perform control.

<5. Configuration of Game Apparatus as Another Embodiment> As the game apparatus of the present embodiment, the infrared LED panel 3 can be omitted from the configuration shown in FIG. For example, when the game device according to the present invention is used in an environment with strong external light such as outdoors, the infrared light included in daylight natural light is strong, so that the infrared LED panel 3 as shown in FIG. In the configuration in which the infrared light is used as the light source for detecting the operation information, the intensity of the infrared light emitted from the infrared LED panel 3 is relatively weaker than the infrared light included in the natural light. May not be performed (that is, appropriate detected image information that can recognize the operation information may not be obtained).

Therefore, in such a case, the infrared ray LE
The D panel 3 is omitted, and instead, infrared light included in natural light can be used as a light source for detecting operation information. In this case, the reference input image level Lint required to obtain the detected image information is, for example, such that there is no detection target such as an approaching body or an operating body (no operation is performed on the translucent surface 2). In this state, the detection is performed based on image information obtained from an image pickup signal transmitted through the translucent surface 2 from the front side and imaged by the CCD camera 4.

If any operation is performed on the translucent surface 2, for example, when the approaching body and the operating body on the translucent surface 2 are viewed from the CCD camera 4, the approaching body In addition, since the infrared rays of the natural light are blocked by the operating body and the like, this can be seen as a shadow of the infrared light included in the natural light. In the control device 6 according to the present embodiment, image information that changes so that the image level becomes lower (darker) than the reference input image level Lint is treated as operation information. In this case, the internal configuration of the control device 6 shown in FIG.
The drive unit 10 is not provided.

Further, as a game device of the present embodiment, in the configuration shown in FIG. 1, for example, a microwave generator is provided instead of the infrared LED panel 3, and
A configuration in which a microwave receiver is provided instead of the camera 4 is also conceivable. In this case, in the control device 6 shown in FIG. 2, instead of the LED drive unit 10 (see FIG. 1),
A microwave drive circuit for driving the microwave generator is provided. Also, an image signal input circuit that receives a microwave supplied from a microwave receiver, converts the received microwave into, for example, data in a predetermined format, and outputs the received signal. Then, it is necessary to provide an input data processing circuit which obtains detected image information and obtains operation information based on the detected image information by performing required processing. The image signal input circuit and the input data processing circuit are functional circuit units that replace the image input unit 11 and the input image processing unit 12 shown in FIG. 2, respectively. Further, since microwaves are used as a medium for detecting operation information, the infrared transmission filter 4a provided in the CCD camera 4 and the infrared cutoff filter 5a provided in the projector 5 become unnecessary.

As described above, even if the medium such as a microwave having the property of reflecting the object irradiated with the medium is used for detecting the operation information, the embodiment described so far (infrared ray Example of using to detect operation information)
It is possible to configure the game device as the present invention in the same manner as described above.

The game that can be executed by the game device of the present invention described above is merely an example, and the present invention is not limited to this, and various other games can be considered. Although the description of the audio output system is omitted in the present embodiment, it is possible to output various game sounds. Further, in the present embodiment, the case where the translucent surface 2 is set vertically (wall shape) has been described, but the function of the translucent surface 2 (display panel function and operation panel) as the present invention is described. Considering (function), the present invention is not limited to this, and it is also possible to install horizontally or to form the translucent surface 2 as a curved surface such as a spherical surface.

[0080]

As described above, according to the present invention, the light or the electromagnetic wave of a predetermined wavelength band is reflected to give a state change (this state change is reflected as detected image information). If the object can be operated, the object is established as an operating body for performing an operation. That is, the user can perform an input operation with a high degree of freedom using his / her arm or ball. In addition, since the translucent surface can be easily enlarged at a low cost, if the game display screen functions as a display panel by projecting various game screens on the translucent surface, direct input is not possible. The operation can be performed, and a more realistic game can be enjoyed.

In the case of the present invention, an image projected and displayed on a translucent surface is viewed on a large screen, for example, instead of directly viewing an image displayed on a display device such as a CRT. When the game is performed, the user does not particularly burden the eyes, and the user can play the game healthy by moving his / her whole body.

When a game device having the same effect as the present invention is obtained by using a display device such as a CRT or a liquid crystal display, a touch panel, a track pad, or the like in combination, the configuration becomes complicated. However, in the present invention, in order to obtain the above-described effects, a simple translucent surface and an imaging device for detecting an operation performed on the translucent surface are required. A projection display device or the like for displaying a game image or the like on the translucent surface may be provided, and this can be realized with a simpler configuration.

[Brief description of the drawings]

FIG. 1 is a conceptual diagram showing a configuration example of a game device as an embodiment of the present invention.

FIG. 2 is a diagram showing an internal configuration of a control device provided in the game device according to the embodiment of the present invention.

FIG. 3 is a flowchart illustrating a processing operation for detecting and holding a reference input image level.

FIG. 4 is a flowchart illustrating a processing operation for generating detected image information.

FIG. 5 is an explanatory diagram showing a basic operation example in the game device of the embodiment.

FIG. 6 is a flowchart showing a processing operation for realizing the operation shown in FIG. 5;

FIG. 7 is a diagram showing a front surface image when a ball rally game is executed in the game device of the present embodiment.

8 is a flowchart showing a processing operation for executing the ball rally game shown in FIG.

FIG. 9 is a diagram showing a surface image when a shooting game is executed in the game device of the present embodiment.

FIG. 10 is a flowchart showing a processing operation for executing the shooting game shown in FIG. 9;

FIG. 11 is a diagram showing a surface image when a shooting game is executed in the game device of the present embodiment.

[Explanation of symbols]

1 game device, 2 translucent surface, 3 infrared LED panel, 4 CCD camera, 5 projector, 6 control device, 10 LED drive unit, 11 image input unit, 12 input image processing unit, 13 threshold control unit, 14 database Drive unit, 15 database memory, 16 image generation unit, 17 image synthesis unit, 18 RGB signal generation unit, 2
127 balls, 22 25 Game screen, 23 2
6 targets, 24 arrows

Claims (2)

[Claims] 1. A translucent surface, an imaging unit that captures only light or an electromagnetic wave of a predetermined wavelength band incident from a direction on the translucent surface side as an image, and an imaging signal input from the imaging unit, Control processing means for generating detection image information in which the operation given to the translucent surface is reflected, and performing a required control process based on the operation information identified based on the detection image information, Projection display means provided so as to be capable of projecting and displaying an image of visible light not containing the wavelength band of light or electromagnetic waves to be imaged by the imaging means on the translucent surface, wherein the control processing means A display control for the projection display means for projecting and displaying a game image whose display form changes in accordance with a predetermined rule based on a game rule. Location. 2. The game device according to claim 1, further comprising a radiating unit that radiates light or an electromagnetic wave in a predetermined wavelength band to be received by the imaging unit to the translucent surface.