JPH07282265A - Image control unit - Google Patents

Abstract

PURPOSE:To prevent malfunction when a body other than an object of detection is present in a picked-up image by detecting the size of a chromakey area and sending an indication for stopping operation to a control means when the detected size exceeds a specific size. CONSTITUTION:A position detection processing part 40 generates process screen maps, frame by frame, on the basis of a chromakey detection signal CRO as to a bat image included in sampling image data DS supplied from the side of an image pickup part 1, finds the coordinate position of a collision between the bat image and an object image (ball image) and the left-end and right-end coordinates and upper-end and lower-end coordinates of the bat image in a process screen according to block attributes read out of the process screen maps, and calculates the area and gravity center position. Further, the processing part 40 judges whether or not a chromakey-detected area is large enough to induce malfunction of the game, and decides that the game possibly malfunctions when the area exceeds a specific value, thereby forcibly ending the game.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image control device for controlling display of an image displayed on a display unit based on a specific color image extracted from a picked-up image.

[0002]

2. Description of the Related Art Conventionally, various image control devices have been put into practical use, which control a moving image of an object image or generate a sound effect in accordance with an operation of an operation pad or the like. In addition,
The object image mentioned here refers to a “character” displayed on the game screen, and is moved and displayed on the background screen as a background. This type of device is called a video game or a TV game, and a shooting game that asks a player's reflexes, a game that simulates a virtual reality, and the like are known.

Such a video game is composed of an image processing section for generating a video signal corresponding to a game operation and a display for displaying the video signal supplied from the image processing section. The image processing unit is a CPU, RO
M and RAM etc., for example, sequentially read out the image information and control information stored in the ROM pack,
A background image serving as a screen background is displayed on the display, and a corresponding character (object image) is displayed as a moving image on the screen background in response to a game operation, and a sound effect corresponding to the movement is pronounced.

[0004]

In the above-mentioned conventional image control device, when the game is advanced by changing the position or form of the displayed image (background image or object image), the input form is changed. There are many ways to operate the operation pad (external switch). The input operation by this operation pad (external switch) is, for example,
In the case of a game in which the player himself becomes a player of the game and simulates actions such as hitting and throwing a ball, the game does not actually move his body. It becomes something that is not realistic yet.

Under such a background, therefore, what can be considered, for example, is that the player has a tool (bat, racket, etc.) used in the game, the movement of the tool is detected, and the object on the display screen is detected. It is a method to control the movement of the image (ball image or opponent image). As a method for detecting the movement or position of the tool, there is a chroma key detection (specific color image detection) method, but there is a problem in practical use. That is, when an object of the same color as the tool to be detected exists in the image captured by the image capturing means,
The point is that the object and the tool are indistinguishable. If the game is executed with such an object present in the captured image, it may inevitably cause a malfunction.

Therefore, for the purpose of avoiding such an adverse effect, there is a method of preventing a part of the object from being detected by the chroma key as a dead zone, but there are many objects of the same color as the tool to be detected or As the size increases, the dead zone itself may be a factor that hinders normal game operation. Therefore, in other words, the conventional image control device has a problem that it is impossible to prevent a malfunction when an object other than the detection target is present in the captured image. The present invention has been made in view of the above circumstances,
It is an object of the present invention to provide an image control device that prevents malfunctions when an object other than a detection target is present in a captured image.

[0007]

In order to achieve the above object, in the invention described in claim 1, a chroma key area of a specific color is extracted from a captured image, and a detecting means for detecting the size of the chroma key area is provided. Controlling the display mode of the computer image displayed on the display screen according to the display position of the chroma key image formed by the chroma key area, and determining whether the chroma key area exceeds a predetermined size. , And an instruction means for instructing the control means to stop the operation when the predetermined size is exceeded.

According to the second aspect of the present invention, the pointing means determines that an object of a specific color other than the detection target is present in the captured image when the chroma key area exceeds a predetermined size. It is characterized by being different.

Further, in the invention according to claim 3, the chroma key extraction means for extracting the chroma key area of the specific color from the picked-up image and the display mode of the computer image displayed on the display screen are controlled by the chroma key area. Control means for controlling according to the display position of the formed chromakey image, and operation determination means for forcibly ending the processing of the control means when there is a possibility of malfunction when the area of the chromakey region exceeds a predetermined value. It is characterized by having. Further, according to the invention described in claim 4, the chroma key extraction means extracts a chroma key area of a specific color for each imaging frame.

[0010]

According to the present invention, the detection means extracts the chroma key area of the specific color from the picked-up image, detects the size of the chroma key area, and the control means displays the computer image on the display screen. Are controlled according to the display position of the chroma key image formed by the chroma key area. Then, the instruction means determines whether or not the chroma key area exceeds a predetermined size, and when the chroma key area exceeds the predetermined size, instructs the control means to stop the operation. As a result, it is possible to prevent malfunction when an object other than the detection target is present in the captured image.

[0011]

Embodiments of the present invention will be described below with reference to the drawings. A. Outline of Embodiments FIG. 1 is an external view showing an overall configuration of an image control apparatus according to the present invention, and illustrates an example applied to a batting game. In this figure, reference numeral 1 is an image pickup unit including a solid-state image pickup device such as a CCD, and picks up an image of a player B held on a batter box (not shown). Here, the player B performs a batting operation using, for example, a bat BAT colored in blue for chroma key detection. Reference numeral 2 denotes an apparatus main body, which performs chroma key detection on the image pickup signal supplied from the image pickup unit 1 to determine the position of the bat BAT in the actual image. The actual image refers to an image captured by the image capturing unit 1. Further, the device body 2 includes a background image BG which is a background scene of the game, and an object image OB which is moved and displayed on the background image BG.
J and J are combined, and this is displayed on the display 3 as a computer graphic image (hereinafter referred to as a CG image). The CG image displayed on the display 3 is composed of, for example, a throwing motion image of a pitcher on a background scene and a flying image of a ball corresponding to the throwing motion.

Further, as shown in FIG. 2A, the apparatus main body 2 obtains the position of the center of gravity of the "ball" from the CG image, while chroma key detection is performed from the actual image as shown in FIG. The position of the center of gravity of the "bat BAT" image is calculated.
Then, it is determined at every predetermined timing whether the “ball” in the CG image and the “bat BAT” in the actual image collide with each other. Depending on the hit condition. For example, in FIG.
As shown in (c), if the positions of both centers of gravity match at the time of collision,
Perform a simulation close to reality as if it were a "home run" as just meat.

B. Configuration of Embodiment Next, the electrical configuration of the imaging unit 1 and the apparatus main body 2 will be described with reference to FIG. (1) Configuration of Image Pickup Section 1 The image pickup section 1 is composed of the constituent elements 10 to 13.
An oscillating circuit 10 generates and outputs an 8 times oversampling signal 8f _SC . An image pickup signal processing unit 11 supplies the 8 × oversampling signal 8f _SC to the clock driver 12 in the next stage and converts the image pickup signal SS output from the CCD 13 into sampled image data D _S. The configuration of the image pickup signal processing unit 11 will be described later. The clock driver 12 generates various timing signals such as a horizontal drive signal, a vertical drive signal, a horizontal / vertical sync signal, and a blanking signal based on the 8 times oversampling signal 8f _SC supplied from the oscillator circuit 10. An image pickup drive signal corresponding to the horizontal drive signal and the vertical drive signal is generated and supplied to the CCD 13. CCD
13 generates an image pickup signal SS obtained by picking up an image of an object according to the image pickup drive signal.

The image pickup signal processing section 11 conditions the image pickup signal SS supplied from the CCD 13 and then A
The _S / D conversion is performed to generate the sampled image data D _S , and its schematic configuration will be described with reference to FIG. In FIG. 4, 11a is a sampling circuit,
The image pickup signal SS is sampled and held according to the 4 × oversampling signal 4f _SC supplied from the clock driver 12 and output to the next stage. Reference numeral 11b is an AGC (automatic gain control) circuit for converting the sampled image pickup signal SS into a predetermined level and outputting it. Reference numeral 11c is a γ correction circuit which corrects the gamma characteristic of the image pickup signal SS to γ = 1 / 2.2 and outputs it. Reference numeral 11d denotes an A / D conversion circuit that converts the gamma-corrected image pickup signal SS into 8-bit length sampling image data D _S and outputs the sampled image data D _S. The sampling image data D _S is the video signal processing unit 2 described later.
Supplied to zero. Reference numeral 11e denotes D which converts the composite video signal D _CV supplied from the video signal processing unit 20 into an analog video signal S _V and supplies the analog video signal S _V to the display 3 described above.
A / A conversion circuit.

(2) Structure of the device body 2 Next, referring to FIGS. 3 to 8, the structure of the device body 2 will be described.
explain. The device main body 2 includes a video signal processing unit 20 and an image.
From the processing unit 30, the position detection processing unit 40, and the control unit 50
Each of these parts will be described in detail below. Configuration of Video Signal Processing Unit 20 The video signal processing unit 20 includes a video signal processing unit 20 that is supplied from the imaging unit 1.
Pulling image data D Color difference conversion processing and chroma for S
Key detection processing is performed and the result is the position detection processing described later.
It is supplied to the processing unit 40. The processing unit 20 will be described later.
Image processing data D supplied from the image processing unit 30_SPTo
Composite video signal D_CVConverted to D / A
It is supplied to the replacement circuit 11e (see FIG. 4). This image
Processing data D_SPIs the background image BG and
Objects that are moved and displayed on the background image BG
Data to form a CG image that is a composite of the target image OBJ
It is

Here, the configuration of the video signal processing unit 20 that implements the above-described processing will be described with reference to FIG. In FIG. 5, reference numeral 20a denotes a color separation filter, which supplies the sampling image data D _S to the signal Ye (yellow) and the signal Cy.
(Cyan) and signal G (green) are color-separated and output to the next stage. Reference numeral 20b is a contour correction circuit that adjusts the image quality by performing brightness modulation before and after the change point in the video signal. 20c is a white balance circuit for each signal Y
e, Cy, and G are set to specified levels and output. 20d
Is a separation filter composed of a bandpass filter, which converts each signal Ye and Cy into a signal R (red) and a signal B.
(Blue) is sorted and output. Reference numeral 20e designates signals R, G and B representing the three primary colors, a luminance signal Y and a color difference signal B each having a length of 8 bits.
This is a matrix circuit for converting into -Y and RY.

Reference numeral 20f is a chroma key signal generating circuit,
When the color difference signals BY and RY reach a predetermined level, the "H" level chroma key detection signal CRO is generated.
That is, in this circuit 20f, as shown in FIG. 6, the maximum / minimum levels BY- _MAX and BY- _MIN of the color difference BY are obtained.
The maximum / minimum levels RY _MAX and R-Y _{MIN of the} color difference R-Y are predetermined, and when the color difference signals B-Y and R-Y fall within the color difference area E defined by these levels, An "H" level chroma key detection signal CRO indicating that a specific color has been detected is output. In this embodiment, the area E is "blue". Specifically, when the bat BAT image colored blue by the player P is detected, the "H" level chroma key detection signal CRO is detected. To generate.

Next, the configuration of the video signal processing section 20 will be described again with reference to FIG. 20g is VDP
31. Image processing data D supplied from 31 (described later)
_SP (RGB signal) is a luminance signal Y, color difference signals BY, R-
This is a matrix circuit for converting to Y. Reference numeral 20h is a selector, which is a selection signal S supplied from the position detection processing unit 40.
Depending on L, either the output of the matrix circuit 20e or the output of the matrix circuit 20h is selected and supplied to the next stage. 20i is a modulator. The modulator 20i supplies various synchronization signals (horizontal / horizontal / horizontal signal) to the luminance signal Y and the color difference signals BY and RY supplied via the selector 20h.
A digital composite video signal D _{CV on} which a vertical sync signal and a blanking signal) are superimposed is generated.

According to the above configuration, the video signal processing section 20
Is the sampling image data D supplied from the imaging unit 1.
Chroma key detection of a specific color is performed on _S , and the result is used as a chroma key detection signal CRO for the position detection processing unit 40.
Supply to the side (described later). Further, the processing unit 20
Image processing data D input from the image processing unit 30 side
Either _SP (RGB signal) or sampling image data D _S supplied from the image pickup unit 1 is selected according to the selection signal SL, and the selected data is converted into a composite video signal D _CV and output. The selection signal SL is a signal supplied from the position detection processing unit 40 described later.

Configuration of Image Processing Unit 30 Next, the configuration of the image processing unit 30 will be described. The image processing unit 30 includes a video data processor (hereinafter abbreviated as VDP) 31 and a VRAM 32. This VD
The basic function of P31 is to read the background image data D _BG and the object image data D _OB stored in the VRAM 32 according to a control signal SC supplied from the control unit 50 (described later) side, and to read this one scanning line. The purpose is to generate image processing data D _SP representing each dot display color. Hereinafter, the configuration of each unit will be described in detail with reference to FIG. 7.

In FIG. 7, reference numeral 31a is a CPU interface circuit, which is a constituent element 3 in accordance with a control signal SC supplied via the bus of the CPU 51 constituting the control section 50.
Various control instructions are given to 1b to 31d. Control signal SC
Are formed from various commands for controlling the display of the background image BG and the object image OBJ, and the background image data D _BG and the object image data D _OB which are DMA-transferred to the VRAM 32. 31b
Is a VRAM control circuit, and the components 31a,
Data is exchanged with the VRAM 32 in response to the control signals supplied from 31c and 31d.

That is, when the control signal SC indicating the DMA transfer is received from the CPU interface circuit 31a, the background image data D _BG or the object image data D _OB DMA-transferred via the circuit 31a is received. Store in a predetermined storage area. When an instruction to read the background image data D _BG is received from the background control circuit 31c, the corresponding data D _BG is read and returned to the circuit 31c side. Similarly, when an instruction to read the object image data D _OB is received from the object control circuit 31d, the corresponding data D _OB is read and returned to the circuit 31d side.

Background control circuit 31c
Specifies the display position for the background image data D _BG read via the VRAM control circuit 31b based on the background display control command given from the control unit 50 side via the circuit 31a, It is supplied to the color difference data processing circuit 31e.

The object control circuit 31d is
The object table data T _OB given from the control unit 50 side via the circuit 31a is stored in the object table RA.
Write to M31f. The object table data T _OB is the object image data D on the display screen.
_This is coordinate data that specifies the display position of the _OB . Further, the circuit 31d refers to the object table data T _OB for the object image data D _OB read from the VRAM 32 in response to the object display control command, obtains the display position, and the object for one scanning line is obtained. Image data D _OB line buffer RAM 31g
Temporarily store in. The object image data D _OB temporarily stored in the line buffer RAM 31g is updated every scan. The object image data D _OB read from the RAM 31g is supplied to the color difference data processing circuit 31e.

The color difference data processing circuit 31e has a background
Sound control circuit 31c and object controller
Image data of 8-bit length supplied from the troll circuit 31d
Data D_BG, D_OBA well-known color lookup table
Referring to the RAM 31h, R and G signals each having a length of 4 bits
And image processing data D formed from the B signal_SPConversion to
And output. In addition, the color difference data processing circuit 31e
Image processing data D_SPIn addition to (RGB signal), the signal YSBG and
And signal YSOBJ. This signal YSBG and
Signal YSOBJ is the image processing data currently being output.
D_SPIs background image data D_BGCorresponding to
Or object image data D_OBCorresponding to
This is a signal that indicates whether or not to do. For example,
Image processing data D_SPHas a background image
Data D_BGSignal YSBG when
Becomes “H” and the signal YSOBJ becomes “L”.
C) ”. On the other hand, conversely to this, the image processing data D_SP
Is the object image data D O_BThat corresponds to
Signal YSBG becomes “L” and signal YSOBJ becomes
It becomes "H".

As described above, in the image processing unit 30, the background image data D _BG and the object image data D _OB DMA-transferred from the control unit 50 side are stored in the VRAM 3.
2 in accordance with a control signal SC (various display control commands) supplied from the CPU 51.
Reads the image data D _BG or the image data D _OB from 2, while generating the image processing data D _SP representing the dot display color of one scan line per this signal YSBG and YSOBJ representing the attributes of the image processing data D _SP Is output.

Configuration of Position Detection Processing Unit 40 The position detection processing unit 40 is composed of a gate array formed by arranging a plurality of logic elements, a line buffer and a work RAM.
And the collision coordinate position between the chroma key image included in the sampling image data D _S and the object image formed by the object image data D _OB under the instruction of the control unit 50 described later, and these images. The position of the center of gravity and the like are logically calculated based on a predetermined logic. The line buffer (not shown) temporarily stores the chroma key detection signal CRO supplied from the video signal processing unit 20. The work RAM is adapted to temporarily store various calculation results obtained by logical calculation by the gate array.

The position detection processing section 40 is the same as the above-mentioned VD.
Based on the signals YSBG and YSOBJ supplied from P31, the above-mentioned selection signal SL is generated and given to the video signal processing unit 20, and the sampling image data D _S (actual image) and the image processing data D _SP (CG image) are generated. The degree of overlap, that is, the priority order (front-back relationship) of the images displayed on the screen is controlled. Further, the processing unit 40 supplies a register control signal S _REG to the above-mentioned imaging signal processing unit 11, video signal processing unit 20 and VDP 31 under the instruction of the control unit 50, and controls the data set / reset of each unit register. To do.

Next, referring to FIG. 8, the position detection processing unit 40
The storage area of the work RAM will be described. In this figure, E1 is an initial screen area for temporarily storing data of an initial screen formed of 96 dots in the horizontal direction (scanning line) and 96 lines in the vertical direction. The data of the initial screen refers to the chroma key detection result existing in the scene captured before the start of the game. If an object of a chroma key detection color (for example, blue) is present in the scene, it may be mistaken for a part of the bat BAT (see FIG. 1) described above. Therefore, the data temporarily stored in the initial screen area E1 is used when the dot position detected by the chroma key is not mistaken for the bat BAT (see FIG. 1) when the dot position is set to the dead zone.

E2 is 96 dots in the horizontal direction and 96 dots in the vertical direction.
This is a processing screen area formed by lines, and the bat BAT image in which the chroma key is detected in the actual image and the object image (ball image in this embodiment) in the CG image are updated and stored for each frame. E3 to E4 are bat BATs on the processing screen that are updated for each frame.
These are the upper end coordinate area and the lower end coordinate area for temporarily storing the upper end / lower end positions of the image. E5 to E6 are the left end of the bat BAT image on the processing screen updated for each frame /
The left end coordinate area and the right end coordinate area temporarily store the right end position. E7 is the first collision coordinate area. The first collision coordinate area E1 represents the intersection point in the scanning line where the overlap (collision) of the bat BAT image and the object image (ball image) is first detected as coordinates on the processing screen. . In addition, the second collision coordinate area E8
Represents the intersection point in the scanning line where the overlap between the bat BAT image and the object image (ball image) is finally detected as coordinates on the processing screen.

E9 is a barycentric coordinate area, in which the barycentric position calculated based on the area of the bat BAT image detected by the chroma key in the actual image is stored as the coordinate position on the processing screen. E10 is an area area in which the area of the bat BAT image subjected to chroma key detection in the actual image is stored. The area set in the area area E10 is represented by the number of blocks. The block referred to here is a 12-dot area consisting of 6 dots in the horizontal direction and 2 lines in the vertical direction on the processing screen. When chroma key detection of "6 dots" or more is detected in the block formed from the 12 dot area, the block is regarded as the area of the bat BAT image.

Structure of Control Unit 50 Next, the structure of the control unit 50 will be described with reference to FIG. 3 again. The control unit 50 is composed of components 51 to 57. The CPU 51 performs a key scan on various operators provided on the operation panel of the apparatus body 2 and controls each part of the apparatus according to the operator signal KS generated in response to the key scan. It will be described later. This CPU5
1 has an internal timer, and manages the game progress based on the game counter value counted by the timer. The CPU 51 also includes a well-known DMA controller, and sends various data (background image data D _BG , object image data D _OB , or object table data T _OB ) necessary for game operation to the image processing unit 30 described above. It is configured for DMA transfer. Further, the CPU 51 generates a control signal SC necessary for image control according to the game operation and gives an operation instruction to each processing unit. A RAM 52 is used as a work area for the CPU 51 to temporarily store various calculation results and flag values. Reference numeral 53 is a ROM that stores an OS (operating system) program that manages the operation of the CPU 51. Reference numeral 54 is a system clock circuit which generates a system clock that regulates the operation of the entire device under the control of the CPU 51.

Reference numeral 55 denotes a game cartridge which is removably attached to the apparatus main body 2 and includes a ROM 55a and a first cartridge.
The sound source circuit 55b. ROM 55a
Is an application program loaded into the CPU 51. In this embodiment, as described above, the game program for simulating the batting practice is stored. 55b is a first tone generator circuit, which is a CPU
Based on the event data supplied from the 51 side via the position detection processing unit 40, a game sound effect corresponding to the game operation is synthesized and output to the CPU 51 as a tone signal. Reference numeral 56 is a second tone generator circuit, which synthesizes musical sounds corresponding to the progress of the game, for example, musical compositions such as opening and ending, and outputs them. Reference numeral 57 denotes a sound system, which filters the musical tone signals supplied from the first tone generator circuit 55b and the second tone generator circuit 56, such as noise removal, and then amplifies and outputs them.

The above-mentioned first and second sound source circuits 5
The CPUs 51, 5b and 56 supply event information at predetermined timings to synthesize game sounds. Further, the CPU 51 side has a configuration in which the monitoring timer WT is reset every time a data request signal (described later) is supplied from the first and second tone generator circuits 55b and 56, and when the monitoring timer WT overflows. If the game cartridge 55 is pulled out from the apparatus main body 2, the operation is stopped. As a result, the game cartridge 55 requires the first tone generator circuit 55b that operates in cooperation with the CPU 51, and the game cartridge that does not have the circuit 55b does not perform the game operation.

C. Operation of Embodiment Next, the operation of the embodiment having the above configuration will be described.
Here, first, the operation of the position detection processing unit 40 described above is performed.
After explaining about the operation of the control unit 50 (CPU51)
explain about. (1) Operation of Position Detection Processing Unit 40 Here, the operation of the position detection processing unit 40 will be described with reference to FIGS.
This will be described with reference to 15. In this processing unit 40, the control unit
Under the instruction of 50, the sampling image data D Included in S
Based on the chroma key detection signal CRO
Then, the bat BAT image and the object image are detected.
Data D_OBObject image formed by
The position of the collision coordinates with the image) and the position of the center of gravity of these images.
It The details of such operation will be described below.

Operation of Main Routine First, it is assumed that the apparatus main body 2 is powered on and a control signal SC representing a system reset is supplied from the CPU 51 side to the position detection processing section 40. Then, the position detection processing unit 40 executes the main routine shown in FIG. 9 based on the control signal SC, and advances the processing to step SA1.
First, in step SA1, while resetting its own internal register or performing initialization for setting an initial value, a register control signal S _REG for instructing register setting to the imaging signal processing unit 11, the video signal processing unit 20 and the VDP 31 is set. Supply and proceed to the next step SA2.

At step SA2, "initial screen map"
Is created. Where, for example,
When the "initial screen map" is not created, the determination result is "NO", and the process proceeds to the next step SA3. "Initial screen map" means, prior to the start of the game,
The bat BAT (see FIG. 1) is displayed in the imaging screen imaged by the imaging unit 1.
It is for confirming whether or not there is an object of the same color as that of (see). Then, when the processing proceeds to step SA3, the chroma key detection results for a plurality of frames are overlapped and stored in the initial screen area E1 (see FIG. 8) of the work RAM, and the chroma key detection blocks existing in the initial screen are "dead zone". Create an "initial screen map" to be considered as.

When the "initial screen map" is created in this way, the position detection processing section 40 advances the processing to the next step SA4. When the "initial screen map" is prepared in advance, the result of the determination in step SA2 is "YES", and the process proceeds to step SA4. Step S
At A4, the values of the registers X and Y are reset to zero. A value corresponding to screen coordinates formed by 96 dots in the horizontal direction and 96 lines in the vertical direction is sequentially set in the registers X and Y according to the processing content.

Next, in step SA5, the position detection processing section 40 performs chroma key detection for each block on the chroma key detection signal CRO temporarily stored in the line buffer. The block-by-block chroma key detection means the chroma key detection signal CRO read from the line buffer.
Is divided into blocks each consisting of 6 dots in the horizontal direction and 2 lines in the vertical direction, and the "H" level chroma key detection signal CR
When O is present in “6 dots” or more per block, the attribute of the block is regarded as “with chroma key”. The result of such chroma key detection is stored as a block attribute in the processing screen area E2 (see FIG. 8) described above, and this becomes a "processing screen map".

Next, when the chroma key detection for each block unit is performed, the position detection processing unit 40 proceeds to the next step S
Proceed to A6, and the bat BA of the actual image with chroma key detection
The presence or absence of a collision between the T image and the object image OBJ (ball image) in the CG image is detected, and in the case of collision, the collision coordinates are obtained. Then, in step SA7, the processing unit 40 increments the value of the register X by 1, and subsequently in step SA8, the value of the register X is "9."
6 ", that is, it is determined whether the processing for one scanning line is completed. Here, when the value of the register X has not reached "96", the determination result becomes "NO" and the steps SA5 to S are performed until the processing for one scanning line is completed.
Repeat A7.

On the other hand, when the processing for one scanning line is completed, the judgment result here becomes "YES", and step S
In step A9, the value of the register X is reset to zero again and the value of the register Y is incremented by 1 to update the scan line in the vertical direction. Then, when the processing proceeds to step SA10, the processing unit 40 determines whether or not the value of the register Y is "96". Here, the value of the register Y is "96".
If not, the judgment result is “NO”,
The above steps SA5 to SA9 are repeated. And
When the scanning for one frame is completed, the determination result here becomes "YES", and the process proceeds to step SA11.

In step SA11, the above step SA
5, the left edge / right edge coordinates and the upper edge / lower edge coordinates of the chroma key image are calculated based on the blocks detected by the chroma key, and these are stored in the work RAM storage areas E3 to E6.
(See FIG. 8), the area of the chroma key image is calculated from the number of blocks detected by the chroma key. The storage areas E3 to E4 temporarily store the upper and lower end positions of the chroma key image within the detection frame that is updated for each frame, and the storage areas E5 to E6 are detected for each frame. The left and right edge positions of the chroma key image within the frame are temporarily stored. The area calculated from the number of blocks is stored in the storage area E10.

When the bat BAT image is chroma-key detected from the real image in this way, the process proceeds to step SA12, and the barycentric position of the bat BAT image is obtained. Thereafter, it is determined whether or not the warning flag stored in the register KF is "1" (step SA13). If the warning flag is "1", the process proceeds to step SA14 and an interrupt signal is output. Then, in step SA15, it is determined whether or not the interrupt flag is "1". If the interrupt flag is "1", the process proceeds to step SA16 to output an interrupt signal to the CPU 51. After that, the position detection processing unit 40 returns the processing to step SA4, repeats the above-described operation, and obtains the correspondence relationship between the “bat” and the “ball” for each frame. The meaning of the warning flag stored in the register KF will be described later.

Operation of Initial Screen Map Creating Routine Next, the operation of the initial screen map creating routine will be described with reference to FIG. As described above, when the initial screen map is not created, the position detection processing unit 40 advances the processing to step SA3, executes the initial screen map creation routine shown in FIG. 10, and advances the processing to step SB1. In step SB1, the sampling number n set in the internal register is read. The sampling number n is the chroma key detection signal CRO supplied from the image pickup unit 1.
It shows how many frames are taken in. Next, when proceeding to step SB2, the values of the registers X and Y are reset to zero, and then proceeding to the next step SB3. Step S
In B3, of the chroma key detection signal CRO written in the line buffer, 6 dots in the X direction (horizontal direction)
Two lines in the Y direction (vertical direction), that is, one block are read.

Next, at step SB4, it is judged whether or not there is a "H" level chroma key detection signal CRO of "6 dots" or more in the read one block. If "6 dots" or more does not exist, the determination result is "no chroma key" and the determination result is "NO", and the process proceeds to step SB5. In step SB5, the block attribute is set to "0" and the process proceeds to the next step SB7. On the other hand, if there are more than 6 dots,
It is determined that "chroma key is present", the determination result is "YES", and the process proceeds to step SB6. In step SB6, the block attribute is set to "1", and the next step SB
Processing proceeds to 7. In step SB7, it is determined whether or not it is the first frame. Here, if it is the first sampled frame, the determination result is "YES", and the process proceeds to step SB8.

In step SB8, the position detection processing section 40 stores the determined block attribute in the initial screen area E1 according to the values of the current registers X and Y. Then, after that, the process proceeds to Step SB9, the value of the register X is incremented by 1, and the number of the designated block is incremented. Next, in step SB10, it is determined whether or not the number of the stepped designated block is "96", that is, one scanning (horizontal) line is completed. Here, if not completed, the determination result is “NO”, and step SB
Proceed to 11. In step SB11, it is determined whether the value of the register Y is "96", that is, whether one frame has been completed. Here, if the processing for one frame is not completed, the determination result is “NO”, and the process returns to step SB3 described above. As a result, steps SB3 to SB6 are repeated and the next block attribute is determined.

Then, for example, it is assumed that the determination of the block attribute for one scanning (horizontal) line is completed. Then, the determination result of step SB10 becomes "YES", and the processing unit 40 advances the process to step SB13. In step SB13, the register X is reset to zero, and the value of the register Y is incremented by 1 to update the scan line. Then, after this, again, step SB11
Block determination from step SB3 onward is performed via. Next, when the determination of the block attribute for one frame is completed, the above-mentioned determination result of step SB11 becomes "YES", and the process proceeds to step SB12. In step SB12, it is determined whether the sampling number n has reached the set number.

If the set number of times has not been reached, the determination result is "NO", and the process proceeds to step SB14. In step SB14, the number of times of sampling n is incremented, and the above-mentioned step SB2 and subsequent steps are executed again. In this way, the first initial screen map is created,
In the process of creating the initial screen map for the second time, step S
When proceeding to B7, the determination result here becomes "NO", and the routine proceeds to step SB15. In step SB15, the corresponding block attribute stored previously is read from the initial screen area E1 according to the values of the registers X and Y. Then, in step SB16, the logical sum of the previous block attribute and the currently determined block attribute is obtained. Then, in step SB8, this logical sum is stored as a new block attribute in the initial screen area E1 based on the values of the registers X and Y. Then, when the logical sum of a predetermined number of frames is generated, the determination result of step SB12 described above is "YES".
Then, this routine is ended, and the processing of the position detection processing unit 40 returns to the main routine described above.

Operation of Processed Screen Map Creation Routine When the initial screen map is created as described above, the position detection processing section 40 executes the processed screen map creation routine shown in FIG. 11 via step SA5 and executes step SC1.
Proceed to. In step SC1, one block consisting of 6 dots in the X direction (horizontal direction) and 2 lines in the Y direction (vertical direction) is read from the chroma key detection signal CRO written in the line buffer. Then, step SC2
If you proceed to, read "6 dots" in one block.
It is determined whether or not the above "H" level chroma key detection signal CRO is present. If "6 dots" or more does not exist, it is determined that "no chroma key is present" and the determination result is "N.
"O" and the process proceeds to step SC3. At step SC3, the block attribute is set to "0" and the next step SC
Processing proceeds to 4. In step SC4, the determined block attribute is stored in the processing screen area E2 (see FIG. 8) based on the values of the registers X and Y.

On the other hand, when the result of the determination in step SC2 is "YES", that is, when there is a "H" level chroma key detection signal CRO of "6 dots" or more in one block, the processing section 40 Step SC5
Proceed to. In step SC5, it is determined whether or not the reject switch SR has been turned on. The reject switch SR is a switch arranged on the operation panel of the apparatus main body 2, and is for setting whether or not to provide a "dead zone" according to the switch operation. Here, when the switch SR is turned on, the chroma key detection block stored in the initial screen map is regarded as a “dead zone”.

That is, in step SC5,
When the reject switch SR is set to ON, the determination result is "YES", and the next step SC6
Proceed to. At step SC6, the block attribute corresponding to the values of the registers X and Y is read from the initial screen area E1. Next, in step SC7, it is determined whether the block attribute read from the initial screen area E1 is "1". Here, when the block attribute is “1”, the determination result is “YES”, the process proceeds to step SC3 described above, and the block attribute is changed to “0”,
Then, the changed block attribute is written in the processing screen area E2 in accordance with the values of the registers X and Y via step SC4. As a result, the chroma key detection block stored in the initial screen map is set to the "dead zone".

When the reject switch SR is not set to ON, that is, when the "dead zone" is not set, the determination result of step SC5 is "NO", and the process proceeds to step SC8. In step SC8, the attribute of the corresponding block is set to "1" based on the result determined in step SC2 described above, and then the block attribute is set in accordance with the values of the registers X and Y through step SC4. Write in the processing screen area E2.

Operation of Collision Coordinate Detection Routine Next, the operation of the collision coordinate detection routine will be described with reference to FIG. When the processing screen map is created as described above, the position detection processing unit 40 performs step SA6 (see FIG. 9).
The collision coordinate detection routine is executed via (see). In this routine, the bat B of the real image detected by the chroma key detection
Object image OBJ in AT image and CG image
The presence or absence of a collision with the (ball image) is detected. First, when the routine is executed, the processing unit 40 advances the processing to step SD1 and reads the block attribute corresponding to the values of the registers X and Y from the processing screen area E2. Then, in step SD2, it is determined whether or not the read block attribute is "1", that is, the bat BAT image subjected to the chroma key detection. Here, when the block attribute is not "1", the determination result is "NO", and it is determined that a collision cannot occur, and this routine is once terminated.

On the other hand, the read block attribute is
When it is “1”, the judgment result is “YES”, and the next
The process proceeds to step SD3 of. In step SD3
Register the CG data written in the line buffer.
Data is read according to the values of X and Y. CG data referred to here
Is the object image data D_OBIndicates whether to display
Refers to the signal YSOBJ. The signal YSOBJ is VD
It is supplied to the processing unit 40 from P31 (see FIG. 3).
is there. Then, when it proceeds to the next step SD4, the processing unit 4
0 determines whether the read CG data is “1”
To do. At this time, if the CG data is not "1",
The blocks read according to the values of registers X and Y are
Image data D O_BBecause it will not overlap with
No collision occurs and the result of the judgment is "NO".
finish.

On the other hand, if the read CG data is "1", the determination result of step SD4 is "YES",
Go to step SD5. In step SD5, it is determined whether or not the collision flag CF is "0". Collision flag C
F is the bat BAT image of the actual image and the object image OB
It is "1" when J (ball image) overlaps. Here, when the flag CF is “0”,
That is, when the collision of both images is recognized for the first time, the determination result is “YES”, and the process proceeds to the next step SD6. In step SD6, the first detected first
The X coordinate of is stored in the collision coordinate area E7, and subsequently, in step SD7, the corresponding first Y coordinate is stored in the same area E7.

Then, in step SD8, the collision flag CF is set to "1". When the collision flag CF becomes "1" in this way, the processing unit 40 causes the CPU 5 to operate.
An interrupt request is issued to the No. 1 side, and the CPU 51 executes a collision interrupt process (described later) in response to this.
On the other hand, the determination result of step SD5 is "NO".
In the case of, that is, in the state where the collision of both images has already been recognized, the process proceeds to step SD9, the second X coordinate detected at last is stored in the collision coordinate area E8, and subsequently, this is dealt with in step SD10. The second Y coordinate is stored in the same area E7.

Operation of Coordinate Detection Routine Next, the operation of the coordinate detection routine will be described with reference to FIG. By the collision coordinate detection routine described above,
When the collision coordinates of the bat BAT image of the real image subjected to the chroma key detection and the object image OBJ (ball image) in the CG image are detected, the position detection processing unit 40 detects the coordinates through step SA11 (see FIG. 9). The routine is executed and the process proceeds to step SE1. Step SE1
Then, the registers X and Y, the register S, and the registers X ′ and Y ′ are reset to zero and initialized. The register S stores the area of the bat BAT image obtained by accumulating the number of blocks.

Next, when proceeding to step SE2, the processing section 40 reads out the block attribute corresponding to the values of the registers X and Y from the processing screen area E2, and proceeds to step SE2.
The process proceeds to 3. In step SE3, it is determined whether or not the read block attribute is "1", that is, the chroma key detected bat BAT image. here,
When the block attribute is not "1", the determination result is "N
"O" and the process proceeds to step SE4. At step SE4, the value of the register X is incremented by 1 to advance. Then, in step SE5, it is determined whether or not the value of the register X is "96", that is, the block attribute for one horizontal (scanning) line is read. Here, if the reading for one horizontal line is not completed, the determination result is "NO", and the process is returned to the step SE2 again.

Then, for example, if the read block attribute is "1", the determination result of step SE3 is "YE."
S ”, and the process proceeds to step SE6. In step SE6, it is determined whether the value of register X is larger than the value of register X '. The previously detected X coordinate is set in the register X ', and the right end / left end coordinates are updated according to the result of comparison between this coordinate value and the present coordinate value. That is, when the determination result here is "NO", the flow proceeds to step SE7, the value of the register X is stored in the left end coordinate area E5 (see FIG. 8), and the bat BAT is stored.
Update the left edge coordinates of the image. On the other hand, when the determination result of step SE6 is "YES", the process proceeds to step SE8, the value of the register X is stored in the right end coordinate area E6 (see FIG. 8), and the right end coordinate of the bat BAT image is updated.

Next, in step SE9, the processing section 40 determines whether or not the value of the register Y is larger than the value of the register Y '. Here, in the register Y ', similarly to the register X', the previously detected Y coordinate is set, and the upper end / lower end coordinates are updated according to the result of comparison between this coordinate value and the present coordinate value. ing. That is, when the determination result is “NO”, the process proceeds to step SE10,
The value of the register Y is stored in the upper end coordinate area E3 (see FIG. 8) to update the upper end coordinate of the bat BAT image. on the other hand,
When the determination result of step SE9 is "YES", the process proceeds to step SE11, the value of the register Y is stored in the lower end coordinate area E4 (see FIG. 8), and the lower end coordinate of the bat BAT image is updated.

Then, in step SE12, the value of the register S is incremented by 1 to increase the area by 1 block. Then, in step SE13, the values of the registers X and Y are rewritten into the registers X'and Y ', respectively. Thus, the processing of steps SE2 to SE13 is 1
When the horizontal line is completed, the determination result of the above-mentioned step SE5 becomes "YES", and the process proceeds to step SE14,
The value of register X is reset to zero and register Y
Increments the value of. Next, in step SE15, it is determined whether the value of the register Y is "96", that is, whether or not the coordinates of one frame have been detected. Then, when the coordinate detection for one frame is not completed, the above-mentioned step SE2 and subsequent steps are repeated.

On the other hand, when completed, the judgment result is "YE
S ”, and the process proceeds to step SE16. In step SE16, it is determined whether or not the area value stored in the register S exceeds a predetermined value, that is, whether or not the area where the chroma key is detected in the processing screen map may cause a malfunction of the game. Therefore, when the area detected by the chroma key exceeds a predetermined value, there is an object of the same color other than the bat BAT which is the detection target, and it is considered that malfunction occurs, and the determination result is "YES", and the process proceeds to step SE17. When the processing proceeds to step SE17, the processing unit 40 sets the warning flag stored in the register KF to "1", and ends this routine. On the other hand, when the area detected by the chroma key does not exceed the predetermined value, the determination result is "NO", and the process returns from this routine to the main routine (see FIG. 9) described above. When the warning flag is set to "1" in step SE17, a warning interrupt process described later is executed.

Operation of Center of Gravity Calculation Routine When the left edge / right edge coordinates and the upper edge / lower edge coordinates of the bat BAT image detected by the chroma key are detected by the coordinate detection routine, the position detection processing unit 40 causes the position detection processing unit 40 to perform the above-described step SA12 (FIG. 9). 14), the center of gravity calculation routine shown in FIG. 14 is executed, and the process proceeds to step SF1. First, in step SF1, the registers XG and YG are reset to zero. Registers XG and YG are bat BAs calculated based on the blocks detected by the chroma key.
The barycentric coordinates of the T image are stored. Next, in step SF2, the registers X and Y are initialized, and in step SF3, the block attributes corresponding to the values of the registers X and Y are read from the processing screen area E2.

Next, in step SF4, the processing unit 4
0 determines whether or not the read block attribute is "1", that is, the bat BAT image subjected to the chroma key detection. Here, when the block attribute is not "1", the determination result is "NO", and the process proceeds to step SF5. At step SF5, the value of the register X is incremented by 1 to advance. Then, in step SF6, it is determined whether or not the value of the register X is "96", that is, the block attribute for one horizontal (scanning) line is read. Here, when the reading for one horizontal line is not completed, the determination result is “NO”, and the process is returned to the step SF3 again.

Then, for example, assume that the next read block attribute is "1". Then, step SF
The determination result of 4 is "YES", and the processing unit 40 advances the processing to step SF7. In step SF7, the block in which the chroma key is detected is regarded as a mass point, and the center of gravity is calculated by sequentially accumulating the ratio of the coordinates (X, Y) of this block and the area S. The area S is stored in the register S in the coordinate detection routine described above. Next, in step SF8, the barycentric coordinates are updated according to the barycentric calculation result in step SF7, and subsequently, in step SF5, the value of the register X is incremented.

Here, if the reading of one horizontal line is completed, the result of the determination in step SF6 is "YES".
In step SF9, the value of register X is reset to zero and the value of register Y is incremented by one.
Next, in step SF10, it is determined whether or not the value of the register Y is "96", that is, whether the gravity center calculation for one frame has been performed. When the calculation of the center of gravity for one frame is not completed, the determination result is “NO”,
The processing from step SF3 onward is repeated. on the other hand,
When the calculation of the center of gravity for one frame is completed, the determination result is "YES", the routine is ended and the process returns to the main routine (see FIG. 9).

Operation of Warning Interrupt Processing Routine As described above, when the area value stored in the register S exceeds the predetermined value in the coordinate detection routine, the processing unit 40
Sets the warning flag stored in the register KF to "1", considering that there is a risk of malfunction. When this warning flag becomes "1", the processing unit 40 executes the warning interrupt processing routine shown in FIG. 15 and advances the processing to step SH1 to set the start flag stored in the register STF to "0", Force the operation to end. Then, in step SH2, the warning flag is set to "0" and the process returns to the main routine (see FIG. 9).

As described above, in the position detection processing section 40,
Sampling image data D _S supplied from the imaging unit 1 side
The bat BAT image contained in the chroma key detection signal CR
Create a processing screen map for each frame based on O,
According to the block attribute read from the processing screen map, the collision coordinate position between the bat BAT image and the object image (ball image), the left end / right end coordinates and the upper end / lower end coordinates of the bat BAT image on the processing screen are obtained, and The position of the center of gravity is calculated. In addition, the processing unit 40
Judges whether or not the area detected by the chroma key exists so as to induce a malfunction of the game, and when the area exceeds a predetermined value, it is considered that the game may malfunction, and is forced to end. Thereby, for example, the bat BA in the actual image
When there is an object that is the same color as T and has a larger area than that, or when there are many objects to be subjected to the dead zone processing described above, the game operation is forcibly ended, so that malfunction can be prevented. It will be possible.

(2) Operation of control unit 50 (CPU 51) Next, based on various data supplied from the position detection processing unit 40 described above, the image processing unit 30 and the first sound source circuit 55b.
The operation of the CPU 51 that controls the second sound source circuit 56 and manages the progress of the game will be described with reference to FIGS. In the following, CP will be described as a general operation of the CPU 51.
After describing the U main routine, various interrupt processing routines will be described. Subsequently, a sound source processing routine performed in the first and second sound source circuits 55b and 56 after this will be described.

Operation of Main Routine First, when the apparatus main body 2 is powered on, the CPU 51 reads out and loads the operation system program stored in the ROM 53, and then executes the CPU main routine shown in FIG. 16, and step SG1 Proceed to. In step SG1, various registers secured in the RAM 52 are initialized, and a control signal SC for instructing the VDP 31 and the position detection processing unit 40 to initialize is provided.
To supply. Next, when proceeding to step SG2, while supplying the control signal SC which gives the interrupt permission to each part, after canceling the interrupt mask of itself, the monitoring timer WT (described later) provided inside the CPU 51 is started, and the next step Proceed to SG3.

When proceeding to step SG3, the application program is read from the ROM 55a incorporated in the game cartridge 55 and is expanded in a predetermined storage area of the RAM 52. Next, the CPU 51 forms an initial screen displayed at the beginning of the game through steps SG4 to SG6. That is, when the process proceeds to step SG4,
Since the CPU 51 DMA-transfers the background image data D _BG forming the initial screen background to the VDP 31,
The transfer destination address and the transfer source address are set in the MA controller. In addition, the DMA transfer is performed by the display 3
(See FIG. 1) This is performed by transfer interrupt processing synchronized with the vertical blanking period on the side. The DMA controller in which the transfer instruction is set reads the background image data D _BG corresponding to the transfer source address from the ROM 55a (see FIG. 3) under the instruction of the CPU 51, and reads the VDP31 (VRAM3).
DMA transfer to 2). Such interrupt processing will be described later.

Next, when proceeding to step SG5, the CPU
The reference numeral 51 sets the transfer destination address and the transfer source address in the DMA controller in order to DMA transfer the object image data D _OB displayed on the background image BG to the VDP 31. Subsequently, in step SG6, the transfer destination address and the transfer source address of the object table data T _OB corresponding to the data D _OB are DM.
Set it on the A controller. The object table data T _OB specifies the display position of the object image data D _{OB on} the initial screen, and is stored in the object table RAM 31f (see FIG. 9).

Next, when proceeding to step SG7, the transfer flag F stored in the register ACKF is set to "1", and the process proceeds to the next step SG8. The transfer flag F set in the register ACKF indicates whether or not the data set and transferred in the DMA controller is DMA-transferred. When the flag F is "0", it indicates that the DMA transfer is completed. When it is "1", it represents a non-transfer state. Then, in step SG8, the process waits until the transfer flag F becomes “0”, that is, until the DMA transfer is completed by the transfer interrupt processing routine described later.

When the DMA transfer is completed and the initial screen is formed, the CPU 51 advances the processing to step SG9, and determines whether or not a start event has occurred. The start event mentioned here is an event that occurs when a start switch provided on the operation panel of the apparatus body 2 is turned on. Then, when the player turns on the start switch in order to start the game operation, the start event is generated. Therefore, the determination result here is "YES", and the process proceeds to step SG10. In step SG10, the register t is reset to zero, then the process proceeds to step SG11, "1" is set in the register STF, and the process proceeds to the next step SG12. On the other hand, when the start event is not generated, the determination result of step SG9 is “NO”, and the process proceeds to step SG12. A time count value for managing the progress of the game is set in the above-mentioned register t by an interrupt operation described later.

In step SG12, it is determined whether or not the value of the register STF is "1", that is, whether or not the start flag indicating whether or not the game has started is set to the game start state. Here, if "1" is not set, the determination result becomes "NO", and steps SG9 to SG11 described above are repeated until a start event is generated.
When the start event occurs, step SG
The determination result of 12 is "YES", and the CPU 51 causes the CPU of FIG.
The process proceeds to step SG13 shown in FIG. Step S
At G13, it is determined whether the transfer flag F set in the register ACKF is "0". Where DMA
When the transfer is completed, the flag F is “0”, so the determination result of step SG13 is “YES”, and the process proceeds to step SG14.

In step SG14, the corresponding object table data T _OB is calculated based on the time count value stored in the register t. As a result, the display position of the object image data D _OB is determined. in this case,
The object image data D _OB is formed of a character image simulating a “pitcher” and a “ball image” of this character image. Next, when proceeding to step SG15, CP
U51 designates the image data D _OB corresponding to the time count value of the register t from among the plurality of object image data D _OB DMA-transferred to the VDP 31 side in advance. As a result, the object image data D _OB corresponding to the position designated by the table data T _OB on the game screen is displayed.

When the game screen is formed as described above, the CPU 51 proceeds to step SG16 to register A
Set the transfer flag F stored in CKF to "1",
It proceeds to step SG17. Incidentally, the above-mentioned step SG
If the determination result in 13 is "NO", that is, if the object table data T _OB has already been DMA-transferred, the process proceeds to step SG17. Step S
At G17, it is determined whether a stop event has occurred. The stop event is an event that occurs when a stop switch provided on the operation panel of the apparatus body 2 is turned on. Then, when the player turns on the stop switch to stop the game,
The stop event is generated, the determination result here is “YES”, and the process proceeds to step SG18.

In step SG18, the start flag stored in the register STF is set to "0" to stop the game operation. After that, the CPU 51 repeats the operations of steps SG9 to SG17 described above. On the other hand, if the stop switch is not turned on in step SG17, the determination result here is "NO", and the process proceeds to step SG19. Step SG1
At 9, it is determined whether or not the time count value stored in the register t has reached the predetermined value T. Here, if the time count value has not reached the predetermined value T corresponding to the game end time, the determination result is “NO”, and step S
The process is returned to G9 (see FIG. 16). On the other hand, when the time count value reaches the predetermined value T, step SG
After zero resetting the time count value stored in the register t via 20, the process is returned to step SG9 shown in FIG.

Operations of Interrupt Processing Routine Next, operations of various interrupt processing routines executed by the CPU 51 will be described with reference to FIGS. a. Operation of Transfer Interrupt Processing Routine The CPU 51 gives a transfer instruction to the DMA controller (not shown) each time a vertical blanking signal is supplied from the clock driver 12 (see FIG. 3), and executes the transfer interrupt processing routine shown in FIG. Run. First, in step SJ1, the transfer flag F stored in the register ACKF is "1", that is, whether or not the object table data T _OB set by the DMA transfer in step SG6 (see FIG. 16) is in the untransferred state. To judge.
Here, if the data T _OB has already been DMA-transferred, the transfer flag F is set to “0”, the determination result is “NO”, and this routine is once completed.

On the other hand, if the object table data T _OB is in the untransferred state, the result of the judgment is “YES”, and C
The PU 51 advances the process to the next step SJ2. In step SJ2, it is determined based on the time count value whether or not the game has just started. Here, immediately after the start, the determination result is "YES", and the process proceeds to the next step SJ3. In step SJ3, the background image data D _{BG is set} to V for the DMA controller.
Instruct the DP 31 to perform the DMA transfer, and then step SJ4
Go to. On the other hand, if it is not immediately after the start in step SJ2, the determination result is “NO”, and the process proceeds to step SJ4.

In step SJ4, the DMA controller
In contrast, the object image data D O_BTo VDP31 side
The DMA transfer is instructed, and in the subsequent step SJ5,
The data D_OBObject table data T corresponding to
_OB2 DMA transfer is instructed. Then, step SJ6
When the processing advances to, the CPU 51 stores in the register ACKF.
The transfer flag F is set to "0" to indicate that the transfer is completed.
Complete the routine. In this way, the transfer interrupt handling routine
The transfer flag set in the register ACKF
Various data to be DMA-transfer-set according to the lag F
Next transfer.

B. Operation of Collision Interrupt Processing Routine In the CPU 51, the object image data D _OB and the object table data T _OB forming the game screen are sequentially D based on the time count value according to the progress of the game.
MA transfer is controlled, and on the other hand, on the VDP 31 side, the object image OBJ corresponding to these data D _OB and T _OB and the background image BG are combined to generate a CG image that changes from moment to moment. At this time, in the position detection processing unit 40, the above-described collision coordinate detection processing routine (see FIG.
2)) "Bat image" and "Ball image"
The presence or absence of a collision with is detected at any time. When the position detection processing unit 40 detects a collision, the collision flag CF is set to "1".
By setting to, the CPU 51 executes the collision interruption processing routine shown in FIG. 19, and advances the processing to step SK1.

First, in step SK1, it is judged whether or not the time count value set in the register t is within the range of predetermined values T _{1 to} T ₂ . The time count value is
This value is counted immediately after the start of the game and manages the progress of the game. Further, the predetermined value T _{1 to} T _{2 referred} to here is
It refers to the effective period when the "bat image" and the "ball image" meet. That is, in this step SK1, it is determined whether or not the timing at which the “bat image” and the “ball image” collide is within the effective period of the meet. Here, for example, if the player swings the bat BAT early or delays the swing, the timing of the collision will fall outside the effective period of the meet, so the determination result is "NO", and this routine is completed. .

On the other hand, if the collision timing is within the valid period of the meet, the determination result is "YES",
The process proceeds to the next step SK2. In step SK2, the barycentric position of the “bat BAT image” detected by the chroma key, that is, the barycentric coordinate from the barycentric coordinate area E9 in the work RAM of the position detection processing unit 40 is fetched. Next, in step SK3, the correspondence between the center of gravity of the “ball image” formed from the object image data D _OB and the center of gravity of the “bat BAT image” detected by the chroma key is determined. Here, if the barycentric positions of both agree with each other, the process proceeds to step SK4, and a first image processing routine described later is executed. If the center of gravity of the “ball image” is located below the center of gravity of the “bat BAT image”, the process proceeds to step SK5 and the second image processing routine described later is executed. Further, when the center of gravity of the “ball image” is located above the center of gravity of the “bat BAT image”, the process proceeds to step SK6, and the third image processing routine described later is executed. When the execution of these image processing routines is completed, the collision flag CF is determined in step SK7.
To "0".

C. Operation of Image Processing Routine Next, the operation of the first to third image processing routines will be described with reference to FIGS. FIG. 21 is a flowchart in which the processing contents of these first to third image processing routines are shared. First, in step SL1, the display position of the object image data D _OB (“ball image”) is calculated based on the time count value stored in the register t. Then, in step SL2, the display position is determined according to the time count value. Object image data D _OB is designated.

Therefore, in the first image processing routine, since the center of gravity of the "ball image" and the center of gravity of the "bat BAT image" are in agreement, as in the actual batting, for example, "home run". The “ball image” is displayed in the CG image so that Further, in the second image processing routine, as shown in FIG. 22, the center of gravity of the “ball image” is the batting located below the center of gravity of the “bat BAT image”, so that, for example, “goro” is set. The "ball image" is displayed in the CG image. Further, in the third image processing routine, as shown in FIG. 23, since the center of gravity of the “ball image” is the batting located above the center of gravity of the “bat BAT image”, for example, “fly” is set. The "ball image" is displayed in the CG image.

In this way, when the CG image is generated according to the correspondence relationship between the barycentric position of the "ball image" and the barycentric position of the "bat BAT image", the CPU 51 advances the process to step SL3. In step SL3, it is determined whether or not the time count value stored in the register t has reached the game end value END. Here, when the time count value reaches the game end value END, the determination result is “YE
S ”, the process proceeds to step SL4, the time count value is reset to zero, and this routine is completed.

On the other hand, the time count value is the game end value E.
If it is less than ND, the result of the determination in step SL3 is "NO", and the process proceeds to step SL5. In step SL5, it is determined whether or not a stop event has occurred. Here, if the stop event has not occurred, the determination result is “NO”, and the above-described step S
Repeat L1 to SL3. On the other hand, when a stop event occurs by turning on the stop switch,
When the result of the determination is "YES", the flow proceeds to step SL6, the start flag stored in the register STF is set to "0", the game is terminated, and this routine is completed.

D. Timer Interrupt Processing Routine Next, the operation of the timer interrupt processing routine for generating a time count value for managing the progress of the game will be described with reference to FIG.
This will be described with reference to 0. The CPU 51, based on the system clock supplied from the system clock circuit 24,
This routine is started every predetermined period, step SM1 is executed, and the time count value stored in the register t is incremented by 1 to advance.

E. Operation of Monitor Timer Count Processing Routine Next, the operation of the monitor timer count processing routine will be described with reference to FIG. This monitoring timer count processing is involved in sound source processing described later. CPU
The 51 is provided with a monitoring timer WT that regulates the operations of the first and second tone generator circuits 55b and 56 (see FIG. 3). C
The PU 51 executes this routine at regular intervals.
The process proceeds to step SN1 shown in. Step SN1
Then, the monitoring timer value is incremented, and subsequently, in step SN2, it is determined whether or not the timer value overflows. If no overflow has occurred, the determination result is "NO", and this routine is once completed. On the other hand, when an overflow occurs, the determination result is “YES”, and step SN3
And the overflow flag stored in the register OVF is set to "1" to complete this routine.

F. Operation of Overflow Interrupt Processing Routine Next, the operation of the overflow interrupt processing routine will be described with reference to FIG. The overflow interrupt process is started when the overflow flag stored in the register OVF becomes "1" in the above-mentioned monitoring timer count process, and executes step SO1 to execute the CPU
This routine is completed by setting the operation of 51 to the halt state.

G. Operation of Sound Source Request Interrupt Routine The operation of the sound source request interrupt processing routine will be described with reference to FIG. The CPU 51 executes this routine each time a data request signal is supplied from the first and second tone generator circuits 55b and 56, and advances the processing to step SP1.
In step SP1, the above-mentioned monitoring timer WT is reset, and subsequently in step SP2, the musical tone control data is transferred to the first and second tone generator circuits 55b and 56.
This tone control data is information that specifies the pitch, tone color, volume, etc. of a tone that should be generated corresponding to the progress of the game. When there is no musical tone to be generated, musical tone control data representing "no data" is supplied to the first and second tone generator circuits 55b and 56.

Operation of Sound Source Processing Routine Next, the operation of the first and second sound source circuits 55b and 56 for synthesizing a musical effect sound under the control of the CPU 51 will be described with reference to FIG. The first tone generator circuit 55b built in the game cartridge 55 is the CPU 51
Based on the tone control data supplied from the side, a game sound effect corresponding to the game operation is synthesized and output as a tone signal. On the other hand, the second sound source circuit 56 similarly has a CPU.
Based on the musical sound control data supplied from the 51 side, musical compositions corresponding to the progress of the game, for example, musical compositions such as opening and ending are synthesized and outputted.

These first and second tone generator circuits 55b, 5
When the power of the device body 2 is turned on, the step 6 is step SQ.
The process proceeds to 1 to initialize various registers, reset various registers, and set initial values. Then, step S
When proceeding to Q2, "1" is set in the register REQ.
As a result, the circuits 55b and 56 send a data request signal to the CPU 51. The CPU 51, which has received the data request signal, executes the above-described tone generator request interrupt routine to reset the monitoring timer WT and transfers the tone control data to the first and second tone generator circuits 55b and 56.

When the tone control data is received from the CPU 51 side in this way, the result of the determination in step SQ3 is "YES", and the process proceeds to the next step SQ4. Step S
In Q4, the process waits until the data to be transferred becomes stable, and when the data becomes stable, that is, when the reception of the musical tone control data is completed, the determination result here becomes "YES",
The process proceeds to step SQ5. And step SQ
At 5, the register REQ is set to "0" and the transmission of the data request signal is stopped. Next, in step SQ6, the content of the received musical tone control data is interpreted and converted into event data that specifies the pitch, tone color, volume, etc. of the musical tone to be generated in accordance with the progress of the game. Then, in step SQ7, a tone signal corresponding to this event data is created, and thereafter, step SQ2 and subsequent steps are repeated again.

However, according to the operation of this routine,
The first and second sound source circuits 55b and 56 are CPUs at any time.
A data request signal is sent to the 51 side, while the CPU
On the 51 side, musical tone control data is returned to the circuits 55b and 56 in response to the data request signal. Then, the circuits 55b and 56 which have received the tone control data synthesize the tone corresponding to the data. Therefore, for example, when the game operation is performed based on the game cartridge 55 that only has the ROM 55a in which the application program has been copied, the first cartridge that should be incorporated in the cartridge 55a
Since the tone generator circuit 55b does not exist, the data request signal is not sent from this circuit 55b to the CPU 51. Then, the CPU 51 does not execute the sound source request interrupt processing routine described above, and as a result, the monitoring timer WT is not reset and the tone control data is not sent to the sound source circuits 55b and 56. And the monitoring timer WT
If an overflow occurs without being reset, the above-mentioned overflow interrupt processing routine (see FIG. 25)
Based on the above, it stops itself (CPU 51).

As described above, in the present embodiment, when the area detected by chroma key detection from the actual image exceeds a predetermined value, for example, in the actual image, the same color as the bat BAT,
And, when there is an object having a larger area than that, or when there are many objects to be subjected to the dead zone processing described above,
The game operation is not normally performed, and the game is forcibly ended on the assumption that it may malfunction, so it is possible to prevent malfunction when an object other than the detection target is present in the captured image. Is. As a result, it is possible to avoid in advance a problem that a malfunction occurs during the game operation.

In the above-described embodiment, the game is uniquely forcibly terminated when the area detected by the chroma key exceeds a predetermined value. An image for notification may be generated. Further, in this embodiment, the image control device for simulating the "batting" operation is disclosed, but the gist of the present invention is not limited to the device.
For example, the present invention can be applied to various games such as "tennis" and "golf" that incorporate the exercise behavior of the player, or role playing games. Further, in the present embodiment, the game is uniquely forcibly terminated when the area detected by the chroma key exceeds a predetermined value. However, instead of this,
For example, to detect the movement of the area where the chroma key is detected,
It is also possible to regard a region in a stationary state over a plurality of frames as a dead zone and terminate the game when there is a risk of malfunction when the area of other regions exceeds a predetermined value.

[0099]

As described above, according to the present invention,
The area detection means extracts a chroma key area of a specific color from the captured image to detect the area of the chroma key area, and the game control means determines that the area detected by the area detection means exceeds the predetermined value. Since the operation is stopped, it is possible to prevent a malfunction when an object other than the detection target is present in the captured image.

[Brief description of drawings]

FIG. 1 is an external view showing an overall configuration of an image control apparatus according to an embodiment of the present invention.

FIG. 2 is a diagram for explaining the outline of the embodiment.

FIG. 3 is a block diagram showing an electrical configuration of the image control apparatus according to the embodiment.

FIG. 4 is a block diagram showing a configuration of an image pickup signal processing unit 11 in the embodiment.

FIG. 5 is a block diagram showing a configuration of a video signal processing unit 20 in the embodiment.

FIG. 6 is a chroma key signal generation circuit 20 in the same embodiment.
It is a figure for demonstrating f.

FIG. 7 is a block diagram showing a configuration of a VDP 31 in the embodiment.

FIG. 8 is a memory map for explaining the contents of the work RAM of the position detection processing unit 40 in the embodiment.

FIG. 9 is a flowchart showing an operation of a main routine in the position detection processing section 40.

10 is a flowchart showing the operation of an initial screen map creation routine in the position detection processing unit 40. FIG.

11 is a flowchart showing an operation of a processing screen map creation routine in the position detection processing unit 40. FIG.

FIG. 12 is a flowchart showing an operation of a collision coordinate detection processing routine in the position detection processing section 40.

FIG. 13 is a flowchart showing the operation of a coordinate detection processing routine in the position detection processing section 40.

FIG. 14 is a flowchart showing an operation of a centroid calculation processing routine in the position detection processing section 40.

FIG. 15 is a flowchart showing the operation of a warning interrupt processing routine in the position detection processing section 40.

FIG. 16 is a flowchart showing an operation of a CPU main routine in the CPU 51.

FIG. 17 is a flowchart showing an operation of a CPU main routine in the CPU 51.

FIG. 18 is a flowchart showing the operation of a transfer interrupt processing routine in the CPU 51.

FIG. 19 is a flowchart showing the operation of a collision interrupt processing routine in the CPU 51.

FIG. 20 is a flowchart showing the operation of a timer interrupt routine in the CPU 51.

FIG. 21 is a flowchart showing the operation of the n-th image processing routine in the CPU 51.

FIG. 22 is a diagram for explaining the operation of the n-th image processing routine in CPU 51.

FIG. 23 is a diagram for explaining the operation of the n-th image processing routine in the CPU 51.

FIG. 24 is a flowchart showing the operation of a monitoring timer count processing routine in the CPU 51.

FIG. 25 is a flowchart showing the operation of an overflow interrupt processing routine in the CPU 51.

FIG. 26 is a flowchart showing the operation of a sound source request interrupt processing routine in the CPU 51.

FIG. 27 is a flowchart showing an operation of a sound source processing routine in the first and second sound source circuits 55b and 56.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Image pick-up part 2 Device main body 3 Display 20 Video signal processing part (detection means) 30 Image processing part (control means) 40 Position detection processing part (detection means, instruction means) 50 Control part 51 CPU (control means)

Claims (4)

[Claims] 1. A detection means for extracting a chroma key region of a specific color from a captured image and detecting the size of the chroma key region, and a display mode of a computer image displayed on a display screen.
Control means for controlling according to a display position of a chroma key image formed by the chroma key area, and determining whether or not the chroma key area exceeds a predetermined size, and when the size exceeds the predetermined size, the control means And an instruction unit for instructing to stop the operation. 2. The instructing means determines that an object of a specific color other than a detection target is present in the captured image when the chroma key area exceeds a predetermined size. Image control device. 3. A chroma key extraction means for extracting a chroma key area of a specific color from a captured image, and a display mode of a computer image displayed on a display screen.
Control means for controlling according to the display position of the chroma key image formed by the chroma key area, and operation for forcibly ending the processing of the control means as a possibility of malfunction when the area of the chroma key area exceeds a predetermined value An image control apparatus comprising: a determination unit. 4. The image control apparatus according to claim 3, wherein the chroma key extraction means extracts a chroma key area of a specific color for each image pickup frame.