JPH07302324A - Picture controller - Google Patents

Abstract

PURPOSE:To attain a picture controller capable of executing picture control based upon chroma key detecting and processing without generating malfunction even when plural chroma key images exist in a picked-up image. CONSTITUTION:A position detecting and processing part 40 sets up a corresponding detection frame in a picked-up image in accordance with an operation mode specified by a CPU 51 and detects a chroma key image with a specific color from the picked-up image in accordance with the detection frame. When the processing part 40 detects a chroma key image through a detection frame, the CPU 51 generates an operation instruction corresponding to the operation mode and the specified detection frame to give it to a picture processing part 30. The processing part 30 controls a display screen in accordance with the operation instruction. Thereby, even when plural chroma key images exist in a picked-up image, picture control based upon chroma key detecting and processing can be attained without generating malfunction.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image control apparatus suitable for use in, for example, a video game for creating virtual reality.

[0002]

2. Description of the Related Art Conventionally, various image control devices have been put into practical use, which control a moving image of an object image or generate a sound effect in accordance with an operation of an operation pad or the like. In addition,
The object image mentioned here refers to a “character” displayed on the game screen, and is moved and displayed on the background screen as a background. This type of device is called a video game or a TV game, and a shooting game that asks a player's reflexes, a game that simulates a virtual reality, and the like are known.

Such a video game is composed of an image processing section for generating a video signal corresponding to a game operation and a display for displaying the video signal supplied from the image processing section. The image processing unit is a CPU, RO
M and RAM etc., for example, sequentially read out the image information and control information stored in the ROM pack,
A background image serving as a screen background is displayed on the display, and a corresponding character (object image) is displayed as a moving image on the screen background in response to a game operation, and a sound effect corresponding to the movement is pronounced.

[0004]

In the above-described conventional image control device, in many cases, the position of the image (background image or object image) displayed in response to the operation of the operation pad (external switch) and The game is progressing while changing the form. In the input operation using the operation pad (external switch), for example, in the case of a game such as a sports game, the player himself / herself becomes a player of the game and causes the ball to strike or throw a ball in a simulated manner. Does not actually move the body of the player, so that it has a bad effect of becoming unrealistic.

Therefore, what can be considered to solve this problem is, for example, that a player is provided with an operator (exercise tool such as a bat or a racket) used in the game, and the movement of the operator is detected. This is a method of controlling the movement of the object image (ball image or opponent image) on the display screen, and specifically, a method of detecting the position or movement of the operator by a well-known chroma key detection process is conceivable. The chroma key detection processing is that the operator (exercise equipment such as a bat and a racket) is colored with a specific color, the chroma key image of the specific color is extracted from the image of the player, and the player holds it. The position and movement of the operator are detected on the screen.

However, in the case of performing image control by a plurality of operators in accordance with such chroma key detection processing,
Since there are a plurality of manipulators of a specific color in the captured image, there is a disadvantage in that each chroma key image and manipulator cannot be associated. That is, in the conventional image control device,
Since the chroma key image existing in the captured image is simply extracted, it is not possible to distinguish which operator is operated and how it is operated, which causes malfunctions, etc. There is a problem that you can not do. The present invention has been made in view of the above-mentioned circumstances, and provides an image control device capable of performing image control by chroma key detection processing without malfunction even when a plurality of chroma key images are present in a captured image. The purpose is to do.

[0007]

In order to achieve the above object, the invention according to claim 1 has a plurality of operation modes, and a mode selection means for selecting any one of the plurality of operation modes. A detection frame setting means that has a plurality of detection frames that represent a region to be detected, specifies a detection frame corresponding to the selected operation mode from among these detection frames, and sets this as a specified detection frame in the captured image. A chroma key detecting means for detecting a chroma key image of a specific color from the captured image in accordance with the designated detection frame; and when the chroma key image is detected in the designated detection frame, the operation mode and the designated detection frame It is characterized by comprising a display control means for generating the attached operation instruction and controlling the display screen in accordance with the operation instruction.

According to the second aspect of the invention, the detection frame setting means stores the positions and dimensions of the plurality of detection frames as diagonal elements composed of first and second frame coordinates. It is characterized by that.

Further, in the invention according to the third aspect, there are a plurality of operation modes, and a plurality of operation mode selecting means for selecting any one of the plurality of operation modes and a plurality of areas representing the region to be detected. A detection frame corresponding to the selected operation mode, and a detection frame setting unit that sets the detection frame in the captured image as a specified detection frame; and the detection frame according to the specified detection frame. Chroma key detecting means for detecting a chroma key image of a specific color from the captured image, image generating means for reading image data stored in advance in the storing means and displaying a predetermined image on a display screen, and within the designated detection frame, When collision detection means for detecting the presence or absence of a collision between the chroma key image and the predetermined image, and the collision detection means detects a collision between the chroma key image and the predetermined image,
The display control means is configured to generate an operation instruction associated with the collision state and the operation mode, and control a display mode of the predetermined image according to the operation instruction.

In addition, in the invention described in claim 4, a mode selecting means having a plurality of operation modes, and any one of the plurality of operation modes is selected, and a plurality of detections representing a region to be detected. A detection frame setting unit that has a frame and specifies a detection frame corresponding to the selected operation mode in a time-division manner from among the frames, and sets the detection frame as a specified detection frame in the captured image; A chroma key detecting means for detecting a chroma key image of a specific color from a picked-up image, an image generating means for reading out image data stored in advance in a storage means and displaying a predetermined image on a display screen, and the operation mode having a predetermined operation mode When the chroma key image is detected within the designated detection frame when it is below, the display mode of the predetermined image is controlled according to the positional displacement of the chroma key image in the captured image. It is characterized by comprising a that display control means.

According to the invention described in claim 5, the display control means detects the positional displacement based on whether or not there is a difference between the position of the chroma key image in the previous image pickup frame and the position of the chroma key image in the current image pickup frame. It is characterized by doing.

[0012]

According to the present invention, the detection frame setting means specifies the detection frame from among the plurality of detection frames according to the operation mode selected by the mode selection means, and sets this in the picked-up image as the specified detection frame. When the chroma key detection means detects a chroma key image of a specific color from the captured image according to the designated detection frame, the display control means generates an operation instruction associated with the operation mode and the designated detection frame. The display screen is controlled according to the operation instruction. As a result, even if a plurality of chroma key images are present in the captured image, it is possible to perform image control by the chroma key detection processing without malfunction.

[0013]

Embodiments of the present invention will be described below with reference to the drawings. A. Outline of Embodiments FIG. 1 is an external view showing an overall configuration of an image control apparatus according to the present invention, and illustrates an example applied to a baseball game. In this figure, reference numeral 1 denotes an image pickup unit including a solid-state image pickup device such as a CCD, which picks up an image of a player P held on a batter box (not shown). Here, the player P, for example, performs a batting operation with a blue-colored bat B as an operator for detecting a chroma key, while wearing a sock S colored with blue on the foot. This socks S
The meaning of will be described later.

Reference numeral 2 denotes a main body of the apparatus, which performs chroma key detection on the image pickup signal supplied from the image pickup section 1 to extract the position of the bat B or the sock S in the picked up image. The captured image refers to an image captured by the image capturing unit 1, and may be referred to as an actual image in the following description. Also,
The device main body 2 synthesizes a background image BG which is a background scene of the game and an object image OBJ which is moved and displayed on the background image BG, and uses this as a computer graphic image (hereinafter referred to as a CG image). Display on display 3. Display 3
The CG image displayed in is formed from, for example, a throwing motion image of a pitcher on a background scene during batting, and a flight image of a ball corresponding to the throwing, and a “diamond” image that becomes the background after completion of batting. It is formed from a character image running on this "diamond".

Here, referring to FIGS. 2 to 4, the apparatus main body 2
The operation mode of will be described. The operation of the apparatus main body 2 includes the first mode to the third mode. First Mode In the first mode, image control at the start of the game is performed. That is, as shown in FIG. 2, a CG image is formed by an object image OBJ (hereinafter referred to as a start screen) marked as “start”, and a chroma key detection area is formed at a position corresponding to the image OBJ. The 1 detection frame SF1 is combined with the set captured image and displayed on the display 3 as a display screen. When the bat B is positioned within the first detection frame SF1 corresponding to the start screen, the game is started based on the processing described later. As described above, in the first mode, the player P points the start screen displayed on the display 3 with the bat B, so that the device body 2 recognizes the start of the game.

Second Mode In the second mode, image control is performed according to the batting operation. In this case, as shown in FIG. 3, first, in the CG image, an object expressing the throwing motion of the pitcher and the flying motion of the ball that changes in response to the throwing motion on the background scene formed by the background image BG. Image O
BJ is formed. In addition, a “stop” area indicating a game stop is displayed in the upper left portion of the background image BG. On the other hand, in the captured image, the second detection frame SF that becomes the chroma key detection area at the location corresponding to the “stop” area.
2 is provided, and a third detection frame SF3 for detecting the position of the bat B to be batting operated is provided.

The apparatus main body 2 determines whether or not a collision with the ball image is possible at every predetermined timing according to the position of the bat B detected in the third detection frame SF3, and when the collision is detected, the timing for meeting. At this point, the hitting condition is obtained according to the difference between the center of gravity of the bat B image and the center of gravity of the ball image. For example, if the positions of both centers of gravity coincide with each other at the time of the collision, a simulation close to reality is performed so that a “home run” is set as the just meat. In addition, the device main body 2 is the second
When the bat B is located in the detection frame SF2, processing for stopping the game operation is performed. In such a second mode, the captured image is not displayed and only the CG image is displayed on the display 3 as a display screen. That is, the display 3 displays a ball image approaching the player P side according to the throwing motion of the pitcher.

Third Mode In the third mode, image control corresponding to the base running motion is performed. In this case, as shown in FIG. 4, a character (object image OBJ) running on a “diamond” formed by the background image BG is first formed in the CG image. In addition, a “stop” area indicating a game stop is displayed in the upper left portion of the background image BG. On the other hand, in the captured image, a fifth detection frame SF5 serving as a chroma key detection area is provided at a position corresponding to the “stop” region, and a fourth detection frame SF4 that detects the position of the sock S is provided.

The apparatus main body 2 runs a character (object image OBJ) on the basis of the positional displacement of the sock S detected in the fourth detection frame SF4. That is, the player P
The character makes the base run according to the movement of the foot. In addition, the device main body 2 has a bat B on the fifth detection frame SF5.
When is positioned, processing for stopping the game operation is performed. In such a third mode, the captured image is not displayed,
Only the CG image is displayed on the display 3 as a display screen.

B. Configuration of Embodiments Next, the electrical configurations of the imaging unit 1 and the apparatus body 2 will be described with reference to FIG. (1) Configuration of Image Pickup Section 1 The image pickup section 1 is composed of the constituent elements 10 to 13.
An oscillating circuit 10 generates and outputs an 8 times oversampling signal 8f _SC . An image pickup signal processing unit 11 supplies the 8 × oversampling signal 8f _SC to the clock driver 12 in the next stage and converts the image pickup signal SS output from the CCD 13 into sampled image data D _S. The configuration of the image pickup signal processing unit 11 will be described later. The clock driver 12 generates various timing signals such as a horizontal drive signal, a vertical drive signal, a horizontal / vertical sync signal, and a blanking signal based on the 8 times oversampling signal 8f _SC supplied from the oscillator circuit 10. An image pickup drive signal corresponding to the horizontal drive signal and the vertical drive signal is generated and supplied to the CCD 13. CCD
13 generates an image pickup signal SS obtained by picking up an image of an object according to the image pickup drive signal.

The image pickup signal processing section 11 conditions the image pickup signal SS supplied from the CCD 13 and then A
The _S / D conversion is performed to generate the sampled image data D _S , and its schematic configuration will be described with reference to FIG. In FIG. 6, 11a is a sampling circuit,
The image pickup signal SS is sampled and held according to the 4 × oversampling signal 4f _SC supplied from the clock driver 12 and output to the next stage. Reference numeral 11b is an AGC (automatic gain control) circuit for converting the sampled image pickup signal SS into a predetermined level and outputting it. Reference numeral 11c is a γ correction circuit which corrects the gamma characteristic of the image pickup signal SS to γ = 1 / 2.2 and outputs it. Reference numeral 11d denotes an A / D conversion circuit that converts the gamma-corrected image pickup signal SS into 8-bit length sampling image data D _S and outputs the sampled image data D _S. The sampling image data D _S is the video signal processing unit 2 described later.
Supplied to zero. Reference numeral 11e denotes D which converts the composite video signal D _CV supplied from the video signal processing unit 20 into an analog video signal S _V and supplies the analog video signal S _V to the display 3 described above.
A / A conversion circuit.

(2) Structure of the device main body 2 Next, referring to FIG. 5 and FIGS.
The configuration will be described. The device main body 2 is for video signal processing.
Unit 20, image processing unit 30, position detection processing unit 40, and control unit
It is composed of the control unit 50.
Will be described in detail. Configuration of Video Signal Processing Unit 20 The video signal processing unit 20 includes a video signal processing unit 20 that is supplied from the imaging unit 1.
Pulling image data D Color difference conversion processing and chroma for S
Key detection processing is performed and the result is the position detection processing described later.
It is supplied to the processing unit 40. The processing unit 20 will be described later.
Image processing data D supplied from the image processing unit 30_SPTo
Composite video signal D_CVConverted to D / A
It is supplied to the replacement circuit 11e (see FIG. 6). This image
Processing data D_SPIs the background image BG and
Objects that are moved and displayed on the background image BG
Data to form a CG image that is a composite of the target image OBJ
It is

Here, the configuration of the video signal processing unit 20 which embodies the above processes will be described with reference to FIG. In FIG. 7, reference numeral 20a denotes a color separation filter, which supplies the sampling image data D _S to the signal Ye (yellow) and the signal Cy.
(Cyan) and signal G (green) are color-separated and output to the next stage. Reference numeral 20b is a contour correction circuit that adjusts the image quality by performing brightness modulation before and after the change point in the video signal. 20c is a white balance circuit for each signal Y
e, Cy, and G are set to specified levels and output. 20d
Is a separation filter composed of a bandpass filter, which converts each signal Ye and Cy into a signal R (red) and a signal B.
(Blue) is sorted and output. Reference numeral 20e designates signals R, G and B representing the three primary colors, a luminance signal Y and a color difference signal B each having a length of 8 bits.
This is a matrix circuit for converting into -Y and RY.

Reference numeral 20f denotes a chroma key signal generation circuit,
When the color difference signals BY and RY reach a predetermined level, the "H" level chroma key detection signal CRO is generated.
That is, in the circuit 20f, as shown in FIG. 8, the color difference B-Y maximum / minimum level B-Y _MAX, and B-Y _MIN,
The maximum / minimum levels RY _MAX and R-Y _{MIN of the} color difference R-Y are predetermined, and when the color difference signals B-Y and R-Y fall within the color difference area E defined by these levels, An "H" level chroma key detection signal CRO indicating that a specific color has been detected is output. In this embodiment, the area E is “blue”, and specifically, “H” is detected when the bat B colored blue by the player P or the socks S attached to the foot is detected. , To generate a chroma key detection signal CRO.

Next, returning to FIG. 7 again, the description of the configuration of the video signal processing section 20 will be continued. 20g is VDP3
Image processing data D _SP (R
This is a matrix circuit for converting a (GB signal) into a luminance signal Y and color difference signals BY and RY. Reference numeral 20h denotes a selector, which selects either the output of the matrix circuit 20e or the output of the matrix circuit 20h according to the selection signal SL supplied from the position detection processing unit 40 and supplies it to the next stage. 20i is a modulator. Modulator 2
0i is a digital composite video signal D _{CV in} which various synchronizing signals (horizontal / vertical synchronizing signal and blanking signal) are superimposed on the luminance signal Y and the color difference signals BY and RY supplied via the selector 20h. To generate.

According to the above configuration, the video signal processing section 20
Is the sampling image data D supplied from the imaging unit 1.
Chroma key detection of a specific color is performed on _S , and the result is used as a chroma key detection signal CRO for the position detection processing unit 40.
Supply to the side (described later). Further, the processing unit 20
Image processing data D input from the image processing unit 30 side
Either _SP (RGB signal) or sampling image data D _S supplied from the image pickup unit 1 is selected according to the selection signal SL, and the selected data is converted into a composite video signal D _CV and output. The selection signal SL is a signal supplied from the position detection processing unit 40 described later.

Configuration of Image Processing Unit 30 Next, the configuration of the image processing unit 30 will be described. The image processing unit 30 is a video display processor (hereinafter, V
It is composed of a DP (abbreviated as DP) 31 and a VRAM 32. The basic function of the VDP 31 is to read the background image data D _BG and the object image data D _OB stored in the VRAM 32 according to a control signal SC supplied from the control unit 50 (described later) side, and perform one scan. This is to generate image processing data D _SP that represents the dot display color for each line. Hereinafter, the configuration of each unit will be described in detail with reference to FIG.

In FIG. 9, reference numeral 31a denotes a CPU interface circuit, which is a constituent element 31b to 3 according to a control signal SC supplied via a bus of a CPU 51 (described later).
Various control instructions are given to 1d. The control signal SC is formed from various commands for displaying and controlling the background image BG and the object image OBJ, and the background image data D _BG and the object image data D _OB which are DMA-transferred to the VRAM 32. 31b is VRAM
A VRAM 3 which is a control circuit and corresponds to a control signal supplied from the components 31a, 31c and 31d.
Exchange data with 2.

That is, when the control signal SC for the DMA transfer is received from the CPU interface circuit 31a, the background image data D _BG or the object image data D _OB DMA-transferred through the circuit 31a is received. Store in a predetermined storage area. When an instruction to read the background image data D _BG is received from the background control circuit 31c, the corresponding data D _BG is read and returned to the circuit 31c side. Similarly, when an instruction to read the object image data D _OB is received from the object control circuit 31d, the corresponding data D _OB is read and returned to the circuit 31d side.

Background control circuit 31c
Specifies the display position for the background image data D _BG read via the VRAM control circuit 31b based on the background display control command given from the control unit 50 side via the circuit 31a, It is supplied to the color difference data processing circuit 31e.

The object control circuit 31d is
The object table data T _OB given from the control unit 50 side via the circuit 31a is stored in the object table RA.
Write to M31f. The object table data T _OB is the object image data D on the display screen.
_This is coordinate data that specifies the display position of the _OB . Further, the circuit 31d refers to the object table data T _OB for the object image data D _OB read from the VRAM 32 in response to the object display control command, obtains the display position, and the object for one scanning line is obtained. Image data D _OB line buffer RAM 31g
Temporarily store in. The object image data D _OB temporarily stored in the line buffer RAM 31g is updated every scan. The object image data D _OB read from the RAM 31g is supplied to the color difference data processing circuit 31e.

The color difference data processing circuit 31e has a background
Sound control circuit 31c and object controller
Image data of 8-bit length supplied from the troll circuit 31d
Data D_BG, D_OBA well-known color lookup table
Referring to the RAM 31h, R and G signals each having a length of 4 bits
And image processing data D formed from the B signal_SPConversion to
And output. In addition, the color difference data processing circuit 31e
Image processing data D_SPIn addition to (RGB signal), the signal YSBG and
And signal YSOBJ. This signal YSBG and
Signal YSOBJ is the image processing data currently being output.
D_SPIs background image data D_BGCorresponding to
Or object image data D_OBCorresponding to
This is a signal that indicates whether or not to do. For example,
Image processing data D_SPHas a background image
Data D_BGSignal YSBG when
Becomes “H” and the signal YSOBJ becomes “L”.
C) ”. On the other hand, conversely to this, the image processing data D_SP
Is the object image data D O_BThat corresponds to
Signal YSBG becomes “L” and signal YSOBJ becomes
It becomes "H".

As described above, in the image processing unit 30, the background image data D _BG and the object image data D _OB DMA-transferred from the control unit 50 side are stored in the VRAM 3.
2 in accordance with a control signal SC (various display control commands) supplied from the CPU 51.
Reads the image data D _BG or the image data D _OB from 2, while generating the image processing data D _SP representing the dot display color of one scan line per this signal YSBG and YSOBJ representing the attributes of the image processing data D _SP Is output.

Configuration of Position Detection Processing Unit 40 The position detection processing unit 40 shown in FIG. 5 comprises a gate array formed by arranging a plurality of logic elements, a line buffer and a work RAM, and a control unit 50 described later.
Under the instruction, the collision coordinate position between the chroma key image included in the sampled image data D _S and the object image OBJ formed by the object image data D _OB , the center of gravity position of these images, and the like are set in a predetermined logic. Based on the logical operation. The line buffer (not shown) temporarily stores the chroma key detection signal CRO supplied from the video signal processing unit 20. In the work RAM,
Various operation results obtained by logical operation by the gate array are temporarily stored.

This position detection processing unit 40 is the same as the above-mentioned VD.
Based on the signals YSBG and YSOBJ supplied from P31, the above-mentioned selection signal SL is generated and given to the video signal processing unit 20, and the sampling image data D _S (actual image) and the image processing data D _SP (CG image) are generated. The degree of overlap, that is, the priority order (front-back relationship) of the images displayed on the screen is controlled. Further, the processing unit 40 supplies a register control signal S _REG to the above-mentioned imaging signal processing unit 11, video signal processing unit 20 and VDP 31 under the instruction of the control unit 50, and controls the data set / reset of each unit register. To do.

Next, referring to FIG. 10, the position detection processing unit 4
The storage area of the work RAM 0 will be described. In this figure, E1 is an initial screen area for temporarily storing data of an initial screen formed of 96 dots in the horizontal direction (scanning line) and 96 lines in the vertical direction. The data of the initial screen refers to the chroma key detection result existing in the scene captured before the start of the game. If an object of a chroma key detection color (for example, blue) exists in the scene, it may be mistakenly recognized as a part of the bat B or socks S (see FIG. 1) described above. Therefore, the data temporarily stored in the initial screen area E1 is used when the dot position detected by the chroma key is not mistaken for the bat B or the sock S (see FIG. 1) when the dot position is set as the dead zone. .

E2 is 96 dots in the horizontal direction and 96 dots in the vertical direction.
This is a processing screen area formed by lines, and the bat B (or socks S) image that is chroma key detected in the actual image is updated and stored for each frame. E3 to E4
Is an upper end coordinate area and a lower end coordinate area for temporarily storing the upper end / lower end positions of the bat B (or sock S) image on the processing screen updated for each frame. E
Reference numerals 5 to E6 are a left end coordinate area and a right end coordinate area for temporarily storing the left end / right end positions of the bat B (or socks S) image on the processing screen updated for each frame. E7 is the first collision coordinate area. The first collision coordinate area E1 represents the intersection point in the scanning line where the overlap (collision) of the chroma key image and the object image is first detected as coordinates on the processing screen.
Further, the second collision coordinate area E8 expresses the intersection point in the scanning line where the overlap between the chroma key image and the object image is finally detected as the coordinate on the processing screen.

E9 is a barycentric coordinate area, in which the barycentric position calculated based on the area of the chroma key image detected by the chroma key in the actual image is stored as the coordinate position on the processing screen.
E10 is an area area in which the area of the chroma key image is stored. The area set in this area E10 is
It is represented by the number of blocks. The block here is
A 12-dot area consisting of 6 dots in the horizontal direction and 2 lines in the vertical direction on the processing screen. When chromakey detection of "6 dots" or more is detected in the block formed from the 12-dot region, the block is regarded as the area of the chromakey image.

Structure of Control Unit 50 Next, the structure of the control unit 50 will be described with reference to FIG. 5 again. The control unit 50 is composed of components 51 to 57. The CPU 51 performs a key scan on various operators provided on the operation panel of the apparatus body 2 and controls each part of the apparatus according to the operator signal KS generated in response to the key scan. It will be described later. This CPU5
1 has an internal timer, and manages the game progress based on the game counter value counted by the timer. The CPU 51 also includes a well-known DMA controller, and is configured to DMA-transfer various data (background image data D _BG and object image data D _OB ) necessary for game operation to the above-described image processing unit 30. There is. Further, the CPU 51 generates a control signal SC necessary for image control according to the game operation and gives an operation instruction to each processing unit. 52 is a RAM, and the CPU 5
As a work area 1, various calculation results and flag values are temporarily stored. 53 is an OS that manages the operation of the CPU 51
(Operating system) R in which the program is stored
OM. Reference numeral 54 is a system clock circuit which generates a system clock that regulates the operation of the entire device under the control of the CPU 51.

Reference numeral 55 denotes a game cartridge which is removably attached to the apparatus main body 2 and includes a ROM 55a and a first cartridge.
The sound source circuit 55b. An application program loaded into the CPU 51 is stored in the ROM 55a. In this embodiment, as described above, the game program for simulating the batting practice is stored. 55b is a first tone generator circuit, which is a CPU
The game sound effect synchronized with the game operation is synthesized according to the musical sound control data supplied from the 51 side through the position detection processing unit 40, and this is output to the CPU 51 as a musical sound signal. 56 is a second tone generator circuit, and is the first tone generator circuit 55.
Similar to b, music corresponding to the progress of the game, for example, music such as opening and ending is synthesized and outputted in accordance with the music control data supplied from the CPU 51 side. Reference numeral 57 denotes a sound system, which filters the musical tone signals supplied from the first tone generator circuit 55b and the second tone generator circuit 56, such as noise removal, and then amplifies and outputs them.

C. Operation of the Embodiment Next, as the operation of the embodiment having the above-described configuration, the operation of the position detection processing unit 40 will be described first, and then the operation of the control unit 50 (CPU 51) will be described. (1) Operation of the position detection processing unit 40 Here, with reference to FIGS.
The operation of 0 will be described. In the processing unit 40, the control unit 5
0 (CPU 51) specifies a detection frame corresponding to an operation mode (first detection frame SF1 to fifth detection frame SF5)
Chroma key detection of the bat B image or socks S image is performed based on the above, and the collision coordinate position between the detected chroma key image (bat B image or socks S image) and the object image OBJ and the center of gravity position of these images are calculated. There is. In particular, the processing unit 40 that performs such processing designates one of the first detection frame SF1 to the fifth detection frame SF5 in time division according to the above-described first mode to third mode, and performs the bat in the designated detection frame. Since the B or socks S are detected by the chroma key detection, the chroma key detection processing can be performed without malfunction even when there are a plurality of chroma key images in the captured image. The details will be described below for each mode.

Operation of Main Routine a. Operation in First Mode First, it is assumed that the apparatus main body 2 is powered on and the control signal SC indicating the system reset is supplied from the CPU 51 side to the position detection processing unit 40. Then, the position detection processing section 40 executes the main routine shown in FIG. 11 based on the control signal SC, and advances the processing to step SA1. In step SA1, the internal register of itself is reset, or initialization is performed to set an initial value. Specifically, the control signal S supplied from the CPU 51
Based on C, the value "1" representing the first mode is set in the register MODE, and the first detection frame S is set in the register n.
The value "1" representing F1 is set. As a result, the operation of the processing unit 40 is set to the first mode. Further, in step SA1, a register control signal S _REG for instructing a register set is supplied to the image pickup signal processing unit 11, the video signal processing unit 20 and the VDP 31, respectively.
Go to next step SA2.

Next, in step SA2, the processing unit 4
0 determines whether or not to create an “initial screen map”.
Here, for example, when the “initial screen map” is not created, the determination result is “YES”, and the next step S
The process proceeds to A3. This “initial screen map” is used to confirm whether or not there is an object of the same color other than the bat B or the socks S (see FIG. 1) which is the detection target in the captured image before the game starts. The details will be described later. Then, when it proceeds to step SA3, the chroma key detection results extracted from the captured images of a plurality of frames are overlaid and stored in the initial screen area E1 (see FIG. 10) of the work RAM,
An “initial screen map” is created to consider a chroma key detection block (described later) existing in the initial screen as a “dead zone”.

When the "initial screen map" is created, the position detection processing section 40 advances the processing to the next step SA4. If the "initial screen map" is prepared in advance, the result of the determination in step SA2 is "NO", and in this case, the process proceeds to step SA4. Step SA4
Then, it is determined whether or not the collision flag CF that identifies whether or not the chroma key image and the object image OBJ overlap each other is “1”. The collision flag CF is a flag indicating whether or not there is a collision between the chroma key image of the bat B and the object image OBJ on the display screen, and is “1” when the collision state is present, and is “0” otherwise. .

Here, since the first detection frame SF1 has not been determined yet, the determination result is "NO", and the process proceeds to step SA5. In step SA5, the coordinate values (x ₁ , y ₁ ) of the first detection frame SF1 (see FIG. 2) stored in the register M (1) corresponding to the value of the register n,
Read (x ₂ , y ₂ ). This coordinate value (x ₁ ,
As shown in FIG. 2, y ₁ ), (x ₂ , y ₂ ) correspond to diagonal elements that specify the frame size and frame position of the first detection frame SF1, and are determined by the CPU main routine described later. The data is transferred from the CPU 51 to the position detection processing unit 40 side.

In this way, when the first detection frame SF1 in the first mode is set, the processing section 40 advances the processing to step SA6, and resets the values of the registers X and Y to zero.
The registers X and Y have horizontal 96 dots,
A value corresponding to the screen coordinates formed by 96 lines in the vertical direction is sequentially set according to the processing content. Then, FIG.
When it proceeds to step SA7 shown in FIG.
Performs chroma key detection for each block on the chroma key detection signal CRO temporarily stored in the line buffer. Chromakey detection in block units means that the chromakey detection signal CRO read from the line buffer is divided into blocks each consisting of 6 dots in the horizontal direction and 2 lines in the vertical direction, and the chromakey detection signal CRO at the “H” level is “6 dots” per block. When the block exists, the attribute of the block is regarded as “with chroma key”. The result of such chroma key detection is the processing screen area E described above.
2 (see FIG. 10) is stored as a block attribute, and this becomes a “processing screen map”.

Here, for example, it is assumed that the player P positions the bat B on the object image OBJ forming the start screen, as shown in FIG. Then,
The bat B image is chroma-key detected in the first detection frame SF1 assigned in the captured image corresponding to the object image OBJ. Then, when the chroma key detection for each block unit described above is completed, the position detection processing unit 40
Advances the processing to step SA8 to detect the collision (overlap) between the chroma key detected bat B image and the object image OBJ (start screen) to obtain the collision coordinates, while setting the collision flag CF to "1". . Subsequently, in step SA9, the processing unit 40 increments the value of the register X by 1 and advances the block number. Next, in step SA10, it is determined whether or not the value of the register X that has been stepped is "96", that is, whether the processing for one scanning line has been completed. Here, when the value of the register X has not reached “96”, the determination result is “NO”.
Then, the operations of steps SA7 to SA9 are repeated until the processing for one scanning line is completed.

Now, it is assumed that the processing for one scanning line is completed. Then, the determination result of step SA10 is “YES”, and the process proceeds to step SA11.
In step SA11, the value of the register X is reset to zero again and the value of the register Y is incremented by 1 to update the scan line in the vertical direction. Then, when the processing proceeds to step SA12, the processing unit 40 sets the value of the register Y to "9".
6 ”is determined. Here, when the value of the register Y has not reached "96", it is determined that the scanning for one frame is not completed, and the determination result is "NO".
The above steps SA7 to SA11 are repeated. When the scanning for one frame is completed, the determination result is "Y
ES ”, and the processing unit 40 advances the processing to step SA13.

In step SA13, the above step SA
7, the left edge / right edge coordinates and the upper edge / lower edge coordinates of the chroma key image are calculated based on the blocks detected by the chroma key, and these are stored in the storage areas E3 to E6 of the work RAM.
(See FIG. 8), the area of the chroma key image is calculated from the number of blocks detected by the chroma key. The storage areas E3 to E4 temporarily store the upper and lower end positions of the chroma key image within the detection frame that is updated for each frame, and the storage areas E5 to E6 are detected for each frame. The left and right edge positions of the chroma key image within the frame are temporarily stored. The area calculated from the number of blocks is stored in the storage area E10.

When the chroma key image in the first detection frame SF1 is detected as described above, the processing section 40 advances the processing to step SA14 to obtain the barycentric position of the chroma key image. Then, in step SA15, the register M
It is determined whether the value of ODE is "1", that is, whether the mode is the first mode. In this case, since it is the first mode, the determination result is “YES”, and the process proceeds to step SA16. In step SA16, the collision flag CF is "1".
Or not. Here, the above-mentioned step S
If a collision is detected in A8, the judgment result is "YE
S ”, and the process proceeds to the next step SA17.

At step SA17, an interrupt signal is output to the CPU 51, and then the value of the register n, that is, the designated detection frame value under the current operation mode is transferred to the CPU 51 side via step SA18. And
After that, the processing unit 40 returns the process to step SA4 described above. In step SA16, when the collision flag CF is “0”, that is, when the bat B is not pointed in the first detection frame SF1, the determination result is “NO”, and the above-described steps through step SA18 are performed. SA4 to SA16 will be repeated.

B. Operation in the second mode The bat B is pointed in the first detection frame SF1,
At step SA4, at this time, the collision flag CF is
Since it is "1", the judgment result is "YES", and the step
Proceed to step SA19. In step SA19, the mode change
Transferred from the CPU 51 to the processing unit 40 side in response to the transfer
2 Coordinates of detection frame SF2 (x₃, Y₃), (X 4, y_Four)When,
Coordinates of the third detection frame SF3 (x_Five, Y_Five), (X₆, Y₆)When
Are stored in the register M (1) and the register M (2). Continued
In step SA20, the data is transferred from the CPU 51.
Mode value, in this case "2" indicating the second mode.
Store in Dista MODE.

Next, in step SA21, the processing section 40 resets the collision flag CF to zero, and in the following step SA22, sets the value of the register n to "1". After that, the processing unit 40 performs the above-described steps SA5 to SA5.
Chroma key detection is performed in the second detection frame SF2 (see FIG. 3) via SA14, and the process proceeds to step SA15. Then, in step SA15, the register MO
Whether or not the value of DE is "1" is determined. In this case, since "2" is set in the register MODE, the determination result is "NO", and step SA23 is performed.
Proceed to. In step SA23, the designated detection frame value stored in the register n is incremented by 1, and the designated detection frame is set to the third detection frame SF3. Next, in step SA24, it is determined whether or not the value of the register n is "3". In this case, the designated detection frame value is "2", so the determination result is "NO", The process proceeds to step SA16 and subsequent steps described above.

As a result, the chroma key detection in the third detection frame SF3 under the second mode is started. Then, within this third detection frame SF3, an object image OBJ that forms a chroma key image and a ball image of the bat B
When the collision with the above is detected in step SA8 described above, the determination result of step SA24 becomes "NO", and the process proceeds to step SA25 to preset the designated detection frame value stored in the register n to "1". Then, after this, the determination result of step SA16 becomes "YES", and CP
Send an interrupt signal to U51 (step SA17),
Then, the value of the register n is transmitted (step SA1
8).

C. Operation in Third Mode When the chroma key image of the bat B and the object image OBJ (ball image) collide with each other in the third detection frame SF3 and the process proceeds to step SA4, the collision flag CF is “1” at this time, The determination result is “YES”, and step SA
Proceed to 19. In step SA19, the coordinates (x ₇ , y ₇ ), (x ₈ , y ₈ ) of the fourth detection frame SF4 and the coordinates of the fifth detection frame SF5 transferred from the CPU 51 to the processing unit 40 side according to the mode transition. (X ₉ , y ₉ ) and (x ₁₀ , y ₁₀ ) are stored in the register M (1) and the register M (2). continue,
In step SA20, the mode value transferred from CPU 51, in this case, "3" representing the third mode is stored in register MODE.

Next, in step SA21, the processing unit 40 resets the collision flag CF to zero, and in the following step SA22, the designated detection frame value stored in the register n is reset to "1". After that, the processing unit 40 performs the fourth detection frame S through steps SA5 to SA14 described above.
Chroma key detection in F4 (see FIG. 4) is performed. In the fourth detection frame SF4, the center of gravity of the coordinate position of the chroma key image is detected, and the process proceeds to step SA15. Then, in step SA15, it is determined whether or not the value of the register MODE is "1". In this case, since "3" is set in the register MODE, the determination result is "NO". , Proceeds to step SA23. In step SA23, the value of the register n is incremented by 1, and the designated detection frame is set to the fifth detection frame SF5. Then, thereafter, similarly, the chroma key detection in the fifth detection frame SF5 is performed.

Operation of Initial Screen Map Creating Routine Next, the operation of the initial screen map creating routine will be described with reference to FIG. As described above, when the initial screen map is not created at the beginning of the game, the position detection processing unit 40 proceeds to step SA3 (see FIG. 11) and executes the initial screen map creation routine shown in FIG. Then, the process proceeds to step SB1. In step SB1, the sampling number n set in the internal register is read. The number of times of sampling n represents how many frames the chroma key detection signal CRO supplied from the imaging unit 1 is captured. Next, when proceeding to step SB2, the values of the registers X and Y are reset to zero, and then proceeding to the next step SB3. In step SB3, of the chroma key detection signal CRO written in the line buffer, 6 dots in the X direction (horizontal direction) and 2 in the Y direction (vertical direction).
The line, that is, one block is read.

Next, proceeding to step SB4, it is judged whether or not there is a "H" level chroma key detection signal CRO of "6 dots" or more in this read one block. If "6 dots" or more does not exist, the determination result is "no chroma key" and the determination result is "NO", and the process proceeds to step SB5. In step SB5, the block attribute is set to "0" and the process proceeds to the next step SB7.
On the other hand, when "6 dots" or more are present, it is determined that "chroma key is present", the determination result is "YES", and the process proceeds to step SB6. In step SB6, the block attribute is set to "1", and the next step SB7
Proceed to. In step SB7, it is determined whether or not it is the first frame. Here, if it is the first frame sampled, the determination result is “YES”,
It proceeds to step SB8.

In step SB8, the position detection processing unit 40 stores the determined block attribute in the initial screen area E1 according to the values of the current registers X and Y. Then, after that, the process proceeds to Step SB9, the value of the register X is incremented by 1, and the number of the designated block is incremented. Next, in step SB10, it is determined whether or not the number of the stepped designated block is "96", that is, one scanning (horizontal) line is completed. Here, if not completed, the determination result is “NO”, and step SB
Proceed to 11. In step SB11, it is determined whether the value of the register Y is "96", that is, whether one frame has been completed. Here, if the processing for one frame is not completed, the determination result is “NO”, and the process returns to step SB3 described above. As a result, steps SB3 to SB6 are repeated and the next block attribute is determined.

Then, for example, it is assumed that the determination of the block attribute for one scanning (horizontal) line is completed. Then, the determination result of step SB10 becomes "YES", and the processing unit 40 advances the process to step SB13. In step SB13, the register X is reset to zero, and the value of the register Y is incremented by 1 to update the scan line. Then, after this, again, step SB11
Block determination from step SB3 onward is performed via. Next, when the determination of the block attribute for one frame is completed, the above-mentioned determination result of step SB11 becomes "YES", and the process proceeds to step SB12. In step SB12, it is determined whether the sampling number n has reached the set number.

If the set number of times has not been reached, the determination result is "NO" and the process proceeds to step SB14. In step SB14, the number of times of sampling n is incremented, and the above-mentioned step SB2 and subsequent steps are executed again. In this way, the first initial screen map is created,
In the process of creating the initial screen map for the second time, step S
When proceeding to B7, the determination result here becomes "NO", and the routine proceeds to step SB15. In step SB15, the corresponding block attribute stored previously is read from the initial screen area E1 according to the values of the registers X and Y. Next, in step SB16, a logical sum (OR process) of the previous block attribute and the currently determined block attribute is obtained. Then, in step SB8, this logical sum is stored as a new block attribute in the initial screen area E1 based on the values of the registers X and Y. When a logical sum of a plurality of frames corresponding to the number of times of sampling n is generated, the above-mentioned determination result of step SB12 becomes “YES”, this routine ends, and the processing of the position detection processing unit 40 performs the above-mentioned main processing. Return to routine.

Operation of Processed Screen Map Creation Routine When the initial screen map is created as described above, the position detection processing section 40 executes the processed screen map creation routine shown in FIG. 14 through step SA6 and executes step SC1.
Proceed to. In step SC1, one block consisting of 6 dots in the X direction (horizontal direction) and 2 lines in the Y direction (vertical direction) is read from the chroma key detection signal CRO written in the line buffer. Then, step SC2
If you proceed to, read "6 dots" in one block.
It is determined whether or not the above "H" level chroma key detection signal CRO is present. If "6 dots" or more does not exist, it is determined that "no chroma key is present" and the determination result is "N.
"O" and the process proceeds to step SC3. At step SC3, the block attribute is set to "0" and the next step SC
Processing proceeds to 4. In step SC4, the determined block attribute is stored in the processing screen area E2 (see FIG. 10) based on the values of the registers X and Y.

On the other hand, when the result of the determination in step SC2 is "YES", that is, when there is a "H" level chroma key detection signal CRO of "6 dots" or more in one block, the processing section 40 Step SC5
Proceed to. In step SC5, it is determined whether or not the reject switch SR has been turned on. The reject switch SR is a switch arranged on the operation panel of the apparatus main body 2, and is for setting whether or not to provide a "dead zone" according to the switch operation. Here, when the switch SR is turned on, the chroma key detection block stored in the initial screen map is regarded as a “dead zone”.

That is, in step SC5,
When the reject switch SR is set to ON, the determination result is "YES", and the next step SC6
Proceed to. At step SC6, the block attribute corresponding to the values of the registers X and Y is read from the initial screen area E1. Next, in step SC7, it is determined whether the block attribute read from the initial screen area E1 is "1". Here, when the block attribute is “1”, the determination result is “YES”, the process proceeds to step SC3 described above, and the block attribute is changed to “0”,
Then, the changed block attribute is written in the processing screen area E2 in accordance with the values of the registers X and Y via step SC4. As a result, the chroma key detection block stored in the initial screen map is set to the "dead zone".

When the reject switch SR is not set to ON, that is, when the "dead zone" is not set, the determination result of step SC5 is "NO", and the routine proceeds to step SC8. In step SC8, the attribute of the corresponding block is set to "1" based on the result determined in step SC2 described above, and then the block attribute is set in accordance with the values of the registers X and Y through step SC4. Write in the processing screen area E2.

Operation of Collision Coordinate Detection Routine Next, the operation of the collision coordinate detection routine will be described with reference to FIG. When the processing screen map is created as described above, the position detection processing unit 40 performs step SA7 (see FIG. 1).
2), the collision coordinate detection routine is executed. In this routine, the bat B image and the object image OB in the CG image that are chroma key detected from the captured image
The presence or absence of a collision with J is detected, and when the collision is detected, the collision coordinates on the display screen are obtained, while the aforementioned collision flag CF is set to "1". The contents of such a collision coordinate detection routine will be described below.

First, when the routine is executed, the processing section 40 advances the processing to step SD1, reads out the detection frame coordinates designating the position of the detection frame from the register M (n), and stores this in the register x ₁ , Set to y ₁ and registers x ₂ and y ₂ . The detection frame coordinates stored in the register M (n) are designated by the designated detection frame value stored in the register n. That is, in the first mode, the coordinate values (x ₁ , y ₁ ) and (x ₂ , y ₂ ) of the first detection frame SF1 (see FIG. 2) stored in the register M (1) are designated. In addition, in the second mode, the coordinate value (x ₃ , of the second detection frame SF2 (see FIG. 3) stored in the register M (1) is stored.
_{y 3), (x 4,} y 4), or the coordinate value of the third detection frame SF3 (see Fig. 3) stored in the register _{M (2) (x 5,} y 5), (x 6, y 6) Is specified. Furthermore, in the third mode, the coordinate values (x ₇ , y ₇ ) of the fourth detection frame SF4 (see FIG. 4) stored in the register M (1),
(X ₈ , y ₈ ) or the coordinate values (x ₉ , y ₉ ) of the fifth detection frame SF5 (see FIG. 4) stored in the register M (2),
(X ₁₀ , y ₁₀ ) is designated.

Next, in step SD2, the processing section 40 reads the block attributes corresponding to the values of the registers X and Y from the processing screen area E2 (see FIG. 10), and in the subsequent steps SD3 and SD4, the registers X and Y are registered. It is determined whether or not the block attribute read according to the value of is within the designated detection frame set in the registers x ₁ and y ₁ and the registers x ₂ and y ₂ , respectively. Here, if the values of the registers X and Y are not within the designated detection frame, the determination result of steps SD3 and SD4 is "NO". In this case, it is not necessary to detect the presence or absence of a collision between the chroma key image and the object image OBJ, so this routine is once ended.

On the other hand, when the values of the registers X and Y are within the designated detection frame, the determinations at steps SD3 and SD4 are both "YES", and the process proceeds to step SD5.
Then, in step SD5, it is determined whether or not the block attribute read according to the values of the registers X and Y is "1", that is, the chroma key image. Here, if the block attribute is not “1”, the determination result is “N
"O", and this routine is once terminated because it is considered that a collision cannot occur.

On the other hand, when the read block attribute is "1", the determination result is "YES" and the process proceeds to the next step SD6. At step SD6, the CG data written in the line buffer is read according to the values of the registers X and Y. The CG data mentioned here refers to a signal YSOBJ representing the presence or absence of the object image data D _OB . The signal YSOBJ is VDP3.
1 (see FIG. 3) is supplied to the processing unit 40. Then, when it proceeds to the next step SD7, the processing unit 40
Determines whether the read CG data (signal YSOBJ) is "1". At this time, if the CG data is not "1", the blocks corresponding to the values of the registers X and Y do not overlap with the object image OBJ. Therefore, it is determined that there is no collision and the determination result is "NO". finish.

On the other hand, if the read CG data is "1", the determination result of step SD7 is "YES",
It proceeds to step SD8. In step SD8, it is determined whether or not the collision flag CF is "0". Here, when the flag CF is "0", that is, when the collision of both images is detected for the first time, the determination result is "YES", and the process proceeds to the next step SD9. Step S
At D9, the first detected first X coordinate is stored in the collision coordinate area E7, and subsequently at step SD10, the corresponding first Y coordinate is stored in the same area E7. Next, when proceeding to step SD11, the collision flag C
Set F to "1". On the other hand, the above step S
If the determination result of D8 is "NO", that is, if the collision of both images is already recognized, step SD12 is performed.
Then, the last detected second X coordinate is stored in the collision coordinate area E8, and subsequently, in step SD13, the corresponding second Y coordinate is stored in the same area E7.

Operation of Coordinate Detection Routine Next, the operation of the coordinate detection routine will be described with reference to FIG. By the collision coordinate detection routine described above,
When the collision coordinate position between the chroma key image and the object image OBJ is detected, the position detection processing unit 40 proceeds to step SA.
The coordinate detection routine shown in FIG. 16 is executed via 13 (see FIG. 12), and the process proceeds to step SE1. In step SE1, the registers X and Y, the registers X ′ and Y ′, and the register S are reset to zero and initialized. The register S stores an area obtained by accumulating the number of blocks forming a chroma key image based on the operation described later.

Next, in step SE2, the processing unit 4
0 reads out the corresponding block attribute from the processing screen area E2 (see FIG. 10) according to the values of the registers X and Y,
The process proceeds to step SE3. Step SE3, SE
In 4, the current register X, Y values, registers x _1,
It is determined whether or not it is within the designated detection frame set in y ₁ and registers x ₂ and y ₂ . If the current values of the registers X and Y are not within the designated detection frame, step SE
The determination results of 3 and SE4 are "NO", and the process proceeds to step SE6, which will be described later. On the other hand, when the values of the registers X and Y are within the detection frame, the determinations at steps SE3 and SE4 are both "YES", and the process proceeds to step SE5.

In step SE5, the above step SE2 is executed.
It is determined whether or not the block attribute read in is "1", that is, a chroma key image. Here, if the block attribute is not “1”, the determination result is “N
"O" and the process proceeds to step SE6. At step SE6, the value of the register X is incremented by 1 to advance. Then, in step SE7, it is determined whether the value of the stepped register X is "96", that is, whether the block attribute for one horizontal (scanning) line has been read. Here, when the reading for one horizontal line is not completed, the determination result is “NO”, and the above step SE is performed again.
Return the process to 2.

Then, for example, if the read block attribute is "1", the determination result of step SE5 is "YES", and the process proceeds to step SE8. In step SE8, it is determined whether the value of register X is larger than the value of register X '. The previously detected X coordinate is set in the register X ′, and the right end / left end coordinates are updated according to the result of comparison between the previous coordinate value and the present coordinate value. That is, if the determination result here is "NO", the flow proceeds to step SE9, the value of the register X is stored in the left end coordinate area E5 (see FIG. 10), and the left end coordinate of the chroma key image is updated. On the other hand, if the decision result in the step SE8 is "YES", then the processing advances to a step SE10, where the value of the register X is stored in the right end coordinate area E6 (see FIG. 10) and the right end coordinate of the chroma key image is updated.

Next, in step SE11, the processing section 40 determines whether or not the value of the register Y is larger than the value of the register Y '. Here, similarly to the register X ', the Y coordinate detected last time is set in the register Y', and the upper end / lower end coordinates are updated according to the comparison result of the previous coordinate value and the current coordinate value. I am trying. That is, when the determination result is “NO”, step SE12
To the upper end coordinate area E3 (see FIG. 10).
(Refer to) and update the top coordinates of the chromakey image. On the other hand, if the decision result in the step SE11 is "YES", the flow advances to a step SE13 to store the value of the register Y in the lower end coordinate area E4 (see FIG. 10) to update the lower end coordinate of the chroma key image.

After that, when proceeding to step SE14, the processing section 40 increments the value of the register S by 1, and adds the area by one block. Then, step S
When proceeding to E15, the current coordinate values stored in the registers X and Y are reset in the registers X'and Y ', respectively, and set as the previous coordinate values. In this way, step SE2 above
When the processing of SE15 is performed for one horizontal line, the above-mentioned determination result of step SE7 becomes "YES", and the process proceeds to step SE16, where the value of the register X is reset to zero and the value of the register Y is advanced by one step. Next, proceeding to step SE17, it is determined whether or not the value of the register Y is "96", that is, whether or not the coordinates of one frame have been detected. Then, when the coordinate detection for one frame is not completed, the above-mentioned step SE2 and subsequent steps are repeated. On the other hand, when it is completed, the process is returned from this routine to the above-mentioned main routine (see FIG. 11).

Operation of Center of Gravity Calculation Routine By the above coordinate detection routine, the left end of the chroma key image /
When the right end coordinates and the upper end / lower end coordinates are detected, the position detection processing unit 40 executes the center of gravity calculation routine shown in FIG. 17 through step SA14 (see FIG. 12) described above,
The process proceeds to step SP1. First, step SP1
Then, the registers XG and YG are reset to zero. The registers XG and YG respectively store the barycentric coordinates of the chroma key image calculated based on the blocks detected by the chroma key. Next, in step SP2, the registers X and Y are initialized, and subsequently, in step SP3, the block attributes corresponding to the values of the registers X and Y are read from the processing screen area E2.

Next, at steps SP4 and SP5, it is determined whether or not the current values of the registers X and Y are within the designated detection frames set in the registers x ₁ and y ₁ and the registers x ₂ and y ₂ , respectively. To judge. Where the current register X,
If the value of Y is not within the specified detection frame, steps SP4 and S
The determination result of P5 is "NO", and step S described later
Go to P7. On the other hand, when the values of the registers X and Y are within the designated detection frame, the determinations at steps SP4 and SP5 are both "YES", and the process proceeds to step SP6.
When the processing proceeds to step SP6, the processing unit 40 determines whether or not the read block attribute is "1", that is, a chroma key image. Here, if the block attribute is not "1", the determination result is "NO", and step S
Proceed to P7. At step SP7, the value of register X is set to 1
Increment and advance. And step SP
When it proceeds to 8, it is determined whether the value of the register X is "96", that is, whether the block attribute for one horizontal (scanning) line has been read. Here, when the reading for one horizontal line is not completed, the determination result is “NO”, and the process is returned to the step SP3 again.

Then, for example, assume that the next read block attribute is "1". Then, step SP
The determination result of 6 is “YES”, and the processing unit 40 advances the processing to step SP9. In step SP9, the block in which the chroma key is detected is regarded as a mass point, and the center of gravity is calculated by sequentially accumulating the ratio of the coordinates (X, Y) of this block and the area S. The area S is stored in the register S in the coordinate detection routine described above. Next, in step SP10, the barycentric coordinates are updated in accordance with the barycenter calculation result in step SP9, and subsequently, in step SP7, the value of the register X is incremented.

Here, if the reading of one horizontal line is completed, the determination result of step SP8 is "YES".
Then, in step SP11, the value of the register X is reset to zero and the value of the register Y is incremented by one. Next, in step SP12, it is determined whether or not the value of the register Y is "96", that is, whether the center of gravity for one frame has been calculated. Then, when the calculation of the center of gravity for one frame is not completed, the determination result is “NO”, and the processing from step SP3 described above is repeated. On the other hand, when the calculation of the center of gravity for one frame is completed, the determination result is “YES”, the routine is ended, and the process returns to the main routine (see FIG. 11).

As described above, in the position detection processing section 40, the first detection frame SF1 to the fifth detection frame are selected depending on the first mode to the third mode.
Since any one of the detection frames SF5 is designated as time division, and the bat B or the socks S are detected by the chroma key in the designated detection frame, even if there are a plurality of chroma key images in the captured image, the chroma key can be operated without malfunction. It becomes possible to perform detection processing.

(2) Operation of Control Unit 50 (CPU 51) Next, the operation of the CPU 51 for instructing image control based on various data supplied from the position detection processing unit 40 will be described with reference to FIGS. 18 to 27. To do. Below, the CPU
After explaining the CPU main routine as a schematic operation of 51, various interrupt processing routines executed in the CPU 51 will be described.

Operation of CPU Main Routine First, when the apparatus main body 2 is powered on, the CPU 51 reads out and loads the operation system program stored in the ROM 53, and then the game cartridge 5
5, the application program is read from the ROM 55a built in 5, and loaded in the RAM 52. As a result, the CPU main routine shown in FIG. 18 is started, and C
The process of the PU 51 proceeds to step SG1. Step SG
In 1, the various registers secured in the RAM 52 are initialized, and the control signal SC designating initialization is supplied to the VDP 31 and the position detection processing unit 40. Next, when proceeding to step SG2, while supplying the control signal SC which gives the interrupt permission to each part, the interrupt mask of itself is released. Then, in step SG3, in order to set the operation mode after the power is turned on to the above-mentioned first mode, "1" is set in the register MODE, and the next step SG4
Proceed to. After that, the register MODE
The processing in the first mode to the third mode is performed according to the value stored in. The processing operation for each mode will be described below.

A. Operation in the first mode Immediately after the power source of the device is turned on, the mode is the first mode, and the register MODE is set to "1" by the process of step SG3. Therefore, the determination result of step SG4 is "YES", The CPU 51 advances the process to step SG5. In step SG5, it is determined whether or not the change flag stored in the register CHF is "1". This change flag is a flag that becomes "1" at the time of initialization or when the mode transition occurs in response to a collision between the chroma key image and the object image OBJ, and otherwise becomes "0". Details thereof will be described later. The collision interrupt processing routine will be described.

Here, since the change flag is set to "1" at the time of initialization, the determination result in step SG5 is "YES", and the process proceeds to the next step SG6. When the process is once again advanced to the step SG5 in the state where the mode is changed to the first mode, the change flag becomes "0", so that the determination result becomes "NO" and the process proceeds to step SG13 described later. Next, step SG6
Then, the coordinate values (x ₁ ,
y ₁ ), (x ₂ , y ₂ ) are designated and transferred to the register M (1) of the position detection processing unit 40. Then, in step SG7, the process waits until the transfer of the first detection frame SF1 is completed, and when the transfer completion is confirmed, the determination result is “YES”.
Then, the process proceeds to the next step SG8. In step SG8, the position detection processing unit 40 is supplied with the control signal SC that specifies the display priority of the captured image and the CG image. As a result, the position detection processing unit 40 supplies the selection signal SL for superimposing the CG image and the captured image to the video signal processing unit 20 (see FIG. 5).

Next, when proceeding to step SG9, the object image data D _OB forming the start screen is set to VDP.
In order to perform the DMA transfer to 31, the transfer destination address and the transfer source address are set in the DMA controller. In addition,
The DMA transfer is performed by interrupt processing synchronized with the vertical blanking period on the display 3 (see FIG. 1) side. Under the instruction of the CPU 51, the DMA controller in which the transfer command is set reads the object image data D _OB corresponding to the transfer source address from the ROM 55a (see FIG. 5) and outputs V
DMA transfer to DP31 (VRAM32). Such transfer interrupt processing will be described later.

Next, when proceeding to step SG10, the transfer flag F2 stored in the register AKF2 is set to "1". The transfer flag F2 means the above-mentioned step SG9.
Image data D _OB transferred and set in
Indicates whether or not the DMA transfer is performed, and indicates that the DMA transfer is completed when the flag F2 is “0”.
When it is "1", it means that it is in the untransferred state. And
In step SG11, until the transfer flag F2 stored in the register AKF2 becomes "0", that is, the object image data D _OB is D by the DMA controller.
Wait for MA transfer. Here, the data D _OB
Is DMA-transferred, the transfer flag F2 becomes "0", the judgment result becomes "YES", and the CPU 51 advances the process to step SG12.

When the object image data D _OB forming the start screen is DMA-transferred to the VDP 31, the video signal processing section 20 selects the processed image data D _SP and the sampling image data D _S supplied from the VDP 31 as a selection signal. Switch according to SL and composite image data D
Generate a _CV . As a result, in the first mode, as shown in FIG. 22, a display screen in which the start screen is superimposed is formed on the captured image. Then, when proceeding to step SG12, the CPU 51 resets the change flag stored in the register CHK to zero, and the CPU 51 of FIG.
The process proceeds to step SG13 shown in.

B. Operation in the second mode When the process proceeds to step SG13 (see FIG. 19), the register M
It is determined whether the value of ODE is "2", that is, the second mode. Here, for example, as shown in FIG. 22, when the player P positions the bat B within the first detection frame SF1 corresponding to the start screen, the second mode is performed based on the operation of the collision interrupt processing routine described later. Transition to. Second
When transitioning to the mode, the determination result of step SG13 becomes “YES”, and the process proceeds to step SG14. In step SG14, it is determined whether or not the check flag is "1", that is, whether or not the state has transited from the first mode to the second mode. In this case, since the state has transited from the first mode to the second mode, the determination result is “YES”, and the process proceeds to the next step SG15. Incidentally, when the processing is once again advanced to step SG14 in the state of being in the second mode, the check flag becomes "0", the determination result becomes "NO", and the processing proceeds to step SG22 described later. move on.

When the process proceeds to step SG15, the CPU 51
Are the coordinates (x ₃ , y ₃ ) of the second detection frame SF2 described above,
(X ₄ , y ₄ ) and the coordinates (x ₅ ,
y ₅ ), (x ₆ , y ₆ ) are designated respectively, and these are designated as register M (1) and register M on the position detection processing unit 40 side.
The data is transferred to be stored in (2), and in the subsequent step SG16, the process waits until the transfer is completed. Then, when the transfer is completed, the determination result of step SG16 is "YES".
Then, the process proceeds to the next step SG17. Step SG1
In step 7, the CPU 51 gives priority to the position detection processing unit 40 so as to prioritize the display of CG images. As a result, in the second mode, the display screen including the background image BG and the object image OBJ is displayed on the display.

Next, in step SG18, the background image data D _BG is DMA-transferred to the VDP 31, so that the transfer destination address and the transfer source address are set in the DMA controller. When the DMA transfer is set, the CPU 51 advances the processing to step SG19 and sets the transfer flag F1 stored in the register AKF1 to "1". Then, in step SG20, until the transfer flag F1 stored in the register AKF1 becomes “0”, that is, the background image data D _BG is DM.
A Wait for transfer. When the DMA transfer of the data D _OB is completed, the transfer flag F1 becomes “0”.
The determination result here is "YES", and the CPU 51 advances the process to step SG21.

At step SG21, the value of the register T is reset to zero in order to start the game operation. The register T is configured to store a time count value that is measured according to the progress of the game, and this time count value is incremented at regular intervals by a timer interrupt process described later. And
When proceeding to the next step SG22, the CPU 51 advances the VD in advance.
From among the plurality of object image data D _OB that DMA transfer to the P31 side, to specify the image data D _OB to be displayed corresponding to the time count value stored in the register T, a control signal SC that represents the fact VDP31 Supply to.

Subsequently, in step SG23, the object table data T _OB corresponding to the time count value stored in the register T is designated, and the display position of the object image data D _OB designated in step SG22 is defined. As a result, the display position of the object image data D _OB forming the game screen is determined. in this case,
The object image data D _OB is formed with a “ball image” flying toward the player P, that is, a “ball image” that increases momentarily according to the time count value.

When the game screen is formed as described above, the CPU 51 proceeds to step SG24 and registers A
The transfer flag F2 stored in KF2 is set to "1", and the process proceeds to step SG18. The transfer flag F2 indicates whether or not the object table data T _OB specified in step SG23 described above is DMA-transferred to the VDP 31 side, and the flag F2 is “0”.
Indicates that the DMA transfer is completed, and indicates that it is in a non-transfer state when "1". Next, in step SG25, the process waits until the transfer flag F2 stored in the register AKF2 becomes "0", that is, until the object table data T _OB is DMA-transferred. And
When the data T _OB is DMA transferred, the transfer flag F
2 becomes "0", and the CPU 51 advances the processing to step SG26, and resets the change flag stored in the register CHF to zero.

C. Operation in Third Mode Next, proceeding to step SG27, it is determined whether or not the value of the register MODE is “3”, that is, the third mode. Here, for example, when the chroma key image of the bat B and the object image OBJ forming the “ball image” collide with each other in the third detection frame SF3, the mode is changed to the third mode based on the operation of a collision interruption processing routine described later. .
When transitioning to the third mode, the determination result of step SG27 becomes "YES", and the process proceeds to step SG28. When proceeding to Step SG28, the CPU 51 determines whether or not the change flag is “1”, that is, whether or not the state is the state where the second mode is changed to the third mode. In this case, the determination result is “YES” because the state has transited from the second mode to the third mode, and the next step SG
Proceed to 29. In addition, when the process is once again advanced to step SG28 in the state where the third mode is entered,
Since the change flag is "0", the determination result here is "NO", and the process proceeds to step SG36 described later.

Next, when proceeding to step SG29, CP
U51 is the coordinate (x ₇ ,
y ₇ ), (x ₈ , y ₈ ) and the coordinates (x ₉ , y ₉ ), (x ₁₀ , y ₁₀ ) of the fifth detection frame SF5 are designated respectively, and these are designated by the position detection processing unit 40 side. Transfer the data to be stored in the register M (1) and the register M (2), and then proceed to step SG3.
At 0, it waits until the transfer is completed. Then, when the transfer is completed, the determination result of step SG30 is “YE
S ”, and the process proceeds to the next step SG31. Step S
Go to G31 and set the background image data D _BG to V
In order to perform the DMA transfer to the DP 31, the transfer destination address and the transfer source address are set in the DMA controller. The background image data D _{BG that} is transferred and set forms a “diamond” as shown in FIG.

Background image data D_BGDMA
When the transfer set is completed, the CPU 51 executes the next step.
The process proceeds to SG32 and is stored in the register AKF1.
The transfer flag F1 is set to "1". Then step
In SG33, the transfer stored in this register AKF1
Until the sending flag F1 becomes "0", that is, the background
Image data D_BGWaits for DMA transfer.
Then, the data D O_BIs DMA-transferred, transfer flag
When F1 becomes "0", the judgment result here is "YES".
Then, the process proceeds to the next step SG34.

In step SG34, the registers XG 'and YG' are reset to zero. The register XG 'and the register YG' temporarily store the barycentric coordinates of the sock S image chroma-detected one frame before based on the process of step SG41 described later. Next, when proceeding to step SG35, a register P described later
And the change flag stored in the register CHF are reset to zero. After that, the CPU 51 proceeds to step SG36 shown in FIG. In step SG36, it is determined whether or not the designated detection frame value n sent from the position detection processing unit 40 has been fetched. Then, when the designated detection frame value n is fetched, the determination result here becomes "YES", and the process proceeds to the next step SG37.

In step SG37, it is determined whether or not the fetched designated detection frame value n is "1", that is, a value designating the fourth detection frame SF4 in the third mode. Here, when the designated detection frame value n is "2", that is, when the fifth detection frame SF5 is designated, the determination result is "NO", and the process is returned to step SG13 described above. On the other hand, when the designated detection frame value n is “1” and the fourth detection frame SF4 is designated, the determination result is “YES”, and the process proceeds to step SG38. Step SG3
When proceeding to 8, the CPU 51 reads the barycentric coordinates (x _G , y _G ) from the storage area E9 (see FIG. 10) of the position detection processing unit 40 and sets it in the registers XG, YG. Then, the process proceeds to step SG39, stored whether the 'previous frame centroid coordinates x _G stored in the' center of gravity coordinates x _G and register XG stored in the register XG is mismatched, or register YG 'previous frame centroid coordinates y _G stored in the' center of gravity coordinates y _G and register YG is determined whether the mismatch that. That is, in this step SG39, as shown in FIG. 23, whether or not the sock S'image chroma-detected in the previous frame and the sock S image chroma-detected in the current frame are displaced vertically or horizontally. Is judging.

If the sock S image is not displaced, the result of the determination here is "NO", and the process returns to step SG13 described above. On the other hand, if the sock S image is displaced, the result of the determination is "YES". , ”And the process proceeds to the next step SG40. In step SG40, register P
Is incremented by 1 to proceed, and in step SG41, the barycentric coordinates (x _G , y _G ) of the current frame stored in the registers XG and YG are set in the registers XG ′ and YG ′, respectively. And replace. Next, proceeding to step SG42, the CPU 51 specifies the object image data D _OB corresponding to the value of the register P, and supplies the control signal SC to that effect to the VDP 31. In this case, the object image data D _OB forms a character image that runs on the “diamond” on the basis of the value of the register P.

Then, in step SG43, the object table data T _OB corresponding to the value of the register P is specified, and the display position of the object image data D _OB specified in step SG42 is specified. This allows
When the player P steps on the base run after batting, the sock S image is displaced accordingly, and the character image runs on the "diamond" in accordance with this displacement. When the game screen under the third mode is thus formed, the CPU 51 proceeds to step SG44, sets the transfer flag F2 stored in the register AKF2 to "1", and proceeds to step SG45. Then, step S
Going to G45, the object table data T _OB is D
Wait for MA transfer. And the data T _OB
The transfer flag F2 becomes "0" at the time when the data is DMA-transferred, and the CPU 51 returns the process to step SG13 described above to complete the operation in the third mode.

Operations of Interrupt Processing Routine Next, operations of various interrupt processing routines executed by the CPU 51 will be described with reference to FIGS. a. Operation of Transfer Interrupt Processing Routine The CPU 51 gives a transfer instruction to the DMA controller (not shown) each time a vertical retrace signal is supplied from the clock driver 12 (see FIG. 5), and executes the transfer interrupt processing routine shown in FIG. Run. First, in step SJ1, the transfer flag F1 stored in the register AKF1 is "1", that is, the image data D set by the DMA transfer is set.
Determine if _BG is in untransferred state. Here, when the image data D _BG has already been DMA-transferred,
The determination result is “NO”, and the process proceeds to step SJ4 described later.

On the other hand, the background image data D_BGBut
If it is in the untransferred state, the judgment result will be "YES", and the next
The process proceeds to step SJ2. In step SJ2
Is transfer set to the DMA controller
Background image data D B_GDirect DMA transfer
It Then go to step SJ3
Image data D_BGRegister A to indicate the completion of transfer of
Set the value of the transfer flag F1 stored in KF1 to "0".
To Succeedingly, in the step SJ4, the register A
The value of the transfer flag F2 stored in KF2 is "1", that is,
, The transfer-set object table data T_OB
Is not transferred. Where the data
Data T_OBHas already been DMA-transferred, the transfer flag F
Since 2 is "0", the judgment result is "NO".
To complete this routine and return to the CPU main routine.
Go home.

On the other hand, when the object table data T _OB is in the untransferred state, the determination result of the above step SJ4 becomes “YES”, and the process proceeds to step SJ5. In step SJ5, the object image data D _OB transferred and set to the DMA controller is transferred to VDP3.
To 1 side DMA transfers, the object table data T _OB corresponding to subsequent step SJ6 the data D _OB D
MA transfer. Then, when it proceeds to step SJ7, CP
U51 is a transfer flag F2 stored in the register AKF2.
Is set to "0" to complete this routine. in this way,
In the transfer interrupt processing routine, the register AKF1
The background image data D _BG forming the initial screen background according to the transfer flag F1 set to
Object image data D _OB and object table data T _{OB which} are DMA-transferred to and form a game screen according to the transfer flag F2 set in the register AKF2.
Is DMA-transferred to VDP31.

B. Operation of Collision Interrupt Processing Routine The CPU 51 executes the collision interruption processing routine shown in FIG. 25C based on the collision interruption output output from the position detection processing unit 40, and advances the processing to step SK1. In step SK1, it is determined whether or not the designated detection frame value n sent from the position detection processing unit 40 has been fetched. Then, when the designated detection frame value n is fetched, the determination result here becomes "YES", and the process proceeds to the next step SK2. In step SK2, it is determined whether the value of the register MODE is "1", that is, whether the current mode is the first mode. Here, in the first mode, the determination result is "YES", the flow proceeds to step SK3, the change flag stored in the register CHK is set to "1", and then the flow proceeds to step SK4 to register the MODE mode.
The value of is updated to "2" and the second mode is entered. In this way, when a collision is detected in the first detection frame SF1 in the first mode, the change flag is set to “1” and the second flag is set.
Transition to mode.

On the other hand, if the result of the determination in step SK2 is "NO", that is, if the current mode is not the first mode, the process proceeds to step SK5. Step S
When proceeding to K5, the CPU 51 determines whether or not the value of the register MODE is “2”. Here, for example, the second
In the mode, the determination result is “YES”, and the process proceeds to step SK6. In step SK6, it is determined whether the fetched designated detection frame value n is "1" or "2". Here, when the designated detection frame value n is “1”, that is, when a collision is detected in the second detection frame SF2 (see FIG. 3), the game operation is stopped and the initial state is returned to. In step SK7, the value of the register MODE is set to "1" to return to the first mode.
Then, after this, the CPU 51 advances the process to step SK8, and sets the change flag to "1".

On the other hand, in step SK6, if the designated detection frame value n is "2", that is, the third detection frame SF is detected.
If a collision between the bat B image and the ball image is detected within 3 (see FIG. 3), the process proceeds to step SK9. In step SK9, time count value set in the register T to determine whether Osamu' a range of a predetermined value t ₁ ~t _2. The time count value is a value that is counted immediately after the start of the game and manages the progress of the game. Further, the predetermined values t _{1 to} t _{2 referred} to here refer to an effective period when the “bat image” and the “ball image” meet. Therefore, in this step SK9, it is determined whether or not the collision timing between the "bat image" and the "ball image" is within the effective period of the meet.

Here, for example, if the player swings the bat B early or delays it, the collision timing will fall outside the effective period of the meet, so the determination result is "N.
"O" and the routine is completed. On the other hand, if the collision timing is within the valid period of the meet, the determination result is “YES”, and the process proceeds to the next step SK10. In step SK10, in order to perform the base running operation, the value of the register MODE is set to "3" and the mode is changed to the third mode. After that, the change flag is changed to "1" through step SK8 to indicate the mode change. set.

Next, if the result of the determination made in step SK5 is "NO", that is, if the mode has shifted to the third mode, the CPU 51 advances the process to step SK11. At step SK11, the designated detection frame value n that is currently loaded is “2”, that is, the fifth detection frame SF5 (see FIG. 4).
It is determined whether or not the collision is detected inside. Where the fifth
If the collision is detected within the detection frame SF5, the determination result is “YES”, and the process proceeds to the next step SK12. Next, in step SK12, the value of the register MODE is set to "1" in response to the collision detection in the fifth detection frame SF5 that instructs the game stop, and the mode is changed to the first mode. Step S to represent
The process proceeds to K13, the change flag is set to "1", and this routine is ended. In step SK11, if the determination result is "NO", the fourth detection frame S
Since only chroma key detection in F4 (see FIG. 4) is performed, this routine is ended without doing anything.

C. Timer Interrupt Processing Routine Next, the operation of the timer interrupt processing routine for generating a time count value for managing the progress of the game will be described with reference to FIG.
This will be described with reference to FIG. The CPU 51, based on the system clock supplied from the system clock circuit 24,
This routine is executed every predetermined period, the process proceeds to step SM1, and the time count value stored in the register T is incremented by 1. As a result, the time count value is incremented every predetermined period.

Then, in step SM2, it is determined whether or not the counted time value of the register T has reached a predetermined value corresponding to the game end time. Here, when the predetermined value is reached, the determination result is “Y
ES ”, the process proceeds to the next step SM3, and the register T
Is reset to zero and this routine ends. On the other hand, when the time count value after being counted up has not reached the predetermined value, the determination result of this step SM2 becomes "NO", and this routine is ended.

As described above, according to this embodiment,
First, in the first mode, the start of the game is controlled by pointing the bat B, and then in the second mode, the bat B is operated.
While simulating the batting motion according to the swing position and the timing of the, the batting motion is stopped by pointing with bat B, and in the third mode, the ball image is met under the second mode. The positional displacement of the sock S is detected from the time point, and the base image is made to run in response to this. That is, depending on the operation mode, the first detection frame SF1 to the fifth detection frame SF5
Either one of the above is designated as time division, and the bat B or the socks S are chromakey-detected in the designated detection frame. Therefore, even if there are a plurality of chromakey images in the captured image, the chromakey detection processing can be performed without malfunction. Will be possible. Moreover, according to such processing, image control can be performed without providing an operation switch, an operation pad, or the like, so that it is possible to simulate a batting operation and a base running operation in a form that matches an actual action.

In this embodiment, the image control device for simulating the batting motion and the base running motion is disclosed, but the gist of the present invention is not limited to the device, and for example, "tennis" or "tennis". Golf, etc.
The present invention can be applied to various games that incorporate a player's athletic behavior, or a device that creates a virtual reality. Further, in the above-described embodiment, it is detected whether or not the barycentric coordinates of the sock S image chroma-detected in the fourth detection frame SF4 are displaced for each frame, and if displaced, it is displayed accordingly. The base image of the character image displayed on the screen is run, but the invention is not limited to this.
It is also possible to adopt a mode in which the displacement of each frame is detected by paying attention to either one of the right end coordinate and the left end coordinate.

[0115]

As described above, according to the present invention,
The detection frame setting unit specifies a detection frame from among the plurality of detection frames according to the operation mode selected by the mode selection unit, and sets this in the captured image as the specified detection frame. When the chroma key detection means detects a chroma key image of a specific color from the captured image according to the designated detection frame, the display control means generates an operation instruction associated with the operation mode and the designated detection frame. Since the display screen is controlled in accordance with the operation instruction, even if there are a plurality of chroma key images in the captured image, it is possible to perform image control by the chroma key detection processing without malfunction.

[Brief description of drawings]

FIG. 1 is an external view showing an overall configuration of an image control apparatus according to an embodiment of the present invention.

FIG. 2 is a diagram for explaining an outline of a first mode in the embodiment.

FIG. 3 is a diagram for explaining an outline of a second mode in the same embodiment.

FIG. 4 is a diagram for explaining an outline of a third mode in the embodiment.

FIG. 5 is a block diagram showing an electrical configuration of the image control apparatus according to the embodiment.

FIG. 6 is a block diagram showing a configuration of an image pickup signal processing unit 11 in the embodiment.

FIG. 7 is a block diagram showing a configuration of a video signal processing unit 20 in the embodiment.

FIG. 8 is a chroma key signal generation circuit 20 in the same embodiment.
It is a figure for demonstrating f.

FIG. 9 is a block diagram showing a configuration of a VDP 31 in the embodiment.

FIG. 10 is a memory map for explaining the contents of the work RAM of the position detection processing unit 40 in the embodiment.

FIG. 11 is a flowchart showing an operation of a main routine in the position detection processing section 40.

FIG. 12 is a flowchart showing an operation of a main routine in the position detection processing section 40.

13 is a flowchart showing the operation of an initial screen map creation routine in the position detection processing unit 40. FIG.

FIG. 14 is a flowchart showing an operation of a processing screen map creation routine in the position detection processing unit 40.

FIG. 15 is a flowchart showing an operation of a collision coordinate detection processing routine in the position detection processing section 40.

16 is a flowchart showing the operation of a coordinate detection processing routine in the position detection processing section 40. FIG.

FIG. 17 is a flowchart showing an operation of a centroid calculation processing routine in the position detection processing section 40.

FIG. 18 is a flowchart showing an operation of a CPU main routine in the CPU 51.

FIG. 19 is a flowchart showing an operation of a CPU main routine in the CPU 51.

FIG. 20 is a flowchart showing an operation of a CPU main routine in the CPU 51.

FIG. 21 is a flowchart showing an operation of a CPU main routine in the CPU 51.

FIG. 22 is a diagram for explaining the operation of the first mode in the same example.

FIG. 23 is a diagram for explaining the operation in the third mode in the example.

FIG. 24 is a flowchart showing the operation of a transfer interrupt processing routine in the CPU 51.

FIG. 25 is a flowchart showing the operation of a collision interrupt processing routine in the CPU 51.

FIG. 26 is a flowchart showing the operation of the timer interrupt routine in the CPU 51.

[Explanation of symbols]

1 Imaging Unit (Chroma Key Detecting Means) 2 Device Main Body 3 Display 20 Video Signal Processing Unit (Chroma Key Detecting Means) 30 Image Processing Unit (Display Control Means) 40 Position Detection Processing Unit (Detection Frame Setting Means, Chroma Key Detecting Means) 50 Control Unit 51 CPU (mode selection means, detection frame setting means, display control means)

Claims (5)

[Claims] 1. A mode selection means having a plurality of operation modes, one of the plurality of operation modes being selected, and a plurality of detection frames representing an area to be detected, and the selection is made from these. A detection frame corresponding to the specified operation mode, and setting the detection frame as a specified detection frame in the captured image, and a chroma key for detecting a chroma key image of a specific color from the captured image according to the specified detection frame. When the chroma key image is detected in the detection means and the designated detection frame, an operation instruction associated with the operation mode and the designated detection frame is generated, and a display for controlling the display screen according to the operation instruction is displayed. An image control apparatus comprising: a control unit. 2. The image according to claim 1, wherein the detection frame setting means stores the positions and dimensions of the plurality of detection frames as diagonal elements composed of first and second frame coordinates. Control device. 3. A mode selection means having a plurality of operation modes, wherein any one of the plurality of operation modes is selected, and a plurality of detection frames representing an area to be detected. A detection frame corresponding to the specified operation mode, and setting the detection frame as a specified detection frame in the captured image, and a chroma key for detecting a chroma key image of a specific color from the captured image according to the specified detection frame. A detection unit; an image generation unit that reads out image data stored in advance in the storage unit and displays a predetermined image on a display screen; and a presence / absence of collision between the chroma key image and the predetermined image in the designated detection frame. Collision detecting means for detecting, and when the collision detecting means detects a collision between the chroma key image and the predetermined image, an operation instruction associated with the collision state and the operation mode. Generated, image control apparatus characterized by comprising a display control means for controlling the display mode of the predetermined image in response to the operation instruction. 4. A mode selection means having a plurality of operation modes, one of the plurality of operation modes being selected, and a plurality of detection frames representing a region to be detected, the selection being made from these. A detection frame corresponding to the specified operation mode in time division, and a detection frame setting means for setting the detection frame as a specified detection frame in the captured image; and a chroma key image of a specific color from the captured image according to the specified detection frame. Chroma key detection means, an image generation means for reading out image data stored in advance in the storage means and displaying a predetermined image on the display screen, and within the designated detection frame when the operation mode is under the predetermined operation mode. Display control means for controlling the display mode of the predetermined image in accordance with the positional displacement of the chroma key image in the captured image when the chroma key image is detected. Image control apparatus according to claim. 5. The display control means detects the positional displacement based on whether or not there is a difference between the position of the chroma key image in the previous imaging frame and the position of the chroma key image in the current imaging frame. Image control device.