JPH0855212A - Image controller - Google Patents

Abstract

PURPOSE:To provide an image controller which can set a wide visual field range while securing detection precision. CONSTITUTION:A CPU 51 indicates a visual field direction so that the center point of a chromaky image extracted by a position detection processing part 40 is in the center of the image pickup visual field of an image pickup part. A support mechanism part 14 pans the image pickup part 1 according to an instruction from the CPU 51. Consequently, the chromakey image is put in the image pickup visual field at all times. Therefore, the possibility that malfunction is caused by deviation from the image pickup visual field and the need to widen the visual field angle to prevent the chromakey image from deviating from the image pickup field are eliminated, thus, a video visual field range can be set without causing a decrease in detection precision.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image control apparatus suitable for use in, for example, a video game for creating virtual reality.

[0002]

2. Description of the Related Art Conventionally, various image control devices have been put into practical use, which control a moving image of an object image or generate a sound effect in accordance with an operation of an operation pad or the like. In addition,
The object image mentioned here refers to a “character” displayed on the game screen, and is moved and displayed on the background screen as a background. This type of device is called a video game or a TV game, and a shooting game that asks a player's reflexes, a game that simulates a virtual reality, and the like are known.

Such a video game is composed of an image processing section for generating a video signal corresponding to a game operation and a display for displaying the video signal supplied from the image processing section. The image processing unit is a CPU, RO
M and RAM etc., for example, sequentially read out the image information and control information stored in the ROM pack,
A background image serving as a screen background is displayed on the display, and a corresponding character (object image) is displayed as a moving image on the screen background in response to a game operation, and a sound effect corresponding to the movement is pronounced.

[0004]

In the above-mentioned conventional image control device, the object image is displayed and controlled according to the game operation performed on the operation pad, and the screen corresponding to the game operation is displayed. It is generally generated, and is often unsuitable for games that simulate virtual reality. That is, in order to pursue a virtual reality, it is necessary to perform image control in a form that matches the actual action. For example, in a simulation game in which a pitcher throws a ball on the screen and the player performs a batting operation based on this display screen, the "bat" becomes the operator instead of the operation pad. The image is controlled according to the position or movement of the.

In the case of performing such image control, a method has been proposed in which the image is controlled according to the position and movement of the "bat" which is the operator by a well-known chroma key detection process. In this case, the chroma key detection process is a process of extracting a “bat (operator)” colored in a specific color from the captured image as a chroma key image and detecting the position of the chroma key image on the captured image.

By the way, in a game simulating a virtual reality, since the manipulator is operated according to an actual action (act), the manipulator may deviate from the imaging visual field depending on the operation form. In this case, it is inevitable that the position and movement of the accurate chroma key image cannot be detected, and as a result, this is one of the factors that cause the adverse effect that the image control malfunctions. This problem can be solved by setting the wide field of view to the image pickup field. However, if the wide field of view is set, the chroma key image to be detected becomes smaller relative to the field of view of the image pickup and the detection accuracy is maintained. The drawback is that you cannot do that.

Specifically, for example, 300 × 300
When a chroma key image with a viewing angle of 30 ° is captured by a CCD (imaging device) having dot image pixels, each pixel corresponds to 0.1 °, and in this case, the chroma key image moves with an accuracy of 1 ° or less. Can be detected. On the other hand, the viewing angle is 6
When expanded to 0 °, one pixel corresponds to 0.5 °,
It becomes difficult to detect movements of less than °.

As described above, in an apparatus for controlling an image based on the chroma key detection processing, in order to secure the detection accuracy,
The chroma key image deviates from the imaging visual field to easily cause a malfunction. On the other hand, when the viewing angle is widened so that the chroma key image does not deviate from the imaging visual field, there is a conflicting problem that the detection accuracy is deteriorated. Therefore, the present invention has been made in view of the above circumstances, while maintaining the detection accuracy,
An object is to provide an image control device capable of setting a wide visual field range.

[0009]

In order to achieve the above object, in the invention described in claim 1, an image pickup means for picking up an image of a subject colored in a specific color, and a rotation drive while supporting the image pickup means. A field-of-view direction setting means for setting the imaging visual field of the imaging means to a designated direction, a chromakey extraction means for extracting a chromakey image corresponding to the subject from the captured image output by the imaging means, and the chromakey It is characterized by further comprising a visual field direction designating unit for designating the visual field direction to the visual field direction setting unit so that the center point of the chroma key image extracted by the extracting unit is located at the center of the imaging visual field.

According to a second aspect of the present invention, which depends on the first aspect, the visual field direction setting means includes a first rotary table for rotatably supporting the image pickup means in the elevation direction.
A second rotary table for rotatably supporting the image pickup means in the azimuth direction, and setting the visual field direction of the image pickup means according to the amount of movement of the first and second rotary tables. I am trying.

According to a third aspect of the present invention, which depends on the first aspect, the visual field direction designating means is arranged such that the upper end coordinates of the chroma key image represented by the coordinate system in the captured image for each captured frame. , The lower end coordinates, the right end coordinates and the left end coordinates are added and averaged to calculate the center point of the chroma key image, and the view direction is set to the view direction setting means so that the calculated center point of the chroma key image becomes the center position of the captured image. Characterized by giving instructions.

Further, according to the invention described in claim 4, an image pickup means for picking up an image of a subject colored in a specific color, and a mechanism for rotationally driving the image pickup means while supporting the image pickup means are provided. Field-of-view direction setting means for setting in the instructed direction, chroma key extracting means for extracting a chroma key image corresponding to the subject from the imaged image output by the image capturing means, and the chroma key image from the chroma key image extracted by the chroma key extracting means. And a visual field direction instructing means for instructing a direction of the imaging visual field to a moving position of the chroma key image predicted according to the detected motion vector.

[0013]

According to the present invention, when the visual field direction designating means designates the visual field direction so that the center point of the chroma key image extracted by the chroma key extracting means is located at the center of the imaging visual field, the mechanism for rotationally driving while supporting the imaging means. The field-of-view direction setting means having the: sets the imaging field of view of the imaging means in the instructed direction. This eliminates the possibility of the chroma key image deviating from the imaging field of view and causing a malfunction, and eliminates the need to widen the viewing angle so that the chroma key image does not deviate from the imaging field of view. It is possible to set the range.

[0014]

Embodiments of the present invention will be described below with reference to the drawings. A. Outline of Embodiments FIG. 1 is an external view showing an overall configuration of an image control apparatus according to the present invention, and illustrates an example applied to a game for simulating a batting operation. In this figure, reference numeral 1 denotes an image pickup unit including a solid-state image pickup device such as a CCD, which picks up an image of a player B located in a batter box (not shown). Here, the player B performs a batting operation using, for example, a bat BAT colored in blue for chroma key detection. The imaging unit 1 is mounted on a support mechanism 14 that pans the imaging field of view in the elevation and azimuth directions, and the direction of the field of view is controlled based on the operation described below.

Reference numeral 2 denotes an apparatus main body, which performs chroma key detection on the image pickup signal supplied from the image pickup section 1 to determine the position of the bat BAT in the actual image coordinates. What are the actual image coordinates?
It refers to an image captured by the image capturing unit 1. Further, the device body 2 synthesizes a background image which is a background scene of the game and an object image which is moved and displayed on the background image, and displays this as a computer graphic image (hereinafter referred to as a CG image). Display in 3. Further, the apparatus main body 2 drives and controls the support mechanism 14 based on the operation described later, and controls the imaging visual field direction of the imaging unit 1. The display 3 displays an image of a video signal supplied from the device body 2. For example, the throwing motion of a pitcher on a background scene,
A moving image of the flight of the ball according to the throwing is displayed.

The entire apparatus having the above-described structure obtains the position of the center of gravity of the ball from the position of the ball displayed in the CG image, as shown in FIG. 2 (a), and the actual image as shown in FIG. 2 (b). The position of the center of gravity of the bat BAT image detected by the chroma key is calculated. Then, it is determined at every predetermined timing whether the “ball” in the CG image and the “bat BAT” in the actual image collide with each other. Depending on the hit condition.
For example, as shown in FIG. 2B, if the positions of both centers of gravity coincide with each other at the time of the collision, a simulation close to reality is performed such that a “home run” is set as the just meat.

B. Configuration of Embodiment Next, the electrical configuration of the image pickup unit 1, the support mechanism 14, and the apparatus body 2 will be described with reference to FIG. (1) Configuration of Image Pickup Section 1 The image pickup section 1 is composed of the constituent elements 10 to 13.
An oscillating circuit 10 generates and outputs an 8 times oversampling signal 8f _SC . An image pickup signal processing unit 11 supplies the 8 × oversampling signal 8f _SC to the clock driver 12 in the next stage and converts the image pickup signal output from the CCD 13 into the sampled image data D _S , the configuration of which will be described later. To do.

The clock driver 12 generates various timing signals such as a horizontal driving signal, a vertical driving signal, a horizontal / vertical synchronizing signal and a blanking signal based on the 8 times oversampling signal 8f _SC supplied from the oscillator circuit 12. Meanwhile, an image pickup drive signal corresponding to the horizontal drive signal and the vertical drive signal is generated and supplied to the CCD 13. CC
D13 images the object according to the image pickup drive signal and generates an image pickup signal SS. The imaging signal processing unit 11 uses the CC
After the imaging signal SS supplied from D13 is conditioned, it is A / D converted and sampled image data D _S
Is generated, and its schematic configuration will be described with reference to FIG.

In FIG. 4, 11a is a sampling circuit, which samples the image pickup signal SS according to the 4 × oversampling signal 4f _SC supplied from the clock driver 12 and outputs it to the next stage. Reference numeral 11b is an AGC (automatic gain control) circuit for converting the sampled image pickup signal SS into a predetermined level and outputting it. 11c is
This is a γ correction circuit that corrects the gamma characteristic of the image pickup signal SS to γ = 1 / 2.2 and outputs it. Reference numeral 11d denotes an A / D conversion circuit that converts the gamma-corrected image pickup signal SS into 8-bit length sampling image data D _S and outputs the sampled image data D _S.

Sampling image data D_SWill be described later
It is supplied to the video signal processing unit 20. 11e is a video signal
Composite video signal D supplied from the signal processor 20_CV
Analog video signal S_VConverted to
This is a D / A conversion circuit for outputting to ray 3. Note that the above
Image processing data D output from the video signal processing unit 20 S_P
The contents of will be described later.

(2) Structure of Support Mechanism 14 The support mechanism 14 includes a biaxial rotary table 14a for rotating the image pickup unit 1 in the elevation direction (Y-axis rotation) and the azimuth angle direction (X-axis rotation), and a step motor 14b. , 14c. The step motors 14b and 14c rotate according to drive pulse signals supplied from the CPU 51, which will be described later, to drive the biaxial rotary table 14a. As can be seen from the schematic diagram shown in FIG. 5, these step motors 14b and 14c drive the X-axis rotary table 14a-1 by the rotation of the step motor 14b to rotate the image pickup unit 1 in the azimuth direction. On the other hand, when the step motor 14c rotates, the Y-axis rotary table 14a-2 is driven to rotate the imaging unit 1 in the elevation direction. The intended purpose of these support mechanisms 14 will be described later.

(3) Structure of the device body 2 Next, referring to FIGS. 3 and 6 to 9, the structure of the device body 2 will be described.
Explain the success. The device body 2 is a video signal processing unit.
20, image processing unit 30, position detection processing unit 40 and control
It is composed of parts 50.
Detailed description. Configuration of Video Signal Processing Unit 20 The video signal processing unit 20 includes
Pulling image data D Color difference conversion processing and chroma for S
Key detection processing is performed and the result is the position detection processing described later.
It is supplied to the processing unit 40. The processing unit 20 will be described later.
Image processing data D supplied from the image processing unit 30_SPTo
Composite video signal D_CVConverted to D / A
It is supplied to the replacement circuit 11e (see FIG. 4). In addition, here
Image processing data D_SPIs a background image,
Objects that are moved and displayed on the background image
The CG image is formed by synthesizing the image with the image.

Here, the configuration of the video signal processing unit 20 which implements each of the above processes will be described with reference to FIG. In this figure, reference numeral 20a denotes a color separation filter, which supplies the sampling image data D _S to the signal Ye (yellow) and the signal C.
y (cyan) and signal G (green) are color-separated and output to the next stage. Reference numeral 20b is a contour correction circuit that adjusts the image quality by performing brightness modulation before and after the change point in the video signal. Reference numeral 20c is a white balance circuit, which sets each signal Ye, Cy, G to a specified level and outputs it. 20
Reference numeral d denotes a classification filter including a bandpass filter, which converts each signal Ye and Cy into a signal R (red) and a signal B.
(Blue) is sorted and output. Reference numeral 20e designates signals R, G and B representing the three primary colors, a luminance signal Y and a color difference signal B each having a length of 8 bits.
This is a matrix circuit for converting into -Y and RY.

Reference numeral 20f denotes a chroma key signal generation circuit,
When the color difference signals BY and RY reach a predetermined level, the "H" level chroma key detection signal CRO is generated.
That is, in the circuit 20f, as shown in FIG. 7, the maximum / minimum level of the color difference B-Y B-Y _MAX, and B-Y _MIN,
The maximum / minimum levels RY _MAX and RY _{MIN of} the color difference RY are predetermined, and the color difference signals B-Y and RY are stored in the color difference area E (hue) defined by these levels. In the case of the above, the "H" level chroma key detection signal CRO indicating that the specific color has been detected is output. In this embodiment, the area E is “blue”, and specifically, the above-mentioned image pickup unit 1 has the bat BAT colored in blue.
By capturing the image, the “H” level chroma key detection signal CRO is generated, and the signal CRO is supplied to the position detection processing unit 40.

Reference numeral 20g is a luminance signal Y and color difference signals BY and R each having an 8-bit length, which are output from the matrix circuit 20e.
This is a color difference conversion circuit that converts −Y into a 4-bit long luminance signal Y ′ and 2-bit long color difference signals BY ′ and RY ′. Reference numeral 20h denotes the image processing data D _SP (RGB signal) supplied from the image processing unit 30 (described later) as the luminance signal Y,
This is a matrix circuit for converting into color difference signals BY and RY. Reference numeral 20i denotes a selector, which selects either the output of the matrix circuit 20e or the output of the matrix circuit 20h according to a select signal SL supplied from a position detection processing unit 40 described later and supplies the selected output to the next stage. 20j is a modulator. The modulator 20j is the selector 2
0i, the luminance signal Y, the color difference signal BY,
A digital composite video signal D _{CV in} which various synchronizing signals (horizontal / vertical synchronizing signal and blanking signal) are superimposed on RY is generated.

According to the above configuration, the video signal processing section 20
Is the sampling image data D supplied from the imaging unit 1.
_S is a luminance signal Y ′, 2-bit color difference signals BY ′, R
While converting into −Y ′, a chroma key detection signal CRO is generated and supplied to the image processing unit 30 (described later) side. In addition, the processing unit 20 receives either the image processing data D _SP (RGB signal) input from the image processing unit 30 side or the sampling image data D _S supplied from the imaging unit 1 according to the select signal SL. The selected data is converted into a composite video signal D _CV and output. The select signal SL is the position detection processing unit 40 described later.
Is a signal supplied from.

Configuration of Image Processing Unit 30 Next, the configuration of the image processing unit 30 will be described. The image processing unit 30 is a video display processor (hereinafter, V
It is composed of a DP (abbreviated as DP) 31 and a VRAM 32. The basic function of the VDP 31 is to read the background image data D _BG and the object image data D _OB stored in the VRAM 32 according to a control signal SC supplied from the control unit 50 (described later) side, and perform one scan. This is to generate image processing data D _SP that represents the dot display color for each line. Hereinafter, the configuration of each unit will be described in detail with reference to FIG.

In the figure, reference numeral 31a is a CPU interface circuit, which is a constituent element 31 in accordance with a control signal SC supplied via a bus of a CPU 51 constituting a control unit 50.
Various control instructions are given to b to 31d. The control signal SC is
It is formed from various commands for controlling the display of the background image and the object image, the background image data D _BG and the object image data D _OB which are DMA-transferred to the VRAM 32. Reference numeral 31b is a VRAM control circuit, which is composed of components 31a, 31c and 3a.
Data is exchanged with the VRAM 32 in response to the control signal supplied from 1d.

That is, when the control signal SC for the DMA transfer is received from the CPU interface circuit 31a, the background image data D _BG or the object image data D _OB DMA-transferred through the circuit 31a is received. Store in a predetermined storage area. When an instruction to read the background image data D _BG is received from the background control circuit 31c, the corresponding data D _BG is read and returned to the circuit 31c side. Similarly, when an instruction to read the object image data D _OB is received from the object control circuit 31d, the corresponding data D _OB is read and returned to the circuit 31d side.

Background control circuit 31c
Specifies the display position for the background image data D _BG read via the VRAM control circuit 31b based on the background display control command given from the control unit 50 side via the circuit 31a, It is supplied to the color difference data processing circuit 31e. In addition, the circuit 31c is configured so that the luminance signal Y ′, the color difference signals BY ′, RY ′ supplied from the video signal processing unit 20 described above, that is, the sampling image for one frame imaged by the imaging unit 1 Are stored in the VRAM 32 via the VRAM control circuit 31b. In other words, the captured image can be used as the background image data D _BG .

The object control circuit 31d is
The object table data T _OB given from the control unit 50 side via the circuit 31a is stored in the object table RA.
Write to M31f. The object table data T _OB is the object image data D on the display screen.
_This is coordinate data that specifies the display position of the _OB . Further, the circuit 31d refers to the object table data T _OB for the object image data D _OB read from the VRAM 32 in response to the object display control command, obtains the display position, and the object for one scanning line is obtained. Image data D _OB line buffer RAM 31g
Temporarily store in. The object image data D _OB temporarily stored in the line buffer RAM 31g is updated every scan. The object image data D _OB read from the RAM 31g is supplied to the color difference data processing circuit 31e.

The color difference data processing circuit 31e refers to the well-known color look-up table RAM 31h to obtain 8-bit image data D _BG and D _OB supplied from the background control circuit 31c and the object control circuit 31d. The image processing data D _SP formed from the R signal, G signal, and B signal of bit length is converted and output. Furthermore, the color difference data processing circuit 31e
In addition to image processing data D _SP (RGB signal), signal YSBG
And the signal YSOBJ. The signal YSBG and the signal YSOBJ are signals indicating whether the currently output image processing data D _SP corresponds to the background image data D _BG or the object image data D _OB. is there. For example, when the currently output image processing data D _SP corresponds to the background image data D _BG , the signal YSB
G becomes "H" and the signal YSOBJ becomes "L". On the other hand, conversely to this, the image processing data D _SP
Is corresponding to the object image data D _OB , the signal YSBG is “L” and the signal YSOBJ is “H”.

As described above, in the image processing unit 30, the background image data D _BG and the object image data D _OB DMA-transferred from the control unit 50 side are stored in the VRAM 3.
2 in accordance with the control signal SC (various display control commands) supplied from the CPU 51.
The image data D _BG or the image data D _OB is read out from No. 2 and the image processing data D _SP representing the dot display color for each scanning line is generated and the signals YSBG and YSOBJ representing the attribute of the image processing data D _SP. Is output.

Configuration of Position Detection Processing Unit 40 The position detection processing unit 40 is composed of a gate array formed by arranging a plurality of logic elements, a line buffer and a work RAM.
And a collision coordinate position between a chroma key image included in the sampling image data D _S and an object image formed by the object image data D _OB , and these images under the instruction of the control unit 50 described later. The position of the center of gravity and the like are logically calculated based on a predetermined logic. The line buffer (not shown) temporarily stores the chroma key detection signal CRO supplied from the video signal processing unit 20. The work RAM temporarily stores various calculation results which are logically calculated by the gate array.

The position detection processing section 40 has the signals YSBG and YSOB supplied from the image processing section 30 described above.
Based on J, the above-mentioned select signal SL is generated and given to the video signal processing section 20, and the sampling image data D _S
The degree of overlap between the (actual image) and the image processing data D _SP (CG image), that is, the priority order (front-back relationship) of the images displayed on the screen is controlled. Further, the processing unit 40 includes the control unit 50.
Under the instruction, the register control signal S _REG is supplied to the image pickup signal processing unit 11, the video signal processing unit 20 and the VDP 31 described above, and the data set / reset of each unit register is controlled.

Next, referring to FIG. 9, the position detection processing unit 40
The work RAM in which various calculation results in are stored will be described. In this figure, E1 is an initial screen area in which data of an initial screen formed from 96 dots in the horizontal direction (scanning line) and 96 lines in the vertical direction is temporarily stored. The data of the initial screen refers to the chroma key detection result existing in the scene captured before the start of the game. If an object of a chroma key detection color (for example, blue) is present in the scene, it may be mistaken for a part of the bat BAT (see FIG. 1) described above. Therefore, the data temporarily stored in the initial screen area E1 is used when the dot position detected by the chroma key is not mistaken for the bat BAT (see FIG. 1) when the dot position is set as the dead zone.

E2 is 96 dots in the horizontal direction and 96 dots in the vertical direction.
This is a processing screen area formed by lines, and the bat BAT image in which the chroma key is detected in the actual image and the object image (ball image in this embodiment) in the CG image are updated and stored for each frame. E3 to E4 are bat BATs on the processing screen that are updated for each frame.
These are the upper end coordinate area and the lower end coordinate area for temporarily storing the upper end / lower end positions of the image. E5 to E6 are the left end of the bat BAT image on the processing screen updated for each frame /
The left end coordinate area and the right end coordinate area temporarily store the right end position. E7 is the first collision coordinate area. The first collision coordinate area E1 represents the intersection point in the scanning line where the overlap (collision) of the bat BAT image and the object image (ball image) is first detected as coordinates on the processing screen. . In addition, the second collision coordinate area E8
Represents the intersection point in the scanning line where the overlap between the bat BAT image and the object image (ball image) is finally detected as coordinates on the processing screen.

E9 is a barycentric coordinate area, in which the barycentric position calculated based on the area of the bat BAT image chroma-detected in the actual image is stored as the coordinate position on the processing screen. E10 is an area area in which the area of the bat BAT image subjected to chroma key detection in the actual image is stored. The area set in the area area E10 is represented by the number of blocks. The block referred to here is a 12-dot area consisting of 6 dots in the horizontal direction and 2 lines in the vertical direction on the processing screen. When chroma key detection of "6 dots" or more is detected in the block formed from the 12 dot area, the block is regarded as the area of the bat BAT image.

Configuration of Control Unit 50 Next, the configuration of the control unit 50 will be described with reference to FIG. 3 again. The control unit 50 is composed of components 51 to 57. The CPU 51 performs a key scan on various operators provided on the operation panel of the apparatus body 2 and controls each part of the apparatus according to the operator signal KS generated in response to the key scan. It will be described later. This CPU5
1 has an internal timer, and manages the game progress based on the game counter value counted by the timer. Further, the CPU 51 is provided with a well-known DMA controller and is configured to DMA-transfer various data (background image data D _BG and object image data D _OB ) necessary for game operation to the above-mentioned image processing unit 30. There is. A RAM 52 is used as a work area for the CPU 51 to temporarily store various calculation results and flag values. Reference numeral 53 is a ROM that stores an OS (operating system) program that manages the operation of the CPU 51. A system clock circuit 54 generates a system clock that regulates the operation of the entire device under the control of the CPU 51.

Reference numeral 55 denotes a game cartridge which is removably attached to the apparatus main body 2 and includes a ROM 55a and a first cartridge.
The sound source circuit 55b. ROM 55a
Is an application program loaded into the CPU 51. In this embodiment, as described above, the game program for simulating the batting practice is stored. 55b is a first tone generator circuit, which is a CPU
Based on the event data supplied from the 51 side via the position detection processing unit 40, a game sound effect corresponding to the game operation is synthesized and output to the CPU 51 as a tone signal. Reference numeral 56 is a second tone generator circuit, which synthesizes musical sounds corresponding to the progress of the game, for example, musical compositions such as opening and ending, and outputs them. Reference numeral 57 denotes a sound system, which filters the musical tone signals supplied from the first tone generator circuit 55b and the second tone generator circuit 56 such as noise removal, and then amplifies and outputs the amplified signals.

C. Operation of Embodiment Next, the operation of the embodiment having the above configuration will be described.
Here, first, the operation of the position detection processing unit 40 described above will be described, and then the control unit 50 according to the gist of the present invention.
The operation of the (CPU 51) will be described. (1) Operation of Position Detection Processing Unit 40 Here, the operation of the position detection processing unit 40 configured by the gate array will be described with reference to FIGS. 12 to 17. In this processing unit 40, under the instruction of the control unit 50,
Bat BAT included in the sampled image data D _S
The image is detected based on the chroma key detection signal CRO, and the collision coordinate position between the bat BAT image and the object image (ball image) formed by the object image data D _OB and the center of gravity position of these images are determined. The details of such operation will be described below.

Operation of Main Routine First, it is assumed that the apparatus main body 2 is powered on and a control signal SC indicating a system reset is supplied from the CPU 51 side to the position detection processing section 40. Then, the position detection processing unit 40 loads the microprogram set therein, starts the main routine shown in FIG. 10, and executes step SA1 based on the control signal SC. In step SA1, while resetting its own internal register or performing initialization to set an initial value, the imaging signal processing unit 11, the video signal processing unit 20, and the VDP
A register control signal S _REG for instructing a register set is supplied to each 31 and the process proceeds to the next step SA2.

At step SA2, "initial screen map"
Is created. Where, for example,
When the "initial screen map" is not created, the determination result is "NO", and the process proceeds to the next step SA3. The “initial screen map” means that the bat BAT is displayed in the screen imaged by the imaging unit 1 prior to the start of the game.
This is for confirming whether or not there is an object of the same color (see FIG. 1). Then, when the process proceeds to step SA3,
Chroma key detection results for a plurality of frames are overlaid, stored in the initial screen area E1 (see FIG. 9) of the work RAM, and the chroma key detection block existing in the initial screen is regarded as a "dead zone". To create.

When the "initial screen map" is created in this way, the position detection processing unit 40 proceeds to the next step S
The process proceeds to A4. When the "initial screen map" is prepared in advance, the result of the determination in step SA2 is "YES", and the process proceeds to step SA4. At step SA4, the values of the registers X and Y are reset to zero. In the registers X and Y, a value corresponding to a screen coordinate formed by 96 dots in the horizontal direction and 96 lines in the vertical direction is sequentially set in the registers X and Y according to the processing content.

Next, in step SA5, the position detection processing section 40 performs chroma key detection for each block on the chroma key detection signal CRO temporarily stored in the line buffer. The block-by-block chroma key detection means the chroma key detection signal C read from the line buffer.
RO is divided into blocks each consisting of 6 dots in the horizontal direction and 2 lines in the vertical direction, and when the "H" level chromakey detection signal CRO is "6 dots" or more per block,
The attribute of the block is regarded as “with chroma key”. The result of such chroma key detection is stored as a block attribute in the processing screen area E2 (see FIG. 9) described above, and this is the "processing screen map".

Next, when the chroma key detection for each block unit is performed, the position detection processing unit 40 proceeds to the next step S.
Proceed to A6, and the bat BA of the actual image with chroma key detection
The presence or absence of collision between the T image and the object image (ball image) in the CG image is detected, and in the case of collision, the collision coordinates are obtained. Then, when proceeding to step SA7, the processing unit 40 increments the value of the register X by 1, and subsequently, in step SA8, the value of the register X is "96",
That is, it is determined whether the processing for one scanning line is completed. Here, when the value of the register X has not reached "96", the determination result becomes "NO", and the steps SA5 to SA7 are repeated until the processing for one scanning line is completed.

On the other hand, when the processing for one scanning line is completed, the judgment result here becomes "YES", and step S
In step A9, the value of the register X is reset to zero again and the value of the register Y is incremented by 1 to update the scan line in the vertical direction. Then, when the processing proceeds to step SA10, the processing unit 40 determines whether or not the value of the register Y is "96". Here, the value of the register Y is "96".
If not, the judgment result is “NO”,
The above steps SA5 to SA9 are repeated. And
When the scanning for one frame is completed, the determination result here becomes "YES", and the process proceeds to step SA11.

In step SA11, the above step SA
5, the left edge / right edge coordinates and the upper edge / lower edge coordinates of the bat BAT image are calculated based on the blocks detected by the chroma key, and these are stored in the storage areas E3 to E6 of the work RAM.
The area of the bat BAT image is obtained from the number of blocks detected by the chroma key, while storing in (see FIG. 9). In addition,
The storage areas E3 to E4 temporarily store the upper and lower end positions of the bat BAT image on the processing screen updated for each frame, and the storage areas E5 to E6 are processing screens updated for each frame. The left end / right end position of the BAT BAT image of is temporarily stored. The area of the bat BAT image calculated from the number of blocks is stored in the storage area E10.

When the bat BAT image is chroma key detected from the actual image in this way, the position detection processing unit 41 determines in step SA.
The process proceeds to step 12 to obtain the center of gravity position of the bat BAT image, and then it is determined in step SA13 whether the interrupt flag is "1". If "1", an interrupt signal is output to the CPU 51 ( Step SA14). After that, the process proceeds to step SA15 and the collision flag CF is set to "0". The collision flag CF is “1” when the bat BAT image of the actual image and the object image (ball image) of the CG image are in a collision state, that is, when they overlap each other. Then, after step SA13, the position detection processing unit 40 returns the processing to step SA4,
The above-described operation is repeated to find the correspondence between the "bat" and the "ball" for each frame.

Operation of Initial Screen Map Creating Routine Next, the operation of the initial screen map creating routine will be described with reference to FIG. As described above, when the initial screen map is not created, the position detection processing unit 40 advances the processing to step SA3, executes the initial screen map creation routine shown in FIG. 11, and advances the processing to step SB1. In step SB1, the sampling number n set in the internal register is read. The sampling number n is the chroma key detection signal CRO supplied from the image pickup unit 1.
It shows how many frames are taken in. Next, when proceeding to step SB2, the values of the registers X and Y are reset to zero, and then proceeding to the next step SB3. Step S
In B3, of the chroma key detection signal CRO written in the line buffer, 6 dots in the X direction (horizontal direction)
Two lines in the Y direction (vertical direction), that is, one block are read.

Next, in step SB4, it is judged whether or not there is a "H" level chroma key detection signal CRO of "6 dots" or more in this read one block. If "6 dots" or more does not exist, the determination result is "no chroma key" and the determination result is "NO", and the process proceeds to step SB5. In step SB5, the block attribute is set to "0" and the process proceeds to the next step SB7. On the other hand, if there are more than 6 dots,
It is determined that "chroma key is present", the determination result is "YES", and the process proceeds to step SB6. In step SB6, the block attribute is set to "1", and the next step SB
Processing proceeds to 7. In step SB7, it is determined whether or not it is the first frame. Here, if it is the first sampled frame, the determination result is "YES", and the process proceeds to step SB8.

In step SB8, the position detection processing unit 40 stores the determined block attribute in the initial screen area E1 according to the values of the current registers X and Y. Then, after that, the process proceeds to Step SB9, the value of the register X is incremented by 1, and the number of the designated block is incremented. Next, in step SB10, it is determined whether or not the number of the stepped designated block is "96", that is, one scanning (horizontal) line is completed. Here, if not completed, the determination result is “NO”, and step SB
Proceed to 11. In step SB11, it is determined whether the value of the register Y is "96", that is, whether one frame has been completed. Here, if the processing for one frame is not completed, the determination result is “NO”, and the process returns to step SB3 described above. As a result, steps SB3 to SB6 are repeated and the next block attribute is determined.

Then, for example, it is assumed that the determination of the block attribute for one scanning (horizontal) line is completed. Then, the determination result of step SB10 becomes "YES", and the processing unit 40 advances the process to step SB13. In step SB13, the register X is reset to zero, and the value of the register Y is incremented by 1 to update the scan line. Then, after this, again, step SB11
Block determination from step SB3 onward is performed via. Next, when the determination of the block attribute for one frame is completed, the above-mentioned determination result of step SB11 becomes "YES", and the process proceeds to step SB12. In step SB12, it is determined whether the sampling number n has reached the set number.

If the set number of times has not been reached, the determination result is "NO", and the process proceeds to step SB14. In step SB14, the number of times of sampling n is incremented, and the above-mentioned step SB2 and subsequent steps are executed again. In this way, the first initial screen map is created,
In the process of creating the initial screen map for the second time, step S
When proceeding to B7, the determination result here becomes "NO", and the routine proceeds to step SB15. In step SB15, the corresponding block attribute stored previously is read from the initial screen area E1 according to the values of the registers X and Y. Then, in step SB16, the logical sum of the previous block attribute and the currently determined block attribute is obtained. Then, in step SB8, this logical sum is stored as a new block attribute in the initial screen area E1 based on the values of the registers X and Y. Then, when the logical sum of a predetermined number of frames is generated, the determination result of step SB12 described above is "YES".
Then, this routine is ended, and the processing of the position detection processing unit 40 returns to the main routine described above.

Operation of Processed Screen Map Creation Routine When the initial screen map is created as described above, the position detection processing section 40 executes the processed screen map creation routine shown in FIG. 12 through step SA5 and executes step SC1.
Proceed to. In step SC1, one block consisting of 6 dots in the X direction (horizontal direction) and 2 lines in the Y direction (vertical direction) is read from the chroma key detection signal CRO written in the line buffer. Then, step SC2
If you proceed to, read "6 dots" in one block.
It is determined whether or not the above "H" level chroma key detection signal CRO is present. If "6 dots" or more does not exist, it is determined that "no chroma key is present" and the determination result is "N.
"O" and the process proceeds to step SC3. At step SC3, the block attribute is set to "0" and the next step SC
Processing proceeds to 4. In step SC4, the determined block attribute is stored in the processing screen area E2 (see FIG. 9) based on the values of the registers X and Y.

On the other hand, when the result of the determination in step SC2 is "YES", that is, when there is a "H" level chroma key detection signal CRO of "6 dots" or more in one block, the processing section 40 Step SC5
Proceed to. In step SC5, it is determined whether or not the reject switch SR has been turned on. The reject switch SR is a switch arranged on the operation panel of the apparatus main body 2, and is for setting whether or not to provide a "dead zone" according to the switch operation. Here, when the switch SR is turned on, the chroma key detection block stored in the initial screen map is regarded as a “dead zone”.

That is, in step SC5,
When the reject switch SR is set to ON, the determination result is "YES", and the next step SC6
Proceed to. At step SC6, the block attribute corresponding to the values of the registers X and Y is read from the initial screen area E1. Next, in step SC7, it is determined whether the block attribute read from the initial screen area E1 is "1". Here, when the block attribute is “1”, the determination result is “YES”, the process proceeds to step SC3 described above, and the block attribute is changed to “0”,
Then, the changed block attribute is written in the processing screen area E2 in accordance with the values of the registers X and Y via step SC4. As a result, the chroma key detection block stored in the initial screen map is set to the "dead zone".

When the reject switch SR is not set to ON, that is, when the "dead zone" is not set, the determination result of step SC5 is "NO", and the routine proceeds to step SC8. In step SC8, the attribute of the corresponding block is set to "1" based on the result determined in step SC2 described above, and then the block attribute is set in accordance with the values of the registers X and Y via step SC4. Write in the processing screen area E2.

Operation of Collision Coordinate Detection Routine Next, the operation of the collision coordinate detection routine will be described with reference to FIG. When the processing screen map is created as described above, the position detection processing unit 40 performs step SA6 (see FIG. 1).
The collision coordinate detection routine is executed via (see 0). In this routine, the presence or absence of a collision between the bat BAT image of the real image subjected to the chroma key detection and the object image (ball image) in the CG image is detected. First, when the routine is executed, the processing section 40 executes step SD.
1 to the register X, from the processing screen area E2.
The block attribute corresponding to the value of Y is read. Then, when the process proceeds to step SD2, the read block attribute is "1", that is, the bat BAT where the chroma key is detected.
Determine if it is an image. Here, when the block attribute is not "1", the determination result is "NO", and it is determined that a collision cannot occur, and this routine is once terminated.

On the other hand, the read block attribute is
When it is “1”, the judgment result is “YES”, and the next
The process proceeds to step SD3 of. In step SD3
Register the CG data written in the line buffer.
Data is read according to the values of X and Y. CG data referred to here
Is the object image data D in the CG image._OBCorresponding to
Signal YSOBJ to be used. The signal YSOBJ is
Also supplied from the VDP 31 (see FIG. 3) to the processing unit 40.
Of. Then, when the process proceeds to the next step SD4, the process
The unit 40 determines whether the read CG data is “1”.
to decide. At this time, the CG data must be "1".
For example, the block read according to the values of registers X and Y
Is the object image data D O_BWill not overlap
Therefore, the judgment result is “NO”, indicating that there is no collision.
Exit the routine.

On the other hand, if the read CG data is "1", the determination result of step SD4 is "YES",
Go to step SD5. In step SD5, it is determined whether or not the collision flag CF is "0". Collision flag C
F is “1” when the bat BAT image of the actual image and the object image (ball image) of the CG image overlap each other. Here, when the flag CF is "0", that is, when the collision of both images is recognized for the first time, the determination result is "YES", and the next step SD6.
Proceed to. At step SD6, the first detected first X coordinate is stored in the collision coordinate area E7, and subsequently at step SD7, the corresponding first Y coordinate is stored in the same area E7. Then, in step SD8, the collision flag CF is set to "1". When the collision flag CF becomes "1" in this way, the processing unit 40 issues an interrupt request to the CPU 51 side, and in response to this, the CPU 51 executes the collision interrupt process (described later). On the other hand, if the result of the determination in step SD5 is "NO", that is, if the collision of both images has already been recognized, the process proceeds to step SD9, in which the last detected second X coordinate is set in the collision coordinate area. Stored in E8, and subsequently in step SD10, the corresponding second Y coordinate is stored in the same area E7.

Operation of Coordinate Detection Routine Next, the operation of the coordinate detection routine will be described with reference to FIG. By the collision coordinate detection routine described above,
When the collision coordinates of the bat BAT image of the real image subjected to the chroma key detection and the object image (ball image) in the CG image are detected, the position detection processing unit 40 causes the position detection processing unit 40 to perform step SA.
The coordinate detection routine is executed via 11 (see FIG. 10), and the process proceeds to step SE1. In step SE1, the registers X and Y, the registers X ′ and Y ′, and the register S are reset to zero and initialized. In addition,
The register S has a bat B formed by accumulating the number of blocks.
The area of the AT image is stored. Also, registers X'and Y '
The value stored in will be described later.

Next, when proceeding to step SE2, the processing section 40 reads out the block attribute corresponding to the values of the registers X and Y from the processing screen area E2, and then step SE2.
The process proceeds to 3. In step SE3, it is determined whether or not the read block attribute is "1", that is, the chroma key detected bat BAT image. here,
When the block attribute is not "1", the determination result is "N
"O" and the process proceeds to step SE4. At step SE4, the value of the register X is incremented by 1 to advance. Then, in step SE5, it is determined whether or not the value of the register X is "96", that is, the block attribute for one horizontal (scanning) line is read. Here, if the reading for one horizontal line is not completed, the determination result is "NO", and the process is returned to the step SE2 again.

Then, for example, if the read block attribute is "1", the determination result of step SE3 is "YE."
S ”, and the process proceeds to step SE6. In step SE6, it is determined whether the value of register X is larger than the value of register X '. The previously detected X coordinate is set in the register X ', and the right end / left end coordinates are updated according to the result of comparison between this coordinate value and the present coordinate value. That is, when the determination result here is "NO", the flow proceeds to step SE7, the value of the register X is stored in the left end coordinate area E5 (see FIG. 9), and the bat BAT is stored.
Update the left edge coordinates of the image. On the other hand, when the determination result of step SE6 is "YES", the process proceeds to step SE8, the value of the register X is stored in the right end coordinate area E6 (see FIG. 9), and the right end coordinate of the bat BAT image is updated.

Next, in step SE9, the processing section 40 determines whether or not the value of the register Y is larger than the value of the register Y '. Here, in the register Y ', similarly to the register X', the previously detected Y coordinate is set, and the upper end / lower end coordinates are updated according to the result of comparison between this coordinate value and the present coordinate value. ing. That is, when the determination result is “NO”, the process proceeds to step SE10,
The value of the register Y is stored in the upper end coordinate area E3 (see FIG. 9) and the upper end coordinate of the bat BAT image is updated. on the other hand,
When the determination result in step SE9 is "YES", the flow proceeds to step SE11, the value of the register Y is stored in the lower end coordinate area E4 (see FIG. 9), and the lower end coordinate of the bat BAT image is updated.

Then, at step SE12, the value of the register S is incremented by 1 to increase the area by 1 block. Then, in step SE13, the values of the registers X and Y are rewritten into the registers X'and Y ', respectively. Thus, the processing of steps SE2 to SE13 is 1
When the horizontal line is completed, the determination result of the above-mentioned step SE5 becomes "YES", and the process proceeds to step SE14,
The value of register X is reset to zero and register Y
Increments the value of. Next, in step SE15, it is determined whether the value of the register Y is "96", that is, whether or not the coordinates of one frame have been detected. Then, when the coordinate detection for one frame is not completed, the above-mentioned step SE2 and subsequent steps are repeated. On the other hand, when the processing is completed, the processing is returned from this routine to the above-mentioned main routine (see FIG. 12).

Operation of Center of Gravity Calculation Routine When the coordinate detection routine detects the left end / right end coordinates and the upper end / lower end coordinates of the chroma key-detected bat BAT image, the position detection processing unit 40 proceeds to step SA1.
The center of gravity calculation routine shown in FIG. 15 is executed via 2, and the process proceeds to step SF1. First, in step SF1, the registers XG and YG are reset to zero. The registers XG and YG store the barycentric coordinates of the bat BAT image calculated based on the blocks detected by the chroma key. Next, in step SF2, the registers X and Y are initialized, and subsequently, in step SF3, the block attributes corresponding to the values of the registers X and Y are read from the processing screen area E2.

Next, in step SF4, the processing unit 4
0 determines whether or not the read block attribute is "1", that is, the bat BAT image subjected to the chroma key detection. Here, when the block attribute is not "1", the determination result is "NO", and the process proceeds to step SF5. At step SF5, the value of the register X is incremented by 1 to advance. Then, in step SF6, it is determined whether or not the value of the register X is "96", that is, the block attribute for one horizontal (scanning) line is read. Here, when the reading for one horizontal line is not completed, the determination result is “NO”, and the process is returned to the step SF3 again.

Then, for example, assume that the next read block attribute is "1". Then, step SF
The determination result of 4 is "YES", and the processing unit 40 advances the processing to step SF7. In step SF7, the block in which the chroma key is detected is regarded as a mass point, and the center of gravity is calculated by sequentially accumulating the ratio of the coordinates (X, Y) of this block and the area S. The area S is stored in the register S in the coordinate detection routine described above. Next, in step SF8, the barycentric coordinates are updated according to the barycenter calculation result in step SF7, and subsequently, in step SF5, the value of the register X is incremented.

Here, assuming that the reading for one horizontal line is completed, the determination result of step SF6 is "YES".
In step SF9, the value of register X is reset to zero and the value of register Y is incremented by one.
Next, in step SF10, it is determined whether or not the value of the register Y is "96", that is, whether the gravity center calculation for one frame has been performed. When the calculation of the center of gravity for one frame is not completed, the determination result is “NO”,
The processing from step SF3 onward is repeated. on the other hand,
When the calculation of the center of gravity for one frame is completed, the determination result is "YES", the routine is terminated and the process returns to the main routine (see FIG. 10).

As described above, in the position detection processing section 40,
Sampling image data D _S supplied from the imaging unit 1 side
The bat BAT image contained in the chroma key detection signal CR
Create a processing screen map for each frame based on O,
According to the block attribute read from the processing screen map, the collision coordinate position between the bat BAT image and the object image (ball image), the left end / right end coordinates and the upper end / lower end coordinates of the bat BAT image on the processing screen are obtained, and The position of the center of gravity is calculated.

(2) Operation of control unit 50 (CPU 51) Next, based on various data supplied from the position detection processing unit 40 described above, a wide visual field range is set and a game operation is controlled while maintaining detection accuracy. The operation of the CPU 51 will be described with reference to FIGS. Here, the CPU main routine will be described first, and then various interrupt processing routines of the CPU 51 will be sequentially described.

Operation of Main Routine First, when the apparatus main body 2 is powered on, the CPU 51 reads out and loads the operation system program stored in the ROM 53, and then the game cartridge 5
5, the application program is read from the ROM 55a built in 5, and loaded in the RAM 52. As a result, the CPU main routine shown in FIG. 16 is started, and C
The process of the PU 51 proceeds to step SG1. Step SG
In 1, the various registers secured in the RAM 52 are initialized, and the control signal SC designating initialization is supplied to the VDP 31 and the position detection processing unit 40. Next, when proceeding to step SG2, while supplying the control signal SC which gives the interrupt permission to each part, the interrupt mask of itself is released.

Next, the CPU 51 forms an initial screen at the start of the game through steps SG3 to SG7. That is, when proceeding to step SG3, the CPU 51 sets the transfer destination address and the transfer source address in the DMA controller in order to DMA transfer the background image data D _BG which is the initial screen background to the VDP 31.
The DMA transfer is performed by an interrupt process synchronized with the vertical blanking period on the display 3 (see FIG. 1) side. The DMA controller in which the transfer command is set is the CPU 5
Under the instruction of 1, the background image data D _BG corresponding to the transfer source address is read from the ROM 55a (see FIG. 3) and DMA-transferred to the VDP 31 (VRAM 32). Such interrupt processing will be described later.

Next, when proceeding to step SG4, the CPU
Reference numeral 51 sets the transfer destination address and the transfer source address in the DMA controller in order to DMA transfer the object image data D _OB 1 displayed on the screen background to the VDP 31. The object image data D _OB 1 corresponds to a “cursor” displayed on the screen background and is moved and displayed corresponding to a predetermined portion (for example, an upper end portion) of the bat BAT image detected by the chroma key. It is something. Then, in step SG5, the data D _OB 1
The transfer destination address and the transfer source address of the object table data T _OB 1 corresponding to are set in the DMA controller. This object table data T _OB 1
Is for designating a display position of the object image data D _OB 1 on the initial screen, that is, a display position corresponding to a predetermined portion (for example, an upper end portion) of the bat BAT image subjected to chroma key detection as described above, It is stored in the object table RAM 31f (see FIG. 8).

In step SG6, the object image data D _OB 2 displayed on the background of the initial screen is set to VDP31.
In order to perform the DMA transfer to, the transfer destination address and the transfer source address are set in the DMA controller. The object image data D _OB 2 is formed from a character image that imitates a “pitcher” and a “ball image” that this character image has. Then, when proceeding to step SG7, the CPU 51
Sets the transfer destination address and the transfer source address of the object table data T _OB 2 corresponding to the data D _OB 2 in the DMA controller. As a result, the preparation for forming the initial screen is completed, and the background image data D _BG and the object image data D are generated for each vertical blanking period.
_OB 1, D _OB 2 and object table data T
_OB 1 and T _OB 2 are DMA-transferred, and the VDP 31 generates image processing data D _SP based on them.

When the initial screen is formed in this way,
The CPU 51 drives and controls the support mechanism unit 14 via steps SG8 to SG11 to position the “bat BAT” image detected by the chroma key at the center of the imaging visual field. That is,
When proceeding to step SG8, the CPU 51 reads the upper end coordinates, the lower end coordinates, the left end coordinates, and the right end coordinates of the “bat BAT” image from the position detection processing unit 40 side, and based on the arithmetic mean of these coordinate values, the central coordinates of the “bat BAT” image. (Rx, R
Calculate y). The center coordinates (Rx, R
As shown in FIG. 18, y) is the coordinate position within the captured image area currently captured by the image capturing unit 1.

Next, in step SG9, the center coordinates (Gx, Gy) in the global coordinate system are obtained based on the camera position information stored in the registers Cx, Cy and the center coordinates (Rx, Ry). The camera position information stored in the registers Cx and Cy is the step motor 14b, which drives the above-mentioned two-axis rotary table 14a, respectively.
14c (see FIG. 5). The global coordinate system means a range that can be taken by the captured image area of the image capturing unit 1 driven by the support mechanism unit 14. Therefore, the center coordinates in the global coordinate system are (Rx + Cx, Ry + Cy), which is obtained by adding the center coordinates (Rx, Ry) to the values of the registers Cx, Cy, as shown in FIG. Then, in step SG9, the obtained center coordinates (Rx + Cx, Ry + Cy) in the global coordinate system are set in the registers Gx and Gy, respectively.

Next, when proceeding to step SG10, CP
U51 is the center coordinates (Rx, R) of the "Bat BAT" image.
y) and the center point coordinates (RCx, R in the current captured image area)
The difference (Mx, My) with Cy) is calculated. This difference (Mx, My) is the center coordinate (R of the “bat BAT” image).
(x, Ry) corresponds to the amount of movement to position the center of the captured image area after changing the visual field direction. Then, in step SG11, drive pulse signals respectively corresponding to the differences (Mx, My) are generated, and the step motors 14b, 14 are driven.
supply to c. As a result, the above-mentioned two-axis rotary table 14a is driven by the step motors 14b and 14c to pan the imaging unit 1, and the center coordinates of the "bat BAT" image are located at the center point of the captured image area. Then, according to the processing of steps SG8 to SG11,
There is no risk of the chroma key image deviating from the imaging field of view and causing a malfunction, and since it is not necessary to widen the viewing angle so that the chroma key image does not deviate from the imaging field of view, a wide field of view range can be set without degrading detection accuracy. It is possible to do.

Next, when proceeding to step SG12, the transfer flag F1 set in the register ACKF1 is "0".
Or not. The transfer flag F1 indicates whether or not the object table data T _OB 1 transferred and set in step SG5 described above has been DMA-transferred. When the flag F1 is “0”, the DMA is carried out.
It means that the transfer is completed, and when it is "1", it means that the transfer is not completed. When the flag F1 is "0", the determination result of this step SG12 is "YES", and the process proceeds to the next step SG13. In step SG13, the obtained center coordinates (R
x, Ry) are temporarily stored in the registers Rx, Ry,
The DMA transfer is set by using these as address data.

Next, when proceeding to step SG14, the CPU
The 51 sets "1" in the register ACKF1 and advances the processing to the next step SG15. Further, when the transfer flag F1 stored in the register ACKF1 is "1" in the step SG12, the step SG15 is also executed.
Proceed to. When the process proceeds to step SG15, the CPU 5
1 determines whether a start event has occurred. The start event mentioned here is an event that occurs when a start switch provided on the operation panel of the apparatus body 2 is turned on. Then, when the player turns on the start switch in order to start the game, the start event is generated. Therefore, the determination result here is "YES", and the process proceeds to step SG16.

In step SG16, the register t is reset to zero to be initialized, and then the process proceeds to step SG17 where "1" is set in the register STF and the process proceeds to the next step SG18. On the other hand, when the start event is not generated, the determination result of step SG15 is “NO”, and the process proceeds to step SG18. A time count value for managing the progress of the game is set in the above-mentioned register t by an interrupt operation described later.

In step SG18, it is determined whether or not the value of the register STF is "1", that is, whether or not the start flag indicating whether or not the game has started is set to the game start state. Here, if "1" is not set, the determination result is "NO", and steps SG8 to SG17 described above are repeated until a start event is generated.
When the start event occurs, step SG
The determination result of 18 is “YES”, and the process proceeds to step SG19 shown in FIG. In step SG19,
It is determined whether the transfer flag F2 set in the register ACKF2 is "0". The transfer flag F2 is
It indicates whether or not the object table data T _OB 2 transferred and set in the above-mentioned step SG7 is DMA-transferred. When the flag F2 is “0”, it indicates that the DMA transfer is completed, and when it is “1”, it indicates. Indicates that it is in the untransferred state.

If the flag F2 is "0", the result of the determination in step SG19 is "YES",
The process proceeds to the next step SG20. Step SG2
At 0, the corresponding object table data T _OB 2 is calculated based on the value of the register t, that is, the time count value according to the progress of the game. As a result, the display position of the object image data D _OB 2 forming the game screen is determined. In this case, for example, the object image data D _OB 2 is formed from a character image that imitates a “pitcher” and a “ball image” that this character image has. next,
When proceeding to step SG21, the CPU 51 causes the VDP3 in advance.
A plurality of object image data D DMA-transferred to one side
A control signal SC that specifies the image data D _OB 2 corresponding to the time count value stored in the register t from among _OB 2.
Occurs. As a result, the object image data D _OB 2 corresponding to the position designated by the table data T _OB 2 on the game screen is displayed.

When the game screen is formed as described above, the CPU 51 proceeds to step SG22 to register A
The transfer flag F2 stored in CKF2 is set to "1", and the process proceeds to step SG23. In addition, when the determination result in step SG19 is “NO”, that is,
Even when the object table data T _OB 2 has already been DMA-transferred, the process proceeds to step SG23. In step SG23, it is determined whether or not a stop event has occurred. The stop event is an event that occurs when a stop switch provided on the operation panel of the apparatus body 2 is turned on. Then, when the player turns on the stop switch to stop the game, the stop event is generated, the determination result here becomes "YES", and the process proceeds to step SG24.

In step SG24, the start flag stored in the register STF is set to "0" to stop the game operation. After this, the CPU 51 continues to execute the above-mentioned steps SG8 to SG18 until the start event occurs.
Repeat the operation of. On the other hand, if the stop switch is not turned on in step SG23, the determination result here is "NO", and the process proceeds to step SG25. In step SG25, it is determined whether or not the time count value stored in the register t has reached the predetermined value T. Here, when the time count value has not reached the predetermined value T corresponding to the game end time, the determination result is "NO", and the process is returned to step SG8. On the other hand, when the time count value reaches the predetermined value T, the process proceeds to step SG26, where the time count value stored in the register t is reset to zero, and then the step SG
Return the process to 8.

Operation of Interrupt Processing Routine Next, operation of various interrupt processing routines executed by the CPU 51 will be described with reference to FIGS. a. Operation of Transfer Interrupt Processing Routine The CPU 51 gives a transfer instruction to the DMA controller (not shown) every time a vertical blanking signal is supplied from the clock driver 12 (see FIG. 3), and executes the transfer interrupt processing routine shown in FIG. Run. First, in step SJ1, it is determined whether or not the transfer flag F1 stored in the register ACKF1 is “1”, that is, whether the object table data T _OB 1 set by the DMA transfer is in the non-transfer state. Here, if the data T _OB 1 has already been DMA-transferred, the transfer flag F1 is “0”.
The determination result is “NO”, and the process proceeds to step SJ4 described later.

On the other hand, the object table data T _OB 1
Is not transferred, the judgment result is "YES",
The CPU 51 advances the process to the next step SJ2. In step SJ2, the center coordinates (Rx, Ry) of the bat BAT image stored in the registers Rx, Ry are read out, and these are set as object table data T _OB 1 in VDP3.
DMA transfer to 1 side. As described above, this object table data T _OB 1 represents the display position of the “cursor” on the initial screen, and corresponds to the center coordinate position of the bat BAT image detected by the chroma key. Therefore, based on the operation of this step SJ2, the bat B
A "cursor" corresponding to the center coordinate position of the AT image is displayed in the initial screen.

Next, when proceeding to step SJ3, the transfer flag F1 stored in the register ACKF1 for indicating the completion of the DMA transfer of the object table data T _OB 1.
Is set to "0" and the process proceeds to the next step SJ4.
In step SJ4, the value of the transfer flag F2 stored in the register ACKF2 is "1", that is, whether or not the object table data T _OB 2 transferred and set in step SG7 (see FIG. 16) described above is in the untransferred state. To judge. Here, the data T _OB 2 is already DMA
If the transfer has been completed, the transfer flag F2 is "0", so the determination result is "NO", the routine is completed, and the process returns to the CPU main routine.

On the other hand, the object table data T _OB 2
Is not transferred, the judgment result is "YES",
The process proceeds to the next step SJ5. In step SJ5, the object image data D _OB 2 that is transferred set to the DMA controller and DMA transfers to the VDP31 side, followed by the object table data T _OB 2 corresponding to the data D _OB 2 step SJ6 to DMA transfers. Next, when proceeding to step SJ7, the CPU 51 sets the transfer flag F2 stored in the register ACKF2 to "0".
To complete this routine. As described above, in the transfer interrupt processing routine, the object table data T _OB 2 representing the “cursor” position is DMA-transferred to the VDP 31 according to the transfer flag F1 set in the register ACKF1 and set in the register ACKF2. Object image data D _OB 2 and object table data T _OB that form a CG image according to the transfer flag F2
2 is DMA-transferred to VDP31.

B. Operation of Collision Interrupt Processing Routine In the CPU 51, the time count value according to the progress of the game
Object image data that forms the game screen based on
TA D_OB2 and object table data T O_BOrder 2
It is controlled so that the next DMA transfer is performed, while VDP31
On the side, these data D_OB2, T_OBObject corresponding to 2
Image and BAT BAT image with chroma key detection combined.
CG image that changes from moment to moment is generated. This time,
In the position detection processing unit 40, the collision coordinate detection processing routine described above is executed.
Based on the movement of the arc (see Fig. 13),
The presence or absence of a collision with the "ball image" is detected at any time. And
When the position detection processing unit 40 detects a collision, a collision flag
By setting CF to "1", the CPU 51
The collision interrupt processing routine shown in 0 is executed, and step S
The process proceeds to K1.

First, in step SK1, it is judged whether or not the time count value set in the register t is within the range of predetermined values T _{1 to} T ₂ . The time count value is
This value is counted immediately after the start of the game and manages the progress of the game. Further, the predetermined value T _{1 to} T _{2 referred} to here is
It refers to the effective period when the "bat image" and the "ball image" meet. That is, in this step SK1, it is determined whether or not the timing at which the “bat image” and the “ball image” collide is within the effective period of the meet. Here, for example, if the player swings the bat BAT early or delays the swing, the timing of the collision will fall outside the effective period of the meet, so the determination result is "NO", and this routine is completed. .

On the other hand, if the collision timing is within the valid period of the meet, the determination result is "YES",
The process proceeds to the next step SK2. In step SK2, the barycentric position of the “bat BAT image” detected by the chroma key, that is, the barycentric coordinate from the barycentric coordinate area E9 in the work RAM of the position detection processing unit 40 is fetched. Then, it is determined In step SK3, the center of gravity of the "ball image" formed from the object image data D _OB 2, the correspondence relationship between the position of the center of gravity of the chroma key detected "Bat BAT picture". Here, if the barycentric positions of both agree with each other, the process proceeds to step SK4, and a first image processing routine described later is executed. When the center of gravity of the “ball image” is located below the center of gravity of the “bat BAT image”, the process proceeds to step SK5 and the second image processing routine described later is executed. Further, when the center of gravity of the “ball image” is located above the center of gravity of the “bat BAT image”, the process proceeds to step SK6, and the third image processing routine described later is executed. Then, thereafter, in step SK7, the collision flag CF is returned to "0", and the process returns to the main routine.

C. Timer Interrupt Processing Routine Next, the operation of the timer interrupt processing routine for generating a time count value for managing the progress of the game will be described with reference to FIG.
This will be described with reference to FIG. The CPU 51, based on the system clock supplied from the system clock circuit 24,
This routine is started every predetermined period, step SM1 is executed, and the time count value stored in the register t is incremented by 1 to advance. As a result, the time count value is successively incremented from the beginning of the game, and the progress of the game is managed.

D. Operation of Image Processing Routine Next, operation of the above-described first to third image processing routines will be described with reference to FIGS. FIG. 22 is a flowchart in which the processing contents of these first to third image processing routines are shared. First, in step SL1, the display position of the object image data D _OB 2 (“ball image”) is calculated based on the time count value stored in the register t, and then in step SL2, the display position is determined according to the time count value. Designated object image data D _OB 2.

Therefore, in the first image processing routine, the center of gravity of the “ball image” and the center of gravity of the “bat BAT image” match, so that, for example, a “home run” will occur as in the actual batting. A "ball image" is displayed in the CG image. Further, in the second image processing routine, as shown in FIG. 23, the center of gravity of the “ball image” is the batting located below the center of gravity of the “bat BAT image”, so that, for example, “goro” is set. The "ball image" is displayed in the CG image. Further, in the third image processing routine, as shown in FIG. 24, since the center of gravity of the “ball image” is batting located above the center of gravity of the “bat BAT image”, for example, “fly” is set. The "ball image" is displayed in the CG image.

In this way, when the CG image is generated according to the correspondence relationship between the barycentric position of the "ball image" and the barycentric position of the "bat BAT image", the CPU 51 advances the process to step SL3. In step SL3, register ACKF
The transfer flag F2 stored in 2 is set to "1" to indicate that the object image data D _OB 2 has not been transferred yet, and then the process proceeds to step SL4. In step SL4, it is determined whether or not the time count value stored in the register t has reached the game end value END.

Here, when the time count value reaches the game end value END, the determination result is "YES", the flow proceeds to step SL5, the time count value is reset to zero, and this routine is completed. On the other hand, when the time count value is less than the game end value END, the determination result of step SL4 is “NO”, and the process proceeds to step SL6. In step SL6, it is determined whether or not a stop event has occurred. Here, when the stop event has not occurred, the determination result is “NO”, and the above steps SL1 to SL3 are repeated. On the other hand, when a stop event occurs, the determination result is "YES", the process proceeds to step SL7, the start flag stored in the register STF is set to "0", and this indicates that the game is over. Complete the routine.

As described above, in this embodiment, the CPU 51
In order for the BAT BAT image detected by the chroma key to always fit in the center of the imaging field of view, the support mechanism 14 on which the imaging unit 1 is mounted is pan-controlled in the elevation direction and the azimuth direction. Therefore, there is no risk that the chroma key image will deviate from the imaging field of view and cause a malfunction, and since it is not necessary to widen the viewing angle so that the chroma key image does not deviate from the imaging field of view, the detection accuracy will not be degraded and the wide field of view will be reduced. It is possible to set the range.

In the embodiment described above, the panning control of the image pickup unit 1 is performed so that the center of the chroma key image detected for each image pickup frame falls within the center of the image pickup visual field. Then, focus on one point of the detected chroma key image, for example, one of the upper end coordinate, the lower end coordinate, the left end coordinate, and the right end coordinate, extract the motion vector of the focused point, perform the dynamic prediction of the chroma key image, and make the prediction. Based on the result, the imaging unit 1 may be pan-controlled to always capture the chroma key image in the center of the imaging field of view, in which case a better response is obtained. Further, when the amount of movement of the image pickup unit 1 in the elevation direction and the azimuth direction is large, the coordinate system of the picked-up image area is distorted. Therefore, a means for correcting this distortion according to the amount of movement is provided to eliminate a chroma key detection error. It may be suppressed. Further, in the present embodiment, the image control device for simulating the “batting” operation is disclosed, but the gist of the present invention is not limited to the device, and the point is that the image control is performed according to the result of the chroma key detection. It is needless to say that the device is not limited to the game device and can be applied to various applied devices. It is possible to

[0101]

According to the present invention, when the visual field direction designating means designates the visual field direction so that the center point of the chroma key image extracted by the chroma key extracting means is located at the center of the imaging visual field, the visual field direction supporting means rotates while supporting the imaging means. The field-of-view direction setting means having a mechanism for driving dynamically sets the image-capturing field of view of the image-capturing means in the instructed direction, so that there is no possibility that the chroma key image deviates from the image-capturing field and causes a malfunction, and the chroma-key image capturing field It is not necessary to widen the viewing angle so as not to deviate from the above, and as a result, a wide viewing range can be set without degrading the detection accuracy.

[Brief description of drawings]

FIG. 1 is an external view showing an overall configuration of an image control apparatus according to an embodiment of the present invention.

FIG. 2 is a diagram for explaining the outline of the embodiment.

FIG. 3 is a block diagram showing an electrical configuration of the embodiment.

FIG. 4 is a block diagram showing a configuration of an image pickup signal processing unit 11 in the embodiment.

FIG. 5 is a perspective view showing a schematic configuration of a support function portion 14 in the embodiment.

FIG. 6 is a block diagram showing a configuration of a video signal processing unit 20 in the embodiment.

7 is a diagram for explaining a chroma key signal generation circuit 20f in the video signal processing unit 20. FIG.

FIG. 8 is a block diagram showing a configuration of a VDP 31 in the embodiment.

FIG. 9 is a memory map for explaining the contents of the work RAM of the position detection processing unit 40 in the embodiment.

FIG. 10 is a flowchart showing an operation of a main routine in the position detection processing section 40.

FIG. 11 is a flowchart showing an operation of an initial screen map creation routine in the position detection processing unit 40.

FIG. 12 is a flowchart showing an operation of a processing screen map creation routine in the position detection processing unit 40.

FIG. 13 is a flowchart showing an operation of a collision coordinate detection processing routine in the position detection processing section 40.

FIG. 14 is a flowchart showing the operation of a coordinate detection processing routine in the position detection processing section 40.

FIG. 15 is a flowchart showing an operation of a gravity center calculation processing routine in the position detection processing section 40.

FIG. 16 is a flowchart showing an operation of a CPU main routine in the embodiment.

FIG. 17 is a flowchart showing an operation of a CPU main routine in the embodiment.

FIG. 18 is an absolute coordinate system and BAT BAT in the same embodiment.
It is a figure for demonstrating the correspondence with an image.

FIG. 19 is a flowchart showing the operation of a transfer interrupt processing routine in the CPU 51.

FIG. 20 is a flowchart showing the operation of a collision interrupt processing routine in the CPU 51.

FIG. 21 is a flowchart showing the operation of the timer interrupt routine in the CPU 51.

FIG. 22 is a flowchart showing the operation of the n-th image processing routine in the CPU 51.

FIG. 23 is a diagram for explaining the operation of the n-th image processing routine in CPU 51.

FIG. 24 is a diagram for explaining the operation of the n-th image processing routine in CPU 51.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Image pick-up part (imaging means) 2 Device main body 3 Display 14 Support mechanism part (visual field direction setting means) 20 Video signal processing part 30 Image processing part 40 Position detection processing part (chroma key extraction means) 50 Control part 51 CPU (visual field direction setting) Means, visual field direction indicating means) BAT bat (operator)

Claims (4)

[Claims] 1. A field-of-view direction for setting an image-capturing field of the image-capturing means to an instructed direction, comprising an image-capturing means for capturing an image of a subject colored in a specific color and a mechanism for rotatably driving the image-capturing means. Setting means, chroma key extracting means for extracting a chroma key image corresponding to the subject from the captured image output by the image capturing means, and a center point of the chroma key image extracted by the chroma key extracting means is located at the center of the image capturing visual field. An image control apparatus, comprising: a visual field direction designating unit for designating a visual field direction to the visual field direction setting unit. 2. The field-of-view direction setting means includes a first rotary table that rotatably supports the image pickup means in an elevation angle direction, and a second rotation table that rotatably supports the image pickup means in an azimuth angle direction. 2. The image control apparatus according to claim 1, further comprising a table, wherein the visual field direction of the image pickup means is set according to the movement amount of the first and second rotary tables. 3. The chroma-key is calculated by averaging upper-end coordinates, lower-end coordinates, right-end coordinates, and left-end coordinates of a chroma-key image represented by a coordinate system in the picked-up image for each picked-up frame. 2. The image control apparatus according to claim 1, wherein a center point of the image is calculated, and the view direction is instructed to the view direction setting unit so that the calculated center point of the chroma key image becomes the center position of the captured image. 4. A field-of-view direction for setting an image-capturing field of the image-capturing means in an instructed direction, comprising an image-capturing means for capturing an image of a subject colored in a specific color and a mechanism for rotating the image-capturing means while supporting the image-capturing means. Setting means, chroma key extraction means for extracting a chroma key image corresponding to the subject from the imaged image output by the image sensing means, and a motion vector representing the moving direction of the chroma key image from the chroma key image extracted by the chroma key extraction means Then, the image control device further comprises a visual field direction instructing means for instructing a direction of the imaging visual field to a moving position of the chroma key image predicted according to the detected motion vector.