JP3407394B2 - Image display control apparatus and image display control method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display control device and an image display control method suitable for use in, for example, a video game for creating virtual reality.

[0002]

2. Description of the Related Art Conventionally, various image control devices have been put into practical use, which control a moving image of an object image or generate a sound effect in accordance with an operation of an operation pad or the like. In addition,
The object image mentioned here refers to a “character” displayed on the game screen, and is moved and displayed on the background screen as a background. This type of device is called a video game or a TV game, and a shooting game that asks a player's reflexes, a game that simulates a virtual reality, and the like are known.

Such a video game is composed of an image processing section for generating a video signal corresponding to a game operation and a display for displaying the video signal supplied from the image processing section. The image processing unit is a CPU, RO
M and RAM etc., for example, sequentially read out the image information and control information stored in the ROM pack,
A background image serving as a screen background is displayed on the display, and a corresponding character (object image) is displayed as a moving image on the screen background in response to a game operation, and a sound effect corresponding to the movement is pronounced.

[0004]

As described above, in the conventional image control apparatus, the display control of the object image is generally performed according to the operation of the operation pad, and the virtual reality is simulated. It is often unsuitable for playing games. That is, in order to pursue a virtual reality, it is necessary to perform image control in a form that matches the actual action. For example, in a simulation game in which a pitcher throws a ball on the screen and the player performs a batting operation based on this display screen, the "bat" becomes the operator instead of the operation pad.
The image is controlled according to the position or movement of the.

When performing such image control, a method of detecting the position and movement of the operating element by a well-known chroma key detection process is adopted. In this case, the chroma key detection processing means that in this case, the "bat (operator)" is colored in advance with a specific color, and the chroma key image of this specific color is extracted from the image of the player. The position and the movement of the operator held by the player are detected from the screen. By the way, in the chroma key detection processing, the shape of the chroma key image may change, or the image itself may blur or blink depending on the lighting condition at the time of image capturing or the change of the chroma key level. Therefore, for example, by pointing the "icon" set in the display screen by the chroma key image, you can set the operation mode of the game, etc.
Considering the image display control processing, there is a problem that the operability is deteriorated.

Therefore, the present invention has been made in view of the above circumstances, and an object thereof is to provide an image display control device and an image display control method capable of realizing an image display control process having extremely excellent operability. There is.

[0007]

In order to achieve the above-mentioned object, in the invention described in claim 1, a special feature is selected from the captured images.
Image extracting means for extracting a chroma key image of a constant color;
Display screen of chroma key image extracted by image extraction means
Position detection means for detecting the upper coordinate position and this position detection
Averages the coordinate positions of multiple frames detected by the means,
The first coordinate value averaged this time is the second average value previously averaged.
If the coordinates are within the specified range with the center value as the center value,
Is the second coordinate value as the display position, and the predetermined range is
If it exceeds, the position with the first coordinate value as the display position
Control means and a hand for generating an image corresponding to the display screen
On a background image that is a step and is the screen background
, The object image showing the predetermined shape is displayed at the display position.
Image processing means for moving and displaying the image according to the above.

According to the second aspect of the invention , an image is captured.
The converted image signal to a color difference signal, and
Generate a chroma key signal corresponding to a predetermined specific color from
Depending on the specific color discrimination means to be formed and the chroma key signal,
The chroma key image is extracted from the captured image and displayed on the display screen.
Coordinates of the top, bottom, left, and right edges of the chromakey image
Position detecting means for detecting a position, and at least the above-mentioned black
One of the top, bottom, left, and right edges of the Mackey image
The average coordinate position is acquired by capturing the coordinate positions of
While calculating, the first average value calculated this time is calculated last time.
Within the specified range with the second average value as the center value
The second average value as the display position,
If it exceeds the predetermined range, the first average value is displayed
Position control means and an image signal corresponding to the display screen.
Is a means to generate
Image and display on the background image
Image of the object image to be moved and displayed according to the position
And an image processing unit for synthesizing .

Further, in the invention according to claim 3, the position detecting means divides the picked-up image into blocks formed of a plurality of dots, and determines the presence or absence of the chroma key signal for each divided block. When a chroma key signal corresponding to a predetermined number of dots per block is detected, the block is regarded as a part of the chroma key image .

According to the invention described in claim 4 , the image pickup is performed.
Image Extraction to Extract Chromakey Image of Specific Color from Selected Image
And the black color obtained in the image extraction step.
A position detection switch that detects the coordinate position of the McKee image on the display screen.
Step and multiple frames detected by this position detection step.
The first coordinate that is averaged this time.
Where the value is centered on the second coordinate value averaged last time
Displays the second coordinate value if it is within the fixed range
Position, and on the other hand, if it exceeds the predetermined range, the first
A position control step in which coordinate values are used as display positions, and the display
The step of generating an image corresponding to the screen,
A predetermined shape is displayed on the background image that becomes the background.
The object image is moved and displayed according to the display position.
And an image processing step for performing the image processing .

Further, in the invention according to claim 5, the image pickup is performed.
The converted image signal is converted into a color difference signal, and
From the chromakey signal corresponding to the specific color
The specific color discrimination step to generate and the chroma key signal
The chroma key image is extracted from the captured image accordingly and displayed on the display screen.
The top, bottom, left and right edges of the chromakey image in question
Position detection step to detect the coordinate position of
Also the top, bottom, left and right edges of the chromakey image
The coordinate position of any one point is captured for multiple frames and flattened.
Calculate the uniform coordinate position and calculate the first flatness calculated this time.
Predetermined with the average value as the center value of the second average value calculated last time
If the value falls within the range, the second average value is displayed.
On the other hand, on the other hand, if it exceeds the specified range,
A position control step in which the average value is the display position,
The step of generating an image signal corresponding to the
The background image that becomes the background and the background
To move and display on the bound image according to the display position.
An image processing step for combining the image with the object image.
It is characterized by having . Claim as a preferred embodiment
In the invention of item 6, the position detecting step includes
Divide the captured image into blocks composed of multiple dots
And the chroma key for each divided block.
The presence / absence of a signal is discriminated, and a predetermined number of dots per block are paired.
Block when the corresponding chromakey signal is detected
Is regarded as part of the chroma key image .

[0012]

In the present invention, the image is extracted by the image extracting means.
A specific color chroma key image is extracted from the display and displayed by the position detection means.
The coordinate position of the chroma key image on the screen is detected.
Here, the position control unit flattens the coordinate positions for a plurality of frames.
The first coordinate value averaged this time is averaged
Within the specified range with the centered second coordinate value
If the second coordinate value is used as the display position,
If it exceeds the fixed range, the first coordinate value is regarded as the display position.
To do. Then, the image processing means becomes the background of the display screen.
The object that represents the specified shape is displayed on the background image.
The target image is moved and displayed according to the display position. You
In other words, the position control means makes the chromakey image blur or change.
Because the shape can be corrected, the chroma key is extremely easy to operate.
Implement input processing.

[0013]

[0014]

Embodiments of the present invention will be described below with reference to the drawings. A. Outline of Embodiments FIG. 1 is an external view showing an overall configuration of an image control apparatus according to the present invention, and illustrates an example applied to a game for simulating a batting operation. In this figure, reference numeral 1 denotes an image pickup unit including a solid-state image pickup device such as a CCD, which picks up an image of a player B located in a batter box (not shown). Here, the player B performs a batting operation using, for example, a bat BAT colored in blue for chroma key detection. Reference numeral 2 denotes an apparatus main body, which performs chroma key detection on the image pickup signal supplied from the image pickup unit 1 to determine the position of the bat BAT in the actual image coordinates. The actual image coordinates refer to an image captured by the image capturing unit 1. Also,
The device main body 2 synthesizes a background image which is a background scene of the game and an object image which is moved and displayed on the background image, and displays this on the display 3 as a computer graphic image (hereinafter, referred to as a CG image). indicate. In the display 3, for example,
A moving image of the throwing motion of the pitcher on the background scene and the flying motion of the ball corresponding to the throwing motion is displayed.

Further, as shown in FIG. 2 (a), the apparatus main body 2 obtains the position of the center of gravity of the ball from the position of the ball displayed in the CG image, while, as shown in FIG. The position of the center of gravity of the bat BAT image detected by the chroma key is calculated. Then, it is determined at every predetermined timing whether the “ball” in the CG image and the “bat BAT” in the actual image collide with each other. Depending on the hit condition. For example, as shown in FIG. 2B, if the positions of both centers of gravity coincide with each other at the time of the collision, a simulation close to reality is performed so that the just meat is “home run”.

B. Configuration of Embodiments Next, the electrical configurations of the imaging unit 1 and the apparatus main body 2 will be described with reference to FIG. (1) Configuration of Image Capturing Unit 1 The image capturing unit 1 is composed of components 10 to 13.
An oscillating circuit 10 generates and outputs an 8 times oversampling signal 8f _SC . An image pickup signal processing unit 11 supplies the 8 × oversampling signal 8f _SC to the clock driver 12 in the next stage and converts the image pickup signal output from the CCD 13 into the sampled image data D _S , the configuration of which will be described later. To do. The clock driver 12 generates various timing signals such as a horizontal drive signal, a vertical drive signal, a horizontal / vertical sync signal, and a blanking signal based on the 8 times oversampling signal 8f _SC supplied from the oscillator circuit 12. An image pickup drive signal corresponding to the horizontal drive signal and the vertical drive signal is generated to generate C
Supply to CD13. The CCD 13 picks up an image of an object according to the image pickup drive signal and generates an image pickup signal SS.

The image pickup signal processing section 11 conditions the image pickup signal SS supplied from the CCD 13 and then A
The _S / D conversion is performed to generate the sampled image data D _S , and its schematic configuration will be described with reference to FIG. In FIG. 4, 11a is a sampling circuit,
The image pickup signal SS is sampled according to the 4 × oversampling signal 4f _SC supplied from the clock driver 12 and output to the next stage. Reference numeral 11b is A for converting the sampled image pickup signal SS into a predetermined level and outputting it.
It is a GC (automatic gain control) circuit. Reference numeral 11c is a γ correction circuit which corrects the gamma characteristic of the image pickup signal SS to γ = 1 / 2.2 and outputs it. The reference numeral 11d denotes the gamma-corrected image pickup signal SS which is sampled image data D _S of 8-bit length.
Is an A / D conversion circuit for converting to and outputting. The sampling image data D _S is supplied to the video signal processing unit 20 described later. Reference numeral 11e denotes the composite video signal D _CV supplied from the video signal processing unit 20 and the analog video signal S
D / A converted to _V and output to the display 3 described above
It is a conversion circuit. The contents of the image processing data D _SP output from the video signal processing unit 20 will be described later.

(2) Structure of the device body 2 Next, referring to FIGS. 3 to 11, the structure of the apparatus main body 2 will be described.
Explain. The device body 2 includes a video signal processing unit 20 and an image processor.
Image processing unit 30, position detection processing unit 40, and control unit 50
These parts are described in detail below.
It Configuration of video signal processing unit 20 The video signal processing unit 20 is provided with a sample supplied from the image pickup unit 1.
Pulling image data D Color difference conversion processing and chroma for S
Key detection processing is performed and the result is the position detection processing described later.
It is supplied to the processing unit 40. The processing unit 20 will be described later.
Image processing data D supplied from the image processing unit 30_SPTo
Composite video signal D_CVConverted to D / A
It is supplied to the replacement circuit 11e (see FIG. 4). This image
Processing data D_SPIs the background image and the background
Object image that is moved and displayed on the background image
The image and the image are combined to form a CG image.

Here, the configuration of the video signal processing unit 20 which implements the above-mentioned respective processes will be described with reference to FIG. In FIG. 5, reference numeral 20a denotes a color separation filter, which supplies the sampling image data D _S to the signal Ye (yellow) and the signal Cy.
(Cyan) and signal G (green) are color-separated and output to the next stage. Reference numeral 20b is a contour correction circuit that adjusts the image quality by performing brightness modulation before and after the change point in the video signal. 20c is a white balance circuit for each signal Y
e, Cy, and G are set to specified levels and output. 20d
Is a separation filter composed of a bandpass filter, which converts each signal Ye and Cy into a signal R (red) and a signal B.
(Blue) is sorted and output. Reference numeral 20e designates signals R, G and B representing the three primary colors, a luminance signal Y and a color difference signal B each having a length of 8 bits.
This is a matrix circuit for converting into -Y and RY.

20f is a chroma key signal generating circuit,
When the color difference signals BY and RY reach a predetermined level, the "H" level chroma key detection signal CRO is generated.
That is, in this circuit 20f, as shown in FIG. 6, the maximum / minimum levels BY- _MAX and BY- _MIN of the color difference BY are obtained.
The maximum / minimum levels RY _MAX and R-Y _{MIN of} the color difference RY are predetermined, and when the color difference signals B-Y and RY fall within the color difference area E defined by these levels. ,
An "H" level chroma key detection signal CRO indicating that a specific color has been detected is output. In this embodiment, the area E is “blue”, and specifically, the image pickup unit 1 picks up an image of the bat BAT colored in blue so that the chroma key detection signal C at the “H” level is obtained.
RO is generated, and the signal CRO is detected by the position detection processing unit 40.
Is supplied to.

Reference numeral 20g denotes a luminance signal Y and color difference signals BY and R each having an 8-bit length, which are output from the matrix circuit 20e.
This is a color difference conversion circuit that converts −Y into a 4-bit long luminance signal Y ′ and 2-bit long color difference signals BY ′ and RY ′. In this circuit 20g, as shown in FIG. 7, three levels of threshold values R-Y _HIGH and R-Y axis and B-Y axis,
R-Y _MID , R-Y _LOW and threshold values B-Y _HIGH , B-
Y _MID and BY _LOW are set in advance, and the color difference signals BY and RY are coded into 2 bits in accordance with these threshold values. The lower 4 bits of the 8-bit luminance signal Y are discarded, and the upper 4 bits are set as the luminance signal Y '.

Reference numeral 20h is a matrix circuit for converting image processing data D _SP (RGB signals) supplied from the image processing section 30 (described later) into a luminance signal Y and color difference signals BY and RY. Reference numeral 20i denotes a selector, which selects either the output of the matrix circuit 20e or the output of the matrix circuit 20h according to a select signal SL supplied from a position detection processing unit 40 described later and supplies it to the next stage. Two
0j is a modulator. Modulator 20j the luminance signal Y, the color difference signal B-Y, the digital composite video signal by superimposing the various synchronization signals to the R-Y (horizontal / vertical synchronization signals and blanking signals) D _CV supplied through the selector 20i To generate.

According to the above configuration, the video signal processing section 20
Is the sampling image data D supplied from the imaging unit 1.
_S is a luminance signal Y ′, 2-bit color difference signals BY ′, R
While converting into −Y ′, a chroma key detection signal CRO is generated and supplied to the image processing unit 30 (described later) side. In addition, the processing unit 20 selects either the image processing data D _SP (RGB signal) input from the image processing unit 30 side or the sampling image data D _S supplied from the imaging unit 1 according to the select signal SL. The selected data is converted into a composite video signal D _CV and output. The select signal SL is the position detection processing unit 40 described later.
Is a signal supplied from.

Configuration of Image Processing Unit 30 Next, the configuration of the image processing unit 30 will be described. The image processing unit 30 includes a video data processor (hereinafter abbreviated as VDP) 31 and a VRAM 32. This VD
The basic function of P31 is to read the background image data D _BG and the object image data D _OB stored in the VRAM 32 according to a control signal SC supplied from the control unit 50 (described later) side, and to read this one scanning line. The purpose is to generate image processing data D _SP representing each dot display color. Hereinafter, the configuration of each unit will be described in detail with reference to FIG.

In the figure, reference numeral 31a is a CPU interface circuit, which is a constituent element 31 according to a control signal SC supplied via a bus of a CPU 51 constituting a control unit 50.
Various control instructions are given to b to 31d. The control signal SC is
It is formed from various commands for controlling the display of the background image and the object image, the background image data D _BG and the object image data D _OB which are DMA-transferred to the VRAM 32. Reference numeral 31b is a VRAM control circuit, which is composed of components 31a, 31c and 3a.
Data is exchanged with the VRAM 32 in response to the control signal supplied from 1d.

That is, when the control signal SC indicating the DMA transfer is received from the CPU interface circuit 31a, the background image data D _BG or the object image data D _OB DMA-transferred via the circuit 31a is received. Store in a predetermined storage area. When an instruction to read the background image data D _BG is received from the background control circuit 31c, the corresponding data D _BG is read and returned to the circuit 31c side. Similarly, when an instruction to read the object image data D _OB is received from the object control circuit 31d, the corresponding data D _OB is read and returned to the circuit 31d side.

Background control circuit 31c
Specifies the display position for the background image data D _BG read via the VRAM control circuit 31b based on the background display control command given from the control unit 50 side via the circuit 31a, It is supplied to the color difference data processing circuit 31e. In addition, the circuit 31c is configured such that the luminance signal Y ′ and the color difference signals BY ′ and RY ′ supplied from the video signal processing unit 20 described above, that is, the sampling image for one frame imaged by the imaging unit 1 Are stored in the VRAM 32 via the VRAM control circuit 31b. In other words, the captured image can be used as the background image data D _BG .

The object control circuit 31d is
The object table data T _OB given from the control unit 50 side via the circuit 31a is stored in the object table RA.
Write to M31f. The object table data T _OB is the object image data D on the display screen.
_This is coordinate data that specifies the display position of the _OB . Further, the circuit 31d refers to the object table data T _OB for the object image data D _OB read from the VRAM 32 in response to the object display control command, obtains the display position, and the object for one scanning line is obtained. Image data D _OB line buffer RAM 31g
Temporarily store in. The object image data D _OB temporarily stored in the line buffer RAM 31g is updated every scan. The object image data D _OB read from the RAM 31g is supplied to the color difference data processing circuit 31e.

The color-difference data processing circuit 31e refers to the well-known color look-up table RAM 31h to obtain 8-bit image data D _BG and D _OB supplied from the background control circuit 31c and the object control circuit 31d. The image processing data D _SP formed from the R signal, G signal, and B signal of bit length is converted and output. The color difference data processing circuit 31e
When the sampling image for one frame is supplied through the background control circuit 31c, generates the image processing data D _SP based on the configuration shown in FIG. As shown in FIG. 9, the circuit 31e converts the 2-bit color difference signals BY 'and RY' into 4-bit color difference signals BY and RY, respectively, and a BY table 31e-.
1 and an RY table 31e-2. These tables 31e-1 and 31e-2 are provided in the CPU 51, which will be described later.
The conversion table is rewritten by the. Specifically, for example, R- shown in FIG.
As in an example of the Y table 31e-2, a 4-bit color difference signal RY is output according to the input color difference signal RY '. In this figure, RY1 and RY0 represent the upper bit and the lower bit of the input color difference signal RY '.

Further, the color difference data processing circuit 31e is configured such that the BY table 31e-1 and the RY table 3 are
The output of 1e-2 and the luminance signal Y ′ are used as the image processing data D.
RGB conversion logic circuit 3 for converting to _SP (RGB signal)
1e-3 (see FIG. 9). This logic circuit 31
The e-3 generates an R signal, a G signal, and a B signal each having a 4-bit length according to the following equations (1) to (3). That is, R signal = luminance signal Y ′ + color difference signal RY (1) G signal = luminance signal Y ′ + color difference signal BY (2) B signal = luminance signal Y′−color difference signal RY / 2-color difference signal BY-3 / 16 (3)

Further, the color difference data processing circuit 31e is provided with the image processing data D generated based on the above-mentioned configuration.
_{In addition to SP} (RGB signal), signal YSBG and signal YSO
BJ is generated. This signal YSBG and signal YSOB
J is a signal indicating whether the currently output image processing data D _SP corresponds to the background image data D _BG or the object image data D _OB . For example, when the currently output image processing data D _SP corresponds to the background image data D _BG , the signal YSBG becomes “H (high)” and the signal YSOBJ becomes “L (low)”. On the other hand, on the contrary, if the image processing data D _SP corresponds to the object image data D _OB , the signal YS
BG becomes “L” and the signal YSOBJ becomes “H”.

As described above, in the image processing unit 30, the background image data D _BG and the object image data D _OB DMA-transferred from the control unit 50 side are stored in the VRAM 3.
2 in accordance with a control signal SC (various display control commands) supplied from the CPU 51.
Reads the image data D _BG or the image data D _OB from 2, while generating the image processing data D _SP representing the dot display color of one scan line per this signal YSBG and YSOBJ representing the attributes of the image processing data D _SP Is output.

Configuration of Position Detection Processing Unit 40 The position detection processing unit 40 includes a gate array formed by arranging a plurality of logic elements, a line buffer and a work RAM.
And the collision coordinate position between the chroma key image included in the sampling image data D _S and the object image formed by the object image data D _OB under the instruction of the control unit 50 described later, and these images. The position of the center of gravity and the like are logically calculated based on a predetermined logic. The line buffer (not shown) temporarily stores the chroma key detection signal CRO supplied from the video signal processing unit 20. The work RAM temporarily stores various calculation results which are logically calculated by the gate array.

The position detection processing unit 40 is provided with the signals YSBG and YSOB supplied from the image processing unit 30 described above.
Based on J, the above-mentioned select signal SL is generated and given to the video signal processing section 20, and the sampling image data D _S
The degree of overlap between the (actual image) and the image processing data D _SP (CG image), that is, the priority order (front-back relationship) of the images displayed on the screen is controlled. Further, the processing unit 40 includes the control unit 50.
Under the instruction, the register control signal S _REG is supplied to the image pickup signal processing unit 11, the video signal processing unit 20 and the VDP 31 described above, and the data set / reset of each unit register is controlled.

Next, referring to FIG. 11, the position detection processing unit 4
The work RAM in which various calculation results at 0 are stored will be described. In this figure, E1 is an initial screen area for temporarily storing data of an initial screen formed of 96 dots in the horizontal direction (scanning line) and 96 lines in the vertical direction. The data of the initial screen refers to the chroma key detection result existing in the scene captured before the start of the game. Chroma key detection color in the scene (eg blue)
If such an object exists, it may be mistakenly recognized as a part of the bat BAT (see FIG. 1) described above. Therefore, the data temporarily stored in the initial screen area E1 is used when the dot position detected by the chroma key is not mistaken for the bat BAT (see FIG. 1) when the dot position is set to the dead zone.

E2 is 96 dots in the horizontal direction and 96 dots in the vertical direction.
This is a processing screen area formed by lines, and the bat BAT image in which the chroma key is detected in the actual image and the object image (ball image in this embodiment) in the CG image are updated and stored for each frame. E3 to E4 are bat BATs on the processing screen that are updated for each frame.
These are the upper end coordinate area and the lower end coordinate area for temporarily storing the upper end / lower end positions of the image. E5 to E6 are the left end of the bat BAT image on the processing screen updated for each frame /
The left end coordinate area and the right end coordinate area temporarily store the right end position. E7 is the first collision coordinate area. The first collision coordinate area E1 represents the intersection point in the scanning line where the overlap (collision) of the bat BAT image and the object image (ball image) is first detected as coordinates on the processing screen. . In addition, the second collision coordinate area E8
Represents the intersection point in the scanning line where the overlap between the bat BAT image and the object image (ball image) is finally detected as coordinates on the processing screen.

E9 is a barycentric coordinate area, in which the barycentric position calculated based on the area of the bat BAT image detected by the chroma key in the actual image is stored as the coordinate position on the processing screen. E10 is an area area in which the area of the bat BAT image subjected to chroma key detection in the actual image is stored. The area set in the area area E10 is represented by the number of blocks. The block referred to here is a 12-dot area consisting of 6 dots in the horizontal direction and 2 lines in the vertical direction on the processing screen. When chroma key detection of "6 dots" or more is detected in the block formed from the 12 dot area, the block is regarded as the area of the bat BAT image.

Structure of Control Unit 50 Next, the structure of the control unit 50 will be described with reference to FIG. 3 again. The control unit 50 is composed of components 51 to 57. The CPU 51 performs a key scan on various operators provided on the operation panel of the apparatus body 2 and controls each part of the apparatus according to the operator signal KS generated in response to the key scan. It will be described later. This CPU5
1 has an internal timer, and manages the game progress based on the game counter value counted by the timer. The CPU 51 also includes a well-known DMA controller, and is configured to DMA-transfer various data (background image data D _BG and object image data D _OB ) necessary for game operation to the above-described image processing unit 30. There is. A RAM 52 is used as a work area for the CPU 51 to temporarily store various calculation results and flag values. Reference numeral 53 is a ROM that stores an OS (operating system) program that manages the operation of the CPU 51. Reference numeral 54 is a system clock circuit which generates a system clock that regulates the operation of the entire device under the control of the CPU 51.

Reference numeral 55 denotes a game cartridge which is removably attached to the main body 2 of the apparatus, and includes a ROM 55a and a first cartridge.
The sound source circuit 55b. ROM 55a
Is an application program loaded into the CPU 51. In this embodiment, as described above, the game program for simulating the batting practice is stored. 55b is a first tone generator circuit, which is a CPU
Based on the event data supplied from the 51 side via the position detection processing unit 40, a game sound effect corresponding to the game operation is synthesized and output to the CPU 51 as a tone signal. Reference numeral 56 is a second tone generator circuit, which synthesizes musical sounds corresponding to the progress of the game, for example, musical compositions such as opening and ending, and outputs them. Reference numeral 57 denotes a sound system, which filters the musical tone signals supplied from the first tone generator circuit 55b and the second tone generator circuit 56, such as noise removal, and then amplifies and outputs them.

The first and second sound source circuits 5 described above
The CPUs 51, 5b and 56 supply event information at predetermined timings to synthesize game sounds. Further, the CPU 51 side has a configuration in which the monitoring timer WT is reset each time a data request signal (described later) is supplied from the first and second sound source circuits 56 and 57, and when the monitoring timer WT overflows. If the game cartridge 55 is pulled out from the apparatus main body 2, the operation is stopped. As a result, the game cartridge 55 requires the first sound source circuit 55b that operates in cooperation with the CPU 51, and a game cartridge that does not have the circuit 55b does not allow the game operation. I'm trying to prevent the copy. Note that these points will be described later in detail.

C. Operation of Embodiment Next, the operation of the embodiment having the above configuration will be described.
Here, first, the operation of the position detection processing unit 40 described above will be described, and then the control unit 50 according to the gist of the present invention.
The operation of the (CPU 51) will be described. (1) Operation of Position Detection Processing Unit 40 Here, the operation of the position detection processing unit 40 configured by the gate array will be described with reference to FIGS. 12 to 17. In this processing unit 40, under the instruction of the control unit 50,
Bat BAT included in the sampled image data D _S
The image is detected based on the chroma key detection signal CRO, and the collision coordinate position between the bat BAT image and the object image (ball image) formed by the object image data D _OB and the center of gravity position of these images are determined. The details of such operation will be described below.

Operation of Main Routine First, it is assumed that the apparatus main body 2 is powered on and the control signal SC representing the system reset is supplied from the CPU 51 side to the position detection processing section 40. Then, the position detection processing unit 40 loads the microprogram set therein, starts the main routine shown in FIG. 12, and executes step SA1 based on the control signal SC. In step SA1, while resetting its own internal register or performing initialization to set an initial value, the imaging signal processing unit 11, the video signal processing unit 20, and the VDP
A register control signal S _REG for instructing a register set is supplied to each 31 and the process proceeds to the next step SA2.

At step SA2, "initial screen map"
Is created. Where, for example,
When the "initial screen map" is not created, the determination result is "NO", and the process proceeds to the next step SA3. The “initial screen map” means that the bat BAT is displayed in the screen imaged by the imaging unit 1 prior to the start of the game.
This is for confirming whether or not there is an object of the same color (see FIG. 1). Then, when the process proceeds to step SA3,
Chroma key detection results for multiple frames are overlaid, and this is used as the initial screen area E1 of the work RAM (see FIG. 11).
Create a “initial screen map” that stores the chroma key detection blocks existing in the initial screen as “dead zones”.

When the "initial screen map" is created in this way, the position detection processing unit 40 proceeds to the next step S
The process proceeds to A4. When the "initial screen map" is prepared in advance, the result of the determination in step SA2 is "YES", and the process proceeds to step SA4. At step SA4, the values of the registers X and Y are reset to zero. A value corresponding to screen coordinates formed by 96 dots in the horizontal direction and 96 lines in the vertical direction is sequentially set in the registers X and Y according to the processing content.

Next, in step SA5, the position detection processing section 40 performs chroma key detection for each block on the chroma key detection signal CRO temporarily stored in the line buffer. The block-by-block chroma key detection means the chroma key detection signal CRO read from the line buffer.
Is divided into blocks each consisting of 6 dots in the horizontal direction and 2 lines in the vertical direction, and the "H" level chroma key detection signal CR
When O is present in “6 dots” or more per block, the attribute of the block is regarded as “with chroma key”. The result of such chroma key detection is stored as a block attribute in the above-mentioned processing screen area E2 (see FIG. 11), and this becomes a “processing screen map”.

Next, when the chroma key detection for each block unit is performed, the position detection processing unit 40 proceeds to the next step S.
Proceed to A6, and the bat BA of the actual image with chroma key detection
The presence or absence of a collision between the T image and the object image (ball image) in the CG image is detected, and in the case of collision, the collision coordinates are obtained. Then, when proceeding to step SA7, the processing unit 40 increments the value of the register X by 1, and subsequently, at step SA8, the value of the register X is "96",
That is, it is determined whether the processing for one scanning line is completed. Here, when the value of the register X has not reached "96", the determination result becomes "NO", and the steps SA5 to SA7 are repeated until the processing for one scanning line is completed.

On the other hand, when the processing for one scanning line is completed, the judgment result here becomes "YES", and step S
In step A9, the value of the register X is reset to zero again and the value of the register Y is incremented by 1 to update the scan line in the vertical direction. Then, when the processing proceeds to step SA10, the processing unit 40 determines whether or not the value of the register Y is "96". Here, the value of the register Y is "96".
If not, the judgment result is “NO”,
The above steps SA5 to SA9 are repeated. And
When the scanning for one frame is completed, the determination result here becomes "YES", and the process proceeds to step SA11.

In step SA11, the above step SA
5, the left edge / right edge coordinates and the upper edge / lower edge coordinates of the bat BAT image are calculated based on the blocks detected by the chroma key, and these are stored in the storage areas E3 to E6 of the work RAM.
The area of the bat BAT image is calculated from the number of blocks detected by the chroma key, while storing in (see FIG. 11). The storage areas E3 to E4 temporarily store the upper and lower end positions of the bat BAT image on the processing screen updated for each frame, and the storage areas E5 to E6 respectively store 1
The left edge / right edge position of the bat BAT image on the processing screen updated for each frame is temporarily stored. The area of the bat BAT image calculated from the number of blocks is equal to the storage area E1.
Stored in 0.

When the bat BAT image is chroma key detected from the real image in this way, the process proceeds to step SA12, the center of gravity position of the bat BAT image is obtained, and then step SA1.
3 determines whether the interrupt flag is "1",
If it is "1", an interrupt signal is output to the CPU 51 (step SA14). After that, the process proceeds to step SA15 and the collision flag CF is set to "0". The collision flag CF is “1” when the bat BAT image of the actual image and the object image (ball image) of the CG image are in a collision state, that is, when they overlap each other. Then, after step SA13, the position detection processing unit 40 returns the processing to step SA4, repeats the above-described operation, and obtains the correspondence relationship between "bat" and "ball" for each frame.

Operation of Initial Screen Map Creating Routine Next, the operation of the initial screen map creating routine will be described with reference to FIG. As described above, when the initial screen map is not created, the position detection processing unit 40 advances the processing to step SA3, executes the initial screen map creation routine shown in FIG. 13, and advances the processing to step SB1. In step SB1, the sampling number n set in the internal register is read. The sampling number n is the chroma key detection signal CRO supplied from the image pickup unit 1.
It shows how many frames are taken in. Next, when proceeding to step SB2, the values of the registers X and Y are reset to zero, and then proceeding to the next step SB3. Step S
In B3, of the chroma key detection signal CRO written in the line buffer, 6 dots in the X direction (horizontal direction)
Two lines in the Y direction (vertical direction), that is, one block are read.

Next, in step SB4, it is judged whether or not there is a "H" level chroma key detection signal CRO of "6 dots" or more in this read one block. If "6 dots" or more does not exist, the determination result is "no chroma key" and the determination result is "NO", and the process proceeds to step SB5. In step SB5, the block attribute is set to "0" and the process proceeds to the next step SB7. On the other hand, if there are more than 6 dots,
It is determined that "chroma key is present", the determination result is "YES", and the process proceeds to step SB6. In step SB6, the block attribute is set to "1", and the next step SB
Processing proceeds to 7. In step SB7, it is determined whether or not it is the first frame. Here, if it is the first sampled frame, the determination result is "YES", and the process proceeds to step SB8.

In step SB8, the position detection processing unit 40 stores the determined block attribute in the initial screen area E1 according to the values of the current registers X and Y. Then, after that, the process proceeds to Step SB9, the value of the register X is incremented by 1, and the number of the designated block is incremented. Next, in step SB10, it is determined whether or not the number of the stepped designated block is "96", that is, one scanning (horizontal) line is completed. Here, if not completed, the determination result is “NO”, and step SB
Proceed to 11. In step SB11, it is determined whether the value of the register Y is "96", that is, whether one frame has been completed. Here, if the processing for one frame is not completed, the determination result is “NO”, and the process returns to step SB3 described above. As a result, steps SB3 to SB6 are repeated and the next block attribute is determined.

Then, for example, it is assumed that the determination of the block attribute for one scanning (horizontal) line is completed. Then, the determination result of step SB10 becomes "YES", and the processing unit 40 advances the process to step SB13. In step SB13, the register X is reset to zero, and the value of the register Y is incremented by 1 to update the scan line. Then, after this, again, step SB11
Block determination from step SB3 onward is performed via. Next, when the determination of the block attribute for one frame is completed, the above-mentioned determination result of step SB11 becomes "YES", and the process proceeds to step SB12. In step SB12, it is determined whether the sampling number n has reached the set number.

If the set number of times has not been reached, the determination result is "NO", and the process proceeds to step SB14. In step SB14, the number of times of sampling n is incremented, and the above-mentioned step SB2 and subsequent steps are executed again. In this way, the first initial screen map is created,
In the process of creating the initial screen map for the second time, step S
When proceeding to B7, the determination result here becomes "NO", and the routine proceeds to step SB15. In step SB15, the corresponding block attribute stored previously is read from the initial screen area E1 according to the values of the registers X and Y. Then, in step SB16, the logical sum of the previous block attribute and the currently determined block attribute is obtained. Then, in step SB8, this logical sum is stored as a new block attribute in the initial screen area E1 based on the values of the registers X and Y. Then, when the logical sum of a predetermined number of frames is generated, the determination result of step SB12 described above is "YES".
Then, this routine is ended, and the processing of the position detection processing unit 40 returns to the main routine described above.

Operation of Processed Screen Map Creation Routine When the initial screen map is created as described above, the position detection processing section 40 executes the processed screen map creation routine shown in FIG. 14 via step SA5 and executes step SC1.
Proceed to. In step SC1, one block consisting of 6 dots in the X direction (horizontal direction) and 2 lines in the Y direction (vertical direction) is read from the chroma key detection signal CRO written in the line buffer. Then, step SC2
If you proceed to, read "6 dots" in one block.
It is determined whether or not the above "H" level chroma key detection signal CRO is present. If "6 dots" or more does not exist, it is determined that "no chroma key is present" and the determination result is "N.
"O" and the process proceeds to step SC3. At step SC3, the block attribute is set to "0" and the next step SC
Processing proceeds to 4. In step SC4, the determined block attribute is stored in the processing screen area E2 (see FIG. 11) based on the values of the registers X and Y.

On the other hand, when the result of the determination in step SC2 is "YES", that is, when there is a "H" level chroma key detection signal CRO of "6 dots" or more in one block, the processing section 40 Step SC5
Proceed to. In step SC5, it is determined whether or not the reject switch SR has been turned on. The reject switch SR is a switch arranged on the operation panel of the apparatus main body 2, and is for setting whether or not to provide a "dead zone" according to the switch operation. Here, when the switch SR is turned on, the chroma key detection block stored in the initial screen map is regarded as a “dead zone”.

That is, in step SC5,
When the reject switch SR is set to ON, the determination result is "YES", and the next step SC6
Proceed to. At step SC6, the block attribute corresponding to the values of the registers X and Y is read from the initial screen area E1. Next, in step SC7, it is determined whether the block attribute read from the initial screen area E1 is "1". Here, when the block attribute is “1”, the determination result is “YES”, the process proceeds to step SC3 described above, and the block attribute is changed to “0”,
Then, the changed block attribute is written in the processing screen area E2 in accordance with the values of the registers X and Y via step SC4. As a result, the chroma key detection block stored in the initial screen map is set to the "dead zone".

When the reject switch SR is not set to ON, that is, when the "dead zone" is not set, the determination result of step SC5 is "NO", and the routine proceeds to step SC8. In step SC8, the attribute of the corresponding block is set to "1" based on the result determined in step SC2 described above, and then the block attribute is set in accordance with the values of the registers X and Y through step SC4. Write in the processing screen area E2.

Operation of Collision Coordinate Detection Routine Next, the operation of the collision coordinate detection routine will be described with reference to FIG. When the processing screen map is created as described above, the position detection processing unit 40 performs step SA6 (see FIG. 1).
2), the collision coordinate detection routine is executed. In this routine, the presence or absence of a collision between the bat BAT image of the real image subjected to the chroma key detection and the object image (ball image) in the CG image is detected. First, when the routine is executed, the processing section 40 executes step SD.
1 to the register X, from the processing screen area E2.
The block attribute corresponding to the value of Y is read. Then, when the processing proceeds to step SD2, the read block attribute is "1", that is, the bat BAT where the chroma key is detected.
Determine if it is an image. Here, when the block attribute is not "1", the determination result is "NO", and it is determined that a collision cannot occur, and this routine is once terminated.

On the other hand, the read block attribute is
When it is “1”, the judgment result is “YES”, and the next
The process proceeds to step SD3 of. In step SD3
Register the CG data written in the line buffer.
Data is read according to the values of X and Y. CG data referred to here
Is the object image data D in the CG image._OBCorresponding to
Signal YSOBJ to be used. The signal YSOBJ is
Also supplied from the VDP 31 (see FIG. 3) to the processing unit 40.
Of. Then, when the process proceeds to the next step SD4, the process
The unit 40 determines whether the read CG data is “1”.
to decide. At this time, the CG data must be "1".
For example, the block read according to the values of registers X and Y
Is the object image data D O_BWill not overlap
Therefore, the judgment result is “NO”, indicating that there is no collision.
Exit the routine.

On the other hand, if the read CG data is "1", the determination result of step SD4 is "YES",
Go to step SD5. In step SD5, it is determined whether or not the collision flag CF is "0". Collision flag C
F is “1” when the bat BAT image of the actual image and the object image (ball image) of the CG image overlap each other. Here, when the flag CF is "0", that is, when the collision of both images is recognized for the first time, the determination result is "YES", and the next step SD6.
Proceed to. At step SD6, the first detected first X coordinate is stored in the collision coordinate area E7, and subsequently at step SD7, the corresponding first Y coordinate is stored in the same area E7. Then, in step SD8, the collision flag CF is set to "1". When the collision flag CF becomes "1" in this way, the processing unit 40 issues an interrupt request to the CPU 51 side, and the CPU 51 executes a collision interrupt process (described later) in response to this. On the other hand, if the result of the determination in step SD5 is "NO", that is, if the collision of both images has already been recognized, the process proceeds to step SD9, in which the last detected second X coordinate is set in the collision coordinate area. Stored in E8, and subsequently in step SD10, the corresponding second Y coordinate is stored in the same area E7.

Operation of Coordinate Detection Routine Next, the operation of the coordinate detection routine will be described with reference to FIG. By the collision coordinate detection routine described above,
When the collision coordinates between the bat BAT image of the real image subjected to the chroma key detection and the object image (ball image) in the CG image are detected, the position detection processing unit 40 causes the position detection processing unit 40 to perform step SA.
The coordinate detection routine is executed via 11 (see FIG. 12), and the process proceeds to step SE1. In step SE1, the registers X and Y, the registers X ′ and Y ′, and the register S are reset to zero and initialized. In addition,
The register S has a bat B formed by accumulating the number of blocks.
The area of the AT image is stored. Also, registers X'and Y '
The value stored in will be described later.

Next, when proceeding to step SE2, the processing section 40 reads out the block attribute corresponding to the values of the registers X and Y from the processing screen area E2, and then step SE2.
The process proceeds to 3. In step SE3, it is determined whether or not the read block attribute is "1", that is, the chroma key detected bat BAT image. here,
When the block attribute is not "1", the determination result is "N
"O" and the process proceeds to step SE4. At step SE4, the value of the register X is incremented by 1 to advance. Then, in step SE5, it is determined whether or not the value of the register X is "96", that is, the block attribute for one horizontal (scanning) line is read. Here, if the reading for one horizontal line is not completed, the determination result is "NO", and the process is returned to the step SE2 again.

Then, for example, if the read block attribute is "1", the determination result of step SE3 is "YE."
S ”, and the process proceeds to step SE6. In step SE6, it is determined whether the value of register X is larger than the value of register X '. The previously detected X coordinate is set in the register X ', and the right end / left end coordinates are updated according to the result of comparison between this coordinate value and the present coordinate value. That is, when the determination result here is "NO", the flow proceeds to step SE7, the value of the register X is stored in the left end coordinate area E5 (see FIG. 11), and the bat BA is set.
Update the left edge coordinates of the T image. On the other hand, if the result of the determination in step SE6 is “YES”, then the process proceeds to step SE8,
The value of the register X is stored in the right end coordinate area E6 (see FIG. 11) and the right end coordinate of the bat BAT image is updated.

Next, in step SE9, the processing section 40 determines whether or not the value of the register Y is larger than the value of the register Y '. Here, in the register Y ', similarly to the register X', the previously detected Y coordinate is set, and the upper end / lower end coordinates are updated according to the result of comparison between this coordinate value and the present coordinate value. ing. That is, when the determination result is “NO”, the process proceeds to step SE10,
The value of the register Y is stored in the upper end coordinate area E3 (see FIG. 11) and the upper end coordinate of the bat BAT image is updated. On the other hand, if the determination result of step SE9 is “YES”,
In step SE11, the value of the register Y is stored in the lower end coordinate area E4 (see FIG. 11) to update the lower end coordinate of the bat BAT image.

Then, at step SE12, the value of the register S is incremented by 1 to increase the area by 1 block. Then, in step SE13, the values of the registers X and Y are rewritten into the registers X'and Y ', respectively. Thus, the processing of steps SE2 to SE13 is 1
When the horizontal line is completed, the determination result of the above-mentioned step SE5 becomes "YES", and the process proceeds to step SE14,
The value of register X is reset to zero and register Y
Increments the value of. Next, in step SE15, it is determined whether the value of the register Y is "96", that is, whether or not the coordinates of one frame have been detected. Then, when the coordinate detection for one frame is not completed, the above-mentioned step SE2 and subsequent steps are repeated. On the other hand, when the processing is completed, the processing is returned from this routine to the above-mentioned main routine (see FIG. 12).

Operation of Center of Gravity Calculation Routine When the left edge / right edge coordinates and the upper edge / lower edge coordinates of the bat BAT image subjected to the chroma key detection are detected by the coordinate detection routine, the position detection processing unit 40 proceeds to step SA1.
The center of gravity calculation routine shown in FIG. 17 is executed via 2, and the process proceeds to step SF1. First, in step SF1, the registers XG and YG are reset to zero. The registers XG and YG store the barycentric coordinates of the bat BAT image calculated based on the blocks detected by the chroma key. Next, in step SF2, the registers X and Y are initialized, and in step SF3, the block attributes corresponding to the values of the registers X and Y are read from the processing screen area E2.

Next, in step SF4, the processing unit 4
0 determines whether or not the read block attribute is "1", that is, the bat BAT image subjected to the chroma key detection. Here, when the block attribute is not "1", the determination result is "NO", and the process proceeds to step SF5. At step SF5, the value of the register X is incremented by 1 to advance. Then, in step SF6, it is determined whether or not the value of the register X is "96", that is, the block attribute for one horizontal (scanning) line is read. Here, when the reading for one horizontal line is not completed, the determination result is “NO”, and the process is returned to the step SF3 again.

Then, for example, assume that the next read block attribute is "1". Then, step SF
The determination result of 4 is "YES", and the processing unit 40 advances the processing to step SF7. In step SF7, the block in which the chroma key is detected is regarded as a mass point, and the center of gravity is calculated by sequentially accumulating the ratio of the coordinates (X, Y) of this block and the area S. The area S is stored in the register S in the coordinate detection routine described above. Next, in step SF8, the barycentric coordinates are updated according to the barycentric calculation result in step SF7, and subsequently, in step SF5, the value of the register X is incremented.

Here, assuming that the reading for one horizontal line is completed, the determination result of step SF6 is "YES".
In step SF9, the value of register X is reset to zero and the value of register Y is incremented by one.
Next, in step SF10, it is determined whether or not the value of the register Y is "96", that is, whether the gravity center calculation for one frame has been performed. When the calculation of the center of gravity for one frame is not completed, the determination result is “NO”,
The processing from step SF3 onward is repeated. on the other hand,
When the calculation of the center of gravity for one frame is completed, the result of the determination is "YES", this routine is terminated, and the process returns to the main routine (see FIG. 12).

As described above, the position detection processing section 40 creates a processing screen map for each frame of the bat BAT image included in the sampling image data D _S supplied from the imaging section 1 side based on the chroma key detection signal CRO. The position of the collision coordinate between the bat BAT image and the object image (ball image) created on the basis of the block attribute created and read from the processing screen map, and the left end of the bat BAT image on the processing screen /
The right end coordinates and the upper end / lower end coordinates are obtained, and the area and the position of the center of gravity are calculated.

(2) Operation of control unit 50 (CPU 51) Next, based on various data supplied from the position detection processing unit 40 described above, the image processing unit 30 and the first sound source circuit 55b.
The operation of the CPU 51 that controls the second sound source circuit 56 and manages the progress of the game will be described with reference to FIGS. Here, first, the CPU main routine will be described, and then the averaging processing routine and the camera shake control routine that are called in the routine will be described. Further, various interrupt processing routines performed by the CPU 51 and the first and second tone generator circuits 5 are also provided.
The sound source processing routine performed in 5b and 56 will be sequentially described.

Operation of Main Routine First, when the apparatus main body 2 is powered on, the CPU 51 reads out and loads the operation system program stored in the ROM 53, and then the game cartridge 5
5, the application program is read from the ROM 55a built in 5, and loaded in the RAM 52. As a result, the CPU main routine shown in FIG. 18 is started, and C
The process of the PU 51 proceeds to step SG1. Step SG
In 1, the various registers secured in the RAM 52 are initialized, and the control signal SC designating initialization is supplied to the VDP 31 and the position detection processing unit 40. Next, when proceeding to step SG2, while supplying the control signal SC which gives the interrupt permission to each part, the interrupt mask of itself is released. Subsequently, in step SG3, the monitoring timer WT provided inside the CPU 51 is started.

Next, the CPU 51 forms an initial screen at the start of the game through steps SG4 to SG8. That is, when proceeding to step SG4, the CPU 51 sets the transfer destination address and the transfer source address in the DMA controller in order to DMA transfer the background image data D _BG which is the initial screen background to the VDP 31.
The DMA transfer is performed by an interrupt process synchronized with the vertical blanking period on the display 3 (see FIG. 1) side. The DMA controller in which the transfer command is set is the CPU 5
Under the instruction of 1, the background image data D _BG corresponding to the transfer source address is read from the ROM 55a (see FIG. 3) and DMA-transferred to the VDP 31 (VRAM 32). Such interrupt processing will be described later.

Next, when proceeding to step SG5, the CPU
51 sets the transfer destination address and the transfer source address in the DMA controller in order to DMA transfer the object image data D _OB 1 displayed on the screen background to the VDP 31. The object image data D _OB 1 corresponds to a “cursor” displayed on the screen background and is moved and displayed corresponding to a predetermined portion (for example, an upper end portion) of the bat BAT image detected by the chroma key. It is something. Then, in step SG6, the data D _OB 1
The transfer destination address and the transfer source address of the object table data T _OB 1 corresponding to are set in the DMA controller. This object table data T _OB 1
Is for designating a display position of the object image data D _OB 1 on the initial screen, that is, a display position corresponding to a predetermined portion (for example, an upper end portion) of the bat BAT image subjected to chroma key detection as described above, It is stored in the object table RAM 31f (see FIG. 8).

At step SG7, the object image data D _OB 2 displayed on the background of the initial screen is set to VDP31.
In order to perform the DMA transfer to, the transfer destination address and the transfer source address are set in the DMA controller. The object image data D _OB 2 is formed of a character image simulating a “pitcher” and a “ball image” of this character image. Then, when proceeding to step SG8, the CPU 51
Sets the transfer destination address and the transfer source address of the object table data T _OB 2 corresponding to the data D _OB 2 in the DMA controller. As a result, the preparation for forming the initial screen is completed, and the background image data D _BG and the object image data D are generated for each vertical blanking period.
_OB 1, D _OB 2 and object table data T
_OB 1 and T _OB 2 are DMA-transferred, and the VDP 31 generates image processing data D _SP based on them.

When the initial screen is formed in this way,
The CPU 51 proceeds to step SG9 and determines whether or not a start event has occurred. The start event mentioned here is an event that occurs when a start switch provided on the operation panel of the apparatus body 2 is turned on. Then, when the player turns on the start switch to start the game, the start event is generated. Therefore, the determination result here is "YES", and the process proceeds to step SG10. Step SG
At 10, the register t is reset to zero, then the process proceeds to step SG11, "1" is set in the register STF, and the process proceeds to the next step SG12. On the other hand, when the start event is not generated, the above step S
The determination result of G9 is "NO", and the process proceeds to step SG12. A time count value for managing the progress of the game is set in the above-mentioned register t by an interrupt operation described later.

In step SG12, it is determined whether or not the value of the register STF is "1", that is, the start flag indicating whether or not the game has started is set to the game start state. Here, if "1" is not set, the determination result becomes "NO", and steps SG9 to SG11 described above are repeated until a start event is generated.
When the start event occurs, step SG
The determination result of 12 is "YES", and the CPU 51 advances the process to the next step SG13. At step SG13, the transfer flag F1 set in the register ACKF1 is set.
Is determined to be "0". The transfer flag F1 indicates whether or not the object table data T _OB 1 transferred and set in step SG6 described above is DMA-transferred, and indicates that the DMA transfer is completed when the flag F1 is “0”. , "1" indicates that the transfer is not in progress.

If this flag F1 is "0", the result of the determination in step SG13 is "YES",
The processing of the CPU 51 proceeds to step SG14 shown in FIG. In step SG14, an averaging process is performed to average the "cursor" position that is moved and displayed in the initial screen corresponding to a predetermined portion (for example, an upper end portion) of the bat BAT image detected by the chroma key. Details of this averaging process will be described later. Next, when proceeding to step SG15, camera shake control processing for correcting the fluctuation of the averaged “cursor” position is performed. The details of the camera shake control process will be described later. In the averaging process and the camera shake control process, it is possible to suppress the wobbling of the “cursor” position that is moved and displayed corresponding to a predetermined part (for example, the upper end part) of the bat BAT image, and improve the so-called chroma key input operability. There is. For example, it becomes easy to set the operation mode of the game or signal the end of the game by inputting the chroma key to point the icon set in the initial screen with the “cursor”.

When the averaging process and the camera shake control process are completed, or when the object table data T _OB 1 has already been DMA-transferred in step SG13, the CPU 51 causes the CPU 51 to execute the next step SG1.
The process proceeds to 6. In step SG16, register A
It is determined whether the transfer flag F2 set in CKF2 is "0". The transfer flag F2 represents whether or not the object table data T _OB 2 transferred and set in step SG8 described above is DMA-transferred, and indicates that the DMA transfer is completed when the flag F2 is “0”. , "1" indicates that the transfer is not in progress.

When the flag F2 is "0", the result of the determination in step SG16 is "YES",
The process proceeds to the next step SG17. Step SG1
In 7, the corresponding object table data T _OB 2 is calculated based on the value of the register t, that is, the time count value according to the progress of the game. As a result, the display position of the object image data D _OB 2 forming the game screen is determined. In this case, the object image data D _OB 2
Is formed from a character image simulating a "pitcher" and a "ball image" possessed by this character image. Next, when proceeding to step SG18, the CPU 51 specifies the image data D _OB 2 corresponding to the time count value stored in the register t from among the plurality of object image data D _OB 2 DMA-transferred to the VDP 31 side in advance. The control signal SC is generated. As a result, the table data T is displayed on the game screen.
Object image data D _OB 2 corresponding to the position specified by _OB 2 is displayed.

When the game screen is formed as described above, the CPU 51 proceeds to step SG19 to register A
The transfer flag F2 stored in CKF2 is set to "1", and the process proceeds to step SG20. In addition, when the determination result in step SG16 described above is “NO”, that is,
Even when the object table data T _OB 2 has already been DMA-transferred, the process proceeds to step SG20. In step SG20, it is determined whether or not a stop event has occurred. The stop event is an event that occurs when a stop switch provided on the operation panel of the apparatus body 2 is turned on. Then, when the player turns on the stop switch in order to stop the game, the stop event is generated, the determination result here becomes "YES", and the process proceeds to step SG21.

In step SG21, the start flag stored in the register STF is set to "0" to stop the game operation. After that, the CPU 51 repeats the operations of steps SG9 to SG20 described above. On the other hand, when the stop switch is not turned on in step SG20, the determination result here is “NO”, and the process proceeds to step SG22. Step SG2
At 2, it is determined whether or not the time count value stored in the register t has reached the predetermined value T. Here, if the time count value has not reached the predetermined value T corresponding to the game end time, the determination result is “NO”, and step S
The process is returned to G9. On the other hand, when the time count value reaches the predetermined value T, the time count value stored in the register t is reset to zero, and then the process is returned to step SG9.

Operation of Averaging Process Next, referring to FIG. 20, a "cursor" that is moved and displayed in the initial screen corresponding to a predetermined portion (for example, an upper end portion) of the bat BAT image detected by the chroma key. The operation of the averaging processing routine for averaging the positions will be described. First,
As described above, the processing of the CPU 51 is performed in step SG14.
If it advances to, the averaging processing routine is started, and step SH
Execute 1. In step SH1, the upper end coordinate (X, Y) of the bat BAT image detected by the chroma key is set to the upper end coordinate area E3 of the work RAM in the position detection processing unit 40.
(See FIG. 11). In this example,
Although the "cursor" is associated with the upper end coordinates (X, Y) of the bat BAT image, the present invention is not limited to this, and the "cursor" can be associated with either the lower end coordinates or the left end / right end coordinates. .

In this way, when the coordinates corresponding to the "cursor" position are read, the CPU 51 advances the processing to the next step SH2, and accumulates the upper end coordinates (X, Y) in the registers POSX and POSY, respectively. set.
Then, when the process proceeds to step SH3, the register count
The value of the number of accumulations stored in is incremented by 1. Next, in step SH4, it is determined whether or not the cumulative number of times is "20" or more. Here, the accumulated count value is “2
If it is 0 or less, the judgment result is “NO”,
Once, this routine is completed. On the other hand, when the value of the number of times of accumulation becomes “20” or more, it is determined that the accumulation of the upper end coordinates (X, Y) is completed, and the determination result becomes “NO”.
The process proceeds to H5. In step SH5, register c
The count value stored in the count is stored in the register count
After resetting to t ′, the register count is reset to zero, and the process proceeds to step SH6.

At step SH6, the averaging process flag stored in the register AF is set to "1". The averaging process flag is a flag that becomes “1” at the time of completion of accumulation. Then, when the operation proceeds to step SH7, the register PO
The upper end X-coordinate accumulated value and the upper end Y-coordinate accumulated value respectively stored in SX and POSY are divided by the number of accumulation times stored in the register count ', and each average value POSX /
count ', POSY / count' is obtained and stored in the registers POSX, POSY. Next, when proceeding to step SH8, the CPU 51 determines that the register POS
Average value POSX / count stored in X and POSY
t ′ and POSY / count ′ are multiplied by scale factors “6” and “2” respectively to obtain averaged upper end coordinates, which are set again in the registers POSX and POSY. Thus, in the averaging processing routine, the blurring of the “cursor” that is moved and displayed in accordance with the upper end coordinates is reduced by averaging the upper end coordinates of the bat BAT image that is chroma key detected.

Operation of Camera Shake Control Processing Routine Next, the operation of the camera shake control processing routine for removing the camera shake from the upper end coordinates obtained by the averaging processing routine will be described with reference to FIG. First, the CPU
When the processing of 51 proceeds to step SG15 (see FIG. 19), the camera shake control processing routine is activated and step SI
Execute 1. In step SI1, it is determined whether the averaging process flag stored in the register AF is "1", that is, whether or not accumulation has been completed in the above-described averaging process routine. Here, if the averaging process flag is “0”, it is considered that the upper end coordinates are being averaged in the averaging process routine, and the determination result is “NO”.
Then, this routine is once completed.

On the other hand, when the averaging process flag is set to "1", the determination result is "Y", indicating that the calculation of the averaged upper end coordinates is completed in the averaging process routine.
ES ”, and the process proceeds to the next step SI2. In step SI2, it is determined whether the upper end X coordinate value stored in the register POSX is within the camera shake range. The camera shake range mentioned here refers to a range in which the margin value α is added or subtracted from the previous coordinate value stored in the register OLDX. Here, if the upper end X coordinate value stored in the register POSX is within the camera shake range, the determination result is “YES”, and the next step SI
In step 3, the previous coordinate value stored in the register OLDX is written in the register POSX. That is, when the upper end X coordinate value detected this time is within the camera shake range, the upper end X coordinate value is replaced with the previous value to cancel the coordinate shift due to the camera shake.

On the other hand, when the upper end X coordinate value stored in the register POSX deviates from the camera shake range,
The result of the determination in step SI2 is "NO", and the process proceeds to step SI4. In step SI4, the register PO
It is determined whether the upper Y coordinate value stored in SY is within the camera shake range. Here, if the upper end Y coordinate value stored in the register POSY is within the camera shake range, the determination result is “YES”, and the next step SI
Go to 5. In step SI5, the previous coordinate value stored in the register OLDY is written in the register POSY, and the process proceeds to step SI6. As a result, the upper end Y coordinate value is replaced with the previous value and the coordinate shift due to camera shake is canceled.

On the other hand, when the upper Y coordinate value stored in the register POSY is out of the camera shake range, the result of the determination in step SI4 is "NO", and the CPU 51
Advances the processing to step SI6. In step SI6, the current upper end coordinate value stored in the registers POSX and POSY is changed to the register O in which the previous upper end coordinate value is stored.
Write to LDX and OLDY, respectively. When the values of the registers OLDX and OLDY are updated in this way, the CPU 51
Advances the processing to the next step SI7, and registers ACKF
Set the transfer flag F1 stored in 1 to "1",
Complete this routine.

Operation of Interrupt Processing Routine Next, the operation of various interrupt processing routines executed by the CPU 51 will be described with reference to FIGS. a. Operation of Transfer Interrupt Processing Routine The CPU 51 gives a transfer instruction to the DMA controller (not shown) each time a vertical blanking signal is supplied from the clock driver 12 (see FIG. 3), and executes the transfer interrupt processing routine shown in FIG. Run. First, in step SJ1, the transfer flag F1 stored in the register ACKF1 is "1", that is, is the object table data T _OB 1 set by the DMA transfer in step SG6 (see FIG. 18) described above in the untransferred state? Determine whether or not. Here, if the data T _OB 1 has already been DMA-transferred, the transfer flag F1 is “0”, the determination result is “NO”, and the process proceeds to step SJ4 described later.

On the other hand, the object table data T _OB 1
Is not transferred, the judgment result is "YES",
The CPU 51 advances the process to the next step SJ2. In step SJ2, the upper end coordinate value of the bat BAT image stored in the registers POSX and POSY is read out, and this is DMA-transferred to the VDP 31 side as object table data T _OB 1. This object table data T _OB
As described above, 1 represents the display position of the "cursor" on the initial screen and corresponds to the upper end coordinate position of the bat BAT image detected by the chroma key. Therefore, based on the operation of this step SJ2, the bat BAT
A "cursor" corresponding to the top coordinate position of the image is displayed in the initial screen. The "cursor" displayed in this manner is displayed by the "cursor" by the averaging processing routine and the camera shake control processing routine described above.
Is suppressed, and as a result, chroma key input such as pointing the icon set in the initial screen with the "cursor" can be performed very easily.

Next, when proceeding to step SJ3, the transfer flag F1 stored in the register ACKF1 for indicating the completion of the DMA transfer of the object table data T _OB 1.
Is set to "0" and the process proceeds to the next step SJ4.
In step SJ4, the value of the transfer flag F2 stored in the register ACKF2 is “1”, that is, whether the object table data T _OB 2 transferred and set in step SG8 (see FIG. 18) described above is in the untransferred state. To judge. Here, the data T _OB 2 is already DMA
If the transfer has been completed, the transfer flag F2 is "0", so the determination result is "NO", the routine is completed, and the process returns to the CPU main routine.

On the other hand, the object table data T _OB 2
Is not transferred, the judgment result is "YES",
The process proceeds to the next step SJ5. In step SJ5, the object image data D _OB 2 that is transferred set to the DMA controller and DMA transfers to the VDP31 side, followed by the object table data T _OB 2 corresponding to the data D _OB 2 step SJ6 to DMA transfers. Next, when proceeding to step SJ7, the CPU 51 sets the transfer flag F2 stored in the register ACKF2 to "0".
To complete this routine. As described above, in the transfer interrupt processing routine, the object table data T _OB 2 representing the “cursor” position is DMA-transferred to the VDP 31 according to the transfer flag F1 set in the register ACKF1 and set in the register ACKF2. Object image data D _OB 2 and object table data T _OB that form a CG image according to the transfer flag F2
2 is DMA-transferred to VDP31.

B. Operation of collision interrupt processing routine In the CPU 51, the time count value according to the progress of the game
Object image data that forms the game screen based on
TA D_OB2 and object table data T O_BOrder 2
It is controlled so that the next DMA transfer is performed, while VDP31
On the side, these data D_OB2, T_OBObject corresponding to 2
Image and BAT BAT image with chroma key detection combined.
CG image that changes from moment to moment is generated. At this time,
In the position detection processing unit 40, the collision coordinate detection processing routine described above is executed.
Based on the movement of the arc (see Figure 15),
The presence or absence of a collision with the "ball image" is detected at any time. And
When the position detection processing unit 40 detects a collision, a collision flag
By setting CF to "1", the CPU 51
The collision interrupt processing routine shown in FIG.
The process proceeds to K1.

First, in step SK1, it is determined whether or not the time count value set in the register t is within the range of predetermined values T _{1 to} T ₂ . The time count value is
This value is counted immediately after the start of the game and manages the progress of the game. Further, the predetermined value T _{1 to} T _{2 referred} to here is
It refers to the effective period when the "bat image" and the "ball image" meet. That is, in this step SK1, it is determined whether or not the timing at which the “bat image” and the “ball image” collide is within the effective period of the meet. Here, for example, if the player swings the bat BAT early or delays the swing, the timing of the collision will fall outside the effective period of the meet, so the determination result is "NO", and this routine is completed. .

On the other hand, if the timing of the collision is within the effective period of the meet, the determination result is "YES",
The process proceeds to the next step SK2. In step SK2, the barycentric position of the “bat BAT image” detected by the chroma key, that is, the barycentric coordinate from the barycentric coordinate area E9 in the work RAM of the position detection processing unit 40 is fetched. Then, it is determined In step SK3, the center of gravity of the "ball image" formed from the object image data D _OB 2, the correspondence relationship between the position of the center of gravity of the chroma key detected "Bat BAT picture". Here, if the barycentric positions of both agree with each other, the process proceeds to step SK4, and a first image processing routine described later is executed. If the center of gravity of the “ball image” is located below the center of gravity of the “bat BAT image”, the process proceeds to step SK5 and the second image processing routine described later is executed. Further, when the center of gravity of the “ball image” is located above the center of gravity of the “bat BAT image”, the process proceeds to step SK6, and the third image processing routine described later is executed.

C. Operation of Image Processing Routine Next, the operation of the first to third image processing routines will be described with reference to FIGS. FIG. 25 is a flowchart in which the processing contents of these first to third image processing routines are made common. First, in step SL1, the display position of the object image data D _OB 2 (“ball image”) is calculated based on the time count value stored in the register t, and then in step SL2, the display position is determined according to the time count value. Designated object image data D _OB 2.

Therefore, in the first image processing routine, the center of gravity of the "ball image" and the center of gravity of the "bat BAT image" match, so that, for example, a "home run" will occur as in the actual batting. A "ball image" is displayed in the CG image. Further, in the second image processing routine, as shown in FIG. 26, the center of gravity of the “ball image” is batting located below the center of gravity of the “bat BAT image”, so that, for example, “goro” is set. The "ball image" is displayed in the CG image. Further, in the third image processing routine, as shown in FIG. 27, since the center of gravity of the “ball image” is batting located above the center of gravity of the “bat BAT image”, for example, “fly” is set. The "ball image" is displayed in the CG image.

In this way, when the CG image is generated according to the correspondence relationship between the barycentric position of the "ball image" and the barycentric position of the "bat BAT image", the CPU 51 advances the process to step SL3. In step SL3, it is determined whether or not the time count value stored in the register t has reached the game end value END. Here, when the time count value reaches the game end value END, the determination result is “YE
S ”, the process proceeds to step SL4, the time count value is reset to zero, and this routine is completed. On the other hand, when the time count value is less than the game end value END, the determination result of step SL3 is “NO”,
It proceeds to step SL5. In step SL5, it is determined whether or not a stop event has occurred. Here, when the stop event has not occurred, the determination result is "N
"O" and the above steps SL1 to SL3 are repeated. On the other hand, when a stop event occurs, the determination result is “YES”, and the process proceeds to step SL6,
The start flag stored in the register STF is set to "0" to indicate the end of the game, and this routine is completed.

D. Timer Interrupt Processing Routine Next, the operation of the timer interrupt processing routine for generating a time count value for managing the progress of the game will be described with reference to FIG.
This will be described with reference to FIG. The CPU 51, based on the system clock supplied from the system clock circuit 24,
This routine is started every predetermined period, step SM1 is executed, and the time count value stored in the register t is incremented by 1 to advance.

E. Operation of Monitor Timer Count Processing Routine Here, the operation of the monitor timer count processing routine will be described with reference to FIG. This monitoring timer count processing is involved in sound source processing described later. C
The PU 51 includes a monitoring timer WT that regulates the operations of the first and second sound source circuits 55b and 56 (see FIG. 3). The CPU 51 starts this routine at regular intervals,
The process proceeds to step SN1 shown in FIG. In step SN1, the monitoring timer value is incremented, and subsequently in step SN2, it is determined whether or not the timer value overflows. If no overflow has occurred, the determination result is "NO", and this routine is once completed. On the other hand, when an overflow occurs, the determination result is "YES", the process proceeds to step SN3, the overflow flag stored in the register OVF is set to "1", and this routine is completed.

F. Operation of Overflow Interrupt Processing Routine Next, the operation of the overflow interrupt processing routine will be described with reference to FIG. In this overflow interrupt processing, when the overflow flag stored in the register OVF becomes "1" in the monitoring timer count processing, step SO1 is executed, the operation of the CPU 51 is set to the halt state, and this routine is completed. To do.

G. Operation of Sound Source Request Interrupt Routine Here, the operation of the sound source request interrupt processing routine will be described with reference to FIG. The CPU 51 executes this routine each time a data request signal is supplied from the first and second tone generator circuits 55b and 56, and advances the processing to step SP1. In step SP1, the above-mentioned monitoring timer W
When T is reset and then the process proceeds to step SP2, the musical tone control data is transferred to the first and second tone generator circuits 55b and 56. This tone control data is information that specifies the pitch, tone color, volume, etc. of a tone that should be generated corresponding to the progress of the game. When there is no musical tone to be generated, musical tone control data representing "no data" is supplied to the first and second tone generator circuits 55b and 56.

Operation of Sound Source Processing Routine Next, the operation of the sound source processing routine performed in the first and second sound source circuits 55b and 56 for synthesizing game sound effects under the control of the CPU 51 will be described with reference to FIG. To do. The first sound source circuit 55b built in the game cartridge 55 synthesizes a game effect sound corresponding to the game operation based on the event data supplied from the CPU 51 side, and outputs this as a tone signal. on the other hand,
Similarly, the second tone generator circuit 56 synthesizes and outputs a musical composition corresponding to the progress of the game, for example, a musical composition such as an opening or ending based on the event data supplied from the CPU 51 side.

These first and second tone generator circuits 55b, 5
When the power of the device body 2 is turned on, the step 6 is step SQ.
The process proceeds to 1 to initialize various registers, reset various registers, and set initial values. Then, step S
When proceeding to Q2, "1" is set in the register REQ.
As a result, the circuits 55b and 56 send a data request signal to the CPU 51. The CPU 51, which has received the data request signal, executes the above-described tone generator request interrupt routine to reset the monitoring timer WT and transfers the tone control data to the first and second tone generator circuits 55b and 56.

When the musical tone control data is received from the CPU 51 side in this way, the result of the determination in step SQ3 is "YES", and the process proceeds to the next step SQ4. Step S
In Q4, the process waits until the data to be transferred becomes stable, and when the data becomes stable, that is, when the reception of the musical tone control data is completed, the determination result here becomes "YES",
The process proceeds to step SQ5. And step SQ
At 5, the register REQ is set to "0" and the transmission of the data request signal is stopped. Next, in step SQ6, the content of the received musical tone control data is interpreted and converted into event data that specifies the pitch, tone color, volume, etc. of the musical tone to be generated in accordance with the progress of the game. Then, in step SQ7, a tone signal corresponding to this event data is created, and thereafter, step SQ2 and subsequent steps are repeated again.

Therefore, according to the operation of this routine,
The first and second sound source circuits 55b and 56 are CPUs at any time.
A data request signal is sent to the 51 side, while the CPU
On the 51 side, musical tone control data is returned to the circuits 55b and 56 in response to the data request signal. Then, the circuits 55b and 56 which have received the tone control data synthesize the tone corresponding to the data. Therefore, for example, when the game operation is performed based on the game cartridge 55 that only includes the ROM 55a in which the application program is illegally copied, the first tone generator circuit 55b that should be incorporated in the cartridge 55a does not exist.
No data request signal is sent from the CPU 51 to the CPU 51.

Then, the CPU 51 does not execute the tone generator request interrupt processing routine described above, and as a result, the monitoring timer WT is not reset and the tone control data is not sent to the tone generator circuits 55b and 56. When the monitoring timer WT is not reset and enters an overflow state, the above-described overflow interrupt processing routine (see FIG.
9), the self (CPU 51) is stopped.
After all, unless the first sound source circuit 55b is provided in the game cartridge 55, not only the game sound effect is not generated, but the game operation itself is stopped.
Therefore, the game cartridge can be hardware-protected.

As described above, in this embodiment, based on the operations of the averaging processing routine and the camera shake control processing routine, the fluctuation of the "cursor" position that is moved and displayed in correspondence with the upper end coordinates of the bat BAT image is suppressed. Therefore, chroma key input processing with extremely good operability is realized. Thereby, for example, it is possible to easily set the operation mode of the game by pointing the icon set in the initial screen with the “cursor” and signal the end of the game. Further, in the above embodiment, the first sound source circuit 55b is provided inside the game cartridge 55, and when the data request signal is not sent from the first sound source circuit 55b, not only the game sound effect is generated but also the game operation itself. Since it is stopped, it becomes possible to further enhance the protection function as compared with the conventional one in which copy guard is applied by software.

Although the image control device for simulating the "batting" operation has been disclosed in the above-described embodiment, the gist of the present invention is not limited to the device, and for example, "tennis". Or "golf", etc.
The present invention can be applied to various games incorporating a player's athletic behavior or role-playing games. Further, in the present embodiment, the "bat BAT" detected by the chroma key is detected.
The "cursor" is assigned to the "image", but instead of this, for example, the "bat BAT image" is extracted from the captured image based on known pattern recognition, or
A heat source is provided inside the bat BAT so that the bat radiates infrared rays of a predetermined wavelength, and a “bat BAT image” is extracted by capturing an infrared image, and a “cursor” is displayed on this.
It is also possible to assign

[0112]

According to the present invention, it is possible to extract from a captured image.
Set the coordinate position on the display screen of the chroma key image
First coordinate value averaged this time
Is a predetermined value with the second coordinate value averaged last time as the center value
If it is within the range, the second coordinate value is displayed.
The first seat when it exceeds the predetermined range.
The standard value is the display position. And with the background of the display screen
On the background image
The eject image is moved and displayed according to the display position.
, The blur and deformation of the chroma key image are corrected, and
For example, the icon (back
The ground image) corresponds to the chroma key image
Set the operation mode of the game by pointing with "Sol"
It is easy to do and signal the end of the game
It is possible to realize an image display control process having good properties .

[Brief description of drawings]

FIG. 1 is an external view showing an overall configuration of an image control apparatus according to an embodiment of the present invention.

FIG. 2 is a diagram for explaining the outline of the embodiment.

FIG. 3 is a block diagram showing an electrical configuration of the embodiment.

FIG. 4 is a block diagram showing a configuration of an image pickup signal processing unit 11 in the embodiment.

FIG. 5 is a block diagram showing a configuration of a video signal processing unit 20 in the embodiment.

6 is a diagram for explaining a chroma key signal generation circuit 20f in the video signal processing unit 20. FIG.

FIG. 7 is a color difference conversion circuit 2 in the video signal processing unit 20.
It is a figure for demonstrating 0g.

FIG. 8 is a block diagram showing a configuration of a VDP 31 in the embodiment.

FIG. 9 is a color difference data processing circuit 31e in the VDP 31.
3 is a block diagram showing the configuration of FIG.

FIG. 10 is a diagram for explaining the contents of a BY table 31e-1 and an RY table 31e-2 in the color difference data processing circuit 31e.

FIG. 11 is a memory map for explaining the contents of the work RAM of the position detection processing unit 40 in the embodiment.

FIG. 12 is a flowchart showing an operation of a main routine in the position detection processing section 40.

13 is a flowchart showing the operation of an initial screen map creation routine in the position detection processing unit 40. FIG.

FIG. 14 is a flowchart showing an operation of a processing screen map creation routine in the position detection processing unit 40.

FIG. 15 is a flowchart showing an operation of a collision coordinate detection processing routine in the position detection processing section 40.

16 is a flowchart showing the operation of a coordinate detection processing routine in the position detection processing section 40. FIG.

FIG. 17 is a flowchart showing an operation of a centroid calculation processing routine in the position detection processing section 40.

FIG. 18 is a flowchart showing an operation of a CPU main routine in the embodiment.

FIG. 19 is a flowchart showing an operation of a CPU main routine in the embodiment.

FIG. 20 is a flowchart showing the operation of an averaging processing routine in the CPU 51.

FIG. 21 is a flowchart showing the operation of a camera shake control processing routine in the CPU 51.

FIG. 22 is a flowchart showing the operation of a transfer interrupt processing routine in the CPU 51.

FIG. 23 is a flowchart showing the operation of a collision interrupt processing routine in the CPU 51.

FIG. 24 is a flowchart showing the operation of the timer interrupt routine in the CPU 51.

FIG. 25 is a flowchart showing the operation of the n-th image processing routine in the CPU 51.

FIG. 26 is a diagram for explaining the operation of the n-th image processing routine in the CPU 51.

FIG. 27 is a diagram for explaining the operation of the n-th image processing routine in CPU 51.

FIG. 28 is a flowchart showing the operation of a monitoring timer count processing routine in the CPU 51.

FIG. 29 is a flowchart showing the operation of an overflow interrupt processing routine in the CPU 51.

FIG. 30 is a flowchart showing an operation of a sound source request interrupt processing routine in the CPU 51.

FIG. 31 is a flowchart showing an operation of a sound source processing routine in first and second sound source circuits 55b and 56.

[Explanation of symbols]

1 Imaging unit 2 device body 3 display (display screen) 20 Video signal processing unit (image extracting means) 30 image processing unit (image processing means) 40 Position detection processing unit (position detection means) 50 control unit (control means) 51 CPU (position control means, data monitoring means) 55b First sound source circuit (musical tone generating means) 56 Second sound source circuit (musical tone generating means)

─────────────────────────────────────────────────── ─── Continuation of front page (58) Fields surveyed (Int.Cl. ⁷ , DB name) A63F 13/00-13/12 H04N 5/262 H04N 9/75 G06F 3/03 G06F 3/033 G09G 5 / 38

Claims (6)

(57) [Claims] 1.Chroma key of specific color from captured image
Image extraction means for extracting an image, Table of chroma key images extracted by the image extracting means
Position detecting means for detecting the coordinate position on the display screen, Coordinate positions for multiple frames detected by this position detection means
Is averaged, and the first coordinate value averaged this time is the previous average
Within the specified range with the centered second coordinate value
If the second coordinate value is set as the display position,
On the other hand, if it exceeds the predetermined range, the first coordinate value is displayed.
Position control means for setting the position, Means for generating an image corresponding to the display screen,
Draw a predetermined shape on the background image that becomes the screen background.
A table for moving the object image to be displayed according to the display position.
Image processing means to show An image characterized by comprising
Image display control device. 2.Converts captured image signal to color difference signal
However, it corresponds to a predetermined specific color from the color difference signal.
A specific color determining means for generating a chroma key signal, Chroma key image from the captured image according to the chroma key signal
The top of the chromakey image on the display screen,
A position detector that detects the coordinate positions of the bottom edge, left edge, and right edge.
Dan, At least the top edge, bottom edge, left edge and
And the coordinate position of any one point on the right end
It is calculated this time as well as calculating the average coordinate position
The first average value is the second average value calculated last time as the central value.
When it is within the predetermined range, the second average value
If the display position is exceeded, on the other hand, if it exceeds the predetermined range,
Position control means for setting the average value of 1 as the display position, It is a means for generating an image signal corresponding to the display screen.
The background image that becomes the screen background and the background image.
Moved to the background image according to the display position
Image processing means for image-synthesizing the object image
An image display control device comprising: 3. The position detecting means divides the captured image into blocks formed of a plurality of dots, and
The presence or absence of the chroma key signal is discriminated for each of the divided blocks, and a chroma corresponding to a predetermined number of dots per block is determined.
Wherein the block if the key signal is detected chroma
The image display control device according to claim 2, wherein the image display control device is regarded as a part of a key image . 4.Chroma key of specific color from captured image
An image extraction step for extracting an image, Table of the chromakey image obtained in the image extraction step
A position detection step of detecting the coordinate position on the display screen, Coordinates for multiple frames detected by this position detection step
Positions are averaged and the first coordinate value averaged this time is the last time
Within a predetermined range with the averaged second coordinate value as the center value
When it is within the range, the second coordinate value is used as the display position,
On the other hand, if it exceeds the predetermined range, the first coordinate value is displayed.
A position control step for setting the indicated position, The step of generating an image corresponding to the display screen.
On the background image that becomes the screen background.
The object image showing the shape is moved according to the display position.
And an image processing step for displaying a moving image.
To Image display control method. 5.Converts captured image signal to color difference signal
However, it corresponds to a predetermined specific color from the color difference signal.
A specific color determining step for generating a chroma key signal to Chroma key image from the captured image according to the chroma key signal
The top of the chromakey image on the display screen,
A position detection switch that detects the coordinate positions of the bottom edge, left edge, and right edge.
Tep, At least the top edge, bottom edge, left edge and
And the coordinate position of any one point on the right end
It is calculated this time as well as calculating the average coordinate position
The first average value is the second average value calculated last time as the central value.
If it falls within the predetermined range, the second average value
Is the display position.
A position control step in which the display value is the first average value, In the step of generating an image signal corresponding to the display screen
There is a background image that becomes the screen background and
Depending on the display position on the background image Move table
Image processing that synthesizes the image with the object image to be displayed.
With step It is characterized by comprising Image display control method
Law. 6. The position detecting step includes the captured image.
Is divided into blocks formed by multiple dots.
, The presence of the chroma key signal for each divided block.
If there is nothing, a block corresponding to a certain number of dots per block
If a Romakey signal is detected, the block is
6. It is regarded as a part of the Romakey statue, and it is characterized in that
Image display control method.