JP4006949B2 - Image processing system, image processing apparatus, and imaging apparatus - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image processing system that captures an image of a player and uses the captured image.
[0002]
[Prior art]
Arcade game devices and home video game devices installed in game centers and the like have recently developed a wide variety of interesting games, and are very popular as entertainment.
[0003]
A conventional game device is known in which a player is imaged and the captured image is used. For example, like a print club, you can capture a player's image, print it in combination with the background, and provide it to the player, or capture the player's face image and paste it on the game character's face. There are things that create new characters.
[0004]
Further, in a conventional game device, a position on the display screen is instructed by a position instructing unit such as a controller, and the game is controlled based on the color information displayed at the instructed position, or a specific moving body There are things that generate.
[0005]
[Problems to be solved by the invention]
However, in the conventional game device, even if a player is imaged, all or part of the captured image is used as an image, and specific information is not obtained from the captured image.
[0006]
An object of the present invention is to provide an image processing system that obtains specific information from a captured image of a player or the like and controls image display based on the information.
[0007]
Another object of the present invention is to provide an image processing system capable of moving a moving body smoothly and uniquely in relation to a player's instruction.
[0008]
Still another object of the present invention is to provide an image processing system capable of smoothly performing operation input from a player.
[0009]
[Means for Solving the Problems]
An image processing system according to the present invention includes an imaging unit that captures an image of a player, a storage unit that stores a plurality of frames of image data captured by the imaging unit, and image data stored in the storage unit on a display screen. Image display means for sequentially displaying the difference, and difference calculation means for obtaining a difference by comparing the currently displayed image data with the image data displayed in the past, and the difference calculated by the difference calculation means Based on this, the behavior of the moving body displayed on the display screen is determined.
[0010]
In addition, an image processing system according to the present invention includes an imaging unit that captures an image of a player, a storage unit that stores a plurality of frames of image data captured by the imaging unit, and displays image data stored in the storage unit. The image display means for sequentially displaying on the screen, and the presently displayed image data and the previously displayed image data in a predetermined area in the display screen are compared with each other to obtain a difference between predetermined color components. And a difference calculating means for obtaining, when the difference between the predetermined color components calculated by the difference calculating means is greater than or equal to a predetermined value, it is determined that there has been a predetermined operation input from the player. And
[0011]
DETAILED DESCRIPTION OF THE INVENTION
[First Embodiment]
A video game apparatus according to a first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram showing functions of the video game apparatus according to the present embodiment, FIG. 2 is an explanatory diagram showing a first specific example of the playing method of the video game apparatus according to the present embodiment, and FIG. FIG. 4 is an explanatory view showing a second specific example of the playing method of the video game apparatus of the embodiment, and FIG. 4 is an explanatory view showing a third specific example of the playing method of the video game apparatus of the present embodiment.
[0012]
As shown in FIG. 1, the game device 200 includes a CPU 202 that controls execution of a game program and the entire system, and a system memory (used as a buffer memory that stores programs and data necessary for the CPU 202 to perform processing). RAM) 204 is commonly connected to the bus arbiter 210 through a bus line.
[0013]
Further, as a program data storage device or storage medium 206 in which game programs and data are stored, a CD-ROM drive for driving a CD-ROM that is a game recording medium, and a program and data for starting the game device 200 are provided. A stored boot ROM 208 is connected to the bus arbiter 210 via a bus line.
[0014]
Further, a rendering processor 212 that performs rendering according to a drawing command generated by the drawing library and a graphic memory 214 that records an image signal drawn by the rendering processor 212 are connected via the bus arbiter 210. Image data recorded in the graphic memory 214 is converted from a digital signal to an analog signal by a video DAC (not shown) and displayed on the display monitor 216.
[0015]
Also, an audio processor 218 that generates audio data and an audio memory 220 that records the generated audio data are connected via the bus arbiter 210. The audio data recorded in the audio memory 220 is converted from a digital signal to an analog signal by an audio DAC (not shown) and output from the speaker 222 as audio.
[0016]
The bus arbiter 210 also has a function as an interface and is connected to an external communication line via the modem 224. Game device 200 can communicate with other game devices and the like via modem 224.
[0017]
In addition, a controller 226 for operating the game device 200 is connected to the bus arbiter 210. For example, a backup memory 228 composed of a memory card or the like is attached to the controller 226.
[0018]
Further, in order to input a player's image and sound, the bus arbiter 210 is connected to an electronic camera 232 for capturing an image, and the controller 226 is connected to a microphone 230 for inputting sound.
[0019]
A first specific example of the playing method using the video game apparatus of this embodiment will be described with reference to FIG.
[0020]
In this specific example, the electronic camera 232 connected to the game apparatus 200 is placed on the display monitor 216, and the player 300 stands in front of the electronic camera 232 and gives various instructions to be described later. An image captured by the electronic camera 232 is displayed on the display monitor 216. The player 300 performs various operations while viewing his / her captured image.
[0021]
In this specific example, an image is captured by the electronic camera 232 using the YUV method. The YUV method is a data format used in home televisions and the like, and is a method of expressing colors with three information of luminance (Y), color difference (U) from red, and color difference (V) from blue. is there. For example, when an image is displayed with only the Y component, it becomes a black and white image. An image captured by the YUV method is compressed and stored in the system memory 204. Note that conversion to RGB signals is necessary depending on the type of display.
[0022]
Since the player 300 performs various operations toward the electronic camera 232 while viewing the image displayed on the display 216, the captured image 300 ′ is displayed in an inverted manner so that the player 300 can operate without feeling uncomfortable. That is, as shown in FIG. 2, when the player 300 raises his left hand, the player's image 300 ′ displayed on the display 216 displays the right hand up.
[0023]
In this specific example, image data captured by the electronic camera 232 is compressed and sequentially stored in the system memory 204. The system memory 204 stores image data displayed in the past in addition to the image data currently displayed. The image data displayed in the past may be, for example, image data one frame before the currently displayed image data, or image data before a predetermined frame of the currently displayed image data. Also good. The past image data may be image data for one frame, or may be image data for two or more frames.
[0024]
In this specific example, a difference between current image data and past image data stored in the system memory 204 is calculated, and various processes are performed based on the difference data. For the current image data and the past image data, the difference of each color component (luminance, red, blue) in the YUV method is calculated for each pixel.
[0025]
In this specific example, the moving body is controlled based on the difference data of each color component. This prevents the moving image data such as the background from being affected. For example, since a human hand has many redness components, when the player 300 moves his / her hand, a large redness component difference value appears only in the moved region, and the redness component difference value in other regions is almost zero. It becomes.
[0026]
Therefore, in the present embodiment, when the difference value of the redness component becomes equal to or larger than a predetermined value, for example, the moving body 302 that imitates wrinkles is automatically generated. An infinite number of bubbles 303 are displayed in a region where the difference value of the redness component is equal to or larger than a predetermined value, and the generated moving body 302 moves following the portion where the difference value of the redness component is the maximum value. As a result, when the player moves his / her hand, the bubble 303 appears in the entire area, and the kite of the moving body 303 follows the bubble 303 so as to swim. It should be noted that a special effect may be obtained by displaying other than bubbles, for example, a heart mark or a flame in a region where the difference value of the redness component is a predetermined value or more.
[0027]
The algorithm for generating, following, and disappearing the moving body 302 is basically the same as the algorithm for the insect movement drawing process (FIGS. 14 to 24) in the second embodiment of the present invention to be described later. In the insect movement drawing process of the second embodiment, drawing control of a moving body such as an insect is performed using the color data of the image itself, but the difference is that the difference data of the color components is used in this embodiment.
[0028]
When the moving body 302 is generated by the difference data of the redness component and is drawn so as to follow the pixel of the maximum value of the difference data, there are many redness components in the human hand. Is displayed as if the moving body 302 is following, and as if the moving body 302 is chasing the hand of the player 300.
[0029]
In this specific example, as shown in FIG. 2, another moving body 304 that is generated, follows, and disappears based on the difference data of the blue component of the captured image is displayed. In addition, other mobile objects whose behavior is determined by the difference data may be displayed. For example, the moving object is generated based on the total value of the difference data of each color component (brightness, red, blue) between the current image data and the past image data, the maximum value, the average value, the distribution, etc. Processing such as extinction may be performed.
[0030]
Further, the algorithm of the animal movement drawing process (FIGS. 27 to 36) in the second embodiment of the present invention to be described later may be used as the algorithm of the process for the moving object 302. This algorithm is applied to the difference data of the color components of the image data to generate a moving body or the like on the display monitor 216, and the picture of the moving body is switched based on the difference data around the moving body, or sometimes stops. Or you may.
[0031]
As described above, according to this specific example, since the redness component of the human hand is used, it is not necessary to attach a special device to clothes or hands, and it can be used as a simpler character input means. The moving body can be moved smoothly and uniquely in relation to the user's instructions.
[0032]
Further, instead of using the redness component of the human hand, a special tool may be attached. For example, an effective display as in this specific example may be performed by operating a command stick with a red tip instead of a hand. Further, a red glove may be attached to the right hand and a blue glove may be attached to the left hand, and the moving body 302 generated by the red component and the moving body 304 generated by the blue component may be freely manipulated by the movement of the right hand and the movement of the left hand. . Furthermore, a method using a human hand itself and a method using a special tool may be appropriately combined.
[0033]
A second specific example of the playing method using the video game apparatus of this embodiment will be described with reference to FIG.
[0034]
In this specific example, as in the first specific example, the image data captured by the electronic camera 232 is compressed and sequentially stored in the system memory 204. The difference between the current image data stored in the system memory 204 and the past image data is calculated, and processing is performed based on the difference data.
[0035]
In this specific example, a specific detection area 312 is set on the display monitor 216, and the operation information of the player 310 is detected based on the difference data value in the specific detection area 312. For example, the player 310 is provided with a red pointer 314, and the operation information is detected based on whether or not the image 314 ′ of the pointer 314 has moved within the detection area 312. When the image 314 ′ of the pointing bar 314 moves in the detection area 312, the redness component difference value in the detection area 312 becomes a predetermined value or more. Thereby, the operation of the player 310 is detected.
[0036]
When the player 310 wants to give a predetermined operation instruction to the game apparatus 200 while looking at the images 310 ′ and 314 ′ displayed on the display monitor 216, the image 314 ′ of the pointing bar 314 moves in the detection area 312. You only need to operate it across. The player 310 can freely operate in a free style.
[0037]
It should be noted that the detection area 312 may be preliminarily colored with a specific color so that the player 310 can recognize the position. The player 310 can know the detection area 312 and operate it reliably. Conversely, the detection area 312 may not be given a special color. Searching the player 310 for the position of the detection area 312 can be incorporated into the game.
[0038]
As described above, according to the present specific example, it is only necessary to move the operation means such as the pointing rod, so that it can be used as a simpler operation input means, and the operation input from the player can be performed smoothly.
[0039]
A third specific example of the playing method using the video game apparatus of the present embodiment will be described with reference to FIG.
[0040]
In this specific example, as in the first specific example, the image data captured by the electronic camera 232 is compressed and sequentially stored in the system memory 204. The difference between the current image data stored in the system memory 204 and the past image data is calculated, and processing is performed based on the difference data.
[0041]
In this specific example, a player's intentional operation is detected and activated in response to the start of the game. When the player shakes his / her hand in front of the electronic camera 232, the movement distance of the movement of the hand is accumulated, and it is determined that the input is made when the accumulated distance exceeds a predetermined set value. By this operation input, various controls such as starting a game, appearing a specific character, and switching screens are performed.
[0042]
On the initial screen, as shown in FIG. 4A, a round window 320 is displayed in a black screen. This window 320 serves as a window for detecting hand movement. When the player holds his / her hand in front of the electronic camera 232 and moves it, the position where the hand moves is detected from the difference data of the redness component, and the window 320 is moved to the moved position. As a result, as shown in FIG. 4B, a state in which the player's hand 322 is shown in the round window 320 is displayed.
[0043]
When the player moves the hand 322, as shown in FIGS. 4C and 4D, the round window 320 moves following the movement of the player's hand 322. The game apparatus 200 calculates the moving distance of the round window 320 and accumulates the moving distance. When the accumulated distance from the start of the operation by the player reaches a predetermined value, it is determined that the game start operation has been input, and the game is started as shown in FIG.
[0044]
Various measures are taken to prevent the game from being determined to be started by an unintended movement by the player. For example, the movement distance is accumulated in consideration of the speed of hand movement. When the speed of the hand movement is equal to or greater than a predetermined value, the movement distance is accumulated as it is. However, when the movement of the hand is equal to or smaller than the predetermined value, a value obtained by subtracting the predetermined distance from the actual movement distance is accumulated. If the accumulated distance does not reach the predetermined value for starting the game even after a predetermined time has elapsed since the hand movement was detected, the accumulated distance is reset.
[0045]
In the above embodiment, the player's hand image 322 is displayed in the round window 320, but may be displayed with a schematic mark without using an actual hand image. That is, when the movement of the player's hand is detected, the image of the moving body may be changed from a simple round window mark to a mark in which a hand is drawn in the round window. Note that the operation of shaking the player's hand may be operation information other than the start of the game.
[0046]
Thus, according to this specific example, the player can give an operation instruction such as starting a game by waving his hand in front of the electronic camera, and the player can smoothly input the operation.
[0047]
[Second Embodiment]
A video game apparatus according to a second embodiment of the present invention will be described with reference to FIGS. FIG. 5 is a perspective view showing the appearance of the video game apparatus of the present embodiment, FIG. 6 is a software cartridge of the video game apparatus of the present embodiment, and FIG. 7 shows the hardware of the video game apparatus of the present embodiment. FIG. 8 is a block diagram showing functions of the video game apparatus according to the present embodiment.
[0048]
(Game device itself)
The video game apparatus of the present embodiment is one in which a picture book type software cartridge 12 is mounted on a foldable game apparatus body 10. As shown in FIG. 5, the upper lid 16 is removed from the bottom lid 14 of the game apparatus body 10 and opened, and the software cartridge 12 is inserted into the cartridge slot 18 on the inside.
[0049]
As will be described later, in the present embodiment, it is also possible to provide an electronic camera 55 as in the first embodiment. For example, the electronic camera 55 is placed on a monitor 90 as shown in FIG. 3 and connected to a connector (not shown) of the software cartridge 12.
[0050]
Inside the bottom cover 14 of the game apparatus body 10, a direction button 20 and an execution button 22 are provided on the left side, a drawing tablet 24 is provided in the center, and a touch pen holder 26 is provided on the right side.
[0051]
The direction button 20 and the execution button 22 are operated by the player. The direction button 20 is used to instruct four directions (up, down, left and right), and the execution button 22 is used to give an execution instruction. The touch pen holder 26 holds the touch pen 28. The touch pen 28 is used to operate the picture book software by touching the drawing tablet 24. A pen button 28 a is provided at the tip of the touch pen 28. The player gives an instruction by pressing the pen button 28a.
[0052]
The drawing tablet 24 detects the position where the touch pen 28 is close by the electromagnetic induction method. The position is detected by receiving an electromagnetic signal emitted from the drawing tablet 24 by the touch pen 28. The player gives an instruction based on the position by pressing the pen button 28a.
[0053]
A picture book tablet 32 to which a picture book type software cartridge 12 is attached is provided in the center of the upper cover 16 of the game apparatus body 10. The picture book tablet 32 detects a position where the touch pen 28 is close by an electromagnetic induction method similar to that of the drawing tablet 24.
[0054]
A power switch 34 for turning the power on and off is provided at the lower left part of the picture book tablet 32. A cartridge slot 18 into which the software cartridge 12 is inserted is provided at the lower right side of the picture book tablet 32. The installed software cartridge 12 can be removed from the cartridge slot 18 by pressing the reject button 36.
[0055]
A page sensor 38 is provided on the upper right side in the picture book tablet 32. The page sensor 38 detects which page 42 of the picture book of the software cartridge 12 is open. A cut is formed in the upper right part of each page 42 of the picture book, and the cut width is increased in the page order. By doing so, the number of sensors to be shielded differs according to the opened page, and the currently opened page can be detected.
[0056]
As shown in FIG. 5, the software cartridge 12 has a basic form like a picture book in which a plurality of pages 42 are bound by a binding ring 40 at the left edge. Each page 42 has a picture corresponding to the game program.
[0057]
(Software cartridge)
The software cartridge 12 will be described with reference to FIG. FIG. 6 is a plan view of the software cartridge 12 in a state in which each page 42 of the picture book is closed.
[0058]
The upper part of the software cartridge 12 is a picture book placement part 46 for placing a picture book, and the lower part is a board storage part 50 for storing a circuit board 48 therein.
[0059]
A binding ring 40 is provided at the left edge of the picture book placement unit 46, and each page 42 of the picture book is closed. In this embodiment, the page 42 of 5 pages is closed, and the index is shifted and formed on the right edge of each page 42. Six sensor holes 52 corresponding to the position of the page sensor 38 of the picture book tablet 32 are formed in the upper right part of the picture book placement unit 46.
[0060]
A circuit board 48 is housed in the board housing portion 50. The circuit board 48 is formed with a connector 49 for connection to the game apparatus main body 10 and is mounted with a program ROM 54 storing a game program.
[0061]
(Hardware)
Next, the hardware configuration of the video game apparatus of this embodiment will be described with reference to FIG.
[0062]
The game apparatus body 10 will be described. The MPU 60 controls the entire video game device. The RAM 62 is a work memory for the MPU 60. A video display processor (VDP) 64 controls drawing processing of a background, a character, and the like. Video information is written into the video RAM 66. The video signal from the video display processor 64 is output from the video terminal 70 to the monitor 90.
[0063]
When the electronic camera 55 is used, the video processor (VDP) 64 controls the drawing information by synthesizing video information captured by the electronic camera 55 with a game image such as a background or a character. The video information is written into the video RAM 66 and is output from the video terminal 70 to the monitor 90 by the video processor (VDP) 64. Operation input can also be performed by recognizing video information captured by the electronic camera 55.
[0064]
A voice synthesis LSI (ADPCM) 72 synthesizes all voices such as words spoken by the character. Synthesize and pronounce the sound according to the game. The audio signal from the video display processor 64 and the audio signal from the audio synthesis LSI 72 are mixed and output to the monitor 90 via the audio terminal 76.
[0065]
The controller 78 monitors the state of the direction button 20, the execution button 22, the touch pen 28, the pen button 28 a, and the page sensor 38, and outputs information input by the player's operation to the MPU 60.
[0066]
The controller 78 monitors the states of the picture book tablet 32 and the drawing tablet 24 via the analog switch 80 and outputs input information by the player's operation to the MPU 60.
[0067]
When the electronic camera 55 is used, the image information of the operator imaged by the electronic camera 55 or the input information by the operation of the operator is output to the MPU 60.
[0068]
The MPU 60, RAM 62, video display processor 64, speech synthesis LSI 72, and controller 78 are connected by an address bus 84, a data bus 86, and a control bus 88.
[0069]
In the software cartridge 12, a program ROM 54 storing a game program is mounted on the circuit board 48. The software cartridge 12 is connected to the game apparatus body 10 via connectors 49 and 82, and an address bus 84, a data data bus 86, and a control bus 88 are connected thereto. A power supply line (not shown) is also connected to the software cartridge 12 via connectors 49 and 82.
[0070]
(Function block diagram)
Next, functions of the video game apparatus according to the present embodiment will be described with reference to the block diagram of FIG. FIG. 8 is a functional block diagram when the software cartridge 12 is attached to the game apparatus body 10 and the whole is operating as a video game apparatus.
[0071]
The control unit 100 controls drawing processing and sound generation processing in the video game apparatus. The drawing control unit 102 controls the drawing processing unit 104 to draw a predetermined picture based on the proximity position of the touch pen 28 to the picture book tablet 32. The drawing processing unit 104 draws a diagram in the buffer memory 120 via the buffer memory input / output unit 110. Under the control of the drawing processing unit 104, a predetermined picture is drawn in the buffer memory 120, a diagram is drawn in the buffer memory 120 according to the proximity position of the touch pen 28 to the drawing tablet 24, and the moving object drawing unit 106 Under the control, a picture of a moving body such as an insect or an animal is drawn in the buffer memory 120. The moving object drawing unit 106 draws a picture of the moving object according to the direction of the moving object such as an insect or an animal determined by the route determining unit 107. The sound generation processing unit 108 performs sound generation processing based on the proximity position of the touch pen 28 to the drawing tablet 24 and the color information in the buffer memory 120.
[0072]
When the electronic camera 55 is used, the drawing processing unit 104 performs control based on image data from a memory (not shown) in which image data from the electronic camera 55 is stored.
[0073]
The buffer memory input / output unit 110 writes color information into the buffer memory 120 in accordance with drawing control from the control unit 100, reads color information from the buffer memory 120, and outputs it to the control unit 100.
[0074]
When writing color information, the coordinate conversion unit 112 converts the writing position from the control unit 100 into the address of the buffer memory 120, and the color information writing unit 114 instructs the converted address to the converted address. Write color information.
[0075]
When reading the color information, the reading position from the control unit 100 is converted into the address of the buffer memory 120 by the coordinate conversion unit 116, and the color information of the buffer memory 120 at the converted address is read by the color information reading unit 118. The sound is output to the sound generation processing unit 108 of the control unit 100.
[0076]
As the video information, an image based on the color information stored in the buffer memory 120 is written into the video RAM 66 for each frame and output to the monitor 90 via the video terminal 70.
[0077]
As the audio information, the audio signal output from the sound generation processing unit 108 is output to the monitor 90 via the audio terminal 76.
[0078]
(First example of video game)
Next, a first specific example of the video game of the video game apparatus according to the present embodiment will be described with reference to FIGS.
[0079]
(Basic drawing process)
The drawing process of this example will be described with reference to FIGS.
[0080]
FIG. 9 is a specific example of a picture of the software cartridge 12 used in the drawing process of this specific example. When the touch pen 28 is brought close to each part of the picture in FIG. 9, the proximity position of the touch pen 28 is detected by the picture book tablet 32, and a drawing instruction corresponding to the proximity position is input by pressing the pen button 28 a.
[0081]
When the electronic camera 55 is used, a selection screen similar to that shown in FIG. 9, for example, a selection screen including icons such as a pencil area 211, an eraser area 212, a net area 213, a baton area 214, and a color designation area 215. Is displayed on the monitor 90, for example, the cursor is moved by moving the player's hand to select the icon.
[0082]
In the page 200 on the left side of FIG. 9, a campus area 201 and sample picture areas 202, 203, and 204 are arranged. When the touch pen 28 touches the campus area 201, a campus on which a picture can be freely drawn is displayed on the monitor 90. When the sample picture area 202, 203, 204 is touched with the touch pen 28, a predetermined sample picture is displayed on the monitor 90.
[0083]
In the page 210 on the right side of FIG. 8, a pencil area 211, an eraser area 212, a net area 213, a baton area 214, and a color designation area 215 are arranged. When touching the pencil area 211 with the touch pen 28, the touch pen 28 functions as a pencil. Further, by touching the desired color area of the color designation area 215 with the touch pen 28, the color of the pencil can be designated. When the touch pen 28 contacts the eraser region 212, the touch pen 28 functions as an eraser. When the touch pen 28 touches the net region 213, the touch pen 28 functions as a catching net. When the touch pen 28 contacts the baton area 214, the touch pen 28 functions as a baton.
[0084]
The drawing process will be described with reference to the flowchart of FIG.
[0085]
First, it is determined whether a sample picture is selected with the touch pen 28 (step S10). When the player touches the touch pen 28 with any of the sample picture areas 202, 203, and 204, the drawing control unit 102 controls the drawing processing unit 104 to draw the selected sample picture on the monitor 90 (step S11). . FIG. 11 shows a specific example of the sample picture. A picture of a grand piano is drawn.
[0086]
When using the electronic camera 55, for example, if the cursor is set to move in response to a red component, the human hand has a lot of red component, so the player faces the electronic camera 55. By moving the hand, the player can operate as desired.
[0087]
Further, when a desired function is selected by touching the sample area, pencil area, eraser area, and color designation area with the touch pen 28 and the hand is moved in front of the electronic camera 55 in the selected state, the tablet 24 is moved. Unlike the pen input used, it can be operated without contact.
[0088]
If no sample picture has been selected, it is determined whether or not the campus has been selected with the touch pen 28 (step S12). When the player touches the touch pen 28 with the campus area 201, the drawing control unit 102 controls the drawing processing unit 104 to draw the campus on the monitor 90 (step S13). FIG. 11 shows a specific example of a campus picture. At first, a campus where no picture is drawn is drawn.
[0089]
Next, a diagram is drawn on the monitor 90 using a pencil. Although a case where a diagram is drawn on the campus shown in FIG. 12 will be described, a diagram can also be drawn on the sample picture shown in FIG.
[0090]
In the case of using the electronic camera 55, it is possible to draw a diagram by moving the player's hand by reacting to the redness component that is often present in human hands.
[0091]
First, it is determined whether a pencil and a color are selected by the touch pen 28 (step S14). When the touch pen 28 is brought into contact with the pencil area 211 and any one of the color designation areas 215 is touched, the designated color paint brush 200 is displayed on the monitor 90.
[0092]
Next, it is determined whether or not the touch pen 28 is on the drawing tablet 24 (step S15), and further it is determined whether or not a pen button (not shown) is pressed (step S16). When the player touches the drawing pen 24 with the touch pen 28, a position signal is output from the drawing processing unit 104 to the coordinate conversion unit 112, and a color signal is output to the color information writing unit 114. The coordinate conversion unit 112 converts the position signal into an address signal of the buffer memory 120, and writes the color information indicated by the color signal by the color information writing unit 114 at the converted address (step S17). When the player moves the touch pen 28 while touching the drawing tablet 24, the paint brush 500 moves in synchronization with the movement of the touch pen 28 on the monitor 90 as shown in FIG. The figure is drawn.
[0093]
When using the electronic camera 55, the hand is moved toward the electronic camera 55 to move the designated color paintbrush displayed on the monitor 90 and draw a diagram on the monitor 90. be able to.
[0094]
When the touch pen 28 is brought into contact with the color designation area 215, the color of the paint brush 500 is changed and a plurality of color diagrams are drawn on the campus of the monitor 90. Further, the touch pen 28 is brought into contact with the eraser area 212 to display the eraser on the monitor 90, and then the touch pen 28 is moved while being in contact with the drawing tablet 24, whereby a diagram drawn on the campus of the monitor 90 is displayed. Can be erased. In this way, it is possible to freely draw a picture on the campus of the monitor 90 as if drawing a picture on an actual campus.
[0095]
In the case of using the electronic camera 55, when each function of touching a desired area with the touch pen 28 is selected, a picture can be freely drawn on the monitor 90 as if a picture is drawn on the campus. Here, screen data such as “eraser area” and “color designation area” are prepared in advance and displayed on the monitor 90, and the cursor on the monitor 90 is moved to that area by moving the hand toward the electronic camera 55. Then you can select the desired function.
[0096]
Furthermore, if the player moves his / her hand toward the electronic camera 55, the locus along the movement of the hand can be displayed on the monitor 90, and a picture can be freely drawn on the campus of the monitor 90.
[0097]
When using the electronic camera 55, unlike the case of using the touch pen 28 and the tablet 24, the operation input can be performed in a non-contact manner, so that the user can enjoy drawing with a mysterious feeling.
[0098]
(Sounding process 1)
The sound generation process of this example will be described with reference to the flowchart of FIG. The case where sound generation processing is performed using the sample picture of the grand piano shown in FIG. 11 will be described, but sound generation processing can also be performed using the diagram on the campus shown in FIG.
[0099]
First, it is determined whether or not a baton has been selected with the touch pen 28 (step S20). When the player touches the touch pen 28 with the baton area 214, the baton 502 is displayed on the monitor 90.
[0100]
Next, it is determined whether or not the touch pen 28 is on the drawing tablet 24 (step S21), and further it is determined whether or not the pen button 28a is pressed (step S22). When the player touches the drawing pen 24 with the touch pen 28, the position signal is output from the sound generation processing unit 108 to the coordinate conversion unit 116 and converted into the address of the buffer memory 120. Subsequently, the color information reading unit 118 reads the color signal in the buffer memory 120 at the converted address and outputs it to the sound generation processing unit 108 (step S23).
[0101]
When the electronic camera 55 is used, if it reacts to the red component, the control unit 100 can input the position signal by causing the electronic camera 55 to recognize the red component (for example, a player's hand). . When the position signal is input by the electronic camera 55, the position signal is output from the sound generation processing unit 108 to the coordinate conversion unit 116 and converted into the address of the buffer memory 120. The color information reading unit stores the position signal in the buffer memory 120 at the converted address. Color signals are read out and output to the sound generation processing unit 108.
[0102]
Next, it is determined whether or not the color information has changed (step S24). If there is no change in the color information, it is determined whether or not it is immediately after the pen button 28a is pressed (step S25). If not immediately after the pen button 28a is pressed, the process returns to step S20.
[0103]
If it is immediately after the pen button 28a is pressed, the sound generation processing unit 108 determines whether or not the read color information is transparent or black (step S26). This is because no sound is generated when the color is transparent or black. In addition, in the case of black, the glowing powder is taken out (step S27), and the process returns to step S20.
[0104]
When the electronic camera 55 is used, it is determined whether the color information is transparent or black immediately after the MPU 60 recognizes the redness component via the electronic camera 55.
[0105]
If the read color information is not transparent or black, the sound generation processing unit 108 determines a sound to be generated according to the color information (step S28). An utterance frequency table in which the magnification of the frequency of the sound corresponding to each color information is determined, and the frequency magnification is determined based on the utterance frequency table. Subsequently, the sound generation processing unit 108 outputs the determined sound signal and outputs it to the monitor 90 via the audio terminal 76 to generate a sound (step S29).
[0106]
In FIG. 11, since the baton 502 is positioned on the yellow note 504, a predetermined sound for yellow, for example, a piano sound is generated.
[0107]
In this way, by moving the touch pen 28 on the drawing tablet 24 and pressing the pen button 28a, various sounds corresponding to the instructed color can be generated.
[0108]
Further, when the electronic camera 55 is used, various sounds can be generated according to the color instructed by the player's movement of the hand, for example.
[0109]
Furthermore, as shown in FIG. 11, if the piano keyboard is drawn in a color that matches the pitch, simple music can be freely played by instructing the piano keyboard with the baton 502. It is.
[0110]
When the electronic camera 55 is used, the baton 502 moves on the screen in accordance with the movement of the player's hand, so simple music can be played by instructing the piano keyboard with the baton 502. It is also possible to play freely. Also, in this case, since it can be operated without contact, it can be played more like a real conductor.
[0111]
(Moving object drawing process 1)
Insect movement drawing processing for moving insects in this specific example will be described with reference to FIGS.
[0112]
In this insect movement drawing process, the moving object drawing unit 106 automatically generates an insect that likes the color according to the color used in the campus diagram, and moves the insect along the color line. It is. The player can play a game such as catching the insect by catching insects.
[0113]
(Basic flow)
FIG. 14 shows a basic flow of the insect movement drawing process.
[0114]
The basic flow of the insect movement drawing process includes an initialization process for initializing various parameters (step S30), a standby process for waiting for the occurrence of insects (step S31), and a flying process for causing the insects to fly into the screen. (Step S32), the movement process (Step S33) for moving the insect within the screen, and the flying process (Step S34) for the insect to fly off the screen. The drawing process is performed independently for the number of insects that occur.
[0115]
Details of each process will be sequentially described.
[0116]
(Initialization process)
FIG. 15 is a flowchart of the initialization process.
[0117]
First, various parameters for the display unit are initialized (step S40).
[0118]
Next, an initial position outside the screen when the insect is generated is set by a random number (step S41). Insects fly from this initial position.
[0119]
Next, a landing position where the generated insects land is set by a random number (step S42). The flying insect will land at this position first.
[0120]
Next, the dwell time timer is initialized (step S43). The flying insects fly away after a certain time. The stay time timer measures the time that the insect stays on the screen.
[0121]
Next, the moving direction setting timer is initialized (step S44). The insect resets the moving direction at a certain frequency based on the surrounding color information while moving. The movement direction setting timer measures the time for resetting the movement direction.
[0122]
Next, the traveling direction fluctuation timer is initialized (step S45). In order to make the insects appear to move naturally, the direction of movement is shifted little by little at a certain frequency. The traveling direction fluctuation timer measures the time for generating fluctuation in the moving direction.
[0123]
When the initialization process ends, the process proceeds to the next standby process.
[0124]
(Standby processing)
FIG. 16 is a flowchart of standby processing.
[0125]
In the standby process, the process waits until a specific color that generates an insect is drawn on the campus. If the specific color is drawn, the type of the insect to be generated is determined according to the color. For example, as shown in FIG. 24, if a red line 506 is drawn, a red ladybug 508 which likes red is generated, and if a blue line 510 is drawn, a blue favorite insect 512 is generated. To do.
[0126]
First, it is determined whether or not a predetermined time has elapsed since the color was drawn on the campus (step S50). If no color is drawn on the campus or if a certain time has not passed even if the color is drawn, the process returns to step S50 again.
[0127]
When a certain period of time has elapsed since the color was drawn on the campus, it is then determined whether or not the insect is a favorite color, that is, whether or not it is a color that generates the insect (step S51). If the insect does not like the color, the process returns to step S50 again.
[0128]
If the insect is one of the favorite colors, the insect type corresponding to that color is determined (step S52). For example, a ladybug is selected if it is red, and an insect that likes blue is selected if it is blue.
[0129]
Subsequently, based on the determined insect type, a color that the insect does not like is set (step S53). For example, green is selected for ladybugs, and brown is selected for insects that like blue.
[0130]
When the standby process ends, the process proceeds to the next incoming process.
[0131]
(Flying process)
FIG. 17 is a flowchart of the incoming process.
[0132]
First, from the initial position outside the screen determined in step S41 of the initialization process of FIG. 15, the type of insects determined in step S52 of the standby process of FIG. 16 are skipped (step S60), and the initialization process steps of FIG. Fly toward the landing position in the screen determined in S42 (step S61).
[0133]
Subsequently, it is determined whether or not the insect has reached the landing position (step S62). If the landing position has not been reached, the process returns to step S61 again. If the landing position has been reached, the flying process is terminated and the process proceeds to the next movement process.
[0134]
(Move process)
FIG. 18 is a flowchart of the movement process, FIG. 19 is a flowchart of the course determination process during the movement process, and FIG. 20 is a flowchart of the movement boundary check process during the movement process.
[0135]
First, as shown in FIG. 18, a course determination process for determining the path of insects according to surrounding color information is performed (step S71). Details of the course determination process will be described with reference to FIG.
[0136]
In the course determination process, first, the moving direction setting timer is decremented (step S90), and it is determined whether or not the moving direction setting timer has become zero (step S91). If the movement direction setting timer is not zero, the current traveling direction is maintained without being changed, and the movement process is terminated.
[0137]
If the moving direction setting timer is zero, a color information work memory is created (step S93). The color information work memory detects and stores color information around the current position of the insect for reference when determining the course. Sixteen specific direction areas are set around the current position of the insect as shown in FIG. These 16 specific direction areas are arranged at a predetermined distance apart in 16 directions around the current position. Each specific direction region has a certain number of dots, for example, an area of 6 dots.
[0138]
The course decision unit 107 reads the color information of the specific direction area. The course determination unit 107 outputs the reading position of each dot in the specific direction area to the coordinate conversion unit 56, and the coordinate conversion unit 116 converts the address into the buffer memory 120, and the color information in the buffer memory 120 at the converted address is color. The information is read by the information reading unit 118 and output to the route determination unit 107. It is determined whether or not the color information is a color that the insect likes or dislikes, and each is counted. The color information is read for all 16 specific direction areas, the number of favorite colors and the number of disliked colors for each specific direction area are counted and stored in the color information work memory.
[0139]
Next, referring to the color information work memory, the next traveling direction of the insect (hereinafter referred to as “turning direction”) is determined (step S94). The direction with many favorite colors around the current traveling direction is determined as the turning direction. For example, as shown in FIG. 23, assuming that the current traveling direction is the upper right direction (1), first, the specific direction area in the upper right direction (1), which is the traveling direction, is investigated, and then The color information of the specific direction area in the direction (2) to the left of the traveling direction is checked, and the color information of the specific direction area in the direction (3) to the right of the travel direction is checked. Investigate the color information of the specific direction area in the direction (4) that is further to the left of the direction. . . Sequentially, the color information of nine specific direction areas centering on the traveling direction is examined in the order indicated by the circled numbers in FIG. Investigate the number of dots of your favorite color and the presence of disliked colors.
[0140]
As a result of the investigation, the direction in which the number of dots of the most favorite color is large is set as the turning direction. If the number of dots of the favorite color is the same, priority is given to the direction closer to the current traveling direction, with the direction with a small number of circles shown in FIG.
[0141]
Next, from the presence / absence of the disliked color investigated in step S94, the number of specific direction areas including the disliked color in the investigated specific direction area is counted (step S95). If there is no specific direction area including the disliked color, the turning direction determined in step S94 is maintained and the process proceeds to step S97. If there are one or two specific direction areas including disliked colors, it is determined that there are disliked colors in the surroundings, the turning direction determined in step S94 is changed by 180 degrees (step S96), and the process proceeds to step S97. . If there are three or more specific direction areas including disliked colors, it is determined that there are a lot of disliked colors in the surroundings, and the process proceeds to the process of flying away insects (step S34).
[0142]
Next, the traveling direction fluctuation timer is decremented (step S97), and it is determined whether or not the traveling direction fluctuation timer has become zero (step S98). If the traveling direction fluctuation timer is not zero, the current traveling direction is maintained without being changed, and the course determination process is terminated.
[0143]
If the traveling direction fluctuation timer is zero, fluctuation is given to the determined turning direction (step S99). Based on the random number, select one direction based on the random number from the determined direction of rotation, the next direction counterclockwise from the direction of rotation, and the next direction clockwise from the direction of rotation. .
[0144]
When the path of the insect is determined according to the surrounding color information by the path determination process in step S71, a movement boundary check process is subsequently performed to reverse the movement of the insect at the edge of the screen (step S72). Details of the moving boundary check process will be described with reference to FIG.
[0145]
In the movement boundary check process, first, when the vehicle travels in the turning direction determined by the course determination process, it is determined whether or not the screen will protrude from the screen in the left-right direction (step S100). If it is determined that it will protrude, the direction of travel is reversed left and right (step S101).
[0146]
Next, when the vehicle travels in the turning direction determined by the course determination process, it is determined whether or not the screen protrudes from the screen in the vertical direction (step S102). If it is determined that it will protrude, the traveling direction is turned upside down (step S103).
[0147]
The current speed is added to the final turning direction determined in this way to determine the next new coordinate (step S104). The drawing processing unit 104 draws the insect so that the insect moves to the coordinate position thus determined.
[0148]
When the next new coordinates are finally determined by the moving boundary process in step S72, the process proceeds to the bug removing game process in step S73 and subsequent steps in FIG.
[0149]
An outline of the bug trapping game will be described. When the player wants to play a bug catching game, the touch pen 28 is brought into contact with the net area 213 and a cursor 514 of a bug catching net is displayed on the monitor 90 as shown in FIG. By moving the touch pen 28 while touching the drawing tablet 24 and pressing the pen button 28a, the insects 508 and 512 on the monitor 90 can be captured and moved together with the insect catching net 514.
[0150]
Note that when using an electronic camera, if the net cursor 514 is set to move in response to redness, for example, the net cursor 514 moves on the screen in accordance with the movement of the player's hand. Therefore, the insects 508 and 512 on the monitor 90 can be captured and moved together with the insect catching net 514.
[0151]
Separately, when a selection button (not shown) is displayed on the screen and the hand is moved toward the electronic camera 55 to move the cursor on the screen, the cursor is superimposed on the selection button. The display may be changed to a net cursor 514 for display.
[0152]
First, it is determined whether or not the cursor on the screen by the touch pen 28 is touching an insect and the pen button 28a is pressed (step S73). If it is determined that the cursor on the screen is touching an insect and the pen button 28a is pressed, it is determined whether or not the cursor is an insect net (step S74). If it is determined that the cursor is not a bug net, the process proceeds to the next fly-off process (step S34).
[0153]
When using the electronic camera, the cursor may be touched by a bug on the screen, and the process may be skipped when the moving speed of the cursor is equal to or higher than a predetermined speed. The number of frames required to move the cursor is obtained from the difference between the current frame and the past frame, and the speed is calculated by multiplying the number of frames by 1/60 seconds (one frame time).
[0154]
If it is determined that the cursor is a insect net, it is determined whether or not the cursor is separated from the insect net (step S75). If it is determined that they are separated, the process returns to step S77 and the above-described processing is repeated. If it is not separated from the insect trapping net, it is determined that the insect is caught by the insect trapping net, and a new coordinate value of the insect is determined so that the insect moves toward the center of the insect trapping net ( Step S76). Subsequently, the process returns to step S75 again, and the processes of steps S75 and S76 are repeated. In this way, the insects 508 and 510 can be caught by the insect catching net 514 and moved together.
[0155]
If it is determined in step S73 that the cursor on the screen by the touch pen 28 is not touching an insect, it is then determined whether or not the screen has been completely erased (step S77). If the entire screen has been erased, the process proceeds to the next skipping process (step S34).
[0156]
If the entire screen has not been erased, it is determined by referring to the color information work memory whether there is a color that the insect likes in the surroundings (step S78). If there is a favorite color in the surroundings, the dwell time timer is initialized (step S81), the process returns to step S77, and the above-described processing is repeated.
[0157]
If there is no favorite color in the surroundings, the stay time timer is decreased (step S79), and it is determined whether or not this stay time timer has become zero (step S80). If the stay time timer is not zero, the process returns to step S77 and the above-described processing is repeated. If the stay time timer has become zero, the process proceeds to the next fly-off process (step S34).
[0158]
(Flying process)
FIG. 21 is a flowchart of the flying process.
[0159]
First, the insect is blown from the current position (step S110), and is blown toward a predetermined position outside the screen (step S111). Subsequently, it is determined whether or not the insect has gone out of the screen (step S112). If it is not out of the screen, the process returns to step S111 again. If it is outside the screen, the flying process is terminated, the process returns to the initialization process (step S30) again, and the above-described process is repeated.
[0160]
In this way, the generation and movement of these insects are performed automatically, and no special operation by the player is required, but the player can play a game such as capturing the insect by catching insects.
[0161]
According to the sound generation process and the moving object drawing process as described above, the picture is not simply drawn on the monitor, but the picture is used to generate a sound, play music, or catch an insect. Various games such as can be performed.
[0162]
(Second specific example of video game)
Next, a second specific example of the video game of the video game apparatus according to the present embodiment will be described with reference to FIGS. The sound generation process and the moving object drawing process are different from the first specific example.
[0163]
(Sound production process 2)
The sound generation process of this example will be described with reference to the flowchart of FIG. A case where sound generation processing is performed using the sample picture of the grand piano shown in FIG. 26 will be described.
[0164]
First, it is determined which type of command stick has been selected by the touch pen 28 (step S120). In this specific example, a command bar that emits the tone of another animal can be selected in addition to a command bar that plays a normal organ sound. As shown in FIG. 26, the type of baton can be displayed on the screen as a tool box 520. The player operates the touch pen 28 to place the cursor on the animal picture in the tool box 520 and press the pen button. Press 28a to select the desired animal. For example, when a cat picture 522 in the tool box 520 is selected, as shown in FIG. 26, a command stick 524 having a cat picture at the tip is displayed.
[0165]
When the electronic camera 55 is used for selection, a plurality of selectable command bar buttons are displayed on the screen, and a selection is made by placing the cursor on the screen on the desired command button. For example, if the image is processed so as to react to redness, the movement of the cursor can be realized by moving the cursor accordingly when the player moves his / her hand toward the electronic camera 55.
[0166]
Next, it is determined whether or not the touch pen 28 is on the drawing tablet 24 (step S121), and further it is determined whether or not the pen button 28a is pressed (step S122). When the player touches the drawing pen 24 with the touch pen 28, the position signal is output from the sound generation processing unit 108 to the coordinate conversion unit 116 and converted into the address of the buffer memory 120. Subsequently, the color information reading unit 118 reads the color signal in the buffer memory 120 at the converted address and outputs it to the sound generation processing unit 108 (step S123).
[0167]
Next, it is determined whether or not the color information has changed (step S124). If there is no change in color information, it is determined whether or not it is immediately after the pen button 28a is pressed (step S125). If not immediately after the pen button 28a is pressed, the process returns to step S120.
[0168]
If it is immediately after the pen button 28a is pressed, the sound generation processing unit 108 determines whether the read color information is transparent, water, or black (step S126). If it is transparent or water or black, the process returns to step S120 without generating a sound.
[0169]
If the read color information is not transparent or water or black, the sound generation processing unit 108 determines a sound to be generated according to the color information and the type of the baton (step S127). A voice that defines the tone color (organ sound, dog voice, cat voice, monkey voice, pig voice, elephant voice) according to the type of conductor, and the sound frequency magnification corresponding to each color information A frequency table is defined, and a generated sound is determined based on the tone color and the utterance frequency table. For example, when a cat is selected, the scale can be played with the voice of the cat.
[0170]
Subsequently, the sound generation processing unit 108 outputs the determined sound signal and outputs it to the monitor 90 via the audio terminal 76 to generate a sound (step S128).
[0171]
In FIG. 26, since the cat baton 524 is positioned on the yellow note 504, a predetermined sound for the cat baton and yellow, for example, a sound of a cat's voice with a height is recorded. appear.
[0172]
In this way, by moving the touch pen 28 on the drawing tablet 24 and pressing the pen button 28a, various sounds corresponding to the instructed color can be generated.
[0173]
(Moving object drawing process 1)
An animal movement drawing process for moving an animal in this example will be described with reference to FIGS.
[0174]
In this animal movement drawing process, an animal appears on the campus by clicking on the picture of the animal in the picture book, and the animal is moved along the color line. Depending on the color information of the surroundings, the picture of the animal changes and sometimes takes a break. In this specific example, as shown in FIG. 34, a hip 221, a gorilla 222, a lion 232, a bird 231, and an elephant 234 are drawn in a picture book, and these five kinds of animals can appear.
[0175]
(Basic flow)
FIG. 27 shows a basic flow of the animal movement drawing process.
[0176]
The basic flow of the animal movement drawing process includes an initialization process for initializing various parameters (step S130), a standby process for waiting until an animal is requested (step S131), and an appearance for causing the selected animal to appear on the screen. Processing (step S132), movement processing for moving or resting animals on the screen (step S133), and exit processing for leaving animals from the screen (step S134) are performed in this order. The drawing process is independently performed for the number of animals generated.
[0177]
Details of each process will be sequentially described.
[0178]
(Initialization process)
FIG. 28 is a flowchart of the initialization process.
[0179]
First, various parameters for the display unit are initialized (step S140).
[0180]
Next, an initial position outside the screen when the animal appears is set by a random number (step S141). Animals appear from this initial position.
[0181]
Next, the favorite color according to the kind of animal which appears is set (step S142). For example, if you are a hippopotamus, if you are an elephant, you like a grass color.
[0182]
Next, the moving direction setting timer is initialized (step S143). The animal resets the moving direction at a certain frequency based on the surrounding color information while moving. The movement direction setting timer measures the time for resetting the movement direction.
[0183]
Next, the traveling direction fluctuation timer is initialized (step S144). In order to make the animal appear to move naturally, the movement direction is gradually shifted at a certain frequency. The traveling direction fluctuation timer measures the time for generating fluctuation in the moving direction.
[0184]
Next, the inversion suppression timer is initialized (step S145). When the moving direction of the animal is reversed, the image of the animal is switched according to the direction. However, in order to make the animal appear to move naturally, the animal image is not changed immediately even if the moving direction is reversed. Suppresses the inversion of the time image. The inversion suppression timer measures the time for suppressing the inversion of the image.
[0185]
When the initialization process ends, the process proceeds to the next standby process.
[0186]
(Standby processing)
FIG. 29 is a flowchart of standby processing.
[0187]
In the waiting process, the process waits until the animal picture in the picture book is touched with the touch pen 28, and prepares to make the touched animal appear.
[0188]
First, it is determined whether or not an animal picture in the picture book has been touched with the touch pen 28 (step S150). If it is not touched anywhere with the touch pen 28 or if it is not touched by the position of the animal picture, the process returns to step S150 again.
[0189]
If an animal picture is touched by the touch pen 28, the type of animal is determined from the output of the picture book tablet 32 (step S151).
[0190]
When the electronic camera 55 is used for selection, a picture of a selectable animal is displayed on the screen, and the selection is made by superimposing a cursor on the screen on the picture of the desired animal.
[0191]
Subsequently, the end position of the movement within the campus when the animal appears is set with a random number (step S152).
[0192]
When the standby process ends, the process proceeds to the next appearance process.
[0193]
(Appearance process)
FIG. 30 is a flowchart of the appearance process.
[0194]
First, from the initial position outside the screen defined in step S141 of the initialization process of FIG. 28, the type of animal defined in step S151 of the standby process of FIG. 29 is caused to appear (step S160), and the standby process step of FIG. 29 is performed. It moves toward the end position in the screen determined in S152 (step S161).
[0195]
Subsequently, it is determined whether or not the animal has reached the end position (step S162). If the end position has not been reached, the process returns to step S161 again. If the end position has been reached, the appearance process is terminated and the process proceeds to the next movement process.
[0196]
(Move process)
FIG. 31 is a flowchart of the movement process, and FIG. 32 is a flowchart of the speed setting / animal inversion process during the movement process. Note that the details of the course determination process and the movement boundary check process during the movement process are the same as those in the first specific example, and thus description thereof is omitted.
[0197]
First, as shown in FIG. 31, a course determination process for determining the course of an animal according to surrounding color information is performed (step S170). The details of the course determination process are the same as those in FIG. 19 of the first specific example, but the difference from the first specific example is that the process regarding the disliked color is not performed.
[0198]
When the course of the animal is determined according to the surrounding color information by the course determination process in step S170, the speed setting / animal inversion process is subsequently performed (step S171). Details of the speed setting / animal inversion processing will be described with reference to FIG.
[0199]
In the speed setting / animal determination process, first, the speed is determined from the turning direction determined by the course determination process, and the horizontal and vertical speed components are obtained (step S181). Since the moving speed differs depending on the animal, the moving speed is read from the speed conversion table, and the horizontal and vertical speed components are obtained from the moving speed and the turning direction.
[0200]
Next, it is determined whether or not the current traveling direction matches the left and right orientations of the current animal image (step S182). A left-facing image and a right-facing image are prepared in advance as images of each animal. If the horizontal component of the speed is to the left, the left-facing image of the animal is displayed, and if it is to the right, a right-facing image is displayed. In step S182, it is determined whether the orientation of the animal image is in the traveling direction.
[0201]
If it is determined that the current traveling direction does not match the orientation of the animal image, the inversion suppression timer is decremented (step S183), and it is determined whether the inversion suppression timer has become zero (step S184). If the inversion suppression timer is zero, the image of the animal is switched to an image in the matching direction (step S185).
[0202]
If it is determined in step S182 that the current traveling direction matches the left and right orientation of the animal image, the inversion suppression timer is initialized (step S186), and the process proceeds to the next moving boundary check process.
[0203]
If it is determined in step S184 that the inversion suppression timer is not zero, the process proceeds to the next moving boundary check process.
[0204]
Subsequently, a moving boundary check process is performed to invert the animal at the edge of the screen (step S72). The details of the moving boundary check process are the same as those in FIG.
[0205]
When the next new coordinate is finally determined by the moving boundary process in step S72, the process proceeds to the process after step S173 in FIG.
[0206]
First, a process of switching an animal image based on surrounding color information is performed.
[0207]
First, the color information work memory created in the course determination process in step S170 is referred to count how many dots around the favorite color of the appearing animal, for example, determine whether there are 46 or more (see FIG. Step S173). If the number is 46 or more, the image of the animal is switched (step S174).
[0208]
For example, in the case of a hippopotamus, if it is surrounded by a light blue color 530, it is determined that the hippo is underwater, and the hippo image is submerged from the walking hippo image 532 shown in FIG. Switch to the image 534 of the hippopotamus swimming. As shown in FIG. 36, it looks as if the hippopotamus 534 is swimming in the water 530. Realistic image display can be performed by switching images when other animals are surrounded by favorite colors.
[0209]
Next, a process is performed in which the animal takes a break at regular intervals. The movement is paused at regular intervals, and an image of a resting animal is displayed. When the break time ends, the movement starts again. Set a break timer for each animal. The time of the break timer varies depending on the animal.
[0210]
First, it is determined whether or not it is a break timing (step S175). If it is time for a break, an image of a resting animal is displayed (step S176). If it is not a break timing, the process proceeds to step S178.
[0211]
Subsequently, it is determined whether or not the break time timer for measuring the break time has become zero (step S177). If the break time timer is zero, an image of the animal at the end of the break is displayed (step S180).
[0212]
Next, a process of generating a cry by clicking an animal image is performed. When the touch pen 28 is operated to move the cursor to an animal on the screen and click, the animal changes its image and generates a cry.
[0213]
First, it is determined whether or not the cursor is on the animal and the touch pen 28 is clicked (step S178). When clicked, an image of an animal that generates a cry is displayed and a cry is generated (step S179).
[0214]
When selecting using the electronic camera 55, a picture of a selectable animal is displayed on the screen, and the cursor on the screen is overlaid on the picture of the desired animal, and the cursor is moved to the left and right. Select with.
[0215]
(Exit processing)
FIG. 33 is a flowchart of exit processing.
[0216]
First, it is determined whether or not an animal picture in the picture book has been touched with the touch pen 28 (step S190). If it is not touched anywhere with the touch pen 28 or if it is not touched by the position of the animal picture, the process returns to the initialization process (step S130) again, and the above-described process is repeated.
[0217]
If an animal picture is touched with the touch pen 28, an exit process for leaving the displayed animal out of the screen is performed. The animal image is moved toward a predetermined position outside the screen (step S191). Subsequently, it is determined whether or not the animal has moved out of the screen (step S192). If not, the process returns to step S191 again. If it is outside the screen, the exit process is terminated, the process returns to the initialization process (step S130) again, and the above-described process is repeated.
[0218]
In this way, various games can be played by generating animals according to the player's instructions, moving them according to the color information of the picture drawn, switching images, taking a break, or making a cry. .
[0219]
When the electronic camera 55 is used, selection means or switching means that can select whether the touch pen 28 or the electronic camera 55 is used as input means is provided. This selection means or switching means may be provided as hardware such as a changeover switch, or may be provided as software such as a program that allows selection on the screen.
Further, both the operation input by the electronic camera 55 and the operation input by the touch pen 28 may be made possible so that both input means can be used simultaneously. For example, a child can perform an operation input using the touch pen 28, and a parent can perform an operation input using the electronic camera 55. A cursor that can be independently operated may be displayed on the display screen, and an operation display corresponding to each operation input, for example, an input operation for drawing a diagram with the cursor may be displayed on the same screen.
[0220]
[Modified Embodiment]
The present invention is not limited to the above embodiment, and various modifications can be made.
[0221]
For example, although the video game device for infants is used in the above embodiment, the basic configuration may be the same as that in the above embodiment, and the present invention may be applied to other game devices.
[0222]
In addition to the game device, the basic configuration may be the same as that of the above-described embodiment, and the present invention may be applied to an electronic tablet such as an electronic tablet that electronically writes pictures.
[0223]
The basic configuration may be the same as that of the above embodiment, and the present invention may be applied to image processing such as a game program and an image program in a general-purpose computer such as a personal computer.
[0224]
The basic configuration may be the same as in the above embodiment, and the present invention may be applied to other games such as a music game that is operated in accordance with music.
[0225]
【The invention's effect】
As described above, according to the present invention, the image pickup means for picking up an image, the storage means for storing image data picked up by the image pickup means for a plurality of frames, and the image data stored in the storage means are sequentially displayed on the display screen. Based on the difference data calculated by the difference calculation means, and the difference calculation means for calculating difference data obtained by comparing the image data of one frame with the image data of another frame. Since the behavior of the moving body displayed on the display screen is determined, specific information can be obtained from the captured image of a player or the like, and the image display can be controlled based on the information.
[Brief description of the drawings]
FIG. 1 is a block diagram showing functions of a video game apparatus according to a first embodiment of the present invention.
FIG. 2 is an explanatory diagram showing a first specific example of the playing method of the video game apparatus according to the first embodiment of the present invention.
FIG. 3 is an explanatory diagram showing a second specific example of the playing method of the video game apparatus according to the first embodiment of the present invention.
FIG. 4 is an explanatory diagram showing a third specific example of the playing method of the video game apparatus according to the first embodiment of the present invention.
FIG. 5 is a perspective view showing an appearance of a video game apparatus according to a second embodiment of the present invention.
FIG. 6 is a diagram showing a software cartridge of a video game apparatus according to a second embodiment of the present invention.
FIG. 7 is a block diagram showing a hardware configuration of a video game apparatus according to a second embodiment of the present invention.
FIG. 8 is a functional block diagram of a video game apparatus according to a second embodiment of the present invention.
FIG. 9 is a diagram showing an example of a picture book of a software cartridge in a first specific example of a video game according to the second embodiment of the present invention.
FIG. 10 is a flowchart of a drawing process in the first specific example of the video game according to the second embodiment of the present invention.
FIG. 11 is a diagram showing an example of a sample picture in the first specific example of the video game according to the second embodiment of the present invention.
FIG. 12 is a diagram showing an example of a picture of a campus in the first specific example of the video game according to the second embodiment of the present invention.
FIG. 13 is a flowchart of a sound generation process in the first specific example of the video game according to the second embodiment of the present invention.
FIG. 14 is a flowchart of an insect movement drawing process in the first specific example of the video game according to the second embodiment of the present invention.
FIG. 15 is a flowchart of initialization processing in the first specific example of the video game according to the second embodiment of the present invention;
FIG. 16 is a flowchart of standby processing in the first specific example of the video game according to the second embodiment of the present invention;
FIG. 17 is a flowchart of the flying process in the first specific example of the video game according to the second embodiment of the present invention.
FIG. 18 is a flowchart of movement processing in a first specific example of a video game according to the second embodiment of the present invention;
FIG. 19 is a flowchart of a course determination process in the first specific example of the video game according to the second embodiment of the present invention.
FIG. 20 is a flowchart of a moving boundary check process in the first specific example of the video game according to the second embodiment of the present invention.
FIG. 21 is a flowchart of a flying process in the first specific example of the video game according to the second embodiment of the present invention.
FIG. 22 is an explanatory diagram of a course decision process in the first specific example of the video game according to the second embodiment of the present invention.
FIG. 23 is an explanatory diagram of a course decision process in the first specific example of the video game according to the second embodiment of the present invention.
FIG. 24 is a diagram showing an example of a picture of a campus in the first specific example of the video game according to the second embodiment of the present invention.
FIG. 25 is a flowchart of sound generation processing in the second specific example of the video game according to the second embodiment of the present invention.
FIG. 26 is a diagram showing a specific example of a sample picture in the second specific example of the video game according to the second embodiment of the present invention.
FIG. 27 is a flowchart of an animal movement drawing process in the second specific example of the video game according to the second embodiment of the present invention.
FIG. 28 is a flowchart of initialization processing in the second specific example of the video game according to the second embodiment of the present invention.
FIG. 29 is a flowchart of standby processing in a second specific example of the video game according to the second embodiment of the present invention.
FIG. 30 is a flowchart of an appearance process in a second specific example of the video game according to the second embodiment of the present invention.
FIG. 31 is a flowchart of movement processing in a second specific example of the video game in the second embodiment of the present invention;
FIG. 32 is a flowchart of speed setting / animal inversion processing in the second specific example of the video game according to the second embodiment of the present invention;
FIG. 33 is a flowchart of exit processing in a second specific example of the video game according to the second embodiment of the present invention.
FIG. 34 is a diagram illustrating an example of a picture book of a software cartridge in a second specific example of the video game according to the second embodiment of the present invention.
FIG. 35 is a diagram showing an example of a picture of a campus in the second specific example of the video game according to the second embodiment of the present invention.
FIG. 36 is a diagram showing an example of a picture of a campus in the second specific example of the video game according to the second embodiment of the present invention.
[Explanation of symbols]
10 ... Game device body
12 ... Software cartridge
14 ... Bottom lid
16 ... Upper lid
18 ... Cartridge slot
20 ... Direction buttons
22 ... execute button
24 ... Drawing tablet
26 ... Touch pen holder
28 ... Touch pen
28a ... Pen button
32 ... Picture book tablet
34 ... Power switch
36 ... Reject button
38 ... Page sensor
40 ... Binding ring
42 ... Page
46. Picture book placement part
48 ... Circuit board
50. Substrate storage part
52 ... Sensor hole
54 ... Program ROM
55 ... Electronic camera
60 ... MPU
62 ... RAM
64 ... Video display processor (VDP)
66 ... Video RAM
70 ... Video terminal
72. Speech synthesis LSI
76 ... Audio terminal
78 ... Controller
80 ... Analog switch
84 ... Address bus
86: Data bus
88 ... Control bus
90 ... Monitor
100: Control unit
102: Drawing control unit
103: Drawing processing unit
106: Moving object drawing unit
107 ... Course determining unit
110: Buffer memory input / output unit
112 ... coordinate conversion unit
114 ... color information writing unit
116: Coordinate conversion unit
118 ... Color information reading unit
120: Buffer memory
200: Game device
202 ... CPU
204 ... System memory
206: Program data storage device or storage medium
208 ... BOOTROM
210 ... Bus Arbiter
212 ... Rendering processor
214 ... Graphic memory
216 ... Display monitor
218 ... Audio processor
220: Audio memory
222 ... Speaker
224 Modem
226 ... Controller
228 ... Backup memory
230 ... Microphone
232 ... Electronic camera
300, 310 ... Player
302, 304 ... moving body
314 ... Indicator bar

Claims (4)

Imaging means for imaging a player;
Storage means for storing a plurality of image data obtained by imaging the player for each frame by the imaging means;
Image display means for sequentially displaying the image data stored in the storage means on a display screen;
A difference calculating means for calculating difference data obtained by comparing the image data of one frame and the image data of another frame among the plurality of image data;
The movement of the player's hand is detected based on the difference data calculated by the difference calculating means, and when the accumulated distance obtained by accumulating the movement distance of the player's hand exceeds a predetermined set value, A control means for starting a game program on the basis of an operation input by a player and displaying the game screen on the display screen by the image display means;
The control means calculates the speed of movement of the player's hand based on the difference data calculated by the difference calculation means, and if the speed of movement of the hand is a predetermined value or more, the movement An image processing system characterized by accumulating distances as they are and accumulating a value obtained by subtracting a predetermined distance from the moving distance when the speed of movement of the hand is a predetermined value or less.   The control means resets the cumulative distance when the cumulative distance does not exceed the predetermined set value even after a predetermined time has elapsed since the movement of the player's hand was detected. The image processing system according to claim 1.   A specific detection area is set on the display screen, the difference calculation means calculates difference data in the specific detection area, and the control means calculates the difference between the specific detection areas calculated by the difference calculation means. The image processing system according to claim 1, wherein an operation input by the player is determined based on difference data. Imaging means for imaging a player;
Storage means for storing a plurality of image data obtained by imaging the player for each frame by the imaging means;
Image display means for sequentially displaying the image data stored in the storage means on a display screen;
A difference calculating means for calculating difference data obtained by comparing the image data of one frame and the image data of another frame among the plurality of image data;
Of the difference data calculated by the difference calculation means, the movement of the player's hand is detected based on the difference data of the redness component, the speed of the player's hand movement is calculated, and the hand When the movement speed of the player is equal to or greater than a predetermined value, the movement distance of the player's hand is accumulated as it is, and when the movement speed of the hand is equal to or less than the predetermined value, the predetermined distance is subtracted from the movement distance. When the cumulative distance obtained by accumulating the movement distance of the player's hand exceeds a predetermined set value, the game program is started by determining that the operation input is made by the player, and the image display means An image processing system comprising: control means for displaying the game screen on the display screen.

Images