JP2013175209A - Image processing program, image processing device, image processing method, and image processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing program and an image processing device that when processing an image displayed by a user operation in accordance with a user operation, process the image while adding a new performance effect.SOLUTION: Image generating means generates an input image on the basis of an output of a pointing device. Image display controlling means displays the input image generated by the image generating means on display means. Image change controlling means decomposes the input image generated by the image generating means into a plurality of partial images, and executes processing for changing at least one of a display position and a display mode for each of the partial images.

Description

  The present invention relates to an image processing program and an image processing apparatus, and more specifically to an image processing program and an image processing apparatus for deleting a displayed image.

  2. Description of the Related Art Conventionally, various devices for erasing displayed images in response to user operations have been developed (see, for example, Patent Document 1). The game device disclosed in Patent Document 1 displays a handwritten image corresponding to a player's handwritten input. In the game device, the displayed handwritten image is erased by the player performing a predetermined erasing operation. For example, when the player operates the delete all button, the line type of the handwritten image displayed until then becomes a wavy line, and the drawing color is changed (for example, changed to a light color) and displayed.

JP 2006-167192 A

  However, since the game device disclosed in Patent Document 1 is only erased by changing the line type and the drawing color of the entire handwritten image, even if the user performs an erase operation, there is also an effect on the operation. There is no event for the operation. Therefore, since the user does not feel the erasing operation itself interesting, the erasing operation itself for erasing the handwritten image is handled as a mere uniform operation. That is, in the game device disclosed in Patent Document 1, since processing for the entire handwritten image is performed in response to a user operation (erasing operation), it is difficult to obtain a new effect on the handwritten image. Met.

  SUMMARY OF THE INVENTION Therefore, an object of the present invention is to provide an image processing program and an image processing apparatus for processing an image displayed by a user operation according to the user operation by adding a new effect to the image. It is.

  The present invention employs the following configuration in order to solve the above problems. Note that reference numerals in parentheses, step numbers, supplementary explanations, and the like in this column indicate correspondence with embodiments described later in order to help understanding of the present invention, and limit the present invention in any way. It is not a thing.

  The first invention is an image processing program executed by a computer (31) of an apparatus that performs a predetermined process on an image (Ihw, Ist) generated in response to an output from a pointing device (13). The image processing program causes the computer to function as image generation means (CPU 31 that executes step 54; only step numbers will be described below), image display control means (S54), and image change control means (S56, S57). . The image generation means generates an input image (Ihw, Ist) based on the output of the pointing device. The image display control means displays the input image generated by the image generation means on the display means (12). The image change control unit decomposes the input image generated by the image generation unit into a plurality of partial images (Ihw1 to Ihw5, Istn), and executes a process of changing at least one of the display position and the display mode for each partial image. To do. The pointing device is an input device for designating an input position and coordinates on the screen. For example, a screen position indicated by a touch panel, a mouse, a track pad, a track ball, a pen tablet, a joystick, or a game controller housing. This is realized by a system for detecting In addition, the process of changing the display position or the display mode includes a process of moving for each decomposed image, a process of changing the shape (enlargement, reduction, etc.) for each decomposed image, and a display direction for each decomposed image. It includes a process of changing (rotating), a process of changing a color for each decomposed image, a process of blinking for each decomposed image, a process of changing the transparency for each decomposed image, and the like. Note that the process of changing the display position or the display mode may target a part of the input image, not the entire input image.

  In a second aspect based on the first aspect, when the user performs an erasing operation, the image change control means performs a process of changing the partial image that is the target of the erasing operation as a target. The subsequent image is displayed on the display means, and the partial image that is the target after the display is deleted from the display screen. Note that the partial image to be erased may be the entire input image or a part of the input image.

  In a third aspect based on the first or second aspect, the image change control means divides the display area of the input image into blocks each composed of a plurality of pixels (S71), and the input image in units of the block. Is decomposed into a plurality of partial images.

  According to a fourth aspect of the present invention, in the first or second aspect of the present invention, the continuous determination means (S76, S94, S114, S134, S153) further functions. The continuous determination means determines a continuous portion of the input image. The image change control means decomposes the input image into a plurality of partial images based on the determination by the continuous determination means so that the continuous parts belong to the same partial image.

  In a fifth aspect based on the fourth aspect, the image change control means divides the display area of the input image into blocks each composed of a plurality of pixels, and the input image is divided into a plurality of partial images in units of the block. Decompose. The continuity determining means determines that the blocks spanned by the input image are continuous. The image change control means further decomposes the input image into a plurality of partial images so that consecutive blocks belong to the same partial image based on the determination by the continuous determination means.

  In a sixth aspect based on the fifth aspect, if the input image is included in one of the adjacent areas of the two adjacent blocks, the continuity determination means is that the two blocks are continuous. Determine (Judgment criteria A in FIG. 20).

  In a seventh aspect based on the fifth aspect, if the input image is included in both adjacent areas of two adjacent blocks, the continuous determination means determines that the two blocks are continuous. (FIG. 20 criteria B).

  In an eighth aspect based on the seventh aspect, the continuity determining means is such that the input image included in the adjacent region of one block of the two blocks and the input image included in the adjacent region of the other block are continuous. Are further determined and it is determined that the two blocks are continuous (determination criterion C in FIG. 20).

  In a ninth aspect based on the fifth aspect, in the adjacent block determined to be continuous to a certain block by the continuous determining means, the adjacent block and another block further adjacent to the adjacent block are continuous. If it is continuous, it is determined that the certain block, the adjacent block, and the other block are continuous (FIGS. 12 to 16).

  In a tenth aspect based on the first aspect, the image change control means changes the display position for each partial image by giving the same movement speed in the same movement direction to the element images constituting the partial image. To do.

  In an eleventh aspect based on the fifth aspect, the image change control means gives the same movement speed in the same movement direction to each block determined to be continuous by the continuous determination means. The display position is changed for each partial image (FIG. 23A).

  In a twelfth aspect based on the first or second aspect, the apparatus comprises imaging means (23, 25) for imaging the periphery of the apparatus. The image display control unit displays the captured image captured by the imaging unit on the display unit in real time, and displays the input image generated by the image generation unit superimposed on the captured image and displayed on the display unit.

  In a thirteenth aspect based on the first or second aspect, the image generation means generates a handwritten image (Ihw) based on the output of the pointing device.

  In a fourteenth aspect based on the first or second aspect, a predetermined composition image (Ist) displayed at a position based on the output of the pointing device is generated.

  In a fifteenth aspect based on the first or second aspect, after the first input image is generated, the image generation means generates a second input image based on the output of the pointing device. The image display control means synthesizes and displays the first input image and the second input image. The image change control means decomposes the image by combining the first input image and the second input image as one image.

  In a sixteenth aspect based on the second aspect, the image change control means decomposes the entire input image into a plurality of partial images when the user performs an erasing operation for erasing all of the plurality of partial images. For all the images, a process for changing at least one of the display position and the display mode is performed and displayed on the display means, and after the display, all the partial images are erased from the display screen.

  In a seventeenth aspect based on the second aspect, the image change control unit moves the partial image to a different display position and causes the display unit to display the image.

  In an eighteenth aspect based on the seventeenth aspect, the image change control means erases the image from the display screen by moving the partial image to the outside of the display screen.

  In a nineteenth aspect based on the seventeenth aspect, the image change control means gives an acceleration in a specific direction common to a plurality of partial images after giving an initial velocity in a different direction for each partial image. Erase the image from the display screen.

  In a twentieth aspect based on the first or second aspect, the pointing device is a touch panel that covers the display screen of the display means.

  In a twenty-first aspect based on the first or second aspect, the image change control means decomposes the input image generated by the image generation means for each color of the image.

  In a twenty-second aspect, in the first or second aspect, the computer is further caused to function as input position history storage control means. The input position history storage control means stores the history of input positions output from the pointing device in the memory (32). Based on the history of the input position, the image change control means is an input image generated from a group of input positions in which the output of the input position is not interrupted among the input positions used by the image generation means to generate the input image. Each time, the input image generated by the image generation means is decomposed.

  In a twenty-third aspect based on the first or second aspect, the image change control means decomposes the input image generated by the image generation means into a mesh shape set in advance.

  In a twenty-fourth aspect based on the first aspect, the image change control means rotates each disassembled partial image and displays it on the display means.

  In a twenty-fifth aspect based on the first aspect, the image change control means enlarges or reduces each decomposed partial image and causes the display means to display the enlarged partial image.

  In a twenty-sixth aspect based on the first aspect, the image color is changed for each decomposed partial image and displayed on the display means.

  In a twenty-seventh aspect based on the first aspect, the image change control means causes each of the decomposed partial images to blink and display on the display means.

  A twenty-eighth aspect of the present invention is an image processing apparatus that performs a predetermined process on an image generated according to an output from a pointing device. The image processing apparatus includes an image generation unit, an image display control unit, and an image change control unit. The image generation means generates an input image based on the output of the pointing device. The image display control means displays the input image generated by the image generation means on the display means. The image change control unit decomposes the input image generated by the image generation unit into a plurality of partial images, and executes a process of changing at least one of the display position and the display mode for each partial image.

  According to the first aspect, since at least one of the display position and the display mode is changed for each partial image obtained by disassembling the input image displayed by the user operation, a new effect is added to the input image. The input image can be processed.

  According to the second aspect of the invention, when partial erasure or full erasure processing is performed on an input image displayed by a user operation according to a user partial erasure or full erasure operation, at least one of the display position and the display mode is set for each partial image. Since it is changed and deleted, the input image can be deleted by adding a new effect to the input image.

  According to the third aspect of the present invention, the processing load of the process of decomposing an image can be reduced by setting the image decomposition unit not as a pixel unit but as a larger block unit.

  According to the fourth aspect, when an input image displayed by a user operation is processed, a new effect can be added to the decomposed image for each continuous portion.

  According to the fifth aspect of the present invention, the determination processing load can be reduced by determining the continuous portion not in units of pixels but in units of larger blocks.

  According to the sixth to eighth aspects, when connection determination between adjacent blocks is performed, accurate connection determination can be performed using only pixels in the adjacent region. In addition, since the determination result of connection between blocks changes by using the determination criteria of each of the sixth to eighth inventions, the processing load, the accuracy of decomposing the input image, and the like are adjusted by using an appropriate determination criterion. be able to.

  According to the ninth aspect, it is possible to accurately determine a group of blocks connected in various modes by repeating recursive processing.

  According to the tenth aspect of the present invention, it is possible to move in units of partial images without considering each partial image formed of element images as one object.

  According to the eleventh aspect, a plurality of blocks belonging to the same group can be moved in units of groups without considering them as one object.

  According to the twelfth to fourteenth aspects, it is possible to perform processing such as adding a user's handwritten line, handwritten character, and handwritten mark (signature, stamp) group on the captured image.

  According to the fifteenth aspect, similar image decomposition processing and image effect processing can be performed without being affected by the number of images generated by the user.

  According to the sixteenth aspect, it is possible to erase all in response to a user's all erasing operation.

  According to the seventeenth to nineteenth aspects, it is possible to produce an image effect such that the partial images are moved in different directions to be erased.

  According to the twentieth aspect, the user can perform intuitive operations by operating using the touch panel.

  According to the twenty-first to twenty-third aspects, an image generated in response to a user operation can be decomposed into partial images in various units, and the image can be processed by adding a new effect to the partial image. .

  According to the twenty-fourth to twenty-seventh aspects, the input image can be processed by adding various effects to the partial image.

  Further, according to the image processing apparatus of the present invention, it is possible to obtain the same effect as the above-described image processing program.

1 is an external view of a game apparatus 1 that executes an image processing program according to an embodiment of the present invention. 1 is a block diagram showing an example of the internal configuration of the game apparatus 1 of FIG. The figure which shows an example of the handwritten character Ihw displayed on lower LCD12 The figure which shows the 1st step of the production example expressed with lower LCD12 when a user performs operation which erases all the handwritten characters Ihw. The figure which shows the 2nd step of the example of production expressed with lower LCD12 when a user performs operation which erases all the handwritten characters Ihw. The figure which shows the 3rd step of the example of production expressed with lower LCD12 when a user performs operation which erases all the handwritten characters Ihw. The figure which shows an example of the handwritten stamp Ist displayed on the lower LCD12 The figure which shows the example of presentation expressed by lower LCD12 when a user performs operation which erases all the handwritten stamps Ist. The figure which shows an example of the various data memorize | stored in the main memory 32 according to performing the image processing program which concerns on one Embodiment of this invention. The figure which shows an example of the block data Db memorize | stored in the main memory 32 The flowchart with which the game device 1 performs an image process by executing the image processing program which concerns on one Embodiment of this invention. A subroutine showing the detailed operation of the image decomposition process performed in step 56 of FIG. Subroutine showing detailed operation of right block confirmation processing performed in step 81 of FIG. Subroutine showing the detailed operation of the upper block confirmation process performed in step 82 of FIG. Subroutine showing the detailed operation of the left block confirmation process performed in step 83 of FIG. Subroutine showing the detailed operation of the lower block confirmation process performed in step 84 of FIG. The figure which shows an example of the display screen DA divided | segmented into the grid | lattice form by the block of m horizontal x vertical n The figure for demonstrating the right block adjacent to the block A, an upper block, a left block, and a lower block The figure for demonstrating an example of the endmost pixel used when judging the connection relation of a process target block and a right block. The figure which shows the example of a judgment result of the connection relation between blocks by judgment criteria A-C The figure for demonstrating the example by which a handwritten image is decomposed | disassembled by image decomposition processing Diagram showing an example of multiple layers that compose the screen The figure which shows an example of the moving speed each given when the blocks A-C which belong to the same group move The figure which shows an example of the moving speed respectively given when the blocks A-C which belong to the same group rotate.

  An image processing apparatus that executes an image processing program according to an embodiment of the present invention will be described with reference to the drawings. The image processing program of the present invention can be applied by being executed by an arbitrary computer system. However, the game apparatus 1 is used as an example of the image processing apparatus, and the image processing program executed by the game apparatus 1 is used. explain. FIG. 1 is an external view of a game apparatus 1 that executes the image processing program of the present invention. Here, a portable game device is shown as an example of the game device 1. Note that the game apparatus 1 has a built-in camera, and functions as an imaging apparatus that captures an image with the camera, displays the captured image on a screen, and stores data of the captured image. In this specification, capturing image data with a camera is referred to as “imaging”, and storing captured image data is referred to as “imaging”.

  In FIG. 1, a game apparatus 1 is a foldable portable game apparatus, and shows the game apparatus 1 in an open state (open state). The game apparatus 1 is configured in such a size that the user can hold it with both hands or one hand even in an open state.

  The game apparatus 1 includes a lower housing 11 and an upper housing 21. The lower housing 11 and the upper housing 21 are connected so as to be openable and closable (foldable). In the example of FIG. 1, the lower housing 11 and the upper housing 21 are each formed in a horizontally-long rectangular plate shape, and are coupled so as to be rotatable at their long side portions. Normally, the user uses the game apparatus 1 in the open state. When the user does not use the game apparatus 1, the user stores the game apparatus 1 in a closed state. In the example shown in FIG. 1, the game apparatus 1 is not limited to the closed state and the open state, and the angle formed by the lower housing 11 and the upper housing 21 is an arbitrary angle between the closed state and the open state. The opening / closing angle can be maintained by a frictional force generated in the connecting portion. That is, the upper housing 21 can be made stationary with respect to the lower housing 11 at an arbitrary angle.

  The lower housing 11 is provided with a lower LCD (Liquid Crystal Display) 12. The lower LCD 12 has a horizontally long shape, and is arranged such that the long side direction coincides with the long side direction of the lower housing 11. In the present embodiment, an LCD is used as the display device built in the game apparatus 1, but other arbitrary display devices such as a display device using EL (Electro Luminescence) are used. May be. The game apparatus 1 can use a display device having an arbitrary resolution.

  The lower housing 11 is provided with operation buttons 14A to 14K and a touch panel 13 as input devices. As shown in FIG. 1, among the operation buttons 14A to 14K, a direction input button 14A, an operation button 14B, an operation button 14C, an operation button 14D, an operation button 14E, a power button 14F, a start button 14G, and a select button 14H. Is provided on the inner main surface of the lower housing 11 which is the inner side when the upper housing 21 and the lower housing 11 are folded. The direction input button 14A is used for, for example, a selection operation. The operation buttons 14B to 14E are used for, for example, a determination operation or a cancel operation. The power button 14F is used for turning on / off the power of the game apparatus 1. In the example shown in FIG. 1, the direction input button 14 </ b> A and the power button 14 </ b> F are on the left and right sides (left side in FIG. 1) of the main surface with respect to the lower LCD 12 provided near the center of the inner main surface of the lower housing 11. Provided on top. In addition, the operation buttons 14B to 14E, the start button 14G, and the select button 14H are provided on the inner main surface of the lower housing 11 that is on the other side of the lower LCD 12 (right side in FIG. 1). The direction input button 14A, the operation buttons 14B to 14E, the start button 14G, and the select button 14H are used for performing various operations on the game apparatus 1.

  In FIG. 1, the operation buttons 14I to 14K are not shown. For example, the L button 14I is provided at the left end portion of the upper side surface of the lower housing 11, and the R button 14J is provided at the right end portion of the upper side surface of the lower housing 11. The L button 14I and the R button 14J are used to perform, for example, a shooting instruction operation (shutter operation) on the game apparatus 1. Furthermore, the volume button 14K is provided on the left side surface of the lower housing 11. The volume button 14K is used to adjust the volume of the speaker provided in the game apparatus 1.

  Further, the game apparatus 1 further includes a touch panel 13 as an input device different from the operation buttons 14A to 14K. The touch panel 13 is mounted so as to cover the screen of the lower LCD 12. In the present embodiment, for example, a resistive film type touch panel is used as the touch panel 13. However, the touch panel 13 is not limited to the resistive film type, and any pressing type touch panel can be used. In the present embodiment, as the touch panel 13, for example, a touch panel having the same resolution (detection accuracy) as that of the lower LCD 12 is used. However, the resolution of the touch panel 13 and the resolution of the lower LCD 12 are not necessarily matched. Further, on the right side surface of the lower housing 11, an insertion port for the touch pen 27 (broken line shown in FIG. 1) is provided. The insertion slot can accommodate a touch pen 27 used for performing an operation on the touch panel 13. Note that the input to the touch panel 13 is normally performed using the touch pen 27, but the touch panel 13 can be operated not only with the touch pen 27 but also with a user's finger or the like.

  Further, on the right side surface of the lower housing 11, an insertion slot (indicated by a two-dot chain line in FIG. 1) for storing the memory card 28 is provided. A connector (not shown) for electrically connecting the game apparatus 1 and the memory card 28 is provided inside the insertion slot. The memory card 28 is, for example, an SD (Secure Digital) memory card, and is detachably attached to the connector. The memory card 28 is used, for example, for storing (saving) an image captured by the game apparatus 1 or reading an image generated by another apparatus into the game apparatus 1.

  Further, an insertion slot (indicated by a one-dot chain line in FIG. 1) for accommodating the memory card 29 is provided on the upper side surface of the lower housing 11. A connector (not shown) for electrically connecting the game apparatus 1 and the memory card 29 is also provided inside the insertion slot. The memory card 29 is a storage medium that stores an image processing program, a game program, and the like, and is detachably attached to an insertion port provided in the lower housing 11.

  Three LEDs 15 </ b> A to 15 </ b> C are attached to the left portion of the connecting portion between the lower housing 11 and the upper housing 21. Here, the game apparatus 1 can perform wireless communication with other devices, and the first LED 15A lights up when wireless communication is established. The second LED 15B is lit while the game apparatus 1 is being charged. The third LED 15C is lit when the power of the game apparatus 1 is on. Therefore, the three LEDs 15A to 15C can notify the user of the communication establishment status, the charging status, and the power on / off status of the game apparatus 1.

  On the other hand, the upper housing 21 is provided with an upper LCD 22. The upper LCD 22 has a horizontally long shape and is arranged such that the long side direction coincides with the long side direction of the upper housing 21. As in the case of the lower LCD 12, instead of the upper LCD 22, a display device having any other method and any resolution may be used. A touch panel may be provided so as to cover the upper LCD 22.

  The upper housing 21 is provided with two cameras (an inner camera 23 and an outer camera 25). As shown in FIG. 1, the inner camera 23 is attached to the inner main surface near the connecting portion of the upper housing 21. On the other hand, the outer camera 25 is a surface on the opposite side of the inner main surface to which the inner camera 23 is attached, that is, the outer main surface of the upper housing 21 (the outer surface when the game apparatus 1 is in a closed state, It is attached to the rear surface of the upper housing 21 shown in FIG. In FIG. 1, the outer camera 25 is indicated by a broken line. As a result, the inner camera 23 can capture an image in the direction in which the inner main surface of the upper housing 21 faces, and the outer camera 25 can rotate in the direction opposite to the image capturing direction of the inner camera 23, that is, the outer main surface of the upper housing 21. It is possible to image the direction in which the surface faces. Thus, in the present embodiment, the two inner cameras 23 and the outer cameras 25 are provided so that the imaging directions are opposite to each other. For example, the user can take an image of a scene viewed from the game apparatus 1 with the inner camera 23 and can also capture an image of the scene viewed from the game apparatus 1 on the opposite side of the user with the outer camera 25. Can do. The lower LCD 12 and / or the upper LCD 22 may be used to display an image captured by the inner camera 23 or the outer camera 25 in real time.

  Note that a microphone (a microphone 43 shown in FIG. 2) is accommodated as an audio input device on the inner main surface near the connecting portion. A microphone hole 16 is formed on the inner main surface near the connecting portion so that the microphone 43 can detect the sound outside the game apparatus 1. The position where the microphone 43 is accommodated and the position of the microphone hole 16 do not necessarily need to be the connecting portion. For example, the microphone 43 is accommodated in the lower housing 11, and the lower housing 11 corresponds to the accommodation position of the microphone 43. A microphone hole 16 may be provided.

  A fourth LED 26 (shown by a broken line in FIG. 1) is attached to the outer main surface of the upper housing 21. The fourth LED 26 is lit while an image is being taken by the inner camera 23 or the outer camera 25. Further, the moving image may be blinked while the inner camera 23 or the outer camera 25 captures a moving image (a captured image is stored as a moving image). In order to prevent the LED from appearing on the screen, the fourth LED 26 may be turned off from the moment the shutter is pressed until the storage of the captured image at the moment the shutter is pressed is completed. The fourth LED 26 can notify the person to be imaged and the surroundings that the imaging by the game apparatus 1 is being performed.

  In addition, sound release holes 24 are formed in the main surfaces on both the left and right sides of the upper LCD 22 provided near the center of the inner main surface of the upper housing 21. Speakers are housed in the upper housings 21 behind the sound release holes 24, respectively. The sound release hole 24 is a hole for releasing sound from the speaker to the outside of the game apparatus 1.

  As described above, the upper housing 21 is provided with the inner camera 23 and the outer camera 25 that are configured to capture images, and the upper LCD 22 that is display means for displaying various images. On the other hand, the lower housing 11 is provided with an input device (touch panel 13 and buttons 14A to 14K) for performing an operation input to the game apparatus 1, and a lower LCD 12 which is a display means for displaying various images. It is done. For example, when the game apparatus 1 is used, the input device displays the captured image (image captured by the camera) on the lower LCD 12 or the upper LCD 22 while the user holds and inputs the lower housing 11. It can be used for applications such as inputting to the apparatus.

  Next, the internal configuration of the game apparatus 1 will be described with reference to FIG. FIG. 2 is a block diagram illustrating an example of the internal configuration of the game apparatus 1.

  2, the game apparatus 1 includes a CPU 31, a main memory 32, a memory control circuit 33, a storage data memory 34, a preset data memory 35, and memory card interfaces (memory card I / F) 36 and 37. And electronic components such as a wireless communication module 38, a local communication module 39, a real-time clock (RTC) 40, a power supply circuit 41, an interface circuit (I / F circuit) 42, and the like. These electronic components are mounted on an electronic circuit board and housed in the lower housing 11 (or the upper housing 21).

  The CPU 31 is information processing means for executing a predetermined program. In the present embodiment, a predetermined program is stored in a memory (for example, the storage data memory 34) or the memory card 28 and / or 29 in the game apparatus 1, and the CPU 31 executes the predetermined program, thereby Image processing to be described later is executed. Note that the program executed by the CPU 31 may be stored in advance in a memory in the game apparatus 1, acquired from the memory card 28 and / or 29, or other programs by communication with other devices. It may be acquired from the device.

  A main memory 32, a memory control circuit 33, and a preset data memory 35 are connected to the CPU 31. In addition, a storage data memory 34 is connected to the memory control circuit 33. The main memory 32 is a storage means used as a work area or buffer area for the CPU 31. That is, the main memory 32 stores various data used for the information processing, and stores programs acquired from the outside (memory cards 28 and 29, other devices, etc.). In the present embodiment, for example, a PSRAM (Pseudo-SRAM) is used as the main memory 32. The storage data memory 34 is a storage unit for storing a program executed by the CPU 31, data of images taken by the inner camera 23 and the outer camera 25, and the like. The storage data memory 34 is configured by a nonvolatile storage medium, and is configured by, for example, a NAND flash memory in this embodiment. The memory control circuit 33 is a circuit that controls reading and writing of data with respect to the storage data memory 34 in accordance with instructions from the CPU 31. The preset data memory 35 is storage means for storing data (preset data) such as various parameters set in advance in the game apparatus 1. As the preset data memory 35, a flash memory connected to the CPU 31 via an SPI (Serial Peripheral Interface) bus can be used.

  Memory card I / Fs 36 and 37 are each connected to CPU 31. The memory card I / F 36 reads and writes data to and from the memory card 28 attached to the connector according to instructions from the CPU 31. The memory card I / F 37 reads and writes data to and from the memory card 29 attached to the connector in accordance with instructions from the CPU 31. In the present embodiment, image data captured by the inner camera 23 and the outer camera 25 and image data received from other devices are written to the memory card 28, or image data stored in the memory card 28 is stored in the memory card 28. Or stored in the storage data memory 34. Various programs stored in the memory card 29 are read out and executed by the CPU 31.

  Note that the image processing program of the present invention may be supplied not only to the computer system through an external storage medium such as the memory card 29 but also to the computer system through a wired or wireless communication line. The image processing program may be stored in advance in a nonvolatile storage device inside the computer system. The information storage medium for storing the image processing program is not limited to the non-volatile storage device, but may be a CD-ROM, a DVD, or an optical disk storage medium similar to them.

  The wireless communication module 38 is, for example, IEEE 802.11. It has a function of connecting to a wireless LAN by a method compliant with the b / g standard. Further, the local communication module 39 has a function of performing wireless communication with the same type of game device by a predetermined communication method. The wireless communication module 38 and the local communication module 39 are connected to the CPU 31. The CPU 31 transmits / receives data to / from other devices via the Internet using the wireless communication module 38, and transmits / receives data to / from other game devices of the same type using the local communication module 39. be able to.

  Further, the RTC 40 and the power supply circuit 41 are connected to the CPU 31. The RTC 40 counts the time and outputs it to the CPU 31. For example, the CPU 31 can calculate the current time (date) based on the time counted by the RTC 40. The power supply circuit 41 controls power supplied from a power supply (typically a battery, which is stored in the lower housing 11) of the game apparatus 1, and supplies power to each component of the game apparatus 1.

  Further, the game apparatus 1 includes a microphone 43 and an amplifier 44. The microphone 43 and the amplifier 44 are each connected to the I / F circuit 42. The microphone 43 detects the voice of the user uttered toward the game apparatus 1 and outputs a voice signal indicating the voice to the I / F circuit 42. The amplifier 44 amplifies the audio signal from the I / F circuit 42 and outputs it from a speaker (not shown). The I / F circuit 42 is connected to the CPU 31.

  The touch panel 13 is connected to the I / F circuit 42. The I / F circuit 42 includes a sound control circuit that controls the microphone 43 and the amplifier 44 (speaker), and a touch panel control circuit that controls the touch panel 13. The voice control circuit performs A / D conversion and D / A conversion on the voice signal, or converts the voice signal into voice data of a predetermined format. The touch panel control circuit generates touch position data in a predetermined format based on a signal from the touch panel 13 and outputs it to the CPU 31. For example, the touch position data is data indicating coordinates of a position where an input is performed on the input surface of the touch panel 13. The touch panel control circuit reads signals from the touch panel 13 and generates touch position data at a rate of once per predetermined time. The CPU 31 can know the position where the input is made on the touch panel 13 by acquiring the touch position data via the I / F circuit 42.

  The operation button 14 includes the operation buttons 14A to 14K and is connected to the CPU 31. From the operation button 14 to the CPU 31, operation data indicating an input status (whether or not the button is pressed) for each of the operation buttons 14A to 14K is output. The CPU 31 obtains operation data from the operation button 14 to execute processing corresponding to the input to the operation button 14.

  The inner camera 23 and the outer camera 25 are each connected to the CPU 31. The inner camera 23 and the outer camera 25 capture an image in accordance with an instruction from the CPU 31 and output the captured image data to the CPU 31. For example, the CPU 31 issues an imaging instruction to one of the inner camera 23 and the outer camera 25, and the camera that has received the imaging instruction captures an image and sends the image data to the CPU 31.

  Further, the lower LCD 12 and the upper LCD 22 are each connected to the CPU 31. The lower LCD 12 and the upper LCD 22 display images according to instructions from the CPU 31, respectively. As an example, the CPU 31 displays an image acquired from either the inner camera 23 or the outer camera 25 on one of the lower LCD 12 and the upper LCD 22, and displays an operation explanation screen generated by a predetermined process on the lower LCD 12 and the upper LCD 22. Is displayed on the other side.

  Next, before describing specific processing operations by the image processing program executed on the game apparatus 1, examples of display forms displayed on the lower LCD 12 by the processing operations with reference to FIGS. explain. FIG. 3 is a diagram illustrating an example of the handwritten character Ihw displayed on the lower LCD 12. FIG. 4 is a diagram illustrating a first stage of an effect example expressed on the lower LCD 12 when the user performs an operation of erasing all the handwritten characters Ihw. FIG. 5 is a diagram showing a second stage of the effect example expressed on the lower LCD 12 when the user performs an operation of erasing all the handwritten characters Ihw. FIG. 6 is a diagram illustrating a third stage of the effect example expressed on the lower LCD 12 when the user performs an operation of erasing all the handwritten characters Ihw. FIG. 7 is a diagram illustrating an example of the handwritten stamp Ist displayed on the lower LCD 12. FIG. 8 is a diagram illustrating an example of an effect expressed on the lower LCD 12 when the user performs an operation of erasing all the handwritten stamps Ist.

  In FIG. 3, handwritten characters, handwritten stamps (standard marks), and the like can be drawn on the lower LCD 12 along the locus of the user touching the touch panel 13 using the touch pen 27. For example, the lower LCD 12 displays a handwritten line drawing button Bhw, a partial erase button Bpe, a handwritten stamp drawing button Bst, a full erase button Bae, and the like. Then, when a button desired by the user is selected by the touch operation, all erasure, drawing for the touch operation, and partial erasure are performed according to the selected button.

  In FIG. 3, the user has selected the handwriting line drawing button Bhw, and a free line along the locus of the touch operation is drawn on the lower LCD 12. Therefore, by touching the touch panel 13 so as to draw a character desired by the user, a character corresponding to the touch operation can be drawn on the lower LCD 12. For example, in the example of FIG. 3, the handwritten character Ihw drawn along the locus where the user touches the touch panel 13 using the touch pen 27 is displayed. Specifically, an example is shown in which the user touches the touch panel 13 to input the character “hello” by handwriting, and the handwritten character Ihw drawn up to the last character “o” is displayed on the lower LCD 12. ing.

  In FIG. 4, after the handwritten character Ihw is drawn on the lower LCD 12, the user touches the all delete button Bae. By this operation, all images input by handwriting via the touch panel 13 (in the example of FIG. 4, handwritten characters Ihw) are all erased from the lower LCD 12. At this time, in this embodiment, the handwritten image that is the target of all erasure (the handwritten character Ihw) is erased from the lower LCD 12 until the handwritten image is decomposed and predetermined for each decomposed image. Will be given.

  For example, in the example shown in FIG. 4, the handwritten character Ihw is broken down into five handwritten characters Ihw1 to Ihw5, each moving in a different direction or moving at a different speed. In the example of FIG. 4, the handwritten character Ihw is decomposed character by character. Specifically, the handwritten character Ihw is the handwritten character Ihw indicating the first character “h”, the handwritten character Ihw2 indicating the first character “e”, and the handwritten character indicating the third character “l”. Ihw3 is divided into a handwritten character Ihw4 indicating the fourth character “l” and a handwritten character Ihw5 indicating the fifth character “o”.

  The decomposed handwritten characters Ihw1 to Ihw5 each move so as to freely fall below the lower LCD 12 (FIG. 5). The handwritten characters Ihw1 to Ihw5 are all erased from the lower LCD 12 by moving outside the display area of the lower LCD 12 (FIG. 6).

  In FIG. 7, the user has selected the handwritten stamp drawing button Bst, and the stamp group (signature group) is drawn on the lower LCD 12 along the locus of the touch operation. For example, in the example of FIG. 7, the handwritten stamp Ist drawn along the locus where the user touches the touch panel 13 using the touch pen 27 is displayed. Specifically, an example is shown in which the user performs a hand operation on the touch panel 13 to input by hand a stamp that is a pair of two leaf images. The pair of stamps are sequentially added and drawn on the lower LCD 12 at predetermined time intervals or at predetermined distance intervals along the locus touched by the user, and as a result, a group of stamps along the locus touched. Is displayed on the lower LCD 12 as a handwritten stamp Ist.

  In FIG. 8, after the handwritten stamp Ist is drawn on the lower LCD 12, the user touches the all delete button Bae. As a result of this operation, all the images input by handwriting via the touch panel 13 (in the example of FIG. 8, the handwritten stamp Ist) are all erased from the lower LCD 12. In this case as well, in this embodiment, the handwritten image that has been subject to all erasure (the handwritten stamp Ist) is erased from the lower LCD 12 until the handwritten image is decomposed and decomposed for each image. A predetermined performance is given.

  For example, in the example shown in FIG. 8, the handwritten stamp Ist is decomposed into n handwritten stamps Istn, each of which moves in different directions or at different speeds. In the example of FIG. 8, the handwritten stamp Ist drawn as a stamp group is decomposed for each pair of stamps including two leaf images, and the pair of stamps is further decomposed for each leaf image.

  The disassembled handwritten stamp Istn also moves so as to freely fall below the lower LCD 12 over time. The handwritten stamp Istn is all erased from the lower LCD 12 by moving outside the display area of the lower LCD 12.

  Note that a real-time image (captured image) captured by the inner camera 23 or the outer camera 25 may be displayed on the background image of the lower LCD 12. In this case, the above-described handwritten image (handwritten character Ihw, handwritten stamp Ist) is drawn on the captured image. That is, the user can perform an operation (graffiti) to add a handwritten image desired by the user to the captured image captured by the inner camera 23 or the outer camera 25.

  Next, with reference to FIGS. 9 to 16, a specific processing operation by the image processing program executed in the game apparatus 1 will be described. FIG. 9 is a diagram illustrating an example of various data stored in the main memory 32 in response to executing the image processing program. FIG. 10 is a diagram illustrating an example of the block data Db stored in the main memory 32. FIG. 11 is a flowchart in which the game apparatus 1 performs image processing by executing the image processing program. FIG. 12 is a subroutine showing the detailed operation of the image decomposition process performed in step 56 of FIG. FIG. 13 is a subroutine showing the detailed operation of the right block confirmation process performed in step 81 of FIG. FIG. 14 is a subroutine showing the detailed operation of the upper block confirmation process performed in step 82 of FIG. FIG. 15 is a subroutine showing the detailed operation of the left block confirmation process performed in step 83 of FIG. FIG. 16 is a subroutine showing the detailed operation of the lower block confirmation process performed in step 84 of FIG. Note that a program for executing these processes is included in a memory (for example, the storage data memory 34), the memory card 28, or the memory card 29 built in the game apparatus 1, and the game apparatus 1 is powered on. When it is turned on, it is read from the memory card 28 or 29 via the memory card I / F 36 or from the built-in memory to the main memory 32 and executed by the CPU 31.

  In FIG. 9, the main memory 32 stores programs read from the built-in memory, the memory card 28, or the memory card 29, and temporary data generated in image processing. In FIG. 9, operation data Da, block data Db, block movement data Dc, image data Dd, and the like are stored in the data storage area of the main memory 32. The program storage area of the main memory 32 stores various program groups Pa constituting the image processing program.

  As the operation data Da, data indicating that the user is operating the game apparatus 1 is stored. The operation data Da includes touch coordinate data indicating the touch position of the screen coordinate system where the user touches the touch panel 13. For example, the touch coordinates are acquired every time unit (for example, 1/60 seconds) in which the game apparatus 1 performs a game process, and stored and updated in the operation data Da according to the acquisition.

  The block data Db stores data for each block obtained by dividing the display screen displaying the handwritten image described above into a plurality of regions. As shown in FIG. 10, the block data Db stores data indicating a block number Bn, an image presence / absence flag, a group number Gn, and a connection flag for each block. The block number Bn is a number assigned to each block. The image presence / absence flag is data indicating whether or not at least a part of the handwritten image is included for each block. The group number Gn is a number assigned to each group divided by handwritten image division processing. The connection flag is data indicating whether or not the block and the adjacent block are connected by a handwritten image on the basis of the block to be processed. For example, the connection flag is a flag indicating whether or not it is connected to the adjacent right block, a flag that indicates whether or not it is connected to the adjacent upper block, and whether or not it is connected to the adjacent left block. And a flag indicating whether or not it is connected to the adjacent lower block.

  Returning to FIG. 9, the block movement data Dc is set for each block, and data (movement direction, movement speed, etc.) for the block to move in the virtual world is stored. The image data Dd stores image data for displaying the above-described handwritten image, operation button image, and the like on the game apparatus 1.

  Next, the operation of the game apparatus 1 will be described with reference to FIG. First, when the power supply (power button 14F) of the game apparatus 1 is turned on, a boot program (not shown) is executed by the CPU 31, whereby image processing stored in the built-in memory or the memory card 28 or the memory card 29 is performed. The program is loaded into the main memory 32. Then, when the loaded image processing program is executed by the CPU 31, the steps shown in FIG. 11 (abbreviated as “S” in FIGS. 11 to 16) are executed.

  In FIG. 9, the CPU 31 performs initial setting of image processing (step 51), and advances the processing to the next step. For example, as an initial setting performed by the CPU 31 in step 51, each parameter stored in the main memory 32 is initialized to a predetermined numerical value. For example, all the image presence / absence flags and connection flags stored in the block data Db are set to OFF, and all the group numbers Gn are set to “0”.

  Next, the CPU 31 acquires operation data output when the user operates the operation button 14 or the touch panel 13, updates the operation data Da (step 52), and advances the processing to the next step. For example, the CPU 31 acquires touch coordinates indicating the touch position of the screen coordinate system touching the touch panel 13 and updates the touch coordinates stored in the operation data Da.

  Next, the CPU 31 determines whether or not the operation data acquired in step 52 is data indicating handwritten input by the user (step 53) and data indicating complete erasure (step 55). For example, if the operation data is data indicating a touch operation after selecting the handwriting line drawing button Bhw or the handwriting stamp drawing button Bst (see FIG. 3 or the like), the CPU 31 determines that the data indicates handwriting input. (Yes in step 53), the process proceeds to the next step 54. If the operation data is data for selecting the all erasure button Bae, the CPU 31 determines that the operation data is data indicating all erasure (Yes in step 55), and proceeds to the next step 56. On the other hand, when the operation data is not data indicating handwritten input or complete erasure (both step 53 and step 55 are No), the CPU 31 proceeds to the next step 59.

  In step 54, the CPU 31 generates a handwritten image according to the operation data (touch coordinate data) acquired in step 52, draws it on the lower LCD 12, and proceeds to the next step 60.

  For example, the CPU core 31 calculates a position in the virtual world according to the touch coordinates acquired in step 52. Here, the position is obtained by perspective-transforming the touch coordinates into the virtual world. As an example, the position is obtained by calculating the position on the two-dimensional plane of the virtual world displayed on the lower LCD 12 so as to overlap the touch coordinates. Then, when the handwritten line drawing button Bhw is selected and the position is calculated in the previous process, the CPU 31 determines from the position calculated in the previous process to the position calculated in the current process. A line segment connected by a line having a thickness of is generated and displayed on the lower LCD 12. Further, when the handwritten stamp drawing button Bst is selected and the position is calculated in the previous process, the CPU 31 calculates the above-described process calculated in the current process from the position of the last stamp displayed on the lower LCD 12. If the distance in the virtual world to the position has reached the threshold value, a new stamp (for example, a pair of two leaf images) is displayed at the position calculated in the current process. Note that, when the handwritten stamp drawing button Bst is selected and the position is calculated in the previous process, the CPU 31 has elapsed from the time when the last stamp is displayed on the lower LCD 12 over the threshold. Sometimes, a new stamp may be displayed at the position calculated in the current process. Further, when the handwritten stamp drawing button Bst is selected and the position is calculated in the previous process, the CPU 31 calculates the above-described process calculated in the current process from the position of the last stamp displayed on the lower LCD 12. If the cumulative amount of displacement in the virtual world up to the position (that is, the cumulative total of the touch coordinates) has reached the threshold value, a new stamp may be displayed at the position calculated in the current process. In addition, when a new handwritten input is performed on the already displayed free line or stamp, the CPU 31 converts the free line or stamp generated according to the later input to the already displayed free line or stamp. Superimposed display.

  On the other hand, when the all erasing operation has been performed (Yes in step 55), the CPU 31 performs image decomposition processing (step 56), and proceeds to the next step. Hereinafter, the detailed operation of the image decomposition process will be described with reference to FIG.

  In FIG. 12, the CPU 31 divides the display screen DA displayed on the lower LCD 12 into a plurality of blocks (step 71), and selects whether or not a handwritten image is included for each block (step 72). The process proceeds to the next step 73.

  For example, as shown in FIG. 17, the display screen DA is divided into a grid pattern with m blocks in the horizontal direction and n blocks in the vertical direction. Preferably, the size of each block is the same. For example, each block is set to have a size of horizontal 8 pixels × vertical 8 pixels. And CPU31 gives block number Bn for every block. The numerical value in the block shown in FIG. 17 shows an example of the assigned block number Bn, and the block number Bn is sequentially assigned 1, 2, 3,... From the upper left block to the right. The block number Bn is m × n (maximum value Bnmax).

  Then, the CPU 31 determines whether or not at least a part of the handwritten image is drawn for each block, and sets an image presence / absence flag (see FIG. 10) corresponding to the block for which the handwritten image is determined to be drawn. Set to ON. For example, when at least one pixel included in the handwritten image or stamp exists in 8 horizontal pixels × 8 vertical pixels corresponding to the block, and at least a part of the input image is drawn in the block The image presence / absence flag corresponding to the block is set to ON.

  In step 73, the CPU 31 sets the block number i to be processed to 1 and the group number j to be processed to 1, respectively, and proceeds to the next step.

  Next, the CPU 31 determines whether or not a handwritten image is drawn in the block of the block number i that is currently processed (step 74). For example, the CPU 31 refers to the image presence / absence flag of the block data Db corresponding to the block number i currently being processed, and the handwritten image is drawn when the image presence / absence flag is on (ON). to decide. When the handwritten image is drawn in the block of block number i that is currently processed, the CPU 31 proceeds to the next step 75. On the other hand, when the handwritten image is not drawn in the block of the block number i that is the current processing target, the CPU 31 proceeds to the next step 86.

  In step 75, the CPU 31 determines whether or not the block with the block number i currently being processed is set in any group. For example, the CPU 31 refers to the group number Gn of the block data Db corresponding to the block number i currently being processed, and the group has been set when a numerical value other than 0 is set for the group number. to decide. If the block with the block number i currently being processed is not set as a group, the CPU 31 proceeds to the next step 76. On the other hand, if the block with the block number i currently being processed is already set in any group, the CPU 31 proceeds to the next step 86.

  In step 76, the CPU 31 sets the block having the block number i currently being processed as a block belonging to the group having the group number j being currently processed, and proceeds to the next step. For example, the CPU 31 updates the block data Db by describing the group number j currently being processed as the group number of the block data Db corresponding to the block number i currently being processed.

  Next, the CPU 31 determines whether or not the handwritten image is included in the rightmost column pixel of the block of the block number i currently being processed (step 77) and whether or not the handwritten image is included in the uppermost row pixel (step 77). 78), whether or not the handwritten image is included in the leftmost column pixel (step 79), and whether or not the handwritten image is included in the lowermost row pixel (step 80) are sequentially determined.

  For example, as shown in FIG. 18, it is assumed that block A is the current processing target block. At this time, the block A is adjacent to the right block, the upper block, the left block, and the lower block. Then, the CPU 31 determines whether or not the block A is connected to these adjacent blocks by a handwritten image. For example, a part of the handwritten character “h” is drawn in the lower block of the block A and the block A, and it is determined that the block A and the lower block are connected by the handwritten character “h”. On the other hand, since there is no common handwritten character in the block A, the left block, the upper block, and the right block, it is determined that the block A and these blocks are not connected.

  In order to determine such a connection relationship between blocks, in this embodiment, the presence / absence of a handwritten image in the endmost pixel of the block of block number i that is the processing target is used as a determination criterion. For example, as shown in FIG. 19, when considering the connection relationship between the processing target block and the right block, the pixels (for example, the block is 8 horizontal pixels × vertical) arranged in the rightmost column RA which is the rightmost edge in the processing target block. In the case of the size of 8 pixels, it is determined whether or not a handwritten image is included in the rightmost column (8 pixels). When a handwritten image is included in at least a part of the right end row RA, it is determined that the processing target block and the right block are connected (determination criterion A).

  Note that other pixels may be used to determine the connection relationship between the blocks. For example, when determining the connection relationship with the right block, as shown in FIG. 19, in addition to the pixel in the right end column RA, the pixel in the left end column LA arranged at the left end of the right block is also used. You may judge the relationship. Specifically, when considering the connection relationship between the processing target block and the right block, both the pixel arranged in the right end column RA of the processing target block and the pixel arranged in the left end column LA of the right block are both When both handwritten images are included, it is determined that the processing target block and the right block are connected (determination criterion B). Furthermore, the processing is performed only when the pixel including the handwritten image in the right end row RA of the processing target block is adjacent to the pixel including the handwritten image in the left end row LA of the right block. It may be determined that the target block and the right block are connected (determination criterion C). In this case, even if a handwritten image is included in any of the pixels in the right end row RA of the processing target block and the pixels in the left end row LA of the right block, there is no one adjacent to the pixel of the handwritten image between them. , It is determined that the processing target block and the right block are not connected.

  FIG. 20 summarizes the determination results of the connection relationship between blocks based on the determination criteria A to C described above. For example, as illustrated in FIG. 20, Examples 1 to 3 are considered by paying attention to the right end row RA of the processing target block and the left end row LA of the right block. As in Example 1 shown in FIG. 20, when a handwritten image (indicated by a filled pixel in FIG. 20) is included only in the right end row RA of the processing target block, it is determined that the blocks are connected according to the criterion A. However, the determination criteria B and C determine that the blocks are not connected. In addition, as in Example 2 illustrated in FIG. 20, both the right end row RA of the processing target block and the left end row LA of the right block include a handwritten image, but there are no pixels adjacent to the handwritten image. The determination criteria A and B determine that the blocks are connected, but the determination criteria C determines that the blocks are not connected. Furthermore, as in Example 3 shown in FIG. 20, both the right end row RA of the processing target block and the left end row LA of the right block include a handwritten image and include pixels adjacent to the pixels of the handwritten image. In this case, it is determined that the blocks are connected by all the determination criteria A to C. As described above, since the determination result changes depending on the setting of the determination criterion, an appropriate determination criterion may be selected according to the processing load and the resolution accuracy described later. In the present embodiment, description will be made using an example in which the connection relationship between blocks is determined based on the determination criterion A.

  Returning to FIG. 12, the CPU 31 determines whether or not the handwritten image is included in the right end column pixel of the block of the block number i currently being processed (step 77). When the CPU 31 determines that the handwritten image is included in the right end column pixel of the block with the block number i currently being processed, that is, when the processing target block and the right block are connected (in step 77). Yes), the connection flag (right) (see FIG. 10) of the block number i is set to ON (ON), right block confirmation processing is performed (step 81), and the processing proceeds to the next step 78. On the other hand, when the CPU 31 determines that the handwritten image is not included in the right end column pixel of the block with the block number i currently being processed, that is, when the processing target block and the right block are not connected (step) 77), the process proceeds to the next step 78 as it is. The detailed operation of the right block confirmation process will be described later.

  In step 78, the CPU 31 determines whether or not a handwritten image is included in the upper end row pixel of the block with the block number i currently being processed. When the CPU 31 determines that the handwritten image is included in the upper row pixel of the block with the block number i currently being processed, that is, when the processing target block and the upper block are connected (in step 78). Yes), the connection flag (upper) of the block number i is set to ON (ON), the upper block confirmation process is performed (step 82), and the process proceeds to the next step 79. On the other hand, when the CPU 31 determines that the handwritten image is not included in the upper row pixel of the block number i currently being processed, that is, the processing target block and the upper block are not connected (step No in 78), the process proceeds to the next step 79 as it is. The detailed operation of the upper block confirmation process will be described later.

  In step 79, the CPU 31 determines whether or not a handwritten image is included in the left end column pixel of the block with the block number i currently being processed. Then, when the CPU 31 determines that the handwritten image is included in the left end column pixel of the block with the block number i currently being processed, that is, when the processing target block and the left block are connected (in step 79). Yes), the connection flag (left) of the block number i is set to ON (ON), left block confirmation processing is performed (step 83), and the processing proceeds to the next step 80. On the other hand, when the CPU 31 determines that the handwritten image is not included in the left end column pixel of the block with the block number i currently being processed, that is, when the processing target block and the left block are not connected (step) No in 79), the process proceeds to the next step 80 as it is. The detailed operation of the left block confirmation process will be described later.

  In step 80, the CPU 31 determines whether or not a handwritten image is included in the bottom row pixel of the block with the block number i currently being processed. Then, when the CPU 31 determines that the handwritten image is included in the lower row pixel of the block No. i currently being processed, that is, when it is determined that the processing target block and the lower block are connected (step 80). Yes), the connection flag (lower) of the block number i is set to ON (ON), the lower block confirmation process is performed (step 84), and the process proceeds to the next step 85. On the other hand, when the CPU 31 determines that the handwritten image is not included in the lower row pixel of the block of the block number i currently being processed, that is, the processing target block and the lower block are not connected ( No at step 80), the process proceeds to the next step 85 as it is. The detailed operation of the lower block confirmation process will be described later.

  In step 85, the CPU 31 adds 1 to the group number j currently being processed, sets a new group number j to be processed, and proceeds to the next step 86.

  In step 86, the CPU 31 adds 1 to the block number i currently being processed, sets a new block number i to be processed, and proceeds to the next step.

  Next, the CPU 31 determines whether or not the block number i currently being processed is larger than the maximum block number Bnmax (step 87). Here, the maximum value Bnmax is a block number maximum value when the display screen DA is divided into blocks and assigned block numbers in step 71. If the block number i currently being processed is equal to or less than the maximum block number Bnmax, the CPU 31 returns to step 74 and repeats the process. On the other hand, if the block number i currently being processed is larger than the block number maximum value Bnmax, the CPU 31 ends the process by the subroutine and proceeds to step 57 (FIG. 11).

  Hereinafter, with reference to FIG. 13, the right block confirmation process performed in step 81 and steps 98, 118, and 158 described later will be described.

  In FIG. 13, the CPU 31 sets the right block adjacent to the right side of the block currently being processed (processing target block) as a new processing target block (step 91), and performs processing in the next step. Proceed. For example, when the block with the block number m + 2 shown in FIG. 17 is a processing target block, the block with the block number m + 3 adjacent to the right side of the block is set as a new processing target block.

  Next, the CPU 31 determines whether or not a handwritten image is drawn on the processing target block (step 92). For example, the CPU 31 refers to the image presence / absence flag of the block data Db corresponding to the current processing target block, and determines that the handwritten image is drawn when the image presence / absence flag is on. Then, the CPU 31 proceeds to the next step 93 when the handwritten image is drawn in the processing target block. On the other hand, if the handwritten image is not drawn in the processing target block, the CPU 31 proceeds to the next step 101.

  In step 93, the CPU 31 determines whether the processing target block is set in any group. For example, the CPU 31 refers to the group number Gn of the block data Db corresponding to the processing target block, and determines that the group has been set when a numerical value other than 0 is set for the group number. If the processing target block is not set to a group, the CPU 31 proceeds to the next step 94. On the other hand, if the processing target block has already been set to any group, the CPU 31 proceeds to the next step 101.

  In step 94, the CPU 31 sets the processing target block to a block belonging to the group having the group number j that is the current processing target, and proceeds to the next step. For example, the CPU 31 updates the block data Db by describing the group number j currently being processed as the group number of the block data Db corresponding to the processing target block. That is, by the processing of step 94, the processing target block is a group having the same group number as the block set as the processing target before the right block confirmation processing (that is, the left block as viewed from the processing target block). Will belong to.

  Next, the CPU 31 determines whether or not a handwritten image is included in the right end column pixel of the processing target block (step 95). Then, when the CPU 31 determines that the processing target block and the right block are connected when the right end column pixel of the processing target block includes the handwritten image (Yes in Step 95), the connection of the processing target block is performed. The flag (right) is set to ON and the right block confirmation process is newly started from step 91 (step 98). After the right block confirmation process is completed, the process proceeds to step 96. On the other hand, when the CPU 31 determines that the handwritten image is not included in the right end column pixel of the processing target block, that is, when the processing target block and the right block are not connected (No in step 95), the next step is continued. The process proceeds to 96.

  In step 96, the CPU 31 determines whether or not a handwritten image is included in the upper row pixel of the processing target block. Then, when the CPU 31 determines that the top row pixel of the processing target block includes a handwritten image, that is, the processing target block and the upper block are connected (Yes in step 96), the CPU 31 connects the processing target block. The flag (upper) is set to ON (ON) and the upper block confirmation process is performed (step 99), and the process proceeds to the next step 97. On the other hand, when the CPU 31 determines that the top row pixel of the processing target block does not include a handwritten image, that is, the processing target block and the upper block are not connected (No in step 96), the next step is continued. The process proceeds to 97.

  In step 97, the CPU 31 determines whether or not a handwritten image is included in the bottom row pixel of the processing target block. When the CPU 31 determines that the processing target block and the lower block are connected when the handwritten image is included in the lower row pixel of the processing target block (Yes in Step 97), the CPU 31 of the processing target block The connection flag (lower) is set to ON (ON) and lower block confirmation processing is performed (step 100), and the processing proceeds to the next step 101. On the other hand, if the CPU 31 determines that the handwritten image is not included in the lower row pixel of the processing target block, that is, if the processing target block and the lower block are not connected (No in step 97), the next processing is continued. The process proceeds to step 101.

  In step 101, the CPU 31 sets the left block adjacent to the left side of the processing target block as a new processing target block, and ends the processing by the subroutine. For example, when the block with the block number m + 3 shown in FIG. 17 is a processing target block, the block with the block number m + 2 adjacent to the left side of the block is set as a new processing target block.

  Hereinafter, with reference to FIG. 14, the upper block confirmation processing performed in step 82 and step 99 and steps 119 and 138 described later will be described.

  In FIG. 14, the CPU 31 sets the upper block adjacent to the upper side of the processing target block currently set as the processing target as a new processing target block (step 111), and proceeds to the next step. For example, when the block with the block number m + 2 shown in FIG. 17 is the processing target block, the block with the block number 2 adjacent to the upper side of the block is set as a new processing target block.

  Next, the CPU 31 determines whether or not a handwritten image is drawn on the processing target block (step 112). Note that the operation example of step 112 is the same as step 92 described above, and thus detailed description thereof is omitted. Then, when a handwritten image is drawn in the processing target block, the CPU 31 proceeds to the next step 113. On the other hand, when the handwritten image is not drawn in the processing target block, the CPU 31 proceeds to the next step 121.

  In step 113, the CPU 31 determines whether or not the processing target block is set in any group. Note that the operation example of Step 113 is the same as Step 93 described above, and thus detailed description thereof is omitted. And CPU31 advances a process to the following step 114, when a process target block is not set to the group. On the other hand, if the processing target block has already been set to any group, the CPU 31 proceeds to the next step 121.

  In step 114, the CPU 31 sets the processing target block to a block belonging to the group of the group number j that is currently the processing target, and proceeds to the next step. Note that the operation example of step 114 is the same as step 94 described above, and thus detailed description thereof is omitted. By the processing in step 114, the processing target block is assigned to the group having the same group number as the block set as the processing target before the upper block confirmation processing (that is, the lower block as viewed from the processing target block). Will belong.

  Next, the CPU 31 determines whether or not a handwritten image is included in the right end column pixel of the processing target block (step 115). Then, when the CPU 31 determines that the processing target block and the right block are connected when the right end column pixel of the processing target block includes the handwritten image (Yes in step 115), the CPU 31 connects the processing target block. The flag (right) is set to ON (ON), the right block confirmation process described above is performed (step 118), and the process proceeds to the next step 116. On the other hand, if the CPU 31 determines that the handwritten image is not included in the right end column pixel of the processing target block, that is, if the processing target block and the right block are not connected (No in step 115), the next step is continued. The process proceeds to 116.

  In step 116, the CPU 31 determines whether or not a handwritten image is included in the upper row pixel of the processing target block. When the CPU 31 determines that the upper end row pixel of the processing target block includes a handwritten image, that is, determines that the processing target block and the upper block are connected (Yes in step 116), the CPU 31 connects the processing target block. The flag (upper) is set to ON and the upper block confirmation process is newly started from step 111 (step 119). After the upper block confirmation process is completed, the process proceeds to step 117. On the other hand, when the handwritten image is not included in the upper row pixel of the processing target block, that is, when the CPU 31 determines that the processing target block and the upper block are not connected (No in step 116), the next step is continued. The process proceeds to 117.

  In step 117, the CPU 31 determines whether or not a handwritten image is included in the bottom row pixel of the processing target block. When the CPU 31 determines that the processing target block and the lower block are connected when the handwritten image is included in the bottom row pixel of the processing target block (Yes in step 117), the CPU 31 of the processing target block The connection flag (lower) is set to ON (ON) and the lower block confirmation process is performed (step 120), and the process proceeds to the next step 121. On the other hand, if the CPU 31 determines that the handwritten image is not included in the lower row pixel of the processing target block, that is, if the processing target block and the lower block are not connected (No in step 117), the next processing is continued. The process proceeds to step 121.

  In step 121, the CPU 31 sets the lower block adjacent to the lower side of the processing target block as a new processing target block, and ends the processing by the subroutine. For example, when the block with the block number 2 shown in FIG. 17 is a processing target block, the block with the block number m + 2 adjacent to the lower side of the block is set as a new processing target block.

  Hereinafter, with reference to FIG. 15, the left block confirmation process performed in step 83 and step 120 and steps 139 and 159 described later will be described.

  In FIG. 15, the CPU 31 sets the left block adjacent to the left side of the processing target block currently set as a processing target as a new processing target block (step 131), and proceeds to the next step. For example, when the block with the block number m + 2 shown in FIG. 17 is a processing target block, the block with the block number m + 1 adjacent to the left side of the block is set as a new processing target block.

  Next, the CPU 31 determines whether or not a handwritten image is drawn on the processing target block (step 132). The operation example of step 132 is the same as that of step 92 described above, and thus detailed description thereof is omitted. Then, when the handwritten image is drawn in the processing target block, the CPU 31 proceeds to the next step 133. On the other hand, if the handwritten image is not drawn in the processing target block, the CPU 31 proceeds to the next step 141.

  In step 133, the CPU 31 determines whether or not the processing target block is set in any group. Note that the operation example of step 133 is the same as step 93 described above, and thus detailed description thereof is omitted. And CPU31 advances a process to the following step 134, when the process target block is not set to the group. On the other hand, if the processing target block has already been set to any group, the CPU 31 proceeds to the next step 141.

  In step 134, the CPU 31 sets the processing target block to a block belonging to the group of the group number j that is currently the processing target, and proceeds to the next step. The operation example of step 134 is the same as that of step 94 described above, and a detailed description thereof will be omitted. By the processing in step 134, the processing target block belongs to the group having the same group number as the block set as the processing target before the left block confirmation processing (that is, the right block as viewed from the processing target block). It will be.

  Next, the CPU 31 determines whether or not a handwritten image is included in the upper row pixel of the processing target block (step 135). Then, when the CPU 31 determines that the top row pixel of the processing target block includes a handwritten image, that is, the processing target block and the upper block are connected (Yes in step 135), the CPU 31 connects the processing target block. The flag (upper) is set to ON (ON) and the above-described upper block confirmation process is performed (step 138), and the process proceeds to the next step 136. On the other hand, when the CPU 31 determines that the top row pixel of the processing target block does not include a handwritten image, that is, the processing target block and the upper block are not connected (No in step 135), the next step is continued. The process proceeds to 136.

  In step 136, the CPU 31 determines whether or not a handwritten image is included in the leftmost column pixel of the processing target block. Then, when the CPU 31 determines that the processing target block and the left block are connected when the left end column pixel of the processing target block includes the handwritten image (Yes in step 136), the CPU 31 connects the processing target block. The flag (left) is set to ON (ON) and the left block confirmation process is newly started from step 131 (step 139). After the left block confirmation process is completed, the process proceeds to step 137. On the other hand, if the CPU 31 determines that the handwritten image is not included in the leftmost column pixel of the processing target block, that is, if the processing target block and the left block are not connected (No in step 136), the next step is continued. The process proceeds to 137.

  In step 137, the CPU 31 determines whether or not a handwritten image is included in the bottom row pixel of the processing target block. When the CPU 31 determines that the processing target block and the lower block are connected when the handwritten image is included in the bottom row pixel of the processing target block (Yes in step 137), the CPU 31 of the processing target block The connection flag (lower) is set to ON (ON) and lower block confirmation processing is performed (step 140), and the processing proceeds to the next step 141. On the other hand, if the CPU 31 determines that the handwritten image is not included in the lower row pixel of the processing target block, that is, if the processing target block and the lower block are not connected (No in step 137), the next processing is continued. The process proceeds to step 141.

  In step 141, the CPU 31 sets the right block adjacent to the right side of the processing target block as a new processing target block, and ends the processing by the subroutine. For example, when the block with the block number m + 1 shown in FIG. 17 is a processing target block, the block with the block number m + 2 adjacent to the right side of the block is set as a new processing target block.

  Hereinafter, with reference to FIG. 16, the lower block confirmation process performed in step 84, step 100, step 140, and step 160 described later will be described.

  In FIG. 16, the CPU 31 sets a lower block adjacent to the lower side of the processing target block currently set as a processing target as a new processing target block (step 151), and performs processing in the next step. Proceed. For example, when the block with the block number m + 2 shown in FIG. 17 is a processing target block, the block with the block number 2m + 2 adjacent to the lower side of the block is set as a new processing target block.

  Next, the CPU 31 determines whether or not a handwritten image is drawn on the processing target block (step 152). Note that the operation example of step 152 is the same as that of step 92 described above, and thus detailed description thereof is omitted. Then, when the handwritten image is drawn in the processing target block, the CPU 31 proceeds to the next step 153. On the other hand, if the handwritten image is not drawn in the processing target block, the CPU 31 proceeds to the next step 161.

  In step 153, the CPU 31 determines whether the processing target block is set in any group. Note that the operation example of step 153 is the same as that of step 93 described above, and thus detailed description thereof is omitted. And CPU31 advances a process to the following step 154, when a process target block is not set to the group. On the other hand, if the processing target block has already been set to any group, the CPU 31 advances the processing to the next step 161.

  In step 154, the CPU 31 sets the processing target block to a block belonging to the group of the group number j that is currently the processing target, and proceeds to the next step. The operation example of step 154 is the same as that of step 94 described above, and a detailed description thereof will be omitted. By the processing in step 154, the processing target block is put into a group having the same group number as the block set as the processing target before the lower block confirmation processing (that is, the upper block as viewed from the processing target block). Will belong.

  Next, the CPU 31 determines whether or not a handwritten image is included in the right end column pixel of the processing target block (step 155). Then, when the CPU 31 determines that the processing target block and the right block are connected when the right end column pixel of the processing target block includes the handwritten image (Yes in Step 155), the CPU 31 connects the processing target block. The flag (right) is set to ON (ON), the right block confirmation process described above is performed (step 158), and the process proceeds to the next step 156. On the other hand, when the CPU 31 determines that the handwritten image is not included in the right end column pixel of the processing target block, that is, when the processing target block and the right block are not connected (No in step 155), the next step is continued. The process proceeds to 156.

  In step 156, the CPU 31 determines whether or not a handwritten image is included in the leftmost column pixel of the processing target block. When the CPU 31 determines that the leftmost column pixel of the processing target block includes a handwritten image, that is, determines that the processing target block and the left block are connected (Yes in step 156), the CPU 31 connects the processing target block. The flag (left) is set to ON (ON), the left block confirmation process described above is performed (step 159), and the process proceeds to the next step 157. On the other hand, if the CPU 31 determines that the handwritten image is not included in the leftmost column pixel of the processing target block, that is, if the processing target block and the left block are not connected (No in step 156), the next step is continued. The process proceeds to 157.

  In step 157, the CPU 31 determines whether or not a handwritten image is included in the bottom row pixel of the processing target block. When the CPU 31 determines that the processing target block and the lower block are connected when the handwritten image is included in the bottom row pixel of the processing target block (Yes in step 157), the CPU 31 of the processing target block The connection flag (lower) is set to ON (ON), and the lower block confirmation process is newly started from step 151 (step 160). After the lower block confirmation process is completed, the process proceeds to step 161. On the other hand, if the CPU 31 determines that the handwritten image is not included in the lower row pixel of the processing target block, that is, if the processing target block and the lower block are not connected (No in step 157), the next processing is continued. The process proceeds to step 161.

  In step 161, the CPU 31 sets the upper block adjacent to the upper side of the processing target block as a new processing target block, and ends the processing by the subroutine. For example, when the block with the block number 2m + 2 shown in FIG. 17 is a processing target block, the block with the block number m + 2 adjacent to the upper side of the block is set as a new processing target block.

  An example in which a handwritten image is decomposed by the above-described image decomposition processing will be described with reference to FIG. In FIG. 21, A to C indicate block numbers, the numerical values in the arrows indicate the order in which the connection relationship between the blocks is determined, and the symbols in the arrows indicate the determination results.

  In FIG. 21, a case is considered where the block of block number A (hereinafter referred to as block A) is the processing target, and the processing from step 74 to step 87 (see FIG. 12) is performed. Since the block A includes a part of the handwritten character “h”, it is set to any group (for example, group of group number 1; hereinafter referred to as group 1) (step 74 to step 76).

  When attention is paid to the left and right and upper blocks adjacent to the block A, these blocks and the block A do not include a common handwritten image. Therefore, the block A is not connected to the left and right and upper blocks (× 1 to × 3). ) (Step 77 to step 79). On the other hand, when attention is paid to the lower block (block B) adjacent to the block A, since the block B includes a part of the same handwritten character “h” as the block A, the connection between the block A and the block B ( (4) It is judged that it has been done (step 80). And the confirmation process (lower block confirmation process; step 84) which made the block B a process target block is performed. By the confirmation process, the block B includes a part of the handwritten character “h”, and thus is set to the same group 1 as the block A (step 151 to step 154).

  Next, when attention is paid to the right block (block C) adjacent to the block B, the block C also includes a part of the same handwritten character “h” as the blocks A and B. It is determined that the connection (（5) is established (step 155). And the confirmation process (right side block confirmation process; step 158) which made the block C a process target block is performed. Since the block C includes a part of the handwritten character “h” by the confirmation process, the block 1 is set to the same group 1 as the blocks A and B (steps 91 to 94).

  Next, focusing on the right and upper and lower blocks adjacent to the block C, these blocks and the block C do not include a common handwritten image, so the block C and the right and upper and lower blocks are not connected ( X6 to x8) (step 95 to step 97). Then, the confirmation processing (right block confirmation processing; step 158) with the block C as the processing target block ends, and the processing returns to the confirmation processing (step 156) with the block B as the processing target block.

  Next, when attention is paid to the left and lower blocks adjacent to the block B, since these blocks and the block B do not include a common handwritten image, the block B and the left and lower blocks are not connected ( X9 and x10) (steps 156 and 157). And the confirmation process (lower block confirmation process; step 84) which used the block B as a process target block is complete | finished, and returns to the confirmation process (step 85) which used the block A as a process target block.

  In this way, in the image decomposition process described above, the block connection determination process is performed on each side of the block, and the same connection determination process is recursively performed in other blocks for which connection determination has been performed, so that a handwritten image is obtained. Judging the continuous range. For example, as shown in FIG. 21, it is determined by such connection determination processing that the range in which the handwritten character “h” is continuous is block A to block B, and the block A to block C are in the same group. Set to Then, by repeating the same image decomposition process, handwritten characters are set in different groups for each continuous portion. This applies not only to handwritten characters but also to handwritten stamps and free lines, and is set to different groups for each portion where handwritten images are continuous.

  Returning to FIG. 11, after the image decomposition process in step 56, the CPU 31 performs an effect display process (step 57), and proceeds to the next step. Hereinafter, the effect display process performed in step 57 will be described with reference to FIG.

  In FIG. 22, the screen displayed on the lower LCD 12 is composed of a plurality of layers. Specifically, the screen displays a real-time image (captured image) captured by the inner camera 23 or the outer camera 25, an image (captured image) stored as image data in the game apparatus 1 or the memory card 28, and the like. A live layer Llive to be displayed, a paint layer Lpaint to display the handwritten image described above, a 3D texture layer L3D to display and display an object moving on the screen, and the like.

  When the user inputs a handwritten character, a handwritten stamp, or the like via the touch panel 13, a handwritten image corresponding to the input is placed on the paint layer Lpaint (upper diagram in FIG. 22). Thereafter, when the user performs an all-erase operation, among the display images on the paint layer Lpaint, blocks belonging to the group classified by the image decomposition process (specifically, one or more group numbers Gn are set) Only the block) is copied onto the 3D texture layer L3D, and all the handwritten images placed on the paint layer Lpaint are deleted (the lower diagram in FIG. 22).

  In the effect display process, a predetermined initial speed is given to each block placed on the 3D texture layer L3D, and is described in the block movement data Dc. At this time, the moving speed and the moving direction given to each group are determined at random, and the same moving speed and the initial speed in the same moving direction are given to the blocks belonging to the group of the same group number Gn.

  For example, as shown in the left diagram of FIG. 23A, when the blocks A to C belong to the same group, the same movement vectors Vba to Vbc are given to the center positions Pba to Pbc of the blocks A to C, respectively. The same moving speed and the initial speed in the same moving direction are given to A to C, respectively. Then, the CPU 31 moves each block together with the handwritten image described on the 3D texture layer L3D according to the movement data (movement speed, movement direction) of each block described in the block movement data Dc. Thereafter, acceleration is given to each block for each processing unit time so that each block freely falls in a predetermined direction (for example, the lower direction of the lower LCD 12), and the block movement data Dc is updated.

  Thus, by giving a moving speed to each block, the handwritten image described in each block can be moved and displayed on the lower LCD 12. Here, for the blocks belonging to the same group, the same movement speed and the same movement direction are always given, and different movement speeds and different movement directions are given between different groups, so that the blocks move together for each group. Thus, the handwritten image (handwritten character Ihw1) divided into groups is represented as if it moved in the divided units (see the right figure in FIG. 23A). Since acceleration in a predetermined direction acts on each block, each block eventually moves out of the display range of the lower LCD 12, and the handwritten image described in each block is erased from the lower LCD 12. (See FIGS. 3 to 6).

  In the above description, an example in which acceleration is given to each block so that each block freely falls in a predetermined direction is used. However, the acceleration may not be given. In this case, each block moves according to the initial speed given to each block, so that the handwritten image divided into groups is expressed as being scattered in all directions.

  Returning to FIG. 11, after the effect display process of step 57, the CPU 31 determines whether or not the effect display process is completed (step 58). And CPU31 continues the process of the said step 57, when the said production | presentation display process is not complete | finished. On the other hand, CPU31 advances a process to the following step 60, when the said production | presentation display process is complete | finished.

  On the other hand, when the operation data acquired in step 52 is not data indicating handwritten input or complete erasure (both step 53 and step 55 are No), the CPU 31 performs other processing according to the operation data (step 59) The process proceeds to the next step 60.

  In step 60, the CPU 31 determines whether or not to end the image processing. Examples of the condition for ending the image processing include that the condition for ending the image processing is satisfied, and that the user performs an operation for ending the image processing. The CPU 31 returns to step 52 when the image processing is not ended, repeats the processing, and ends the processing according to the flowchart when the image processing is ended.

  As described above, when the game apparatus 1 according to the present embodiment erases all the handwritten images displayed by the handwritten input by the user operation by the user operation, the handwritten image is decomposed, and the movement different for each of the decomposed groups. do. Therefore, since a new effect is added to the entire erasing operation in which the user doodles by handwriting input and erases the graffiti, the operation feels interesting to the user.

  Note that the handwriting image decomposition process described above is divided into groups for each continuous portion of the image handwritten by the user, but the image may be decomposed in another manner. For example, an input stroke of a user who has decomposed each color of an image to be erased or has input an image to be erased (for example, input from touch panel 13 to touch-off) Each free line), extracting the edges of the image to be completely erased and disassembling the edges, or displaying the display screen in a preset shape (for example, a mesh of a predetermined shape) It is also possible to divide and decompose an image to be completely erased in this shape. When disassembling each input stroke of the user, if a history of handwriting input by the user (for example, a history of touch positions input to the touch panel 13) is stored, a handwritten image can be decomposed for each input stroke. .

  Moreover, since the handwritten image decomposition process described above divides the handwritten image into predetermined divided areas (blocks) and groups the divided areas based on the handwritten image, the processing load of the decomposition process is reduced. There is an effect. However, when such an effect is not expected, the handwritten image may be decomposed by another method. For example, each pixel may be grouped so that pixels adjacent to each other are set in the same group with respect to the pixel group indicating the handwritten image.

  Further, in the above-described embodiment, handwritten images such as handwritten characters, handwritten lines, and handwritten stamps displayed by handwriting input by a user operation are targeted for all erasing operations, but other images are subjected to all erasing operations of the present invention. It does not matter as a target. For example, the lower LCD 12 of the game apparatus 1 such as a captured image based on image data captured by the user with the inner camera 23 or the outer camera 25 or a captured image based on image data in which the captured image is temporarily stored in a predetermined storage medium. And / or an image that can be displayed on the upper LCD 22 may be the object of all erasure. Specifically, the user can issue a shooting instruction using the inner camera 23 or the outer camera 25 by pressing the operation button 14G or the operation button 14H of the game apparatus 1. Then, the image picked up by the inner camera 23 or the outer camera 25 can be stored (saved) in the saving data memory 34 or the memory card 28 by the shooting process. The CPU 31 may use an image obtained by such shooting processing or an image captured in real time as a target image for the above-described decomposition processing. In this case, the target image is decomposed for each color described above, the target image is decomposed at the edge by edge extraction, or the symmetric image is decomposed in a preset shape, so that all the same as the handwritten image is obtained. An effect at the time of erasure processing is possible.

  Further, in the above-described effect display processing, an example of an effect in which the decomposed handwritten image is moved and deleted in different directions is used, but the image is moved or the display angle is changed or deformed in units of decomposed images. You may perform other animation production processing. For example, the disassembled handwritten image may be erased by rotating and erasing, erasing by reducing each, or erasing by changing the transparency while enlarging each.

  Here, in the effect display process described above, the group is moved integrally by giving the same movement vector to each block belonging to the same group as shown in FIG. 23A. However, when the group is rotated as described above, different movement vectors are given to the blocks belonging to the group.

  For example, as shown in FIG. 23B, it is assumed that the blocks A to C belong to the same group and the blocks A to C are rotated together. In this case, according to the distance from the center of gravity Pg1 of the blocks A to C to the center positions Pba to Pbc of the blocks A to C, the movement vector Vra that moves each of the blocks A to C around the center of gravity Pg1 in the same rotational direction. Calculate ~ Vrc. Then, the blocks A to C are rotated by the angle θ about the center positions Pba to Pbc by the movement angle θ that the blocks A to C have moved about the center of gravity Pg1. As a result, the handwritten image (handwritten character Ihw1) divided into groups is represented so as to rotate in the divided units (see the right figure in FIG. 23B). By adding the above-described movement vectors Vba to Vbc to the movement vectors Vra to Vrc for such rotation, there is also an effect display in which the handwritten image divided in the display screen moves while rotating. It goes without saying that it will be possible.

  Further, in the above-described image processing, an example is used in which the handwritten image divided when the user performs a complete erasure operation is displayed as an effect. However, the same effect display is also performed when the user performs a partial erasure operation. You can go. For example, when the user performs an operation for designating a range to be erased, the above-described image decomposition process is performed only on the blocks included in the range, the effect display process is performed, and the handwritten image described in the block outside the range Is held on the paint layer Lpaint (see FIG. 22), the present invention can be applied even to partial erasure.

  Further, in the above-described effect display process, an example in which the divided handwritten images are moved out of the display range of the lower LCD 12 according to the all erasing operation performed by the user, and each handwritten image is erased from the lower LCD 12. Although shown, if the display position or display mode of each handwritten image is changed, the present invention can be applied without being erased from the display screen. Here, changing the display mode of the decomposed handwritten image changes the shape (enlargement, reduction, etc.) for each decomposed handwritten image, changes (rotates) the display direction for each decomposed handwritten image, The process includes changing the color for each decomposed handwritten image, blinking for each decomposed handwritten image, changing the transparency for each decomposed handwritten image, and the like. For example, each handwritten image may be moved so that the divided handwritten images are overlapped and gathered at predetermined positions on the lower LCD 12 in accordance with a total erasing operation performed by the user. In addition, each handwritten image is moved so that the divided handwritten image floats and moves in the lower LCD 12 according to a predetermined operation (in this case, not all erasing operation) performed by the user. It doesn't matter. Furthermore, depending on a predetermined operation performed by the user (in this case, not all erasing operation), the divided handwritten images are changed to different colors or blinked at different timings, and the lower side It may be displayed on the LCD 12.

  In addition, as described with reference to FIG. 22, when a user inputs a handwritten character, a handwritten stamp, or the like, an example in which a handwritten image corresponding to the input is placed on the paint layer Lpaint is used. You can display it on a layer. For example, when a user inputs a handwritten character or a handwritten stamp, the handwritten image corresponding to the input may be displayed on the 3D texture layer L3D to display the handwritten image.

  In the above-described embodiment, the case where the physically separated lower LCD 12 and upper LCD 22 are arranged one above the other as an example of the liquid crystal display unit for two screens (in the case of two upper and lower screens) has been described. However, the configuration of the display screen for two screens may be other configurations. For example, the lower LCD 12 and the upper LCD 22 may be arranged on the left and right on one main surface of the lower housing 11. In addition, the lower LCD 12 is the same as the lower LCD 12 and has a vertically long LCD that is twice as long as the lower LCD 12 (that is, an LCD that is physically one and has two display screens vertically). Arranged on one main surface of the housing 11 so that two images (for example, an image showing a captured image and an operation explanation screen) are displayed up and down (that is, displayed adjacent to each other without an upper and lower boundary portion). May be. In addition, a horizontally long LCD having the same vertical width as that of the lower LCD 12 and having a width twice as large as that of the lower LCD 12 is disposed on one main surface of the lower housing 11 so that two images are horizontally displayed on the left and right. You may comprise so that it may display (namely, it adjoins without a right-and-left boundary part). That is, two images may be displayed by physically dividing one screen into two. When any of the image forms is displayed on the lower LCD 12 described above, or when the two images are displayed by physically dividing the screen into two, the screen The touch panel 13 may be provided on the entire surface.

  In the above-described embodiment, the touch panel 13 is integrally provided in the game apparatus 1. However, it goes without saying that the present invention can be realized even if the game apparatus and the touch panel are configured separately. In addition, the touch panel 13 may be provided on the upper surface of the upper LCD 22 and the display image displayed on the lower LCD 12 described above may be displayed on the upper LCD 22. Furthermore, although two display screens (lower LCD 12 and upper LCD 22) are provided in the above embodiment, the number of display screens may be one. That is, in the above-described embodiment, the touch panel 13 may be provided with only the lower LCD 12 as a display screen without providing the upper LCD 22. In the above embodiment, the touch panel 13 may be provided on the upper surface of the upper LCD 22 without providing the lower LCD 12, and the display image displayed on the lower LCD 12 may be displayed on the upper LCD 22.

  Moreover, in the said Example, although the touch panel 13 was used as an input means of the game device 1 which implement | achieves a coordinate input, you may use another pointing device. Here, the pointing device is an input device for designating an input position and coordinates on the screen. For example, a pointing device such as a mouse, a track pad, a track ball, a pen tablet, or a joystick is used as an input unit, and is output from the input unit. If the position information of the screen coordinate system calculated from the output value is used, the present invention can be similarly realized.

  In addition, in the case of a stationary game device in which a player holds a game controller and enjoys a game, a pointing device of another aspect is also conceivable. For example, a camera fixed to the housing of the game controller can be used as the pointing device. In this case, the captured image captured by the camera changes in accordance with the change in position indicated by the housing of the game controller. Therefore, by analyzing this captured image, it is possible to calculate the coordinates indicated by the housing with respect to the display screen.

  In this case, the present invention can be realized by handling the coordinates indicating the position indicated by the housing as the touch coordinates in the above-described processing. However, the input presence / absence determination such as touch-on or touch-off in the touch panel input is substituted by the presence / absence or change of another input from the game controller different from the coordinate input. As a first example, the touch-on or touch-off determination is substituted depending on whether an operation button provided in the game controller is pressed (for example, touch-on when the A button is pressed). In the second example, the game controller is composed of two housings. These two housings are composed of one housing on which the camera is mounted and the other housing on which a detection unit such as an acceleration sensor that outputs a signal corresponding to the movement of the other housing is fixed. The In this case, the touch-on or touch-off determination is substituted according to the movement of the other housing (for example, touch-on when the housing is tilted in a predetermined direction). In the third example, voice input means such as a microphone is provided in the housing of the game controller. In this case, a determination that the touch-on and the touch-off are switched when the player makes a predetermined sound is substituted.

  In the above embodiments, the portable game apparatus 1 and the stationary game apparatus have been described. However, the image processing program of the present invention is executed by an information processing apparatus such as a general personal computer to execute the present invention. May be realized.

  In addition, the shape of the game apparatus 1 described above, the shapes, numbers, and installation positions of the various operation buttons 14 and the touch panel 13 provided on the game apparatus 1 are merely examples, and other shapes, numbers, and installation positions. However, it goes without saying that the present invention can be realized. Further, the processing order used in the above-described image processing is merely an example, and it goes without saying that the present invention can be realized even in other orders. For example, in the processing order described above, the order of determining the connection relationship between the blocks is the right block, the upper block, the left block, and the lower block, but the connection relationship between the blocks is determined in another order. It doesn't matter.

  Although the present invention has been described in detail above, the above description is merely illustrative of the present invention in all respects and is not intended to limit the scope thereof. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention.

  When the image processing program and the image processing apparatus of the present invention process an image displayed by a user operation according to the user operation, the image processing program and the image processing apparatus can process the image with a new effect. It is useful for devices that display handwritten images, and is also useful as a program that is executed by these devices.

1 ... Game device 11 ... Lower housing 12 ... Lower LCD
13 ... Touch panel 14 ... Operation buttons 15, 26 ... LED
16 ... Microphone hole 21 ... Upper housing 22 ... Upper LCD
23 ... Inner camera 24 ... Sound release hole 25 ... Outer camera 27 ... Touch pens 28, 29 ... Memory card 31 ... CPU
32 ... Main memory 33 ... Memory control circuit 34 ... Storage data memory 35 ... Preset data memory 36, 37 ... Memory card I / F
38 ... Wireless communication module 39 ... Local communication module 40 ... RTC
41 ... Power supply circuit 42 ... I / F circuit 43 ... Microphone 44 ... Amplifier

Claims (28)

An image processing program executed by a computer of an apparatus that performs predetermined processing on an image generated in response to an output from a pointing device,
The computer,
Image generating means for generating an input image based on the output of the pointing device;
Image display control means for displaying on the display means the input image generated by the image generation means;
An image processing program that decomposes an input image generated by the image generation unit into a plurality of partial images and functions as an image change control unit that executes a process of changing at least one of a display position and a display mode for each partial image .   The image change control means, when an erasure operation is performed by the user, performs the change process for the partial image that is the target of the erasure operation, displays the changed image on the display means, The image processing program according to claim 1, wherein the target partial image is erased from the display screen after the display.   The said image change control means divides | segments the display area of the said input image into the block comprised by several pixels, and decomposes | disassembles the said input image into several partial image for the said block as a unit. Image processing program. Causing the computer to further function as continuous determination means for determining a continuous portion of the input image;
3. The image change control unit according to claim 1, wherein the image change control unit decomposes the input image into a plurality of partial images so that consecutive portions belong to the same partial image based on the determination by the continuous determination unit. Image processing program. The image change control means divides the display area of the input image into blocks each composed of a plurality of pixels, decomposes the input image into a plurality of partial images in units of the block,
The continuity determining means determines that a block spanning the input image is continuous,
The said image change control means is further decomposed | disassembled into the some partial image so that the block which continues may belong to the same partial image based on the determination by the said continuous determination means. Image processing program.   The image according to claim 5, wherein the continuity determination unit determines that the two blocks are continuous when the input image is included in one of the adjacent regions of the two adjacent blocks. Processing program.   The image processing program according to claim 5, wherein the continuity determination unit determines that the two blocks are continuous when the input image is included in both adjacent regions of the two adjacent blocks. .   The continuous determination means further determines that the input image included in the adjacent region of one block of the two blocks and the input image included in the adjacent region of the other block are continuous, and is continuous. In this case, the image processing program according to claim 7, wherein it is determined that the two blocks are continuous.   In the adjacent block determined to be continuous to a certain block, the continuous determination means determines whether or not the adjacent block and another block further adjacent to the adjacent block are continuous. The image processing program according to claim 5, wherein the image processing program determines that the certain block, the adjacent block, and the other block are continuous.   The image processing according to claim 1, wherein the image change control unit changes the display position for each partial image by giving the same moving speed in the same moving direction to the element images constituting the partial image. program.   The image change control means changes the display position for each partial image by giving the same movement speed in the same movement direction to each block determined to be continuous by the continuous determination means. The image processing program according to claim 5. The apparatus includes an imaging unit that images the periphery of the apparatus,
The image display control unit displays the captured image captured by the imaging unit on the display unit in real time, and displays the input image generated by the image generation unit superimposed on the captured image on the display unit. The image processing program according to claim 1 or 2.   The image processing program according to claim 1, wherein the image generation unit generates a handwritten image based on an output of the pointing device.   The image processing program according to claim 1, wherein the image generation unit generates a predetermined composition image displayed at a position based on an output of the pointing device. The image generation means generates the second input image based on the output of the pointing device after the first input image is generated,
The image display control means combines and displays the first input image and the second input image,
The image processing program according to claim 1, wherein the image change control unit decomposes the image by combining an image obtained by combining the first input image and the second input image into one image.   When an erasing operation for erasing all is performed by the user, the image change control means decomposes the entire input image into a plurality of partial images, and displays a display position and a display mode for all of the plurality of partial images. The image processing program according to claim 2, wherein at least one of the processes for changing is performed and displayed on the display unit, and all the partial images are erased from the display screen after the display.   The image processing program according to claim 2, wherein the image change control means moves the display image to a different display position for each partial image and displays the image on the display means.   The image processing program according to claim 17, wherein the image change control unit erases the image from the display screen by moving the partial image to the outside of the display screen.   The image change control means erases the image from the display screen by giving an acceleration in a specific direction common to the plurality of partial images after giving an initial velocity in a different direction for each partial image. Item 18. The image processing program according to Item 17.   The image processing program according to claim 1, wherein the pointing device is a touch panel that covers a display screen of the display unit.   The image processing program according to claim 1, wherein the image change control unit decomposes the input image generated by the image generation unit for each color of the image. As an input position history storage control means for storing a history of input positions output from the pointing device in a memory, the computer is further functioned,
The image change control means is generated based on the history of the input positions from among the input positions that the image generation means used for generating the input images, and the output of the input positions is continuous without interruption. The image processing program according to claim 1, wherein the input image generated by the image generation unit is decomposed for each input image.   3. The image processing program according to claim 1, wherein the image change control unit decomposes the input image generated by the image generation unit into a mesh shape set in advance.   The image processing program according to claim 1, wherein the image change control unit rotates the decomposed partial images for display on the display unit.   The image processing program according to claim 1, wherein the image change control unit enlarges or reduces each of the decomposed partial images to display on the display unit.   The image processing program according to claim 1, wherein the image change control unit changes an image color for each of the decomposed partial images and causes the display unit to display the image color.   The image processing program according to claim 1, wherein the image change control unit causes each of the decomposed partial images to blink and display on the display unit. An image processing apparatus that performs predetermined processing on an image generated according to an output from a pointing device,
Image generating means for generating an input image based on the output of the pointing device;
Image display control means for displaying on the display means the input image generated by the image generation means;
An image processing apparatus comprising: an image change control unit that decomposes the input image generated by the image generation unit into a plurality of partial images and executes a process of changing at least one of a display position and a display mode for each partial image. .

Images