JP2010157192A - Drawing processing program and information processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a drawing processing program and an information processor, allowing drawing with unprecedented new operability. <P>SOLUTION: This information processor continuously acquires an indication position on a display screen based on indication by a pointing device. Next, the information processor detects that voice satisfying a prescribed condition is inputted to a voice input means. The information processor executes prescribed drawing-related processing to a position based on the acquired indication position while it is detected that the voice input satisfying the prescribed condition is present. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a drawing processing program that allows a player to draw a desired picture, and more specifically to a drawing processing program that allows a player to draw a desired picture using a pointing device such as a touch panel. .

  2. Description of the Related Art Conventionally, there is known an apparatus that edits an image by a user operating a touch pen to input to a touch panel (for example, Patent Documents 1 and 2). In these apparatuses, it is possible to perform image editing (such as graffiti) on an image of a subject (user) itself using a touch pen. At this time, it is also possible to select the thickness and line type of the pen.

JP 2003-191567 A JP 2006-129257 A

  However, the apparatus as described above has the following problems. In the above apparatus, drawing is performed while inputting with the touch pen on the touch panel. For this reason, the operation can be performed as if the user was drawing on paper using a pen. On the other hand, since such an operation is a general operation, it is not fresh for the user.

  SUMMARY OF THE INVENTION Therefore, an object of the present invention is to provide a drawing processing program and an information processing apparatus capable of drawing with a novel operability that has not existed before.

  The present invention employs the following configuration in order to solve the above problems. Note that the reference numerals in parentheses, supplementary explanations, and the like are examples of the correspondence with the embodiments described later in order to help understanding of the present invention, and do not limit the present invention.

A first invention is a drawing processing program for causing a computer of an information processing apparatus that can use a pointing device for indicating a position on a display screen and a voice input unit to execute the computer. S22), voice detection means (S51), and drawing-related process execution means (S56). The designated position input coordinate detecting means continuously obtains the designated position on the display screen based on the instruction from the pointing device. Here, regarding acquisition of the designated position, for example, if the pointing device is a touch panel, a touch operation on the touch panel is an instruction operation. In addition, in the case where the pointing device is an operation device including an imaging unit for imaging an imaging target and can be pointed at an arbitrary position on the screen based on imaging information obtained by the imaging unit, the pointing device The instruction operation is performed when a predetermined button provided in the operation device is pressed in the state where the operation is performed. The voice detection unit detects that voice satisfying a predetermined condition is input to the voice input unit. Here, the predetermined condition includes a case where determination is performed using a predetermined threshold. That is, it includes a case where it is determined that there is a voice input when a sound of a certain level is input, and that it is determined by the specific voice determination means described later that the voice is a predetermined voice. This includes cases where The drawing related process executing means executes the predetermined drawing related processing at a position based on the designated position acquired by the designated position detecting means while the voice detecting means detects that there is an input of sound satisfying the predetermined condition. To do. Here, the drawing-related processing is processing for drawing (drawing) an image by lines (straight lines, curved lines), points, and a set of these on the display screen, processing for editing (editing) an already drawn image, etc. It also includes a process of deleting the image or the like.

  According to the first invention, it is possible to provide a drawing program having novel operability.

  In a second aspect based on the first aspect, the drawing-related process execution means changes the content of the drawing-related process to be executed based on the sound detected by the sound detection means according to the characteristics of the sound. Here, the sound characteristics correspond to, for example, volume, frequency, timbre, and the like.

  According to the second aspect, since the content of the drawing-related processing to be executed changes depending on the content of the input voice, it is possible to provide a new way of enjoying to the player.

  In a third aspect based on the second aspect, the drawing-related process execution means determines the contents of the drawing-related process to be executed in conjunction with a time-series change in the sound characteristics repeatedly detected by the sound detection means. Change sequentially.

  According to the third aspect, since the content of the drawing related process changes in real time according to the change of the input voice, it is possible to provide a new way of enjoying to the player. Furthermore, while drawing based on the position detected by the indicated position detection means, the player changes the content of the drawing related processing in accordance with the input from the voice input means, which is another means. The contents of the drawing related process can be changed while continuing the instruction.

  In a fourth aspect based on the second aspect, the voice analysis means executes the predetermined drawing-related process only when the volume of the input voice is equal to or higher than a predetermined threshold.

  According to the fourth aspect, since the drawing-related process is executed only when the volume of the input voice is somewhat high, it is possible to provide a new way of enjoying to the player.

  In a fifth aspect based on the second aspect, the drawing-related processing execution means includes processing for drawing a line connecting the positions based on the designated positions continuously acquired by the input coordinate detecting means in time series as drawing-related processing. Execute.

  According to the fifth aspect, it becomes possible to draw a handwritten image on the display screen with new operability, and a new way of enjoying can be provided to the player.

  In a sixth aspect based on the fifth aspect, the voice analyzing means changes at least one of the thickness of the line and the density of the drawing color of the line according to the volume of the input voice.

  According to the sixth aspect, since the thickness and the density of the drawn line change according to the input volume, a new way of enjoying can be provided to the player.

  In a seventh aspect based on the second aspect, the drawing related process execution means executes a process of drawing one or more points in a drawing range which is a predetermined range including a position based on the designated position as a drawing related process. To do.

  According to the seventh invention, it is possible to provide a player with a drawing feeling such as drawing using a spray together with a novel operability.

In an eighth aspect based on the seventh aspect, the voice analyzing means calculates at least one of the size of the drawing range and the number of points to be drawn in the drawing range in accordance with the volume of the input voice. Change.

  In a ninth aspect based on the eighth aspect, the drawing-related processing execution means draws a point so that the surface density of the number of points increases as the position is closer to the designated position, and the position based on the designated position. The points are drawn so that the surface density of the number of the plurality of points decreases with increasing distance from the point.

  In a tenth aspect based on the eighth aspect, the drawing related processing execution means draws a plurality of points at random positions within the drawing range.

  According to the eighth to tenth aspects, various drawing can be performed according to the volume of the input voice.

  In an eleventh aspect based on the seventh aspect, the drawing-related processing execution means determines a point drawn on the display screen based on the position based on the designated position and the voice input detected by the voice detection means. The process of moving in the direction is executed as a drawing related process.

  In a twelfth aspect based on the eleventh aspect, the drawing related process execution means uses the position based on the indicated position as a reference point, and the direction of the line connecting the reference point and the point displayed on the display screen, and Movement content calculation means for calculating the distance from the reference point to the point displayed on the display screen is included. Then, the drawing-related process execution unit moves the point displayed on the screen based on the direction and distance calculated by the movement content calculation unit.

  According to the eleventh to twelfth inventions, a plurality of already drawn points can be moved by voice input, and new enjoyment can be given to the player.

  In a thirteenth aspect based on the first aspect, the drawing processing program causes the computer to perform a predetermined effect on the predetermined sound output means when the drawing related process execution means executes the predetermined drawing related processing. It further functions as sound effect reproducing means (S60) for outputting sound.

  In a fourteenth aspect based on the thirteenth aspect, the sound effect reproducing means changes the reproduction volume of the sound effect according to the characteristics of the sound detected by the sound detecting means.

  According to the thirteenth to fourteenth aspects, the player can intuitively grasp whether or not the drawing-related processing is being executed.

  In a fifteenth aspect based on the first aspect, the drawing processing program causes the computer to further function as cursor display means (S57) and animation display means (S57). The cursor display means displays a predetermined cursor image at the indicated position. The animation display means animates the cursor when the drawing related process executing means is executing a predetermined drawing related process.

  In a sixteenth aspect based on the fifteenth aspect, the animation display means changes the speed of the animation in accordance with the characteristics of the sound detected by the sound detection means.

  According to the fifteenth to sixteenth aspects, it is possible to cause the player to visually grasp whether or not drawing-related processing is being executed.

  In a seventeenth aspect based on the first aspect, the pointing device is a touch panel.

  According to the seventeenth aspect, intuitive operability can be provided to the player.

  In an eighteenth aspect based on the first aspect, the drawing processing program causes the computer to further function as a captured image acquisition means (S1) and a captured image display means (S21). The captured image acquisition unit acquires image data captured by a predetermined imaging unit. The captured image display means displays the captured image on the display screen. Then, the drawing related process execution means executes a drawing related process on the captured image.

  According to the eighteenth aspect, it is possible to provide editing of a captured image with a new operability.

  In a nineteenth aspect based on the first aspect, the drawing processing program causes the computer to further function as specific sound determination means for determining whether or not the sound detected by the sound detection means is a predetermined sound. Then, the drawing related process execution unit executes the drawing related process only when the specific voice determination unit determines that the sound detected by the sound detection unit is a predetermined sound.

  According to the nineteenth invention, for example, it is possible to identify a specific sound such as a sound that the player blows and execute the drawing-related processing, and to provide a new way of enjoying the player. . In addition, since the drawing related process can be executed only when the player emits a specific sound, it is possible to prevent the drawing related process from being executed in response to an unintended sound.

  A twentieth invention is an information processing apparatus that can use a pointing device (13) for indicating a position on the display screen (12) and a voice input means (42), and an input coordinate detection means (31). And a voice detection means (31) and a drawing related process execution means (31). The input coordinate detection means continuously acquires the indicated position on the display screen based on the instruction from the pointing device. The voice detection unit detects that voice satisfying a predetermined condition is input to the voice input unit. The drawing-related process execution means executes a predetermined drawing-related process at a position based on the designated position while the voice detection means detects that there is a voice input.

  According to the twentieth invention, an effect similar to that of the drawing processing program of the present invention described above can be obtained.

  In a twenty-first aspect based on the twentieth aspect, the sound detecting means is arranged in the vicinity of the display screen.

  According to the twenty-first aspect, since the display screen and the sound detection means are arranged at close positions, when sound is generated toward the screen, drawing is performed on the display screen in response to the sound. It is possible to produce an intuitive production effect such as.

  ADVANTAGE OF THE INVENTION According to this invention, the drawing program and drawing game which can make a player enjoy drawing with novel operativity can be provided.

1 is an external view of a portable game device 10 according to the first embodiment of the present invention. 1 is a block diagram of a portable game device 10 according to a first embodiment of the present invention. An example of a game screen assumed in the present embodiment Example of captured image An example of a game screen assumed in the present embodiment Diagram showing the relationship between the shot image and the canvas An example of a game screen assumed in the present embodiment The figure for demonstrating operation of the game assumed in this embodiment An example of an image rendered in the game assumed in the present embodiment An example of a game screen assumed in the present embodiment An example of a game screen assumed in the present embodiment An example of a game screen assumed in the present embodiment An illustrative view showing a memory map of the main memory 32 shown in FIG. The figure which showed an example of the data structure of the drawing tool master 327 The figure which shows an example of the data structure of the spray table 332 Diagram for explaining the drawing area The flowchart which shows the doodle game process which concerns on embodiment of this invention The flowchart which showed the detail of the camera process shown by step S1 of FIG. The flowchart which showed the detail of the graffiti process shown by step S2 of FIG. The flowchart which showed the detail of the pen process shown by step S29 of FIG. The flowchart which showed the detail of the spray drawing process shown by step S43 of FIG. The flowchart which showed the detail of the eraser process shown by step S31 of FIG. The flowchart which showed the detail of the spray eraser process shown by step S73 of FIG. Diagram for explaining the outline of the blow-off process Diagram for explaining the outline of the blow-off process Diagram for explaining the outline of the blow-off process Flowchart showing details of blow-off processing An example of spray lines using multiple colors

  Embodiments of the present invention will be described below with reference to the drawings. In addition, this invention is not limited by this Example.

  FIG. 1 is an external view of a game apparatus 1 that executes a color conversion program of the present invention. Here, a portable game device is shown as an example of the game device 1. Note that the game apparatus 1 has a built-in camera, and also functions as a photographing apparatus that captures an image with the camera, displays the captured image on a screen, and stores data of the captured image.

  In FIG. 1, a game apparatus 1 is a foldable portable game apparatus, and shows the game apparatus 1 in an open state (open state). The game apparatus 1 is configured in such a size that the user can hold it with both hands or one hand even in an open state.

  The game apparatus 1 includes a lower housing 11 and an upper housing 21. The lower housing 11 and the upper housing 21 are connected so as to be openable and closable (foldable). In the example of FIG. 1, the lower housing 11 and the upper housing 21 are each formed in a horizontally-long rectangular plate shape, and are coupled so as to be rotatable at their long side portions. Normally, the user uses the game apparatus 1 in the open state. Further, when the user does not use the game apparatus 1, the user stores the game apparatus 1 in a closed state. In the example shown in FIG. 1, the game apparatus 1 is not limited to the closed state and the open state, and the angle formed by the lower housing 11 and the upper housing 21 is an arbitrary angle between the closed state and the open state. The opening / closing angle can be maintained by a frictional force or the like generated at the connecting portion. That is, the upper housing 21 can be made stationary with respect to the lower housing 11 at an arbitrary angle.

  The lower housing 11 is provided with a lower LCD (Liquid Crystal Display) 12. The lower LCD 12 has a horizontally long shape, and is arranged such that the long side direction coincides with the long side direction of the lower housing 11. In the present embodiment, an LCD is used as the display device built in the game apparatus 1, but other arbitrary display devices such as a display device using EL (Electro Luminescence) are used. May be. The game apparatus 1 can use a display device having an arbitrary resolution. Although details will be described later, the lower LCD 12 is mainly used to display an image taken by the inner camera 23 or the outer camera 25 in real time.

  The lower housing 11 is provided with operation buttons 14A to 14K and a touch panel 13 as input devices. As shown in FIG. 1, among the operation buttons 14A to 14K, a direction input button 14A, an operation button 14B, an operation button 14C, an operation button 14D, an operation button 14E, a power button 14F, a start button 14G, and a select button 14H. Is provided on the inner main surface of the lower housing 11 which is the inner side when the upper housing 21 and the lower housing 11 are folded. The direction input button 14A is used for, for example, a selection operation. The operation buttons 14B to 14E are used for, for example, a determination operation or a cancel operation. The power button 14F is used for turning on / off the power of the game apparatus 1. In the example shown in FIG. 1, the direction input button 14 </ b> A and the power button 14 </ b> F are on the main surface on one of the left and right sides (left side in FIG. 1) with respect to the lower LCD 12 provided near the center of the inner main surface of the lower housing 11. Provided on top. Further, the operation buttons 14B to 14E, the start button 14G, and the select button 14H are provided on the inner main surface of the lower housing 11 that is on the other left and right sides (right side in FIG. 1) with respect to the lower LCD 12. The direction input button 14A, the operation buttons 14B to 14E, the start button 14G, and the select button 14H are used for performing various operations on the game apparatus 1.

In FIG. 1, the operation buttons 14I to 14K are not shown. For example, the L button 14I is provided at the left end portion of the upper side surface of the lower housing 11, and the R button 14J is provided at the right end portion of the upper side surface of the lower housing 11. The L button 14I and the R button 14J are used to perform, for example, a shooting instruction operation (shutter operation) on the game apparatus 1. Furthermore, the volume button 14K is provided on the left side surface of the lower housing 11. The volume button 14K is used to adjust the volume of the speaker provided in the game apparatus 1.

  In addition, the game apparatus 1 further includes a touch panel 13 as an input device different from the operation buttons 14A to 14K. The touch panel 13 is mounted so as to cover the screen of the lower LCD 12. In the present embodiment, for example, a resistive film type touch panel is used as the touch panel 13. However, the touch panel 13 is not limited to the resistive film type, and any pressing type touch panel can be used. In the present embodiment, as the touch panel 13, for example, a touch panel having the same resolution (detection accuracy) as that of the lower LCD 12 is used. However, the resolution of the touch panel 13 and the resolution of the lower LCD 12 are not necessarily matched. Further, an insertion port (broken line shown in FIG. 1) is provided on the right side surface of the lower housing 11. The insertion opening can accommodate a touch pen 27 used for performing an operation on the touch panel 13. In addition, although the input with respect to the touch panel 13 is normally performed using the touch pen 27, it is also possible to operate the touch panel 13 not only with the touch pen 27 but with a user's finger | toe.

  Further, on the right side surface of the lower housing 11, an insertion slot (indicated by a two-dot chain line in FIG. 1) for storing the memory card 28 is provided. A connector (not shown) for electrically connecting the game apparatus 1 and the memory card 28 is provided inside the insertion slot. The memory card 28 is, for example, an SD (Secure Digital) memory card, and is detachably attached to the connector. The memory card 28 is used, for example, for storing (saving) an image photographed by the game apparatus 1 or reading an image generated by another apparatus into the game apparatus 1.

  Further, an insertion port (indicated by a one-dot chain line in FIG. 1) for housing the cartridge 29 is provided on the upper side surface of the lower housing 11. A connector (not shown) for electrically connecting the game apparatus 1 and the cartridge 29 is also provided inside the insertion slot. The cartridge 29 is a recording medium that records a color conversion program, a game program, and the like, and is detachably attached to an insertion port provided in the lower housing 11.

  Three LEDs 15 </ b> A to 15 </ b> C are attached to the left portion of the connecting portion between the lower housing 11 and the upper housing 21. Here, the game apparatus 1 can perform wireless communication with other devices, and the first LED 15A is lit when the power of the game apparatus 1 is on. The second LED 15B is lit while the game apparatus 1 is being charged. The third LED 15C is lit when wireless communication is established. Therefore, the three LEDs 15A to 15C can notify the user of the power on / off status of the game apparatus 1, the charging status, and the communication establishment status.

  On the other hand, the upper housing 21 is provided with an upper LCD 22. The upper LCD 22 has a horizontally long shape and is arranged such that the long side direction coincides with the long side direction of the upper housing 21. As in the case of the lower LCD 12, instead of the upper LCD 22, a display device having any other method and any resolution may be used. A touch panel may be provided so as to cover the upper LCD 22. For example, the upper LCD 22 displays an operation explanation screen for teaching the user the roles of the operation buttons 14 </ b> A to 14 </ b> K and the touch panel 13.

The upper housing 21 is provided with two cameras (an inner camera 23 and an outer camera 25). As shown in FIG. 1, the inner camera 23 is attached to the inner main surface near the connecting portion of the upper housing 21. On the other hand, the outer camera 25 is a surface on the opposite side of the inner main surface to which the inner camera 23 is attached, that is, the outer main surface of the upper housing 21 (the outer surface when the game apparatus 1 is in a closed state, It is attached to the rear surface of the upper housing 21 shown in FIG. In FIG. 1, the outer camera 25 is indicated by a broken line. As a result, the inner camera 23 can shoot in the direction in which the inner main surface of the upper housing 21 faces, and the outer camera 25 can rotate in the opposite direction of the shooting direction of the inner camera 23, that is, the outer main It is possible to photograph the direction in which the surface faces. As described above, in the present embodiment, the two inner cameras 23 and the outer cameras 25 are provided so that the shooting directions are opposite to each other. For example, the user can shoot a scene viewed from the game apparatus 1 with the inner camera 23 and shoot a scene viewed from the game apparatus 1 in the direction opposite to the user with the outer camera 25. Can do.

  Note that a microphone (a microphone 42 shown in FIG. 2) is housed as an audio input device on the inner main surface in the vicinity of the connecting portion. A microphone hole 16 is formed on the inner main surface near the connecting portion so that the microphone 42 can detect the sound outside the game apparatus 1. The position where the microphone 42 is accommodated and the position of the microphone hole 16 do not necessarily have to be the connecting portion. For example, the microphone 42 is accommodated in the lower housing 11, and the microphone 42 corresponds to the accommodation position in the lower housing 11. A microphone hole 16 may be provided.

  A fourth LED 26 (shown by a broken line in FIG. 1) is attached to the outer main surface of the upper housing 21. The fourth LED 26 is lit when the outer camera 25 has taken a picture (the shutter button has been pressed). Further, it is lit while a moving image is shot by the outer camera 25. The fourth LED 26 can notify the subject to be photographed and the surroundings that photographing by the game apparatus 1 has been performed (performed).

  In addition, sound release holes 24 are formed in the main surfaces on both the left and right sides of the upper LCD 22 provided near the center of the inner main surface of the upper housing 21. A speaker is housed in the upper housing 21 behind the sound release hole 24. The sound release hole 24 is a hole for releasing sound from the speaker to the outside of the game apparatus 1.

  As described above, the upper housing 21 includes the inner camera 23 and the outer camera 25 that are configured to capture an image, and the upper LCD 22 that is a display unit that displays an operation explanation screen at the time of shooting, for example. Provided. On the other hand, the lower housing 11 is provided with an input device (touch panel 13 and buttons 14A to 14K) for performing an operation input to the game apparatus 1 and a lower LCD 12 which is a display means for displaying a game screen. It is done. Therefore, when using the game apparatus 1, the user grasps the lower housing 11 and performs input to the input device while viewing a captured image (image captured by the camera) displayed on the lower LCD 12. be able to.

  Next, the internal configuration of the game apparatus 1 will be described with reference to FIG. FIG. 2 is a block diagram illustrating an example of the internal configuration of the game apparatus 1.

  2, the game apparatus 1 includes a CPU 31, a main memory 32, a memory control circuit 33, a storage data memory 34, a preset data memory 35, a memory card interface (memory card I / F) 36 and a cartridge I / F 44, wireless Electronic components such as a communication module 37, a local communication module 38, a real-time clock (RTC) 39, a power supply circuit 40, and an interface circuit (I / F circuit) 41 are provided. These electronic components are mounted on an electronic circuit board and housed in the lower housing 11 (or the upper housing 21).

The CPU 31 is information processing means for executing a predetermined program. In the present embodiment, a predetermined program is stored in a memory (for example, the storage data memory 34) or the memory card 28 and / or 29 in the game apparatus 1, and the CPU 31 executes the predetermined program, thereby The graffiti process described later is executed. Note that the program executed by the CPU 31 may be stored in advance in the memory in the game apparatus 1, may be acquired from the memory card 28 and / or the cartridge 29, or may be obtained by communication with other devices. May be obtained from other devices. For example, it may be obtained by downloading from a predetermined server via the Internet, or by downloading a predetermined program stored in the stationary game device by communicating with the stationary game device. You may get at.

  A main memory 32, a memory control circuit 33, and a preset data memory 35 are connected to the CPU 31. In addition, a storage data memory 34 is connected to the memory control circuit 33. The main memory 32 is a storage means used as a work area or buffer area for the CPU 31. That is, the main memory 32 stores various data used for the graffiti process and stores programs acquired from the outside (such as the memory cards 28 and 29 and other devices). In the present embodiment, for example, a PSRAM (Pseudo-SRAM) is used as the main memory 32. The storage data memory 34 is a storage unit for storing a program executed by the CPU 31, data of images taken by the inner camera 23 and the outer camera 25, and the like. The storage data memory 34 is configured by a nonvolatile storage medium, and is configured by, for example, a NAND flash memory in this embodiment. The memory control circuit 33 is a circuit that controls reading and writing of data with respect to the storage data memory 34 in accordance with instructions from the CPU 31. The preset data memory 35 is storage means for storing data (preset data) such as various parameters set in advance in the game apparatus 1. As the preset data memory 35, a flash memory connected to the CPU 31 via an SPI (Serial Peripheral Interface) bus can be used.

  The memory card I / F 36 is connected to the CPU 31. The memory card I / F 36 reads and writes data to and from the memory card 28 attached to the connector according to instructions from the CPU 31. In the present embodiment, image data captured by the outer camera 25 is written to the memory card 28, or image data stored in the memory card 28 is read from the memory card 28 and stored in the storage data memory 34. To do.

  The cartridge I / F 44 is connected to the CPU 31. The cartridge I / F 44 reads and writes data to and from the cartridge 29 attached to the connector according to instructions from the CPU 31. In the present embodiment, an application program that can be executed by the information processing apparatus 10 is read from the cartridge 29 and executed by the CPU 31, or data related to the application program (for example, game save data) is written to the cartridge 29. Or

  The graffiti game program of the present invention may be supplied not only to the computer system through an external storage medium such as the cartridge 29 but also to the computer system through a wired or wireless communication line. The graffiti game program may be recorded in advance in a nonvolatile storage device inside the computer system. The information storage medium for storing the color conversion program is not limited to the nonvolatile storage device, but may be a CD-ROM, a DVD, or an optical disk storage medium similar to them.

The wireless communication module 37 is, for example, IEEE 802.11. It has a function of connecting to a wireless LAN by a method compliant with the b / g standard. The local communication module 38 has a function of performing wireless communication with the same type of game device by a predetermined communication method. The wireless communication module 37 and the local communication module 38 are connected to the CPU 31. The CPU 31 transmits / receives data to / from other devices via the Internet using the wireless communication module 37, and transmits / receives data to / from other game devices of the same type using the local communication module 38. be able to.

  Further, the RTC 39 and the power supply circuit 40 are connected to the CPU 31. The RTC 39 counts the time and outputs it to the CPU 31. For example, the CPU 31 can calculate the current time (date) based on the time counted by the RTC 39. The power supply circuit 40 controls power supplied from a power supply (typically a battery, which is stored in the lower housing 11) of the game apparatus 1, and supplies power to each component of the game apparatus 1.

  In addition, the game apparatus 1 includes a microphone 42 and an amplifier 43. The microphone 42 and the amplifier 43 are each connected to the I / F circuit 41. The microphone 42 detects the voice of the user uttered toward the game apparatus 1 and outputs a voice signal indicating the voice to the I / F circuit 41. The amplifier 43 amplifies the audio signal from the I / F circuit 41 and outputs it from a speaker (not shown). The I / F circuit 41 is connected to the CPU 31.

  The touch panel 13 is connected to the I / F circuit 41. The I / F circuit 41 includes a voice control circuit that controls the microphone 42 and the amplifier 43 (speaker), and a touch panel control circuit that controls the touch panel 13. The voice control circuit performs A / D conversion and D / A conversion on the voice signal, or converts the voice signal into voice data of a predetermined format. The touch panel control circuit generates touch position data in a predetermined format based on a signal from the touch panel 13 and outputs it to the CPU 31. For example, the touch position data is data indicating coordinates of a position where an input is performed on the input surface of the touch panel 13. The touch panel control circuit reads signals from the touch panel 13 and generates touch position data at a rate of once per predetermined time. The CPU 31 can know the position where the input is performed on the touch panel 13 by acquiring the touch position data via the I / F circuit 41.

  The operation button 14 includes the operation buttons 14A to 14K and is connected to the CPU 31. From the operation button 14 to the CPU 31, operation data indicating an input status (whether or not the button is pressed) for each of the operation buttons 14A to 14K is output. The CPU 31 obtains operation data from the operation button 14 to execute processing corresponding to the input to the operation button 14.

  The inner camera 23 and the outer camera 25 are each connected to the CPU 31. The inner camera 23 and the outer camera 25 capture an image in accordance with an instruction from the CPU 31 and output the captured image data to the CPU 31. In the present embodiment, the CPU 31 issues a shooting instruction to one of the inner camera 23 and the outer camera 25, and the camera that has received the shooting instruction takes an image and sends the image data to the CPU 31.

  Further, the lower LCD 12 and the upper LCD 22 are each connected to the CPU 31. The lower LCD 12 and the upper LCD 22 display images according to instructions from the CPU 31, respectively.

Next, an outline of an application assumed in the present embodiment will be described with reference to FIGS. The game assumed in this embodiment is a drawing application in which a player can draw a picture using the touch pen 27. FIG. 3 is an example of a game screen assumed in this embodiment. In FIG. 3, a game screen is displayed on the lower LCD 12. A toolbar 103 is displayed on the upper part of the game screen, and a canvas 101 occupying most of the game screen is displayed on the lower side. On the toolbar, a drawing tool icon 111, a line type icon 112, and the like are displayed. 3 shows a state in which the canvas 101 is touched with the touch pen 27, and the cursor 10 is located at the touched position.
2 is displayed. In this application, the player can draw a picture on the canvas 101 by moving the touch pen 27 on the canvas 101. However, the present invention provides a novel operability as described later for the drawing operation. To do.

  In addition, in this application, it is possible to enjoy graffiti on an image captured by the outer camera 25 of the game apparatus 1 (or an image captured by the inner camera 23). For example, when an image as shown in FIG. 4 is shot by the outer camera 25, the shot image is arranged in a “rough sketch” manner on the area of the canvas 101, and a graffiti is added to the shot image as shown in FIG. It is possible to enjoy it.

  FIG. 6 is a schematic diagram showing an arrangement relationship between the photographed image and the canvas 101. In this application, the concept of two layers of the sketch layer 105 and the handwriting layer 106 is used, and the photographed image corresponds to the sketch layer 105. The canvas 101 corresponds to the handwriting layer 106. The handwriting layer 106 is a so-called transparent sheet, and performs a conceptual process of superimposing a transparent sheet on the photographed image and writing graffiti on the sheet. In other words, in the present embodiment, processing for directly editing (directly graffitiing) the captured image is not performed.

  Next, a drawing operation on the canvas 101 in this application will be described. As described above, this application can draw a picture by moving the touch pen 27 on the canvas 101. Here, in this application, two types of “pen” and “eraser” can be used as the types of drawing tools in the game used for drawing. “Pen” is a tool for drawing something on the canvas, and “Eraser” is a tool for erasing the content drawn on the canvas 101. When using the “pen” or “eraser”, it is possible to select a line of uniform thickness or “spray” as the type of line to be drawn (line type). In this application, regarding the selection of these drawing tools, it is possible to select “pen” or “eraser” by operating the drawing tool icon 111 on the toolbar 103. The line type can be selected by operating the line type icon 112. Specifically, it is possible to select whether to use the uniform thickness line or “spray”. At this time, the line thickness of the uniform thickness can also be specified, and in the line type icon 112, the left three icons among the four icons indicate the respective thicknesses. ing. Of the four icons, the icon displaying the rightmost propeller picture indicates “spray”. When “Pen” is selected as the drawing tool, the drawing color (line or spray color) can be designated.

  Next, an operation when using a “pen” as a drawing tool will be described. When the “pen” is selected and the uniform line is selected as the line type, the uniform line is drawn at the touched position as shown in FIGS. Is something that can be done. Here, a line is drawn at the same time that the pen touches. Specifically, the touch input is detected when the player touches the canvas 101 (touch panel 13) after operating the toolbar to select “pen” and selecting a uniform line as the line type. At the same time, a point (when the touch pen 27 is not moved) or a line segment (when the touch pen 27 is moved on the canvas 101) is drawn at the touch position.

On the other hand, when “Spray” is selected as the line type, “Spray line” as described later can be drawn at the touched position. However, unlike the case of the line with the uniform thickness, it can be drawn only by touching. Is not done. Hereinafter, a drawing operation when “spray” is selected as the line type will be described with reference to FIGS. First, the player operates the toolbar 103 to select “pen” as a drawing tool. Specifically, every time the player touches the drawing tool icon 111, the drawing tool is switched from “pen” → “eraser” → “pen” (the image content of the drawing tool icon 111 is also Switch between the nib image and the eraser image). After selecting “Pen”, the player can select “Spray” as the line type by touching the rightmost propeller image icon from the four icons of the line type icon 112. Thereafter, when the player touches a desired position on the canvas 101, as shown in FIG. 7, a cursor 102 of an image imitating a propeller is displayed at the touch position. However, at this point, nothing is drawn on the canvas 101 (in the case of the “pen”, at least the “point” is drawn at the touch position at this point). Therefore, even if the touch pen 27 is moved while touching the canvas 101 in this state, nothing is drawn on the canvas 101.

  In this state, in order to draw on the canvas 101, the player performs an action of blowing toward the cursor 102 as shown in FIG. Then, the cursor 102 is displayed as an animation in which the propeller rotates, and an image (an image in which a large number of points are gathered) as shown in FIG. 9 is displayed at the touch position. Then, by moving the touch pen 27 while breathing on the cursor 102, as shown in FIG. 10, as shown in FIG. It is drawn on the movement trajectory. As described above, in the case of “spray”, it is possible to perform drawing in such a manner that an operation of blowing the propeller-type cursor 102 and blowing ink onto the canvas 101 is performed.

  Furthermore, in this application, the thickness and the density of the spray line change according to the strength of the player's breath. For example, when the strength of blowing is weak, it is possible to draw a thin and thin (small number of dots) spray line as shown in FIG. When a strong breath is blown, a thick and dark spray line (having many dots) can be drawn as shown in FIG. In addition, the strength of blowing is reflected on the spray line in real time. For example, when drawing a single spray line, blow hard at the beginning of drawing, and then gradually reduce the strength of blowing, and the spray line that is drawn will also be drawn at the beginning of FIG. A spray line is drawn in which the number of points increases and the number of points gradually decreases as the drawing progresses. Moreover, in this application, when such a spray line is drawn, the sound which sprays a spray is also reproduced as a sound effect.

  Here, an outline (principle) of the spray line drawing process in the present embodiment will be described. As shown in FIG. 8, when the player blows toward the cursor 102 (touch panel 13) while touching the canvas 101 with the touch pen 27, the blowing sound is input to the microphone 42. In this application, the volume of sound input to the microphone 42 (hereinafter referred to as microphone input sound) is detected, the thickness of the spray line is determined according to the detected volume, and the canvas. 101 is drawn. That is, in the present embodiment, when “spray” is used, when the two types of inputs “touch input” to the touch panel 13 and “voice input” to the microphone 42 are prepared, the above-mentioned spray line drawing process is performed. Execute. Further, the sound volume at the time of drawing the spray line is also changed in reproduction volume according to the detected microphone input sound level.

Next, the “eraser” among the drawing tools will be described. A case will be described in which a drawing tool eraser is selected by operating the toolbar 103 and a line having a uniform thickness is selected as the “line type”. In this case, when the player touches an arbitrary position on the canvas 101, an eraser-type cursor 102 is displayed. The operation at this time can erase lines (uniform lines and spray lines) drawn at the touched position in accordance with the case where a line having a uniform thickness is selected with the “pen”. Next, a case where “spray” is selected as the “line type” will be described. In this case, when the player touches an arbitrary position on the canvas 101, the propeller-type cursor 102 is displayed as in the case where “spray” is used as the line type with the “pen”. If the player blows toward the cursor 102, a spray line or a uniform line within a predetermined range depends on the strength of the breath (that is, the magnitude of the microphone input sound) and the touch position. The thickness line can be erased.

  As described above, in the present embodiment, a process of drawing on the canvas 101 is performed only after performing an operation (speech input to the microphone 42) of blowing in addition to the touch input, such as the “spray”. . As a result, it is possible to provide a drawing application having a new operability that has not existed before.

  Next, details of application processing executed by the game apparatus 1 will be described. First, data stored in the main memory 32 during application processing will be described. FIG. 13 is an illustrative view showing a memory map of the main memory 32 shown in FIG. In FIG. 13, the main memory 32 includes a program storage area 321 and a data storage area 325. The data stored in the program storage area 321 and the data stored in the data storage area 325 are stored in advance in the ROM of the cartridge 29 and copied to the main memory 32. These programs and data are not limited to the cartridge 29, but are stored in the storage data memory 37 in place of the cartridge 29, for example, and when the program is executed, the storage data memory 37 stores the main memory 32. You may make it copy. In the present embodiment, as the touch position data 3262, the latest input coordinate and the previous input coordinate can be stored. The game apparatus 1 repeatedly detects input to the touch panel 13 every unit time. When an input is detected, the data stored as the latest input coordinates until then is stored as the previous input coordinates. When the player is touching the touch panel 13, data indicating the coordinates of the touch position is stored in the touch position data 3262 as the latest input coordinates. When the player has not touched the touch panel 13, the latest input coordinates are NULL and stored in the touch position data 3262.

  The program storage area 321 stores a program executed by the CPU 31, and this program includes a main processing program 322, a camera processing program 323, a graffiti processing program 324, and the like.

  The main processing program 322 is a program corresponding to the processing of the flowchart of FIG. The camera processing program 323 is a program for causing the CPU 31 to execute a process for obtaining a photographed image by the outer camera 25, and the graffiti processing program 324 is a process for scribbling a photographed image as shown in FIG. Is a program for causing the CPU 31 to execute.

  The data storage area 325 stores operation data 326, drawing tool master 327, drawing color data 328, photographed image data 329, current tool data 330, sound effect data 331, spray table 332, sound characteristic data 333, and the like. The

  The operation data 326 is data indicating the operation content of the game apparatus 1 performed by the player, and includes operation button data 3261 and touch position data 3262. The operation button data 3261 is data indicating an input state for each of the operation buttons 14A to 14K. The touch position data 3262 is data indicating the coordinates (input coordinates) of the touch position input to the touch panel 13. In this embodiment, while the player touches the touch panel 13, repeated input coordinates are acquired and stored as touch position data 3262. In the present embodiment, as the touch position data 3262, the latest input coordinates and the previous input coordinates can be stored.

  The drawing tool master 327 is a table related to the drawing tool as described above. FIG. 14 is a diagram showing an example of the table structure of the drawing tool master 327. The drawing tool master 327 has a type 3271, a line type 3272, and cursor image data 3273. FIG. 14 shows an example of the data structure of the drawing tool master 327. The drawing tool master 327 shown in FIG. 14 has a structure having a type 3271, a line type 3272, and cursor image data 3273. The type 3271 is data indicating a drawing tool, and is “pen” and “eraser” in the present embodiment. The line type 3272 is data indicating the line type. In the present embodiment, the line type 3272 is a line having a uniform thickness (hereinafter referred to as a uniform line) and the “spray”. The cursor image data is image data to be displayed as the cursor 102. In this embodiment, when the type 3271 is “pen” and the line type 3272 is “uniform line”, image data indicating the image of the pen tip is stored. When the type 3271 is “pen” and the line type 3272 is “spray”, the image data of the propeller as described above is stored. When the type 3271 is “eraser” and the line type 3272 is “uniform line”, the image data of the eraser is stored, and when the line type 3272 is “spray”, the image of the propeller is stored. .

  The drawing color data 328 is data indicating the color of a line or the like drawn on the canvas 101 when the type of the drawing tool is “pen”. The captured image data 329 is data indicating an image captured by the external camera 25. The current tool data 330 is data for indicating the type (pen or eraser) and line type (uniform line or spot play) of the currently selected drawing tool. The sound effect data 331 is sound effect data reproduced at the time of drawing.

  The spray table 332 is a table that defines the size of the area to be drawn and the number of points to be drawn in association with the volume of the microphone input sound described above. FIG. 15 is a diagram illustrating an example of a data configuration of the spray table 332. The spray table shown in FIG. 15 has a structure having a volume 3321, a region size 3322, and a number of points 3323. The volume 3321 indicates the range of the volume level of the microphone input sound. In this embodiment, the volume level is represented by a value from 0 to 100. The area size 3322 indicates a drawing area of a spray line drawn by one drawing process. In the present embodiment, it is assumed that the shape of the drawing area is circular, and a value indicating the radius of the drawing area is defined as the value of the area size 3322. The number of points 3323 defines the number of points to be drawn in the drawing area. In the example of FIG. 15, for example, when the volume 3321 is “11 to 30”, the number of points indicated by the number of points 3323 is drawn in the circular area 201 having the size as shown in FIG. Is done. If the volume 3321 is “31 to 50”, a larger number of points are drawn in a larger circular area 201 as shown in FIG. 16B (in FIG. 16). The dotted line indicating the circular area 201 is shown for convenience only and is not displayed on the screen).

  Returning to FIG. 13, the sound characteristic data 333 is data indicating characteristics of the sound input to the microphone 42, specifically, volume, frequency, tone color, and the like. In the present embodiment, data indicating the volume of the microphone input sound is stored.

  In addition, the data storage area 325 also stores various flags such as a reproduction flag used to indicate whether or not sound effects are being reproduced in processing described later, various image data, and the like.

Next, the flow of application processing (hereinafter referred to as graffiti game processing) executed in the game apparatus 1 will be described with reference to FIGS. FIG. 17 is a flowchart showing the flow of the graffiti game process executed in the game apparatus 1. When the power of the game apparatus 1 is turned on, the CPU 31 of the game apparatus 1 executes a startup program stored in a boot ROM (not shown), and each unit such as the main memory 32 is initialized. Then, the game program stored in the cartridge 29 is read into the main memory 32, and execution of the application program is started. As a result, the game image is displayed on the lower LCD 12 to start the application.

  In FIG. 17, first, the CPU 31 displays an inquiry screen as to whether or not to execute camera processing (step S1). That is, in this process, it is also possible to execute a graffiti process, which will be described later, without performing imaging by the camera. That is, it is also possible to perform the drawing process on the plain canvas 101 as shown in FIG. 3 without using the sketch as shown in FIG.

  Next, the CPU 31 acquires operation data 326 from the main memory 32 (step S2). Next, it is determined whether or not the content indicated by the operation data is an instruction to execute camera processing (step S3). As a result, when it is not an instruction to execute camera processing (NO in step S3), the CPU 31 proceeds to processing in step S5 described later. On the other hand, when an instruction to execute camera processing is given (YES in step S3), the CPU 31 executes camera processing (step S4). In this process, the outer camera 25 performs a process for capturing and storing the above-described background image. Next, the CPU 31 executes graffiti processing (step S5). In this process, a screen as shown in FIG. 5 is displayed, and a process for enabling graffiti on an image captured by the camera is executed.

  FIG. 18 is a flowchart showing details of the camera process shown in step S4. In FIG. 18, first, the CPU 31 performs an initialization process (step S11). In this process, various shooting parameters (such as shooting magnification and exposure time) defined in advance as initial values are set.

  Next, the CPU 31 displays an image captured by the outer camera 25 on the lower LCD 12 (step 12).

  Next, the CPU 31 acquires operation data 326 from the main memory 32 (step S13). Subsequently, the CPU 31 determines whether or not the operation content of the player indicated by the operation data 326 is a press of the shutter button (step S14). If the result of this determination is that the shutter has been pressed (YES in step S14), the CPU 31 performs processing for recording an image taken by the outer camera 25. That is, an image photographed by the outer camera 25 is stored in the main memory 32 as photographed image data 329 (step S15). Thereafter, the process returns to step S12 to repeat the process.

  On the other hand, if the result of determination in step S <b> 14 is that the shutter has not been pressed (NO in step S <b> 14), then the CPU 31 determines whether the operation content indicated by the operation data 326 is an operation for instructing the end of camera processing. It is determined whether or not (step S16). As a result, when an instruction to end camera processing is given (YES in step S16), the CPU 31 ends the camera processing. On the other hand, when it is not an instruction to end the camera process (NO in step S16), the CPU 31 executes another process based on the operation data 326 (step S17). For example, zoom magnification control, exposure control setting, and the like are executed. Then, it returns to said step S12 and repeats a process. This is the end of the description of the camera process.

Next, the graffiti process shown in step S2 will be described. FIG. 19 is a flowchart showing details of the graffiti process shown in step S2. In FIG. 19, first, the CPU 31 executes an initial process related to the graffiti process (step S21). Specifically, a game screen as shown in FIG. 3 and the like is generated and displayed. In addition, the CPU 31 reads the captured image data 329 from the main memory 32 and displays the captured image captured by the camera process as a “background image” on the canvas 101. At this time, if the camera process has not been performed, nothing is stored in the captured image data 329, and in this case, the CPU 31 displays nothing on the canvas 101. That is, the blank canvas 101 is displayed as it is. Further, the CPU 31 sets data indicating that the drawing tool is “pen” and the line type is “uniform line” in the current tool data 330 as an initial value. That is, when the graffiti process is started, the “pen” whose line type is “uniform line” is selected as the drawing tool.

  When the initial process is completed, the CPU 31 then acquires operation data 326 from the main memory 32 (step S22). Subsequently, the CPU 31 determines whether or not the operation content indicated by the operation data 326 is an instruction to end the graffiti process (step S23). As a result of the determination, when the instruction to end the graffiti process is given (YES in step S23), the CPU 31 ends the graffiti process.

  On the other hand, if it is not an instruction to end the graffiti process (NO in step S23), the CPU 31 next determines whether or not the operation content is an operation for selecting the type of drawing tool (step S24). If the result is a drawing tool selection operation (YES in step S24), a drawing tool selection process is executed based on the contents of the operation data 326 (step S25). Here, an example of the selection operation will be described. First, the player touches the drawing tool icon 111 on the screen as shown in FIG. Each time this operation is detected, the CPU 31 alternately sets “pen” and “eraser” as drawing tools in the current tool data 330. That is, every time the player touches the drawing tool icon 111, the drawing tool is switched between “pen” and “eraser”. Further, the player touches one of the four icons of the line type icon 112. The touched icon (more precisely, its display coordinates) is detected, and a line type corresponding to the content of the icon is set in the current tool data 330. When the rightmost icon of the four icons is touched, “spray” is set in the current tool data 330 as the line type. When another icon is touched, “uniform line” is set as the line type, and data indicating the thickness of the line is also set in the current tool data 330 according to the touched icon. In the example of FIG. 3, it is possible to select the thickness of three types of lines. The rightmost icon is the thinnest uniform line thickness, and the third icon from the left is the thickest uniform. Become a line. As described above, after executing the process of setting the data indicating the drawing tool in the current tool data 330 based on the operation data, the CPU 31 returns to step S22 and repeats the process.

  On the other hand, if the result of determination in step S24 is that the operation content is not a drawing tool selection operation (NO in step S24), the CPU 31 then refers to the operation data 326 and makes a touch input (more accurately) In step S26, it is determined whether or not a touch input to the area of the touch panel 13 corresponding to the display area of the canvas 101 has been performed. Specifically, the CPU 31 refers to the latest input coordinates stored in the touch position data 3262 and determines whether or not the input coordinates are coordinates corresponding to the display area of the canvas 101. As a result, when the touch input is performed on the canvas 101 (YES in step S26), the CPU 31 executes a process of displaying the cursor 102 at the position where the touch input is performed (step S27). More specifically, the CPU 31 first refers to the drawing tool master 327 and obtains cursor image data 3272 corresponding to the currently selected drawing tool. Then, the touch position data 3262 is referred to, and an image based on the cursor image data 3272 is displayed as the cursor 102 at the position where the touch is input.

After the display of the cursor 102, the CPU 31 determines whether or not the drawing tool currently selected, that is, the drawing tool indicated by the current tool data 330 is “pen” (step S2).
8). As a result, when it is “pen”, the CPU 31 executes pen processing (step S29). FIG. 20 is a flowchart showing details of the pen processing. 20, first, the CPU 31 determines whether or not the line type indicated by the current tool data 330 is “spray” (step S41). As a result, when it is not “spray” (NO in step S41), the CPU 31 executes a pen drawing process (step S42). That is, based on the touch position, a process of drawing a uniform line with the currently selected line thickness is executed. Thereafter, the CPU 31 ends the pen process.

  On the other hand, if the result of determination in step S41 is that the line type is “spray” (YES in step S41), the CPU 31 performs spray drawing for drawing the spray line as described above with reference to FIG. The process is executed (step S43), and then the pen process is terminated.

  FIG. 21 is a flowchart showing details of the spray drawing process shown in step S43. In FIG. 21, first, the CPU 31 detects the volume of the sound (microphone input sound) input to the microphone 42 and stores it as the audio characteristic data 333 (step S51).

  Next, the CPU 31 determines whether or not the volume indicated by the audio characteristic data 333 is equal to or greater than a predetermined threshold value (step S52). As a result of the determination, when the volume of the microphone input sound is equal to or higher than the predetermined threshold (YES in step S52), the CPU 31 refers to the spray table 332 and displays the spray line drawing area according to the volume. And the number of points to be drawn are determined (step S53).

  Next, the CPU 31 determines the reproduction volume of the sound effect reproduced at the time of spray line drawing in accordance with the volume level indicated by the audio characteristic data 333 (step S54).

  Next, the CPU 31 sets the reproduction speed of the animation display of the cursor 102 according to the volume level indicated by the audio characteristic data 333 (step S55). As described above, in the present embodiment, when the spray line is drawn, an animation of rotating the propeller is displayed for the propeller-type cursor 102. A process of setting the rotation speed of the propeller according to the volume of the microphone input sound is executed. For example, the animation playback speed is set so that the propeller rotates faster as the volume of the microphone input sound increases. For example, in the case where the rotation animation of the propeller is composed of 3 frames, when the volume of the microphone input sound is high, the setting is made such that the frame is rewritten every frame, and the volume of the microphone input sound is not high. In some cases, it is conceivable to perform a setting to rewrite a frame every 10 frames.

  Next, the CPU 31 arranges the drawing area so that the touch position is at the center, and draws the points constituting the spray line on the canvas 101 (within the drawing area) according to the determination in step S53 (step S56). . Here, the arrangement of each point constituting the spray line may be arranged randomly in the drawing area, or the touch position has the highest density of points with the touch position as the center, and is away from the touch position. You may draw so that the density of points gradually decreases.

  Next, the CPU 31 performs animation display of the cursor 102 (animation in which the propeller rotates) according to the animation reproduction speed set in step S55 (step S57).

Next, the CPU 31 determines whether or not the setting of the reproduction flag is off (step S58). The reproduction flag is a flag for indicating whether or not the sound effect is being reproduced, and is set to off when the sound effect is not being reproduced. If the result of this determination is that the regeneration flag is off (YES in step S58), the CPU 31 sets the regeneration flag to on (step S59). Then, the CPU 31 refers to the sound effect data 331 and starts to reproduce the sound effect (spray spray sound) at the time of spray line drawing at the volume set in step S54 (step S60). Thereafter, the CPU 31 ends the spray process.

  On the other hand, as a result of the determination in step S58, when it is determined that the reproduction flag is not OFF (NO in step S58), it is considered that the sound effect is being reproduced. Therefore, steps S59 and S60 are performed. The spray process is terminated without executing the process.

  Next, processing when the sound volume indicated by the sound characteristic data 333 is less than a predetermined threshold as a result of the determination in step S52 (NO in step S52) will be described. At this time, the CPU 31 next determines whether or not the reproduction flag is set to ON (step S61). As a result, when the reproduction flag is on (YES in step S61), the CPU 31 stops the reproduction of the sound effect that has been reproduced in step S60. Then, the CPU 31 sets the reproduction flag to OFF (step S63).

  On the other hand, if the result of determination in step S61 is that the regeneration flag is not on (NO in step S61), the CPU 31 ends the spray drawing process without executing the processes in steps S62 and S63. This is the end of the description of the spray drawing process.

  Returning to FIG. 19, if the result of the determination in step S <b> 28 is that the current tool data 330 is not “pen” (NO in step S <b> 28), then the CPU 31 determines that the drawing tool indicated by the current tool data 330 is “eraser”. Is determined (step S30). As a result of the determination, if it is not “eraser” (NO in step S30), the CPU 31 returns to step S22 and repeats the process.

  On the other hand, if the result of the determination in step S30 is that the current tool data 330 is “eraser” (YES in step S30), the CPU 31 executes an eraser process (step S31). In this process, when a microphone input sound having a volume equal to or higher than a predetermined value is input, a process of deleting a spray line or the like drawn at the touch position is executed. FIG. 22 is a flowchart showing details of the eraser process. In FIG. 22, first, the CPU 31 determines whether or not the line type indicated by the current tool data 330 is “spray” (step S <b> 71). As a result, when it is not “spray” (NO in step S71), the CPU 31 executes a pen eraser process (step S42). That is, based on the touch position, a process of erasing the uniform line or the spray line with the currently selected line thickness is executed. Thereafter, the CPU 31 ends the eraser process.

  On the other hand, if the result of determination in step S71 is that the line type is “spray”, the CPU 31 executes a spray eraser process (step S73). FIG. 23 is a flowchart showing details of the spray eraser process shown in step S73. In FIG. 23, the processing from step S51 to step S52 and the processing from step S57 to step S63 are the same as the processing of each step described above with reference to FIG. The other processing will be mainly described.

In FIG. 23, in step S52, it is determined whether or not the volume of the microphone input sound is equal to or higher than a predetermined threshold value. If the result is equal to or higher than the predetermined threshold value (YES in step S52), the CPU 31 increases the volume level. Accordingly, the size of the area to be erased (hereinafter referred to as the erase area) is determined (step S81). The method for determining the size of the erase area is the same as that for determining the spray line drawing area. That is, referring to the spray table 332, an area size 3322 corresponding to the volume level is acquired. Based on this size, the size of the erase area is determined. It is assumed that the erase area has a circular shape as in the drawing area.

  Next, the CPU 31 determines the reproduction volume of the sound effect when erasing the spray line or the like according to the volume level (step S82).

  Next, the CPU 31 sets the playback speed of the cursor animation at the time of erasure (step S83). That is, similarly to step S55, the rotation speed of the propeller is set according to the volume of the microphone input sound.

  Next, the CPU 31 arranges the erasing area at a position where the touch position is the center, and erases the spray lines and the like in the erasing area (step S84).

  Thereafter, the CPU 31 displays a cursor animation (step S57), and proceeds to determine whether or not the reproduction flag is off (step S58). Since the subsequent processing is the same as the processing of each step described above with reference to FIG. 21, detailed description thereof is omitted. This is the end of the description of the spray eraser process.

  Returning to FIG. 19, the process when there is no touch input as a result of the determination in step S26 (NO in step S26) will be described. At this time, next, the CPU 31 determines whether or not the touch-off is performed based on the operation data 326 (step S33). That is, it is determined whether the state in which the touch input has been continued (the state in which the touch has been kept) has been interrupted or the state in which the touch has not been touched has been continued. As a result of the determination, when the touch-off is made (YES in step S33), the CPU 31 deletes the cursor 102 (step S34). Then, it returns to said step S22 and repeats a process. On the other hand, when it is not touch-off (NO in step S33), the process returns to step S22 as it is and the process is repeated. This is the end of the description of the graffiti process. Specifically, as the touch position data 3262, when the latest input coordinate is NULL and the previous input coordinate is data indicating the coordinate of the touch position, it is determined as touch-off, and the latest input coordinate. Is NULL, and the previous input coordinate is also NULL, it is determined that the state of not being touched continues.

  As described above, in this embodiment, when the player performs drawing using “spray”, when there are two types of input, that is, touch input to the canvas 101 and voice input to the microphone 42, the canvas 101 is displayed. It is possible to draw. Thereby, it is possible to provide a new game having a new feeling of operation that has not existed before.

  In the present embodiment, the spray line is drawn while the touch input and the voice input to the microphone 42 are continuously performed (the breath is continuously blown). Therefore, the thickness of the spray line can be changed in real time by changing the strength of blowing. As a result, it is possible to provide a new way of enjoying that the thickness of the spray line (corresponding to so-called writing pressure) can be changed depending on how the player blows, that is, the drawn content can be changed. It becomes.

In addition, in the above-described eraser process, the process of erasing the spray line at the touched position was performed, but in addition to this, each point constituting the spray line around the touched position is used for blowing the breath on the touch panel. In response to this, processing that blows away (hereinafter referred to as blow-off processing) may be executed. Hereinafter, an outline of the blow-off process will be described. For example, it is assumed that the positional relationship between the touch position and the point is as shown in FIG. In FIG. 24, a state where there are five points 211a to 211e above the touch position 210 is taken as an example. In this state, when the player blows toward the touch position 210 (ie, voice input to the microphone 42 is performed), first, as shown in FIG. 25, the touch position 210 and the points 211a to 211e Straight lines 212a to 212e are calculated. Then, as shown in FIG. 26, a process of moving each point 211 is executed according to the length and direction of each straight line 212. In the example of FIG. 26, each point 211 is moved outward from the touch position 210 in the direction along each straight line 212. The movement distance is moved so as to be inversely proportional to the length of each straight line. That is, a point closer to the touch position 210 has a longer moving distance, and a point far from the touch position 210 has a shorter moving distance. That is, processing is performed such that the closer to the position where the breath is blown (in this case, the touch position 210), the stronger the breath is blown, and the longer the blow is done.

  Next, the details of the blowing process will be described with reference to FIG. FIG. 27 is a flowchart showing details of the blow-off process. This process will be described by taking as an example a case where the process is executed instead of the spray eraser process in step S73 in the flowchart of the graffiti process described with reference to FIG. Of course, instead of the spray eraser process, the spray eraser process may be used in combination.

  In FIG. 27, first, the CPU 31 performs volume detection (step S51), and determines whether or not the detected volume is equal to or higher than a predetermined threshold (step S52). Since these processes are the same as the processes of steps S51 to S52 in FIG. 23, detailed description thereof is omitted.

  If the result of determination in step S52 is that the volume is not greater than or equal to a predetermined threshold (NO in step S52), the CPU 31 proceeds to the process of step S61. The processing at this time is also the same as the processing after step S61 in FIG.

  On the other hand, if the result of determination in step S52 is that the volume is determined to be greater than or equal to a predetermined threshold (YES in step S52), the CPU 31 determines the area to be blown out (hereinafter referred to as “blow off”) according to the volume level. The size of the area is called (step S81). The size of the area is determined by referring to the spray table 332 and acquiring the area size 3322 according to the volume level, as in step S53.

  Next, the CPU 31 calculates a straight line (see FIG. 25) connecting each point constituting the spray line existing in the blow-off area and the touch position (step S83).

  Next, the CPU 31 moves each point in the blowing area according to the calculated direction and length of each straight line (see FIG. 26). At this time, if a position that overlaps with another point as a result of moving a certain point is drawn such that the point that is closer to the touch position before the movement overlaps.

  If each point is moved by the process as described above, then the CPU 31 proceeds to the process of step S58. The processing after step S58 is the same as the processing described above with reference to FIG.

  As described above, when the player blows on the touched position, the point is moved as if the sand is blown off, thereby providing the player with a new way of enjoying.

Further, in the above-described embodiment, the sound when the player blows on the touch panel 13 is detected and processing is performed based on the sound volume. However, any sound may be used at this time (for example, It could have been a clapping sound.) That is, although the type and content of the sound have not been identified, the present invention is not limited to this, and a “breathing” sound may be identified. Any method for detecting and identifying the “sound that blows” may be used. For example, the waveform pattern of the speech unit for the sound that blows (breath speech) is stored in advance and stored. A method of determining whether or not the player has blown a breath by comparing the previously generated speech unit and the speech unit of the input speech can be considered. In addition, the spectrum of the input voice is calculated by fast Fourier transform processing (FFT), and the calculated spectrum is compared with the spectrum of the breath voice stored in advance, and whether the player blows. You may use the method of judging whether.

  In addition, the characteristics of the input sound such as timbre, frequency, etc. are calculated or identified, and the content of the drawing process is determined according to the characteristics of the sound, not limited to the volume and the type and content of the specific sound as described above. It may be changed.

  Regarding the reproduction of the sound effect, reproduction using the fade-in / fade-out effect may be executed at the start and end of the reproduction of the sound effect. As a result, it is possible to suppress the occurrence of noise at the start of reproduction (for example, noise of a “sound” sound).

  As for the drawing color used for drawing, only one color may be used, or a plurality of colors may be used simultaneously. As an example of using a plurality of colors at the same time, for example, when a “pen” is used as a drawing tool, a border line (a different color is used for the edge color and the middle color) is applicable. In the case of “spray”, a different color point may be used for each point constituting the spray line. For example, when “gray” and “black” are designated as the drawing colors, a spray line composed of both a gray point and a black point may be drawn (see FIG. 28).

  In addition, when a plurality of drawing colors are used and the above-described blow-off process is executed, if dots of different colors overlap as a result of the movement of the points, these colors are displayed as one mixed color point. Also good. As a result, when a spray line is drawn using a large number of drawing colors, the player can display a spray line that is unpredictable by the player with various colors mixed by the blow-off process. Can be provided to the player.

  In the above-mentioned spray eraser process, a translucent effect may be used when erasing spray lines or the like. That is, instead of erasing the spray line or the like as soon as the air is blown, a process may be executed in which the spray line or the like is gradually thinned and finally erased cleanly.

  In addition to the “spray line” composed of a large number of points as described above, the above-described drawing process using the “uniform line” may be executed only when there is a microphone input sound. good. Further, in this case, the writing pressure may be changed depending on the magnitude of the microphone input sound. For example, when the volume of the microphone input sound is low (when the intensity of breathing is weak), it becomes a “shaded line” or “light line”, and when the volume of the microphone input sound is large (the intensity of blowing) When the image is strong), a “clear line” or a “dark line” may be drawn. In addition, the drawing of the “uniform line” by the “pen” itself is executed even when there is no microphone input sound. However, when the “pen” is used to draw the “uniform line”, the drawing on the touch panel 13 is performed. The thickness of the line may be changed in real time by blowing.

Regarding the drawing in the spray process, touch input is continuously detected, but immediately when the volume of the microphone input sound falls below a predetermined threshold (that is, when you stop blowing) For example, the spray line drawing may be continued for about 1 to 2 seconds without stopping the drawing of the spray line. That is, even if the player stops breathing, the propeller may continue to rotate for a while and a spray line may be drawn during that time.

  Needless to say, the image after graffiti created in the above embodiment may be stored. In this case, only the data corresponding to the handwriting layer 106 (see FIG. 6) described above may be stored, or the data of the handwriting layer 106 may be combined with the photographed image and stored as a composite image. good.

  In the above-described embodiment, the case where an image photographed by the outer camera 25 is doodled is taken as an example. However, the present invention is not limited to this, and the external camera 25 is not used, that is, the photographed image or the like is not doodled. The present invention may be applied to general paint software.

  In this embodiment, the portable game device including two display devices has been described as an example. However, a portable terminal including a single display device and a touch panel on the screen of the display device may be used. . In the present embodiment, the touch panel is taken as an example of a device for detecting the player's designated position with respect to the operation area. However, a so-called pointing device that allows the player to designate a position in the predetermined area may be used. By a device equipped with a mouse that can indicate an arbitrary position, a tablet that indicates an arbitrary position on the operation surface that does not have a display screen, and a shooting means for shooting a display screen or markers placed around the display screen from a remote location A pointing device that calculates coordinates on the display screen corresponding to the indicated position on the display screen from the position of the display screen or marker in the captured image obtained by pointing the display screen direction may be used.

  The drawing processing program and the information processing apparatus according to the present invention can make a player enjoy drawing with a novel operability, and are useful for a game apparatus or the like.

1 ... Game device 11 ... Lower housing 12 ... Lower LCD
13 ... Touch panel 14 ... Operation buttons 15, 26 ... LED
16 ... Microphone hole 21 ... Upper housing 22 ... Upper LCD
23 ... Inner camera 24 ... Sound release hole 25 ... Outer camera 27 ... Touch pens 28, 29 ... Memory card 31 ... CPU
32 ... Main memory 33 ... Memory control circuit 34 ... Storage data memory 35 ... Preset data memory 36 ... Memory card I / F
37 ... Wireless communication module 38 ... Local communication module 39 ... RTC
40 ... Power supply circuit 41 ... I / F circuit 42 ... Microphone 43 ... Amplifier 44 ... Cartridge I / F

Claims (21)

A drawing processing program for causing a computer of an information processing apparatus that can use a pointing device and voice input means for indicating a position on a display screen to execute the processing,
The computer,
An indicated position detecting means for continuously obtaining an indicated position on the display screen based on an instruction by the pointing device;
Voice detecting means for detecting that voice satisfying a predetermined condition is input to the voice input means;
While the presence of the voice input is detected by the voice detection unit, the drawing is caused to function as a drawing-related process execution unit that executes a predetermined drawing-related process at a position based on the designated position acquired by the designated position detection unit. Processing program.   The drawing processing program according to claim 1, wherein the drawing-related process execution unit changes the content of the drawing-related process to be executed based on the sound detected by the sound detection unit according to the characteristics of the sound. .   The drawing-related process execution means sequentially changes the contents of the drawing-related process to be executed in conjunction with a time-series change in the sound characteristics repeatedly detected by the sound detection means. The drawing processing program described.   The drawing processing program according to claim 2, wherein the drawing-related processing execution unit executes the predetermined drawing-related processing only when the volume of the input voice is equal to or higher than a predetermined threshold.   The drawing-related process execution unit executes the process of drawing a line connecting positions based on the designated position continuously acquired by the input coordinate detection unit in time series as the drawing-related process. Drawing processing program.   The drawing processing program according to claim 5, wherein the voice analysis unit changes at least one of a thickness of the line and a density of a drawing color of the line according to a volume of the input voice. .   3. The drawing according to claim 2, wherein the drawing-related process execution unit executes a process of drawing one or more points in a drawing range that is a predetermined range including a position based on the designated position as the drawing-related process. Processing program.   8. The voice analysis unit according to claim 7, wherein at least one of a size of the drawing range and a number of points to be drawn in the drawing range is changed according to a volume of the input voice. Drawing processing program.   The drawing-related processing execution means draws a point so that the surface density of the plurality of points is higher as the position is closer to the position based on the designated position, and as the distance from the position based on the designated position increases, The drawing processing program according to claim 8, wherein the points are drawn so that the surface density of the number is low.   The drawing processing program according to claim 8, wherein the drawing-related process execution unit draws a plurality of points at random positions within the drawing range. The drawing-related process execution means performs a process of moving a point drawn on the display screen in a predetermined direction based on a position based on the designated position and a voice input detected by the voice detection means. The drawing processing program according to claim 7, which is executed as related processing. The drawing related process execution means includes:
Using the position based on the indicated position as a reference point, calculate the direction of the line connecting the reference point and the point displayed on the display screen, and the distance from the reference point to the point displayed on the display screen Including movement content calculation means for
The drawing processing program according to claim 11, wherein a point displayed on the screen is moved based on the direction and distance calculated by the movement content calculation unit.   The drawing processing program further functions as a sound effect reproducing unit that causes a predetermined sound output unit to output a predetermined sound effect when the drawing related process execution unit is executing the predetermined drawing related process. The drawing processing program according to claim 1.   The drawing processing program according to claim 13, wherein the sound effect reproduction unit changes a reproduction volume of the sound effect according to a characteristic of the sound detected by the sound detection unit. The drawing processing program causes the computer to
Cursor display means for displaying a predetermined cursor image at the indicated position;
The drawing processing program according to claim 1, further causing the cursor to animate the cursor when the drawing related process executing means is executing the predetermined drawing related process.   The drawing processing program according to claim 15, wherein the animation display unit changes the speed of the animation according to a characteristic of the sound detected by the sound detection unit.   The drawing processing program according to claim 1, wherein the pointing device is a touch panel. The drawing processing program causes the computer to
Captured image acquisition means for acquiring image data captured by a predetermined imaging means;
Further functioning as a captured image display means for displaying a captured image based on the image data on the display screen,
The drawing processing program according to claim 1, wherein the drawing related process execution unit executes a drawing related process on the captured image. The drawing processing program causes the computer to further function as specific sound determination means for determining whether or not the sound detected by the sound detection means is a predetermined sound,
The drawing-related process execution unit executes the drawing-related process only when it is determined by the specific sound determination unit that the sound detected by the sound detection unit is a predetermined sound. Drawing processing program. An information processing apparatus capable of using a pointing device and voice input means for indicating a position on a display screen,
An indicated position detecting means for continuously obtaining an indicated position on the display screen based on an instruction by the pointing device;
Voice detecting means for detecting that voice satisfying a predetermined condition is input to the voice input means;
An information processing apparatus comprising: a drawing-related process execution unit that executes a predetermined drawing-related process at a position based on the designated position while the voice detection unit detects that the voice input is present.   The information processing apparatus according to claim 20, wherein the voice detection unit is disposed in the vicinity of the display screen.

Images