JP5570633B2 - Image processing program, image processing apparatus, and image processing method - Google Patents

Description

  The present invention relates to an image processing program and an image processing apparatus capable of display control according to coordinate values input by a user operation.

  2. Description of the Related Art Conventionally, an image processing technique is known in which an object displayed on a screen is changed (moved, rotated, reduced, enlarged, etc.) in accordance with a user operation via a touch panel or the like.

  For example, Japanese Patent Laying-Open No. 2005-277891 (Patent Document 1) discloses a photo sticker vending machine that uses a touch pen with a rotation function to change the rotation attribute of a stamp image already displayed on the screen. Japanese Patent Application Laid-Open No. 10-188014 (Patent Document 2) and Japanese Patent Application Laid-Open No. 2003-323241 (Patent Document 3) disclose that an image object already displayed on the screen is dragged at a predetermined location. A technique for rotating and displaying is disclosed. Japanese Patent Laid-Open No. 2003-141558 (Patent Document 4) discloses a technique for arranging a stamp image at a touch position.

JP 2005-277891 A JP-A-10-188014 JP 2003-323241 A JP 2003-141558 A

  However, the techniques of Patent Documents 1 to 3 change the rotation attribute of an object image already displayed on the screen. Further, the technique of Patent Document 4 cannot control the orientation of the stamp image.

  The present invention has been made to solve such a problem, and an object of the present invention is to make it possible to display an object at an arbitrary position and in an arbitrary direction by a simpler operation. An image processing program and an image processing apparatus for realizing the above are provided.

  According to an aspect of the present invention, there is provided an image processing program that is executed by a computer (100) that can use input means (13: reference numerals corresponding to the embodiments; hereinafter the same) and display means (12). To do. The image processing program includes a coordinate detection step (S104) for detecting a coordinate value input to the computer (100) by an operation on the input means (13), and a predetermined coordinate value among the detected coordinate values as a first value. A first object display step (S132, S136, S502, S506, S508) acquired as an object arrangement coordinate value and displaying the first object at a corresponding position of the display means based on the first object arrangement coordinate value; Of the detected coordinate values, a continuous coordinate acquisition step (S510 to S514) for acquiring a continuous coordinate value that is a coordinate value subsequent to the first object arrangement coordinate value, and a second coordinate displayed on the display means according to the continuous coordinate value. A direction changing step (S516, S518) for changing the direction of one object is executed.

  In the first object display step, it is preferable that the first object is displayed when the first object arrangement coordinate value is detected.

  According to the present invention, when the user operates the input means (13), the first object arrangement coordinate value is acquired by the operation, and the object is placed at the position of the display means (12) corresponding to the first object arrangement coordinate value. Is displayed. Further, when the user continues to operate the input means (13), the continuous arrangement coordinate value is acquired by the subsequent operation, and the direction of the object is changed based on the continuous coordinate value.

  Preferably, in the first object display step, the coordinate value immediately after the detection of the coordinate value is set as the first object arrangement coordinate value (S132, S136, S502).

  According to the present invention, when the user operates the input means, the object is immediately displayed (arranged), so that it is possible to suppress the stress on the input operation from being given to the user.

  More preferably, in the continuous coordinate acquisition step, a step of determining whether or not the detection of the coordinate value is continued following the detection of the first object arrangement coordinate value (S510), and the coordinate value is continuously detected. Determining whether or not the coordinate value input during the time satisfies a direction changing condition that is a condition for changing the direction of the first object (S514). In the direction changing step, the coordinate value determined to satisfy the direction changing condition is used as the continuous coordinate value (S512), and the direction of the first object is changed according to the continuous coordinate value.

  According to one embodiment, the direction change condition is a condition for suppressing the change of the direction of the object due to an operation unintended by the user. By using such a direction change condition, the user does not intend It is possible to prevent the object from being changed. Thus, the user can comfortably perform the input operation without feeling stress about the input operation.

  More preferably, the direction change condition includes that the distance between the first object arrangement coordinate value and the continuous coordinate value exceeds a predetermined threshold value. The distance includes both a straight line distance (Euclidean distance) and a road distance (trajectory distance) between coordinate points.

  According to the present invention, it is possible to prevent an erroneous operation on the displayed object from occurring even if the input coordinates change slightly when the user stops the operation on the input means. Therefore, it can suppress giving the stress about input operation to a user.

  Preferably, the orientation changing step determines the orientation of the first object based on a positional relationship between the first object arrangement coordinate value and the continuous coordinate value.

  More preferably, the orientation changing step determines the orientation of the first object based on a line passing through the first object arrangement coordinate value and the continuation coordinate value (S516, S518).

  According to this invention, after the object is displayed, the direction of the object is changed following the operation performed by the user, and the user can more intuitively specify the desired direction of the object.

  Preferably, the continuous coordinate acquisition step acquires a continuous coordinate value at any time while the detection of the coordinate value continues, and the orientation change step acquires each continuation at any time while the detection of the coordinate value continues. The orientation of the first object displayed on the display means is changed as needed according to the coordinate value.

  According to the present invention, while the user continues to perform the operation, the direction of the object displayed on the display means is changed substantially in real time, so that the user can experience the good operation response. Can do.

  Preferably, the image processing program further causes the computer to execute an orientation determining condition determining step (S520) for determining whether or not an operation satisfying an orientation determining condition for determining the orientation of the first object has been performed. In the orientation changing step, before the orientation determination condition is satisfied, the orientation of the first object is changed at any time based on the respective continuous coordinate values every time the continuous coordinate values are updated, and the orientation determination conditions are satisfied. After that, the orientation of the first object is fixed (S516, S518, S552).

  According to the present invention, after the object is displayed in the orientation desired by the user, the object is fixed in the orientation by the user performing an operation that satisfies the orientation determination condition. Thereby, when the user wants to display various objects, the user can continuously determine the arrangement and orientation of each object.

  Preferably, the image processing program further causes the computer to execute an orientation determining condition determining step (S520) for determining whether or not an operation satisfying an orientation determining condition for determining the orientation of the first object has been performed. The orientation changing step maintains the orientation of the first object in the initial state before the orientation determination condition is satisfied, and when the orientation determination condition is satisfied, the orientation change step is based on the continuous coordinate value when the orientation determination condition is satisfied. Then, after changing the direction of the first object, the first object is fixed to the changed direction.

  According to the present invention, even if the user continues to operate, the direction of the object is not changed until the orientation determination condition is satisfied, so that the amount of calculation processing can be reduced.

  Preferably, the orientation determination condition includes that the distance between the first object arrangement coordinate value and the continuous coordinate value is equal to or greater than a predetermined value.

  Preferably, the orientation determination condition includes that the detection of the coordinate value is interrupted after the acquisition of the first object arrangement coordinate value.

  According to the present invention, since the orientation determination condition is satisfied at the timing when the user stops the operation on the input means, the user can change the object to a desired orientation, and then, for example, touch pen or the like from the input surface of the touch panel. The user can easily determine the orientation of the object simply by performing an operation such as releasing.

  Preferably, the image processing program causes the computer to further execute a second object display step (S530 to S538) for displaying the second object on the display unit. The second object display step determines whether or not the coordinate value input while the coordinate value is continuously detected following the detection of the first object arrangement coordinate value displays the second object. Determining whether or not the second object display condition is satisfied (S534), and the coordinate value determined to satisfy the second object display condition is set as the second object arrangement coordinate, and the display means is based on the coordinate. Displaying a second object at a corresponding position (S538).

  According to the present invention, a plurality of objects are sequentially displayed by a user performing continuous operations. Thereby, the user can continuously display a plurality of objects by a simple operation.

  Preferably, the second object display condition is the same as the orientation determination condition, the orientation of the first object is determined based on the coordinate value determined to satisfy the condition, and the position corresponding to the coordinate value The second object is displayed on the screen.

  According to the present invention, when the orientation of the object displayed first is fixed (determined), the next object is displayed based on the fixed coordinate value. Thereby, the user can display a plurality of objects continuously more rapidly.

  Preferably, the second object display step determines the orientation of the second object based on the positional relationship between the first object arrangement coordinate value and the second object arrangement coordinate value (S536, S538).

  According to the present invention, for example, the objects are sequentially arranged in the direction along the trajectory input by the user operation, so that a plurality of objects can be arranged in the direction corresponding to the user operation.

  Preferably, the image processing program causes the computer to further execute an input image display step (S200 to S204) for displaying the input image on the display unit. The object is displayed so as to overlap the displayed input image.

  According to the present invention, the user can obtain a feeling of “writing” on the input image. Thus, for example, an editing operation can be freely performed on an image photographed by a camera or the like. Therefore, the user can create and enjoy a desired image by himself.

  According to another aspect of the present invention, there is provided an image processing program to be executed by a computer (100) that can use an input means (13) and a display means (12). The image processing program corresponds to the step (S510, S520, S524, S528 to S532) of detecting a change in the coordinate value continuously input to the computer (100) by an operation on the input means, and the change in the coordinate value. A step of sequentially displaying at least one object (S508, S516, S518, S526, S536, S538) according to the trajectory on the display means is executed. The direction of each of the at least one object is sequentially determined according to the trajectory on the display means.

  According to still another aspect of the present invention, an image processing apparatus (100) that can use the input means (13) and the display means (12) is provided. The image processing apparatus (100) acquires a coordinate value input by a user operation and a predetermined coordinate value among the detected coordinate values as a first object arrangement coordinate value, and the first object Based on the arrangement coordinate value, the first object display means (31; S502, S506, S508) for displaying the first object at the corresponding position of the display means, and the first object arrangement coordinate value among the detected coordinate values. Continuous coordinate acquisition means for acquiring continuous coordinate values that are subsequent coordinate values, and orientation changing means (31; S516, S518) for changing the orientation of the first object displayed on the display means in accordance with the continuous coordinate values. Prepare.

  According to still another aspect of the present invention, an image processing apparatus (100) that can use the input means (13) and the display means (12) is provided. The image processing apparatus (100) includes detection means (13, 31; S510, S520, S524, S528 to S532) for detecting changes in coordinate values continuously input by an operation on the input means, and changes in coordinate values. Object display means (31; S508, S516, S518, S526, S536, S538) for sequentially displaying at least one object according to the trajectory on the corresponding display means. The direction of each of the at least one object is sequentially determined according to the trajectory on the display means.

  According to the present invention, it is possible to provide a user interface capable of displaying an object at an arbitrary position and in an arbitrary direction by a simpler operation.

It is an external view of the game device according to the first embodiment of the present invention. It is a block diagram which shows an example of an internal structure of the game device according to Embodiment 1 of this invention. It is a figure which shows an example of the usage pattern of the game device according to Embodiment 1 of this invention. It is a figure which shows an example of the selection screen in the game device according to Embodiment 1 of this invention. It is FIG. (1) for demonstrating the outline | summary of the "graffiti camera" according to Embodiment 1 of this invention. It is FIG. (2) for demonstrating the outline | summary of the "graffiti camera" according to Embodiment 1 of this invention. It is FIG. (3) for demonstrating the outline | summary of the "graffiti camera" according to Embodiment 1 of this invention. It is FIG. (4) for demonstrating the outline | summary of the "graffiti camera" according to Embodiment 1 of this invention. It is FIG. (5) for demonstrating the outline | summary of the "graffiti camera" according to Embodiment 1 of this invention. It is FIG. (6) for demonstrating the outline | summary of the "graffiti camera" according to Embodiment 1 of this invention. It is FIG. (7) for demonstrating the outline | summary of the "graffiti camera" according to Embodiment 1 of this invention. It is FIG. (1) for demonstrating the detailed process of the "graffiti camera" according to Embodiment 1 of this invention. It is FIG. (2) for demonstrating the detailed process of the "graffiti camera" according to Embodiment 1 of this invention. It is FIG. (3) for demonstrating the detailed process of the "graffiti camera" according to Embodiment 1 of this invention. It is a schematic diagram for demonstrating the drawing process of the game device according to Embodiment 1 of the present invention. It is a figure for demonstrating the effective range of the game device according to Embodiment 1 of this invention. It is a flowchart which shows the process which concerns on the function selection in the game device according to Embodiment 1 of this invention. 18 is a flowchart (No. 1) showing a subroutine process executed when “Rakugaki camera” is selected in step S16 shown in FIG. FIG. 18 is a flowchart (2) showing a subroutine process executed when “Rakugaki camera” is selected in step S16 shown in FIG. It is a flowchart which shows the drawing process subroutine process started execution in step S100 shown in FIG. FIG. 20 is a flowchart showing a “pencil” mode subroutine process executed in step S136 shown in FIG. 19. FIG. It is a flowchart which shows the subroutine process of the "eraser" mode performed in step S138 shown in FIG. FIG. 20 is a flowchart showing a “stamp” mode subroutine process executed in step S140 shown in FIG. 19. FIG. It is a figure for demonstrating the process in the modification 1 of Embodiment 1 of this invention. It is a figure which shows an example of the selection screen in the game device according to Embodiment 2 of this invention. It is FIG. (1) for demonstrating the outline | summary of the "sagging camera" according to Embodiment 2 of this invention. It is FIG. (2) for demonstrating the outline | summary of the "Kagami camera" according to Embodiment 2 of this invention. It is FIG. (3) for demonstrating the outline | summary of the "sagging camera" according to Embodiment 2 of this invention. It is FIG. (4) for demonstrating the outline | summary of the "Kagami camera" according to Embodiment 2 of this invention. It is FIG. (5) for demonstrating the outline | summary of the "Kagami camera" according to Embodiment 2 of this invention. It is a figure for demonstrating the detailed process of the "Kagami camera" according to Embodiment 2 of this invention. It is a schematic diagram for demonstrating the drawing process of the game device according to Embodiment 2 of the present invention. It is a schematic diagram for demonstrating the extraction process of the image object in the game device according to Embodiment 2 of the present invention. FIG. 18 is a flowchart showing a subroutine process that is executed when “Kagami Camera” is selected in step S <b> 16 shown in FIG. 17. FIG. 18 is a flowchart showing a subroutine process that is executed when “Kagami Camera” is selected in step S <b> 16 shown in FIG. 17. FIG. 35 is a flowchart showing a drawing process subroutine process that is started in step S602 shown in FIG. 34. FIG. It is a figure for demonstrating the internal process corresponding to the detailed process shown in FIG. It is a figure for demonstrating the internal process corresponding to the detailed process shown in FIG.

  Embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the same or equivalent part in a figure, the same code | symbol is attached | subjected and the description is not repeated.

[Embodiment 1]
As a representative example of a computer or image processing apparatus according to the present invention, a game apparatus 100 will be described below. In addition, as an example of the image processing program according to the present invention, a program executed by the game apparatus 100 will be described. The image processing apparatus according to the present invention is not limited to a game apparatus, and may be realized as a personal computer capable of executing various applications. That is, the image processing program according to the present invention can be executed by any type of computer as long as the input unit and the display unit can be used. Note that “available” means that the input means and the display means are connected to the computer in a wired or wireless manner, and data communication is possible. The input means and the display means are integrated with the computer device. It includes both cases where there are cases and cases where they are separate.

  Further, the image processing program according to the present invention may be incorporated as a function of various applications executed on a personal computer. In the following, a portable device will be described, but a stationary device may be used.

  In addition, as the input means, a touch panel is preferable as described later if it is a portable device as described later, but a mouse or the like may be used instead. Alternatively, a pointer (typically a Wii (registered trademark) controller or the like) capable of instructing coordinates remotely from the display monitor may be used. In the case of a mouse or pointer, the coordinates of “touch-on” in the embodiments described later may be detected coordinates when a predetermined operation (button operation or the like) is performed, and “touch state is continued”. The determination can be a determination that a predetermined operation is continued (for example, the button operation is continued).

<Appearance of game device>
FIG. 1 is an external view of game device 100 according to the first embodiment of the present invention.

  Referring to FIG. 1, game device 100 according to the present embodiment is a foldable portable game device. FIG. 1 shows the game apparatus 100 in an open state (open state). The game apparatus 100 is configured in a size that allows the user to hold it with both hands or one hand even in an open state.

  The game apparatus 100 includes a lower housing 11 and an upper housing 21. The lower housing 11 and the upper housing 21 are connected so as to be openable and closable (foldable). In the example shown in FIG. 1, the lower housing 11 and the upper housing 21 are each formed in a horizontally-long rectangular plate shape, and are coupled so as to be rotatable at their long side portions.

  Normally, the user uses the game apparatus 100 in the open state. Further, the user stores the game apparatus 100 in a closed state when the game apparatus 100 is not used. In the example shown in FIG. 1, the game apparatus 100 is not limited to the closed state and the open state, but the angle formed by the lower housing 11 and the upper housing 21 is an arbitrary angle between the closed state and the open state. The opening / closing angle can be maintained by a frictional force generated in the connecting portion. That is, the upper housing 21 can be made stationary with respect to the lower housing 11 at an arbitrary angle.

  The lower housing 11 is provided with a lower LCD (Liquid Crystal Display) 12 as a display unit (display means). The lower LCD 12 has a horizontally long shape, and is arranged such that the long side direction coincides with the long side direction of the lower housing 11. In the present embodiment, an LCD is used as a display unit (display means) mounted on game device 100, but other arbitrary displays such as a display device using EL (Electro Luminescence), for example. An apparatus may be used. In addition, the game apparatus 100 can use a display device having an arbitrary resolution.

  The lower housing 11 is provided with operation buttons 14A to 14H as input units (input means). As shown in FIG. 1, among the operation buttons 14A to 14H, a direction input button 14A, an operation button 14B, an operation button 14C, an operation button 14D, an operation button 14E, a power button 14F, a start button 14G, and a select button 14H. Is provided on the inner main surface of the lower housing 11 which is the inner side when the upper housing 21 and the lower housing 11 are folded.

  The direction input button 14A is used for a selection operation, for example. The operation buttons 14B to 14E are used, for example, for a determination operation or a cancel operation. The power button 14F is used to turn on / off the power of the game apparatus 100. In the example shown in FIG. 1, the direction input button 14 </ b> A and the power button 14 </ b> F are on the left and right sides (left side in FIG. 1) of the main surface with respect to the lower LCD 12 provided near the center of the inner main surface of the lower housing 11. Provided on top.

  In addition, the operation buttons 14B to 14E, the start button 14G, and the select button 14H are provided on the inner main surface of the lower housing 11 that is on the other side of the lower LCD 12 (right side in FIG. 1). Direction input button 14 </ b> A, operation buttons 14 </ b> B to 14 </ b> E, start button 14 </ b> G, and select button 14 </ b> H are used to perform various operations on game device 100.

  Note that the game device 100 may further include operation buttons 14I to 14K that are not shown in FIG. For example, the L button 14 </ b> I is provided at the left end portion of the upper side surface of the lower housing 11, and the R button 14 </ b> J is provided at the right end portion of the upper side surface of the lower housing 11. L button 14I and R button 14J are used, for example, to perform a shooting instruction operation (shutter operation) on game device 100. Furthermore, the volume button 14K is provided on the left side surface of the lower housing 11. The volume button 14K is used to adjust the volume of a speaker provided in the game apparatus 100.

  The game apparatus 100 further includes a touch panel 13 as an input unit (input unit) different from the operation buttons 14A to 14H. The touch panel 13 is mounted so as to cover the screen of the lower LCD 12.

  In the present embodiment, the touch panel 13 is arranged in association with the display surface of the lower LCD 12, and for example, a resistive film type touch panel is used. However, the touch panel 13 is not limited to the resistive film type, and any pressing type touch panel can be used.

  In the present embodiment, for example, a touch panel 13 having the same resolution (detection accuracy) as the resolution of the lower LCD 12 is used. However, the resolution of the touch panel 13 and the resolution of the lower LCD 12 are not necessarily matched.

  Further, an insertion port (broken line shown in FIG. 1) for the touch pen 27 is provided on the right side surface of the lower housing 11. The insertion slot can accommodate a touch pen 27 used for operating the touch panel 13. In addition, although the input with respect to the touch panel 13 is normally performed using the touch pen 27, it is also possible to operate the touch panel 13 not only with the touch pen 27 but with a user's finger | toe.

  Further, an insertion slot (indicated by a two-dot chain line in FIG. 1) for storing the memory card 28 is provided on the right side surface of the lower housing 11. A connector (not shown) for electrically connecting the game apparatus 100 and the memory card 28 is provided inside the insertion slot. The memory card 28 is an SD (Secure Digital) memory card, for example, and is detachably attached to the connector. The memory card 28 is used, for example, for storing (storing) an image photographed and / or processed by the game apparatus 100 and reading an image generated by another apparatus into the game apparatus 100.

  Further, an insertion slot (indicated by a one-dot chain line in FIG. 1) for accommodating the memory card 29 is provided on the upper side surface of the lower housing 11. A connector (not shown) for electrically connecting the game apparatus 100 and the memory card 29 is also provided inside the insertion slot. The memory card 29 is a storage medium that stores an image communication program, a game program, and the like, and is detachably attached to an insertion port provided in the lower housing 11.

  Three LEDs 15 </ b> A to 15 </ b> C are attached to the left portion of the connecting portion between the lower housing 11 and the upper housing 21. Game device 100 according to the present embodiment can perform wireless communication with other devices, and first LED 15A is lit when wireless communication is established. The second LED 15B is lit while the game apparatus 100 is being charged. The third LED 15C is lit when the game apparatus 100 is powered on. Therefore, the three LEDs 15A to 15C can notify the user of the communication establishment status, the charging status, and the power on / off status of the game apparatus 100.

  On the other hand, the upper housing 21 is provided with an upper LCD 22. The upper LCD 22 has a horizontally long shape and is arranged such that the long side direction coincides with the long side direction of the upper housing 21. As in the case of the lower LCD 12, instead of the upper LCD 22, a display device having any other method and any resolution may be used. A touch panel may be provided so as to cover the upper LCD 22.

  Furthermore, the upper housing 21 is provided with two cameras (an inner camera 23 and an outer camera 25) that are imaging devices. As shown in FIG. 1, the inner camera 23 is attached to the inner main surface near the connecting portion of the upper housing 21. On the other hand, the outer camera 25 is the surface opposite to the inner main surface to which the inner camera 23 is attached, that is, the outer main surface of the upper housing 21 (the outer surface when the game apparatus 100 is closed, It is attached to the rear surface of the upper housing 21 shown in FIG. In FIG. 1, the outer camera 25 is indicated by a broken line.

  As a result, the inner camera 23 can shoot in the direction in which the inner main surface of the upper housing 21 faces, and the outer camera 25 can capture the direction opposite to the shooting direction of the inner camera 23, that is, the outer main surface of the upper housing 21. It is possible to photograph the direction in which the surface faces.

  Thus, in the present embodiment, the two inner cameras 23 and the outer cameras 25 are provided so that the shooting directions are opposite to each other. For example, the user can shoot a scene viewed from the game apparatus 100 with the inner camera 23 and shoot a scene viewed from the game apparatus 100 in the direction opposite to the user with the outer camera 25. Can do.

  Note that the lower LCD 12 and / or the upper LCD 22 may be used to display an image captured by the inner camera 23 or the outer camera 25 in real time.

  Furthermore, a microphone (a microphone 43 shown in FIG. 2) is accommodated as an audio input device on the inner main surface near the connecting portion. A microphone hole 16 is formed on the inner main surface near the connecting portion so that the microphone 43 can detect sound outside the game apparatus 100. The position where the microphone 43 is accommodated and the position of the microphone hole 16 do not necessarily have to be the connecting portion. For example, the microphone 43 is accommodated in the lower housing 11, and the lower housing 11 corresponds to the accommodation position of the microphone 43. A microphone hole 16 may be provided.

  Further, a fourth LED 26 (shown by a broken line in FIG. 1) is attached to the outer main surface of the upper housing 21. The fourth LED 26 is lit while the inner camera 23 or the outer camera 25 is photographing. Further, the moving image may be blinked while the moving image is shot by the inner camera 23 or the outer camera 25 (the shot image is stored as a moving image).

  In order to prevent the LED from appearing on the screen, the fourth LED 26 may be turned off from the moment the shutter is pressed until the storage of the captured image at the moment the shutter is pressed is completed. The fourth LED 26 can notify the person to be photographed and the surroundings that photographing by the game apparatus 100 is being performed.

  Furthermore, with respect to the upper LCD 22 provided in the vicinity of the center of the inner main surface of the upper housing 21, sound release holes 24 are formed in the main surfaces on the left and right sides, respectively. A speaker is housed in the upper housing 21 behind the sound release hole 24. The sound release hole 24 is a hole for releasing sound from the speaker to the outside of the game apparatus 100.

  As described above, the upper housing 21 is provided with the inner camera 23 and the outer camera 25 that are configured to capture images, and the upper LCD 22 that is a display unit for displaying various images. On the other hand, the lower housing 11 is provided with an input unit (touch panel 13 and buttons 14A to 14K) for performing an operation input to the game apparatus 100, and a lower LCD 12 which is a display means for displaying various images. It is done.

  For example, when the game apparatus 100 is used, the input device displays the photographed image (image photographed by the camera) on the lower LCD 12 or the upper LCD 22 while the user grasps and inputs the lower housing 11. It can be used for such purposes as inputting to the device.

<Internal configuration of game device>
FIG. 2 is a block diagram showing an exemplary internal configuration of game device 100 according to the first embodiment of the present invention.

  Referring to FIG. 2, a game apparatus 100 includes a CPU 31, a main memory 32, a memory control circuit 33, a storage data memory 34, a preset data memory 35, and a memory card interface (memory card I / F). 36 and 37, a wireless communication module 38, a local communication module 39, a real-time clock (RTC) 40, a power supply circuit 41, an interface circuit (I / F circuit) 42, and other electronic components. These electronic components are mounted on an electronic circuit board and housed in the lower housing 11 (or the upper housing 21).

  The CPU 31 is an arithmetic processing unit for executing a predetermined program. In the present embodiment, a predetermined program is recorded in a memory (for example, storage data memory 34) or memory card 28 and / or 29 in game device 100, and CPU 31 executes the predetermined program. Thus, image processing to be described later is executed. Note that the program executed by the CPU 31 may be recorded in advance in the memory in the game apparatus 100, may be acquired from the memory card 28 and / or 29, or may be obtained by communication with other devices. It may be acquired from the device.

  A main memory 32, a memory control circuit 33, and a preset data memory 35 are connected to the CPU 31. In addition, a storage data memory 34 is connected to the memory control circuit 33.

  The main memory 32 is a storage means used as a work area or buffer area for the CPU 31. That is, the main memory 32 stores various data used for the information processing, and stores programs acquired from the outside (memory cards 28 and 29, other devices, etc.). In the present embodiment, for example, PSRAM (Pseudo-SRAM) is used as the main memory 32.

  The storage data memory 34 is a storage unit for storing a program executed by the CPU 31, data of images taken by the inner camera 23 and the outer camera 25, and the like. The storage data memory 34 is constituted by a non-volatile storage medium, and is constituted by, for example, a NAND flash memory in this embodiment. The memory control circuit 33 is a circuit that controls reading and writing of data with respect to the storage data memory 34 in accordance with instructions from the CPU 31.

  The preset data memory 35 is storage means for storing data (preset data) such as various parameters set in advance in the game apparatus 100. As the preset data memory 35, a flash memory connected to the CPU 31 by an SPI (Serial Peripheral Interface) bus can be used.

  Memory card I / Fs 36 and 37 are each connected to CPU 31. The memory card I / F 36 reads and writes data from and to the memory card 28 attached to the connector in accordance with instructions from the CPU 31. The memory card I / F 37 reads and writes data to and from the memory card 29 attached to the connector in accordance with instructions from the CPU 31.

  In the present embodiment, image data captured by the inner camera 23 and the outer camera 25 and image data received from another device are written into the memory card 28, or image data stored in the memory card 28 is stored in the memory card. The data is read from 28 and stored in the storage data memory 34 or transmitted to another device. Various programs stored in the memory card 29 are read out and executed by the CPU 31.

  The image processing program according to the present invention may be supplied not only to the computer system through an external storage medium such as the memory card 29 but also to the computer system through a wired or wireless communication line. The image processing program may be stored in advance in a nonvolatile storage device inside the computer system. The storage medium for storing the image processing program is not limited to the nonvolatile storage device, but may be a CD-ROM, a DVD, or an optical disk storage medium similar to them.

  The wireless communication module 38 is, for example, IEEE 802.11. It has a function of connecting to a wireless LAN by a method compliant with the b / g standard. The local communication module 39 has a function of performing wireless communication with the same type of game device by a predetermined communication method. The wireless communication module 38 and the local communication module 39 are connected to the CPU 31. The CPU 31 transmits / receives data to / from other devices via the Internet using the wireless communication module 38, and transmits / receives data to / from other game devices of the same type using the local communication module 39. be able to.

  Further, an RTC 40 and a power supply circuit 41 are connected to the CPU 31. The RTC 40 counts the time and outputs it to the CPU 31. For example, the CPU 31 can calculate the current time (date) based on the time counted by the RTC 40. The power supply circuit 41 controls power supplied from a power supply (typically a battery, which is stored in the lower housing 11) of the game apparatus 100, and supplies power to each component of the game apparatus 100.

  Furthermore, the game apparatus 100 includes a microphone 43 and an amplifier 44. The microphone 43 and the amplifier 44 are each connected to the I / F circuit 42. The microphone 43 detects the voice of the user uttered toward the game apparatus 100 and outputs a voice signal indicating the voice to the I / F circuit 42. The amplifier 44 amplifies the audio signal from the I / F circuit 42 and outputs it from a speaker (not shown). The I / F circuit 42 is connected to the CPU 31.

  The touch panel 13 is connected to the I / F circuit 42. The I / F circuit 42 includes a sound control circuit that controls the microphone 43 and the amplifier 44 (speaker), and a touch panel control circuit that controls the touch panel 13.

  The voice control circuit performs A / D conversion and D / A conversion on the voice signal, or converts the voice signal into voice data of a predetermined format.

  The touch panel control circuit generates touch position data in a predetermined format based on a signal from the touch panel 13 and outputs it to the CPU 31. For example, the touch position data is data indicating coordinates of a position where an input is performed on the input surface of the touch panel 13. The touch panel control circuit reads signals from the touch panel 13 and generates touch position data at a rate of once per predetermined time.

  The CPU 31 can detect the coordinates input by the user's operation on the touch panel 13 by acquiring the touch position data via the I / F circuit 42.

  The operation button 14 includes the operation buttons 14A to 14K and is connected to the CPU 31. From the operation button 14 to the CPU 31, operation data indicating an input status (whether or not the button is pressed) for each of the operation buttons 14A to 14K is output. The CPU 31 obtains operation data from the operation button 14 to execute processing corresponding to the input to the operation button 14.

  The inner camera 23 and the outer camera 25 are each connected to the CPU 31. The inner camera 23 and the outer camera 25 capture an image in accordance with an instruction from the CPU 31 and output the captured image data to the CPU 31. For example, the CPU 31 issues a shooting instruction to one of the inner camera 23 and the outer camera 25, and the camera that has received the shooting instruction takes an image and sends the image data to the CPU 31.

  Further, the lower LCD 12 and the upper LCD 22 are each connected to the CPU 31. The lower LCD 12 and the upper LCD 22 display images according to instructions from the CPU 31, respectively. As an example, the CPU 31 displays an image acquired from either the inner camera 23 or the outer camera 25 on one of the lower LCD 12 and the upper LCD 22, and displays an operation explanation screen generated by a predetermined process on the lower LCD 12 and the upper LCD 22. Is displayed on the other side.

<Usage example of game device>
FIG. 3 shows an example of a usage pattern of game device 100 according to the first embodiment of the present invention. Referring to FIG. 3, in game device 100, an image such as subject TRG photographed by a mounted camera (inner camera 23 or outer camera 25) is displayed in real time on lower LCD 12, and the user can use touch pen 27. It is possible to add an arbitrary object by operating the touch panel 13 arranged on the lower LCD 12 using the user's finger or the like (hereinafter referred to as “touch pen 27 etc.”). Then, the object corresponding to the user operation is displayed superimposed on the captured image. Thus, in game device 100 according to the present embodiment, the user can freely “grab” the image taken by the camera. The displayed image may be an image (still image or moving image) stored in advance in the memory card 28 (FIG. 2) or the like.

  In the example shown in FIG. 3, the subject TRG is photographed using the outer camera 25, but the subject TRG may be photographed using the inner camera 23, and which camera is used. The user may arbitrarily select it.

  FIG. 4 shows an example of a selection screen in game device 100 according to the first embodiment of the present invention. Referring to FIG. 4, game device 100 according to the present embodiment is equipped with a plurality of functions including the above-described functions that can be freely “written” by the user. Select the desired function.

  In the example shown in FIG. 4, a plurality of icons 150 corresponding to each function mounted on the game apparatus 100 are displayed at the top of the screen, and the user arbitrarily selects an icon corresponding to a desired function among these icons 150. Can be selected. In addition, selection icons 152 and 154 are displayed on both sides of the screen. Each time the user selects the selection icon 152 or 154, the selected function is sequentially changed to the left or right according to the arrangement of the icons 150.

  When the user selects a function by such a method and selects the “Start” icon 158, the selected function is executed. When the “quit” icon 156 is selected, the screen returns to a menu screen (not shown).

  Further, as shown in FIG. 4, the preview area 160 has a name of the selected function (in the example shown in FIG. 4) so that the contents of the function corresponding to the icon 150 selected by the user are presented to the user. "Rakugaki camera") and the outline of its processing is shown.

<Outline of “Rakugaki Camera”>
Hereinafter, with reference to FIG. 5 to FIG. 11, an outline of “a graffiti camera” according to the present embodiment will be described.

  “Rakugaki camera” according to the present embodiment is a function that allows the user to freely “grate” the image taken by the camera. The “Rakugaki Camera” mainly provides a function capable of arranging one object (stamp) prepared in advance at an arbitrary position and orientation, and a function capable of arranging a plurality of objects along a locus inputted by the user. The

  As shown in FIG. 5, in the “Rakugaki camera” mode, an image captured by the camera is displayed in real time, and icons 202 to 208 for selecting a “Rakugaki” operation for this image are displayed at the top of the screen. And icons 210 to 214 for selecting various operations are displayed at the bottom of the screen.

  In the example shown in FIG. 5, an object OBJ2, which is a leaf stamp, and an object OBJ4, which is a heart-shaped stamp, are displayed on the image obtained by photographing the subject TRG. The case where the object OBJ3 which shows the inputted character of "hello" is displayed in piles is shown.

  For the object OBJ3 shown in FIG. 5, the user selects (touches) the “pencil” icon 202 and then moves (slides) while touching the touch pen 27 or the like on the screen. Generated. By selecting the “pencil” icon 202, a selection submenu (not shown) is displayed. In this selection submenu, the thickness of the line, the color of the line, and the like can be arbitrarily selected.

  In addition, after selecting the “eraser” icon 204, the user moves (slides) the touch pen 27 or the like while touching the screen, thereby erasing the object included in the moved locus (area). Further, when the “all button” icon 208 is selected, all objects displayed in the display area 200 are deleted.

  When the “stamp” icon 206 is selected, a selection submenu shown in FIG. 6 is displayed, and the stamp selected in this selection submenu can be input. In the game apparatus 100, a plurality of types of stamps (10 types in the example shown in FIG. 6) are prepared in advance. As shown in FIG. 6, in the selection submenu when the “stamp” icon 206 is selected, A plurality of icons 222 corresponding to the stamp are displayed. When the user selects an icon corresponding to a desired stamp and then selects a “close” icon 224, the selected stamp can be input, and the display of the selection submenu disappears.

  In a state where the selected stamp can be input, when the user touches a desired position on the screen with the touch pen 27 or the like, one stamp selected at the position (corresponding to the first object arrangement coordinate value) is displayed. Be placed.

  In particular, in game device 100 according to the present embodiment, the stamp immediately after being arranged is maintained in an uncertain state with respect to the arrangement direction. That is, after the user touches on the screen with the touch pen 27 etc. to place the stamp, the user moves the touch pen 27 etc. (slide operation) while touching the screen, so that the direction of the stamp is changed after the movement. It changes in real time according to the touch position (corresponding to the continuous coordinate value). Then, when the user performs an operation such as moving the touch pen 27 etc. off the screen or moving the touch pen 27 etc. more than the predetermined distance D1 from the touch-on position, the orientation of the arranged stamp is decided (confirmed) State). As will be described later, when the touch position is shorter than the predetermined distance D2 (D2 <D1) from the touch-on position, the orientation of the stamp is not changed.

  As a specific example, for example, when an icon corresponding to a balloon stamp is selected in the selection submenu shown in FIG. 6 and the user touches a desired position on the screen with the touch pen 27 or the like, as shown in FIG. In addition, the object OBJ4, which is a balloon stamp, is arranged according to the touched position. Note that the orientation of the object OBJ4 at this time is a predetermined orientation (initial value). Further, when the touch pen 27 or the like is moved while being touched on the screen with the touch pen 27 or the like, the object OBJ4 is sequentially rotated according to the position after the touch pen 27 or the like is moved, as shown in FIG. . Note that a center point of rotation is determined in advance for each stamp, and the center point is rotated around the center point according to the movement of the touch pen 27 or the like. Thereafter, when the touch pen 27 or the like is moved away from the screen or the touch pen 27 or the like is moved more than the predetermined distance D1 from the touch-on position, the orientation of the arranged object 4 (stamp) is fixed.

  Further, an example in which the touch pen 27 or the like is moved while being touched on the screen after the first stamp is arranged will be described with reference to FIGS. 9 to 11. In order to facilitate understanding, the example shown in FIGS. 9 to 11 shows a case where a leaf stamp is selected.

  First, when the user touches a desired position on the screen with the touch pen 27 or the like, as shown in FIG. 9, the object OBJ21 that is a leaf stamp is arranged according to the touched position (displayed on the screen). . As described above, the stamp (object OBJ21) immediately after the placement is in an undefined state. Thereafter, when the user moves the touch pen 27 or the like more than the predetermined distance D1 from the touch-on position while touching the screen with the touch pen 27 or the like, the orientation of the object OBJ21 is determined. At the same time as or after the confirmation of the orientation of the object OBJ21, if the screen continues to be touched with the touch pen 27 or the like, an object OBJ22 that is a new stamp (second stamp) is arranged.

  Note that the orientation of the second stamp is determined according to the relative relationship between the position of the first stamp and the position of its own stamp. Therefore, the orientation of the second stamp is fixed when it is placed. After the second stamp is placed, if the object is moved further by a predetermined distance D1 from the position of the object OBJ22 while being touched, the object OBJ23, which is a new stamp (third stamp), is placed. Is done. As with the second stamp, the orientation of the third stamp is fixed at the time of placement. Specifically, the direction is determined according to the relative relationship between the position of the second stamp and the position of its own stamp. Further, if the touch position is continuously moved in the touched state, the fourth and subsequent stamps (OBJ24, OBJ25,...) Are also arranged in the same manner as described above. The direction is determined. As described above, during the series of operations from touching the touch pen 27 or the like on the screen until it is released, the orientation of the first stamp is the position of its own stamp and the stamp after it. Since the direction is determined according to the relative relationship between the positions, the direction is not determined at the time of display, and the direction changes according to the subsequent touch position. On the other hand, the orientation of the second and subsequent stamps is determined according to the relative relationship between the position of the previous stamp and the position of its own stamp. That is, during the series of operations, the stamps arranged after the second one have a fixed direction at the time of display, and therefore there is no undetermined state.

  In this way, when the user moves the touch pen 27 or the like while touching the screen with the touch pen 27 or the like, stamps are sequentially arranged along the locus. Such an operation continues as long as the user touches the screen with the touch pen 27 or the like. Therefore, the user can freely arrange stamps along the locus by operating the touch pen 27 or the like.

  When the screen is touched with the touch pen 27 or the like and is touched off within a predetermined distance D1 from the touch-on position, only one stamp is arranged. Further, when the touch-off is performed within the predetermined distance D2 from the touch-on position, the stamp orientation is displayed in the initial state. That is, when a touch-off occurs immediately after touching (when touch-off is performed within a predetermined distance D2 from the touch-on position), one stamp is displayed in the initial state.

  Thus, in game device 100 according to the present embodiment, a change in coordinate values continuously input by an operation on touch panel 13 is detected, and according to a locus on touch panel 13 corresponding to the change in coordinate values, At least one object is displayed sequentially. At this time, the direction of each object is sequentially determined according to the locus on the touch panel 13. Further, it is possible to arrange only one object, and it is possible to display the one object in the initial orientation or change the orientation.

  Referring to FIG. 5 again, when the “quit” icon 210 is selected, the processing of this “Rakugaki camera” is stopped, and the screen returns to the selection screen as shown in FIG.

  In addition, when the “take” icon 212 is selected, a still image is generated by combining the image captured by the camera at the selected timing with the objects OBJ2 to OBJ4 “written” by the user. It is stored in the data memory 34 (FIG. 2) or the like.

  When the switch icon 214 is selected, the camera used for image capturing is switched between the inner camera 23 and the outer camera 25.

<Detailed processing of “Rakugaki Camera”>
Hereinafter, with reference to FIG. 12, FIG. 13, FIG. 37, and FIG. 38, detailed processing of the “graffiti camera” according to the present embodiment will be described. The examples shown in FIG. 12 and FIG. 13 are for explaining the processing for arranging the objects OBJ21 and OBJ22 shown in FIG. 9 and FIG. 10, and the examples shown in FIG. 37 and FIG. The internal processing in which the objects OBJ21 and OBJ22 shown in FIG.

  When touched on the screen with the touch pen 27 or the like, the touch panel 13 (FIGS. 1 and 2) outputs touch position data indicating coordinates of a position where an input is performed on the input surface. For example, as shown in FIG. 12A, when the first input point P1 is touched with the touch pen 27 or the like (touch-on), touch position data indicating the coordinates of the first input point P1 is obtained.

  Subsequently, a reference line is calculated based on the first input point P1. In the example shown in FIG. 12A, a reference line L1 that passes through the first input point P1 and is parallel to the horizontal direction of the paper surface is used. This reference line is for convenience in determining the direction (initial value) of the stamp (object), and can be arbitrarily selected as long as it reflects the position of the first input point P1. For example, a reference line passing through the first input point P1 and parallel to the vertical direction of the paper surface may be used.

  A first stamp is arranged at the first input point P1. As shown in FIG. 37 (a), an angle reference line SL1 and a center point C1 are determined in advance for each stamp according to its type. In the example shown in FIG. 37A, the object OBJ21 is arranged so that the center point C1 coincides with the first input point P1 (the position of the object OBJ21 is determined at this point). At this time, the object OBJ21 is arranged in an orientation such that its angle reference line SL1 coincides with the reference line L1 as an initial value.

  Further, as shown in FIG. 12B, when the touch pen 27 or the like moves to the second input point P2 while being in the touched state, a reference line L2 passing through the first input point P1 and the second input point P2 is calculated. The reference line L2 is updated in real time every time the coordinate value of the touch position data changes with the movement of the touch pen 27 or the like. That is, the reference line L2 changes according to the latest touch position until the orientation of the object OBJ21 is determined. Specifically, the reference line L2 is a line passing through the center position C1 of the arranged object OBJ21 and the latest touch position. Updated from time to time. As the reference line L2 is calculated (updated), as shown in FIG. 37A, the direction of the object OBJ21 is changed in real time so that the angle reference line SL1 coincides with the latest reference line L2. Is done. That is, the object OBJ21 rotates from the initial direction about the center point C1 by the size of the angle θ formed by the reference line L1 and the angle reference line SL1. In the state shown in FIG. 12B and FIG. 37A, the orientation of the object OBJ21 is in an undetermined state.

  In this undetermined state, the distance (Euclidean distance) ΔL1 between the second input point P2 and the first input point P1 is calculated in real time, and the size of the calculated distance ΔL1 is a predetermined threshold. It is compared with the value Th1. Then, when the distance ΔL1 exceeds the predetermined threshold value Th1, the direction of the object OBJ21 is determined.

  Specifically, as shown in FIG. 12C, the touch pen 27 and the like move from the first input point P1 to the third input point P3 while being in a touch state, and the first input point P1 and the third input at this time are moved. If it is determined that the distance ΔL1 between the point P3 exceeds the predetermined threshold Th1, the direction of the object OBJ21 is determined. That is, the orientation of the object OBJ21 is determined so that the angle reference line SL1 coincides with the reference line L3 passing through the first input point P1 and the third input point P3, as shown in FIG. That is, the direction of the object OBJ21 shifts from the unconfirmed state to the confirmed state.

  Note that the condition for shifting the object orientation from the unconfirmed state to the confirmed state (corresponding to the orientation confirmation condition) is that the above-described distance ΔL1 exceeds the predetermined threshold Th1. Instead, or in addition to this, (1) the duration of the touch operation with the touch pen 27 etc. has exceeded a predetermined time, (2) the touch operation with the touch pen 27 etc. has been made on an area outside the effective range (3) The operation buttons 14A to 14H may be selected, or (4) the touch-off may be used.

  According to the above process, the arrangement position and orientation of the first stamp are determined. Next, processing for arranging the second and subsequent stamps will be described.

  When the movement of the touch pen 27 and the like continues from the third input point P3 in the touched state, a new object OBJ22 is arranged at the same time as or after the direction of the object OBJ21 has shifted to the confirmed state.

  The condition for determining the orientation of the object OBJ21 and the condition for arranging the new object OBJ22 (corresponding to the second object display condition) may be the same or different from each other.

  FIG. 13A shows a case where the next object is placed at the same time as the previous object has shifted to the finalized state. That is, as shown in FIG. 12C, when the touch pen 27 or the like moves to the third input point P3 in the touched state and the orientation of the object OBJ21 shifts to the fixed state, at the same time, in FIG. As shown, a second stamp (object OBJ22) is arranged.

  The object OBJ22 is arranged at a position corresponding to the third input point P3 (touch coordinates when the condition for determining the direction of the object OBJ21 is satisfied). In the example shown in FIGS. 13A and 38A, the object OBJ22 is arranged so that the center point C2 coincides with the third input point P3 (at this time, the position of the object OBJ22 is determined). ). The reference line L3 is a line (in this case, a straight line) passing through the first input point P1 and the third input point P3. Further, as shown in FIG. 38A, the object OBJ22 is arranged in such an orientation that its angle reference line SL2 coincides with the reference line L3.

  On the other hand, FIG. 13B shows a case where the next object is arranged after the previous object shifts to the fixed state. In this case, the distance ΔL2 between the input point after the movement of the touch pen 27 and the like in the touched state and the first input point P1 is calculated in real time even after the transition of the object OBJ21 to the confirmed state, The calculated magnitude of the distance ΔL2 is compared with a predetermined threshold value Th2. The threshold value Th2 is set larger than the threshold value Th1 used to determine the determination of the orientation of the object OBJ21.

  Then, as shown in FIG. 13B, the touch pen 27 and the like move to the fourth input point P4 while in the touch state, and the distance ΔL2 between the first input point P1 and the fourth input point P4 at this time is If it is determined that the predetermined threshold value Th2 has been exceeded, a new object OBJ22 is placed. At this time, a reference line L4 passing through the first input point P1 and the fourth input point P4 is calculated, and the center point C2 of the object OBJ22 is the fourth as shown in FIGS. 13B and 38B. They are arranged so as to coincide with the input point P4 (at this time, the position of the object OBJ22 is determined). Further, as shown in FIG. 38B, the object OBJ22 is arranged in such a direction that its angle reference line SL2 coincides with the reference line L4 (at this time, the direction of the object OBJ is also determined).

  Further, after the object OBJ22 is arranged, the input point after the movement of the touch pen 27 etc. in the touched state and the input point at the timing when the second object OBJ22 is arranged (in the example shown in FIG. 13A, the third input point). Whether or not the third object OBJ23 is to be arranged is determined based on the positional relationship with P3 and the third input point P4) in the example shown in FIG. 13B.

  That is, for example, as shown in FIG. 13A, when the second object OBJ22 is arranged at the third input point P3, the touch pen 27 and the like remain in the touched state from the third input point P3. When the fifth input point P5 located far from the value Th1 is reached, the third object OBJ23 is arranged at the fifth input point P5 (see FIG. 13C). As shown in FIG. 38C, the object OBJ23 is arranged in such an orientation that its angle reference line SL3 coincides with the reference line L5.

  Alternatively, as shown in FIG. 13 (b), when the second object OBJ22 is arranged at the fourth input point P4, the position is separated from the fourth input point P4 by exceeding the threshold Th2. When it reaches, the third object OBJ23 is arranged at the position.

  Similarly, the second and subsequent objects OBJ are sequentially arranged by moving the touch pen 27 and the like in the touched state.

  Furthermore, in order to improve the operability for the user, it is preferable to provide a certain range of insensitivity when changing the orientation of an object in an undefined state. More specifically, as shown in FIG. 14, after the user touches on the first input point P1 with the touch pen 27 or the like and the object OBJ21 is arranged, the touch pen 27 or the like exists in the vicinity of the first input point P1. During this time, the orientation (initial value) of the object OBJ21 is maintained. That is, when the touch pen 27 or the like is within the dead zone DA centered on the first input point P1, the above-described processing for changing the orientation of the object OBJ21 in real time is not performed. Then, when the touch pen 27 or the like moves out of the insensitive range DA in the touched state, a process for changing the orientation of the object OBJ21 is started for the first time.

  As described above, when the user removes the touch pen 27 or the like from the screen, the object in the unconfirmed state shifts to the confirmed state. At this time, the position of the acquired touch pen 27 or the like may slightly change. By providing the insensitive range, it is possible to prevent the orientation of the object from changing due to such an operation not intended by the user. For example, this is effective when it is desired to arrange only one object in the initial state.

  In the above description, the configuration in which the objects OBJ21, OBJ22,... Are displayed at positions corresponding to the first input point P1, the second input point P2,. The objects OBJ21, OBJ22,... May be displayed at positions separated from P2 by a predetermined distance in a predetermined direction.

<Drawing process>
As described above, in game device 100 according to the present embodiment, an image photographed by a camera is displayed in real time, and the orientation of an object in an undetermined state is also real-time according to the position of an operation input by touch pen 27 or the like. It changes with. Therefore, a drawing process for performing such image display will be described with reference to FIG.

  FIG. 15 is a schematic diagram for describing a drawing process of game device 100 according to the first embodiment of the present invention. Referring to FIG. 15, game device 100 according to the present embodiment uses four layers 242, 244, 246, and 248 to generate video signals for screen display. Each of the layers 242, 244, 246 and 248 is realized by forming in the main memory 32 a memory area having a size corresponding to at least the resolution of the lower LCD 12.

  The first layer 242 is a memory area for displaying an image (still image or moving image) taken by the camera or an image (still image or moving image) read from the memory card 28 (FIG. 2) or the like. . The CPU 31 (FIG. 2) develops an image input from any one of the inner camera 23, the outer camera 25, and the memory card 28 and writes it in an area corresponding to the first layer 242 in the main memory 32. When a still image is input, it is only necessary to write it after raster data is developed. However, when a moving image is input, polygon processing or the like is performed in order to improve real-time display. May be used for rendering.

  The second layer 244 is a memory area for displaying an object arranged by the user “writing”. The CPU 31 reads character data and raster data of an object arranged according to a user operation from the memory card 29 or the like and writes it in an area corresponding to the second layer 244 in the main memory 32. As will be described later, since the data of the object in the undetermined state is rendered in the third layer 246, the data for only the object after shifting to the confirmed state is written in the second layer 244.

  The third layer 246 is a memory area for displaying an object in an undetermined state. Data for displaying the above-described stamp is typically stored in advance in the memory card 29 as polygon data. In response to a user operation, the CPU 31 reads polygon data of a necessary stamp and calculates coordinate values of each polygon constituting the stamp in real time. Then, the CPU 31 writes the result rendered by the calculated polygon in an area corresponding to the third layer 246 in the main memory 32.

  Further, when the object in the unconfirmed state shifts to the confirmed state, the CPU 31 transfers the image data on the third layer 246 at that time to a corresponding position in the second layer 244. That is, for an object in an indeterminate state, its image is dynamically generated using polygon processing. However, when the display is changed to a confirmed state and the display is no longer changed, the data for displaying the object is , Stored in the second layer 244.

  The fourth layer 248 is a memory area for displaying an icon for accepting a user operation. The CPU 31 writes data for displaying necessary icons in an area corresponding to the fourth layer 248 in the main memory 32 according to the function and operation mode selected by the user operation.

  An image obtained by combining the data stored in these layers 242, 244, 246 and 248 is displayed on the screen. In each of the layers 242, 244, 246 and 248, only pixels having data to be displayed are treated as effective, and pixels having no data to be displayed are treated as transparent. Therefore, for pixels handled as transparent in a certain layer, the data of the corresponding pixels in the lower layer is displayed on the screen.

  When the “take” icon 212 (FIG. 5) is selected, the CPU 31 generates a composite image based on the data stored in the first layer 242 and the second layer 244, and the generated composite The image is stored in the storage data memory 34 (FIG. 2) or the like.

<Input range>
In addition, the user input range may be limited to a part of the input surface of the touch panel 13. For example, as shown in FIG. 16, in the “graffiti camera” according to the present embodiment, an effective range 260 for an operation input by the user using the touch pen 27 or the like may be determined in advance in the process of placing a stamp. By defining such an effective range 260, it is possible to prevent the object from being “written” on an icon or the like for accepting a user operation.

  Further, as described above, as one of the conditions for shifting the object in the unconfirmed state to the confirmed state, a determination as to whether the operation input by the touch pen 27 or the like is within the effective range 260 may be included. That is, if any of the objects is in the unconfirmed state and the operation input by the touch pen 27 or the like is outside the valid range 260, the object is shifted to the confirmed state.

<Processing procedure>
Hereinafter, a processing procedure related to the “graffiti camera” according to the above-described embodiment will be described with reference to FIGS. 17 to 23. Note that the steps shown in FIGS. 17 to 23 are typically realized by the CPU 31 reading out the program stored in the memory card 29 to the main memory 32 and executing it.

(1. Function selection process)
FIG. 17 is a flowchart showing processing relating to function selection in game device 100 according to the first embodiment of the present invention. The process related to function selection shown in FIG. 17 is executed by the user selecting a predetermined icon from a menu screen (not shown) after the game apparatus 100 is turned on or the start button is pressed.

  Referring to FIG. 17, in step S <b> 2, CPU 31 displays a selection screen as shown in FIG. 4 on lower LCD 12. In subsequent step S <b> 4, the CPU 31 determines whether touch position data is input from the touch panel 13 via the I / F circuit 42. That is, the CPU 31 determines whether or not the user performs a touch operation with the touch pen 27 or the like. If touch position data has not been input (NO in step S4), the process of step S4 is repeated. On the other hand, if touch position data has been input (YES in step S4), the process proceeds to step S6.

  In step S <b> 6, the CPU 31 determines whether the coordinate value indicated by the touch position data is a value within the display range of any icon 150. That is, the CPU 31 determines whether any of the icons 150 has been selected. If the coordinate value indicated by the touch position data is a value within the display range of any icon 150 (YES in step S6), the process proceeds to step S8. On the other hand, if the coordinate value indicated by the touch position data is outside the display range of any icon 150 (NO in step S6), the process proceeds to step S10.

  In step S <b> 8, the CPU 31 updates the selection screen being displayed to display contents corresponding to the selected icon 150. That is, as shown in FIG. 4, for example, when the function of “Rakugaki Camera” is selected, the name “Rakugaki Camera” and the contents of each process are displayed as a preview. Then, the process returns to step S4.

  In step S <b> 10, the CPU 31 determines whether the coordinate value indicated by the touch position data is a value within the display range of the selection icon 152 or 154. That is, the CPU 31 determines whether the selection icon 152 or 154 has been selected. If the coordinate value indicated by the touch position data is a value within the display range of selection icon 152 or 154 (YES in step S10), the process proceeds to step S12. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of selection icons 152 and 154 (NO in step S10), the process proceeds to step S14.

  In step S <b> 12, the CPU 31 updates the displayed selection screen to display contents corresponding to the selected selection icon 152 or 154. Then, the process returns to step S4.

  In step S <b> 14, the CPU 31 determines whether the coordinate value indicated by the touch position data is a value within the display range of the “begin” icon 158. That is, the CPU 31 determines whether or not the “start” icon 158 has been selected. If the coordinate value indicated by the touch position data is a value within the display range of “begin” icon 158 (YES in step S14), the process proceeds to step S16. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of “begin” icon 158 (NO in step S14), the process proceeds to step S18.

  In step S16, the CPU 31 executes the selected function. Here, if “Rakugaki camera” is selected, the CPU 31 executes processing according to the flowcharts shown in FIGS. 18 and 19.

  In step S <b> 18, the CPU 31 determines whether the coordinate value indicated by the touch position data is a value within the display range of the “stop” icon 156. That is, the CPU 31 determines whether or not the “stop” icon 156 has been selected. If the coordinate value indicated by the touch position data is a value within the display range of the “stop” icon 156 (YES in step S18), the process ends. On the other hand, if the coordinate value indicated by the touch position data is outside the display range of “stop” icon 156 (NO in step S18), the process returns to step S4.

(2. “Rakugaki Camera” subroutine)
FIGS. 18 and 19 are flowcharts showing a subroutine process executed when “Rakugaku camera” is selected in step S16 shown in FIG.

  Referring to FIG. 18, first, in step S100, CPU 31 starts a drawing process subroutine shown in FIG. This drawing processing subroutine is a process for performing screen display with a “Rakugaki camera” as shown in FIGS. Note that the processing procedure shown in FIG. 20 is repeatedly executed at a predetermined cycle independently of the processing shown in FIGS. 18 and 19.

  In subsequent step S <b> 102, the CPU 31 writes data for displaying the icons 202 to 214 shown in FIG. 5 in an area corresponding to the fourth layer 248 in the main memory 32. That is, the CPU 31 displays an icon for accepting a user operation on the lower LCD 12.

  In subsequent step S <b> 104, the CPU 31 determines whether touch position data is input from the touch panel 13 via the I / F circuit 42. That is, the CPU 31 determines whether or not the user performs a touch operation with the touch pen 27 or the like. In other words, the CPU 31 determines whether a coordinate value input by a user operation on the touch panel 13 is detected. If touch position data has not been input (NO in step S104), the process of step S104 is repeated. On the other hand, if touch position data has been input (YES in step S104), the process proceeds to step S106.

  In step S <b> 106, the CPU 31 determines whether the coordinate value indicated by the touch position data is a value within the display range of the “pencil” icon 202. That is, the CPU 31 determines whether or not the “pencil” icon 202 has been selected. If the coordinate value indicated by the touch position data is within the display range of the “pencil” icon 202 (YES in step S106), the process proceeds to step S110. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of “pencil” icon 202 (NO in step S106), the process proceeds to step S116.

  In step S110, the CPU 31 sets the internal flag to the “pencil” mode. In the subsequent step S112, the CPU 31 writes data for displaying the selection submenu of the “pencil” mode in an area corresponding to the fourth layer 248 in the main memory 32. That is, the CPU 31 displays a submenu for selecting attributes (line thickness, line color, etc.) in the “pencil” mode on the lower LCD 12. Further, in step S114, the CPU 31 sets an attribute value used in the “pencil” mode in the internal flag in accordance with the user selection. Then, the process returns to step S104.

  In step S <b> 116, the CPU 31 determines whether the coordinate value indicated by the touch position data is a value within the display range of the “eraser” icon 204. That is, the CPU 31 determines whether or not the “eraser” icon 204 has been selected. If the coordinate value indicated by the touch position data is within the display range of “eraser” icon 204 (YES in step S116), the process proceeds to step S118. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of “eraser” icon 204 (NO in step S116), the process proceeds to step S120.

  In step S118, the CPU 31 sets the internal flag to the “eraser” mode. Then, the process returns to step S104.

  In step S <b> 120, the CPU 31 determines whether or not the coordinate value indicated by the touch position data is a value within the display range of the “stamp” icon 206. That is, the CPU 31 determines whether or not the “stamp” icon 206 has been selected. If the coordinate value indicated by the touch position data is a value within the display range of “stamp” icon 206 (YES in step S120), the process proceeds to step S122. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of “stamp” icon 206 (NO in step S120), the process proceeds to step S128.

  In step S122, the CPU 31 sets the internal flag to the “stamp” mode. In subsequent step S <b> 124, the CPU 31 writes data for displaying the selection submenu of the “stamp” mode in an area corresponding to the fourth layer 248 in the main memory 32. That is, the CPU 31 displays on the lower LCD 12 a submenu for selecting attributes (such as the type of stamp) in the “stamp” mode as shown in FIG. Further, in step S126, the CPU 31 sets the type used in the “stamp” mode in the internal flag according to the user selection. Then, the process returns to step S104.

  In step S <b> 128, the CPU 31 determines whether or not the coordinate value indicated by the touch position data is a value within the display range of the “all delete” icon 208. In other words, the CPU 31 determines whether or not the “Keep all” icon 208 has been selected. Then, if the coordinate value indicated by the touch position data is a value within the display range of “all delete” icon 208 (YES in step S128), the process proceeds to step S130. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of “all delete” icon 208 (NO in step S128), the process proceeds to step S132 (FIG. 19).

  In step S130, the CPU 31 resets (zero clears) the data stored in the second layer 244 in the main memory 32. That is, the CPU 31 erases all the objects arranged by being “written” by the user.

  In step S132, the CPU 31 determines whether or not the coordinate value indicated by the touch position data is a value within the effective range 260 (FIG. 16). That is, the CPU 31 determines whether or not the user has performed the “Rakugaki” operation. If the coordinate value indicated by the touch position data is within the effective range 260 (YES in step S132), the process proceeds to step S134. On the other hand, if the coordinate value indicated by the touch position data is a value outside effective range 260 (NO in step S132), the process proceeds to step S142.

  In step S134, the CPU 31 refers to the internal flag to determine the currently set mode. That is, the CPU 31 determines which of the “pencil” icon 202, the “eraser” icon 204, and the “stamp” icon 206 has been selected by the previous user operation. If the currently set mode is the “pencil” mode (“pencil” in step S134), the process proceeds to step S136, and the “pencil” mode subroutine process (FIG. 21) is executed. If the currently set mode is the “eraser” mode (“eraser” in step S134), the process proceeds to step S138, and the “eraser” mode subroutine process (FIG. 22) is executed. If the currently set mode is the “stamp” mode (“stamp” in step S134), the process proceeds to step S140, and the “stamp” mode subroutine process (FIG. 23) is executed.

  On the other hand, in step S <b> 142, the CPU 31 determines whether the coordinate value indicated by the touch position data is a value within the display range of the “take” icon 212. That is, the CPU 31 determines whether or not the “take” icon 212 has been selected. If the coordinate value indicated by the touch position data is a value within the display range of “take” icon 212 (YES in step S142), the process proceeds to step S144. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of “take” icon 212 (NO in step S142), the process proceeds to step S146.

  In step S144, the CPU 31 reads out data stored in areas corresponding to the first layer 242 and the second layer 244 in the main memory 32, and generates a composite image. Further, the CPU 31 writes the composite image in the storage data memory 34 or the like. Then, the process returns to step S104.

  In step S146, the CPU 31 determines whether or not the coordinate value indicated by the touch position data is a value within the display range of the switching icon 214. That is, the CPU 31 determines whether or not the switching icon 214 has been selected. If the coordinate value indicated by the touch position data is within the display range of switching icon 214 (YES in step S146), the process proceeds to step S148. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of switching icon 214 (NO in step S146), the process proceeds to step S150.

  In step S <b> 148, the CPU 31 switches the camera used for image shooting between the inner camera 23 and the outer camera 25. That is, the CPU 31 switches the source of the image input to the first layer 242 in the main memory 32 between the inner camera 23 and the outer camera 25. Then, the process returns to step S104.

  In step S <b> 150, the CPU 31 determines whether or not the coordinate value indicated by the touch position data is a value within the display range of the “stop” icon 210. That is, the CPU 31 determines whether or not the “quit” icon 210 has been selected. If the coordinate value indicated by the touch position data is within the display range of the “stop” icon 210 (YES in step S150), the CPU 31 ends the drawing processing subroutine shown in FIG. 20 (step S152). This process is terminated. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of “stop” icon 210 (NO in step S150), the process returns to step S104.

(3. Drawing processing subroutine)
FIG. 20 is a flowchart showing a drawing process subroutine process to be executed in step S100 shown in FIG.

  Referring to FIG. 20, in step S <b> 200, CPU 31 expands an image input from the selected camera (inner camera 23 or outer camera 25), and corresponds to the first layer 242 in main memory 32. Write to. That is, the CPU 31 updates the image captured by the camera.

  In the subsequent step S202, the CPU 31 combines the data stored in the first layer 242, the second layer 244, the third layer 246, and the fourth layer 248, respectively. The data stored in the second layer 244, the third layer 246, and the fourth layer 248 is associated with the execution of the subroutine processing shown in FIGS. 18 and 19 and the subroutine processing shown in FIGS. It is updated from time to time.

  In further subsequent step S204, CPU 31 renders (renders) an image on lower LCD 12 based on the combined data. Then, the process returns to step S200.

  The subroutine processing shown in FIG. 20 is started in step S100 shown in FIG. 18, and the execution is ended in step S152 shown in FIG.

(4. “pencil” mode processing subroutine)
FIG. 21 is a flowchart showing subroutine processing in the “pencil” mode executed in step S136 shown in FIG.

  Referring to FIG. 21, in step S300, based on the coordinate value indicated by the touch position data, the CPU 31 converts the pixel data of the second layer 244 in the main memory 32 corresponding to the operation input from the user into the internal flag. Change according to the set value. That is, the CPU 31 adds data indicating the object to be “written” to the second layer 244 according to the attribute value used in the “pencil” mode set in step S114 of FIG.

  In subsequent step S <b> 302, the CPU 31 determines whether or not input of touch position data from the touch panel 13 is continued via the I / F circuit 42. That is, the CPU 31 determines whether or not the user continues the touch operation with the touch pen 27 or the like. If the input of the touch position data is continued (YES in step S302), the process of step S300 is repeated. On the other hand, if the input of touch position data has not continued (NO in step S302), the process returns to step S104 in FIG.

(5. “Eraser” mode processing subroutine)
FIG. 22 is a flowchart showing a subroutine process of the “eraser” mode executed in step S138 shown in FIG.

  Referring to FIG. 22, in step S400, CPU 31 zero-clears the pixel data of second layer 244 in main memory 32 corresponding to the operation input from the user, based on the coordinate value indicated by the touch position data. That is, the CPU 31 erases a portion of the already arranged objects where the user touches the touch pen 27 or the like on the screen.

  In subsequent step S <b> 402, the CPU 31 determines whether or not input of touch position data from the touch panel 13 is continued via the I / F circuit 42. That is, the CPU 31 determines whether or not the user continues the touch operation with the touch pen 27 or the like. If the input of the touch position data is continued (YES in step S402), the process of step S400 is repeated. On the other hand, if the input of touch position data is not continued (NO in step S402), the process returns to step S104 in FIG.

(6. “Stamp” mode processing subroutine)
FIG. 23 is a flowchart showing subroutine processing in the “stamp” mode executed in step S140 shown in FIG.

  Referring to FIG. 23, in step S500, CPU 31 initializes (zero-clears) the first coordinate value and the second coordinate value, which are internal variables. In subsequent step S502, CPU 31 sets the coordinate value indicated by the touch position data to the first coordinate value. That is, the first coordinate value among the detected coordinate values is acquired. Here, the coordinate value immediately after the detection of the coordinate value is started (that is, the touch-on coordinate) is regarded as the first coordinate value. Then, the process proceeds to step S504.

  In step S504, the CPU 31 calculates a reference line passing through the first coordinate value set in step S502. In the subsequent step S506, the CPU 31 identifies the stamp object of the type selected in step S126 of FIG. 18 by referring to the internal flag, and displays data (typically polygon data) for displaying the selected stamp. Reading from the memory card 29. In further subsequent step S508, the CPU 31 displays the rendered result in the main memory 32 so that the selected stamp is arranged at a position based on the first coordinate value and in an orientation corresponding to the reference line. Write to the area corresponding to 3 layers 246. That is, in steps S506 and S508, processing for displaying a stamp (object) at a corresponding position on the lower LCD 12 is executed based on the first coordinate value. Then, the process proceeds to step S510.

  In step S <b> 510, the CPU 31 determines whether or not the input of touch position data from the touch panel 13 via the I / F circuit 42 is continued. That is, the CPU 31 determines whether or not the user continues the touch operation with the touch pen 27 or the like. In other words, it is determined whether or not the detection of coordinate values continues. If the input of touch position data continues (YES in step S510), the process proceeds to step S512.

  On the other hand, if the input of touch position data is not continued (NO in step S510), the process proceeds to step S522. That is, after the acquisition of the first coordinate value, on the condition that the detection of the coordinate value is interrupted, as described later, the process for determining the object in the undetermined state shown in step S522 is executed.

  In step S512, the CPU 31 sets the coordinate value indicated by the current touch position data as the second coordinate value. That is, the second coordinate value subsequent to the first coordinate value among the detected coordinate values is acquired. In the subsequent step S514, the CPU 31 determines whether or not the distance between the first coordinate value and the second coordinate value is larger than a threshold value indicating the dead range. That is, it is determined whether or not the coordinate value input while the coordinate value is continuously detected satisfies the first condition (corresponding to the direction change condition). If the distance between the first coordinate value and the second coordinate value is equal to or less than the threshold value indicating the dead range (NO in step S514), the processing in step S510 and subsequent steps is repeated.

  On the other hand, if the distance between the first coordinate value and the second coordinate value is larger than the threshold value indicating the dead range (YES in step S514), the process proceeds to step S516. By these processes, the coordinate value determined to satisfy the first condition is regarded as a valid second coordinate value.

  In step S516, the CPU 31 calculates a reference line that passes through the first coordinate value and the second coordinate value. In the subsequent step S518, the CPU 31 renders an area corresponding to the third layer 246 in the main memory 32 so that the arranged stamp is arranged in an orientation corresponding to the reference line newly calculated in step S516. Update with updated results. That is, the orientation of the object displayed on the lower LCD 12 is changed. Here, the orientation of the object is determined based on a line passing through the first coordinate value and the second coordinate value. Then, the process proceeds to step S520.

  In step S520, the CPU 31 determines whether or not the distance between the first coordinate value and the second coordinate value is greater than a predetermined threshold value Th1. That is, the CPU 31 determines whether or not a condition for shifting the object in the unconfirmed state to the confirmed state is satisfied. If the distance between the first coordinate value and the second coordinate value is greater than threshold value Th1 (YES in step S520), the process proceeds to step S522.

  On the other hand, if the distance between the first coordinate value and the second coordinate value is equal to or smaller than threshold value Th1 (NO in step S520), the processing in step S510 and subsequent steps is repeated. That is, the step of acquiring the second coordinate value and the step of changing the direction of the object are repeated while the detection of the coordinate value is continued. Thus, the orientation of the object is changed as needed every time the second coordinate value is updated until the condition for shifting the object in the unconfirmed state to the confirmed state is satisfied.

  In step S <b> 522, the CPU 31 writes the data stored in the area corresponding to the third layer 246 in the main memory 32 to the area in the second layer 244 in the main memory 32 and the area corresponding to the third layer 246. Is cleared to zero. That is, the CPU 31 shifts the object in the undetermined state to the confirmed state. Thus, when the condition for shifting the object in the unconfirmed state to the confirmed state is satisfied, the direction of the object is fixed.

  Note that after the condition for shifting to the confirmed state is satisfied, the orientation of the first object remains fixed regardless of the subsequent second coordinate value.

  In the subsequent step S524, the CPU 31 determines whether or not the input of touch position data from the touch panel 13 via the I / F circuit 42 is continued. That is, the CPU 31 determines whether or not the user continues the touch operation with the touch pen 27 or the like. If the input of the touch position data is continued (YES in step S524), the process proceeds to step S526. On the other hand, if the input of touch position data is not continued (NO in step S524), the process returns to step S104 in FIG.

  In step S526, the CPU 31 responds to the position where the new stamp is based on the second coordinate value (typically, the position of the second coordinate value) and the reference line newly calculated in step S516. The rendered result is written in an area corresponding to the second layer 244 in the main memory 32 so as to be arranged in the orientation. That is, further objects are displayed on the lower LCD 12 in accordance with changes in the input coordinate values. Even when the operation buttons 14A to 14H are selected, a further object may be displayed.

  In subsequent step S528, CPU 31 sets the coordinate value indicated by the touch position data to the first coordinate value. That is, the touch position data that becomes the reference for the new stamp is regarded as a new first coordinate value. Then, the process proceeds to step S530.

  In step S530, the CPU 31 determines whether or not the input of touch position data from the touch panel 13 via the I / F circuit 42 is continued. That is, the CPU 31 determines whether or not the user continues the touch operation with the touch pen 27 or the like. If the input of touch position data is continued (YES in step S530), the process proceeds to step S532. On the other hand, if the input of the touch position data is not continued (NO in step S530), the process returns to step S104 in FIG.

  In step S532, the CPU 31 sets the coordinate value indicated by the current touch position data as the second coordinate value. In subsequent step S534, CPU 31 determines whether or not the distance between the first coordinate value and the second coordinate value is greater than a predetermined threshold value Th1. That is, the CPU 31 determines whether or not the coordinate value input while the coordinate value is continuously detected satisfies the third condition for determining whether or not a new object should be placed.

  If the distance between the first coordinate value and the second coordinate value is greater than threshold value Th1 (YES in step S534), the process proceeds to step S536. On the other hand, if the distance between the first coordinate value and the second coordinate value is equal to or smaller than threshold value Th1 (NO in step S534), the processing in step S532 and subsequent steps is repeated.

In step S536, a reference line passing through the first coordinate value and the second coordinate value is calculated. In the subsequent step S538, the CPU 31 sets a new stamp at a position relative to the second coordinate value (typically at the position of the second coordinate value), and on the new reference line calculated in step S536. The rendered result is written in an area corresponding to the second layer 244 in the main memory 32 so as to be arranged in a corresponding direction. That is, the orientation of the newly displayed object is based on a line that passes through the coordinate value used to determine the position of the most recently displayed object and the coordinate value used to determine the position of the newly displayed object. Determined. And the process after step S528 is repeated.

  According to the present embodiment, the user can place an object at a desired position by a series of operations on the touch panel 13 and can change the object to a desired orientation. In this way, the user can freely arrange objects and change their orientations by so-called “one action”, so that the objects can be displayed more intuitively.

[Variation 1 of Embodiment 1]
In the above-described first embodiment, it is configured so that an undetermined state does not exist for the second and subsequent stamps. However, an undetermined state also exists for the second and subsequent stamps. It may be. In other words, the second and subsequent stamps may be changed in real time in accordance with the relationship between the position of the previously placed stamp and the position input by the user using the touch pen 27 or the like. Good. Hereinafter, with reference to FIG. 24, characteristic processing in the present modification will be described.

  Except for the processing described below, the hardware configuration, processing procedure, and the like are the same as those of the first embodiment described above, and detailed description thereof will not be repeated.

  For example, as shown in FIG. 24A, after the user touches the first input point P1 on the screen with the touch pen 27 or the like, the second input point P2 passes through the second input point P2 while touching the touch pen 27 or the like on the screen. Consider a case where the touch pen 27 or the like is moved to six input points P6. Further, it is assumed that the objects OBJ21 and OBJ22 are arranged at positions based on the first input point P1 and the second input point P2 by this user operation, respectively. It is assumed that the distance between the second input point P2 and the sixth input point P6 is equal to or less than a threshold value Th1 for moving the object to the finalized state.

  In this modification, in such a state, the object OBJ22 is maintained in an undetermined state. In other words, the orientation of the object OBJ22 is such that the first input point P1 that is a reference for placing the object OBJ21, the second input point P2 that is the reference for placing the object itself, the touch pen 27 at each time point, and the like. Is changed in real time with a line passing through the position input by the user (sixth input point P6 in the example shown in FIG. 24A) as a reference line. As a method for calculating the reference line passing through the three points as described above, Bezier approximation or the like can be typically used. Note that when determining such a reference line, the reference line may be calculated based on the reference positions of a plurality of objects placed ahead, not limited to one object placed ahead.

  Thereafter, as shown in FIG. 24B, when the user moves the touch pen 27 or the like to the seventh input point P7 where the distance from the second input point P2 exceeds the threshold Th1, the object OBJ22. Shifts from the unconfirmed state to the confirmed state. The orientation of the object OBJ22 that has shifted to the finalized state is determined based on a reference line that passes through the three points of the first input point P1, the second input point P2, and the seventh input point P3.

[Modification 2 of Embodiment 1]
In the first embodiment described above, the configuration is described in which the orientation of the object in the undetermined state is changed in real time every time the second input point P2 is updated. However, the object shifts from the undetermined state to the confirmed state. Until the condition for satisfying the condition is satisfied, the orientation of the object is maintained at the initial value, and after the condition is satisfied, the orientation of the object is set in the direction corresponding to the second input point P2 when the condition is satisfied. You may make it transfer to a definite state, after changing direction. After shifting to this finalized state, the object orientation is fixed to the changed orientation.

  In this modification, in the flowchart shown in FIG. 23 described above, the processes shown in steps S516 and S518 are executed prior to the execution of step S522. Since other processes are the same as those in the first embodiment, detailed description will not be repeated.

[Embodiment 2]
In the above-described first embodiment, the function that allows the user to freely “grab” the displayed image has been described. Hereinafter, in the second embodiment, a function of displaying an image like a “kaleidoscope” will be described.

  Since the external view and internal configuration of game device 100A according to the present embodiment are the same as those in FIGS. 1 and 2 described above, detailed description will not be repeated.

<Usage example of game device>
Game device 100A according to the present embodiment is also used in the same usage pattern as game device 100 according to the first embodiment. That is, for example, as shown in FIG. 3, an image (or a part thereof) taken by a camera (inner camera 23 or outer camera 25) mounted on game device 100A is spread like a kaleidoscope, Displayed on the LCD 12 in real time. The user can freely change the mode displayed on the lower LCD 12 by operating the touch pen 27 or the like. The displayed image may be an image (still image or moving image) stored in advance in the memory card 28 (FIG. 2) or the like.

  In the example shown in FIG. 3, the subject TRG is photographed using the outer camera 25, but the subject TRG may be photographed using the inner camera 23, and which camera is used. The user can arbitrarily select.

  FIG. 25 shows an example of a selection screen in game device 100A according to the second embodiment of the present invention. Referring to FIG. 25, game device 100A according to the present embodiment is equipped with a plurality of functions including a function capable of displaying the above-described image like a kaleidoscope, and the user selects as shown in FIG. Select the desired function on the screen.

  In the example shown in FIG. 25, a plurality of icons 150 corresponding to each function mounted on the game apparatus 100 are displayed at the top of the screen, and the user arbitrarily selects one of these icons 150 corresponding to a desired function. Can be selected. In addition, selection icons 152 and 154 are displayed on both sides of the screen. Each time the user selects the selection icon 152 or 154, the selected function is sequentially changed to the left or right according to the arrangement of the icons 150.

  When the user selects a function by such a method and selects the “Start” icon 158, the selected function is executed. When the “quit” icon 156 is selected, the screen returns to a menu screen (not shown).

Also, as shown in FIG. 25, in the preview area 160, the name of the selected function (in the example shown in FIG. 25, the function content corresponding to the icon 150 selected by the user is presented to the user). "Kagami Camera") and the contents of the processing are shown.

<Overview of Kagami Camera>
Hereinafter, with reference to FIGS. 26 to 30, an outline of the “camera camera” according to the present embodiment will be described.

  The “Kagami Camera” according to the present embodiment is used by the user for images taken by the camera, images stored in advance in the memory card 28, etc. (hereinafter, these images are also collectively referred to as “input images”). It is a function that can be displayed freely like a kaleidoscope. “Kagami Camera” mainly has a function to freely change the orientation and size of an image object obtained by extracting a part of an input image according to a user operation, and a screen to be displayed according to the changed image object. And a function that can be updated in real time.

  As shown in FIG. 26, in the “camera camera” mode, the input image is displayed in real time like a kaleidoscope, and icons 302 to 306 for selecting an operation on the display image are displayed at the top of the screen. Icons 310 to 314 for selecting various operations are displayed.

  When the user selects (touches) the “right / left symmetrical” icon 302, an input image and an image obtained by horizontally inverting the input image with respect to the screen are simultaneously displayed as shown in FIG. Furthermore, the orientation of the image displayed on the screen changes in real time in response to a user's touch operation with the touch pen 27 or the like.

  When the user touches the “triangle” icon 304, as shown in FIG. 26, a triangular portion is extracted from the input image as an image object OBJ5, and the image object OBJ5 is line-symmetric with respect to each adjacent side. Images that are developed sequentially are displayed.

  As shown in FIG. 27, when the user rotates and moves the touch pen 27 etc. on the screen, the image object OBJ5 is centered on a predetermined center point 308 by an angle corresponding to the touch operation. Rotate. That is, the orientation of the image object OBJ5 changes in real time according to the user input. As shown in FIG. 27, as the image object OBJ5 rotates, the position of the image developed around the image object OBJ5 also changes.

  Further, as shown in FIG. 28, when the user moves away from or approaches the center point 308 of the image object OBJ5 while touching the touch pen 27 or the like on the screen, the image object OBJ5 responds to the touch operation. To zoom in or out. That is, the size of the image object OBJ5 changes in real time according to the user input. As shown in FIG. 28, with the change in the size of the image object OBJ5, the arrangement and size of the image developed around the image object OBJ5 also changes.

  When the user touches the “square” icon 306, as shown in FIG. 29, a quadrangular portion is extracted from the input image as an image object OBJ6, and the image object OBJ6 is line-symmetric with respect to each adjacent side. An image that is developed sequentially is displayed.

  Also, as shown in FIG. 30, when the user rotates and moves the touch pen 27 etc. on the screen, the image object OBJ6 is centered on a predetermined center point 308 by an angle corresponding to the touch operation. Rotate. That is, the orientation of the image object OBJ6 changes in real time according to the user input. As the image object OBJ6 rotates, the position of the image developed around the image object OBJ6 also changes. Further, as in FIG. 28, when the user moves away from or approaches the center point 308 of the image object OBJ6 while touching the touch pen 27 or the like on the screen, the image object OBJ6 is moved according to the touch operation. Zoom in or out. As the size of the image object OBJ6 changes, the arrangement and size of the image developed around the image object OBJ6 also changes.

  As described above, the center point serving as the reference point for the rotation and / or size change of the image object is determined in advance. As will be described later, the degree of the rotation amount (rotation position) and the reduction / enlargement ratio (size) of the object depends on the relative relationship between the reference point and a vector indicating a change in coordinates accompanying the touch operation and the reference point. Calculated.

  Further, when the “quit” icon 310 is selected, the processing of the “Kagami Camera” is stopped, and the screen returns to the selection screen as shown in FIG.

  When the “take” icon 312 is selected, a still image corresponding to the image displayed at the selected timing is generated and stored in the storage data memory 34 (FIG. 2) or the like.

  When the switch icon 314 is selected, the camera used for image capturing is switched between the inner camera 23 and the outer camera 25.

<Detailed processing of Kagami Camera>
In the following, with reference to FIG. 31, detailed processing of the “camera camera” according to the present embodiment will be described. Note that the example shown in FIG. 31 explains the processing for the image object OBJ5 shown in FIG.

  In particular, in the “Kagami Camera” according to the present embodiment, the rotation amount and the size change amount of the image object are calculated according to the operation amount per unit time that the user performs on the screen with the touch pen 27 or the like. For this reason, when the user operates the touch pen 27 or the like, the rotation speed of the image object becomes faster or is greatly enlarged, so that the user can freely change the image object in response to his / her operation. You can get a sense of being done.

  More specifically, as in the example illustrated in FIG. 31, for example, it is assumed that the user moves the touch pen 27 and the like from the eighth input point P8 to the ninth input point P9 in a touched state. It is assumed that the user's operation of moving the touch pen 27 or the like (change in coordinate values) is performed during the calculation period Δt (so-called frame period). In the following description, it is assumed that the eighth input point is input at time t and the ninth input point is input at time t + Δt.

  The rotation amount and the size change amount of the image object OBJ5 are calculated according to the operation vector Vtp generated by the movement from the eighth input point P8 to the ninth input point P9. More specifically, the rotation amount and the size change amount of the image object OBJ5 are respectively calculated according to the circumferential component vθ and the radial component vr of the operation vector Vtp with respect to the center point 308 of the image object OBJ5.

  Regarding the circumferential direction and the radial direction, an arbitrary straight line passing through the center point 308 of the image object OBJ5 can be defined. However, in the example shown in FIG. 31, the center point 308 of the image object OBJ5 and the start point ( For the straight line L8 passing through the eighth input point P8), the operation vector Vtp is decomposed into a circumferential component and a radial component. That is, the operation vector Vtp is decomposed into a component (circumferential component vθ) perpendicular to the straight line L8 and a component (radial component vr) parallel to the straight line L8.

  Further, using the circumferential component vθ and the radial component vr, the rotation angle θ and the reduction / enlargement ratio α of the image object between a certain time t and the subsequent calculation period (t + Δt) are expressed by the following equations: Calculated.

θ (t + Δt) = θ (t) ± a × vθ (1)
α (t + Δt) = α (t) + b × vr (2)
However, the initial value of θ is 0, and the initial value of α is 1. Even when there is no touch operation, the previous values of θ and α are retained.

θ (t) and α (t) indicate the rotation angle and reduction / enlargement rate at time t.
θ (t + Δt) and α (t + Δt) indicate the rotation angle and reduction / enlargement ratio at time (t + Δt), and a and b indicate bias coefficients.

  Using θ and α determined in this way, an object image rotated by θ around the center point 308 and enlarged / reduced by α is displayed at the position of the center point 308. Note that θ is a rotation angle from the standard direction, and α is an enlargement / reduction ratio from the standard size.

  In the above example, the reduction / enlargement ratio α of the image object is obtained by using the radial component vr of the operation vector Vtp between one frame, but in other examples, the touch-on coordinates and the reduction / enlargement at the time of touch-on are obtained. As long as the rate α0 is stored and the touch operation continues thereafter, the difference Δd (t between the distance from the center point 308 of the image object OBJ5 to the touch-on coordinate and the distance from the center point 308 to the current touch coordinate. ) May be used. In this case, the reduction / enlargement ratio α (t) at time t is calculated by the following mathematical formula. Δd (t) is a negative value when the current touch coordinate is closer to the center point than the touch-on coordinate.

α (t) = α0 + b × Δd (t) (2) ′
In the above example, α (t) is always calculated on the basis of the touch-on time, so that accumulation of errors can be prevented. At this time, similarly, θ may be calculated based on the rotation angle θ0 at the time of touch-on using the difference between the rotation angle at the time of touch-on and the current time, or may be calculated using the previous equation (1). Also good.

  Note that the sign of the second term on the left side of the equation (1) is selected according to the relationship between the definition of the rotation position θ of the image object and the direction of the operation vector Vtp. That is, when the counterclockwise direction with respect to the center point 308 of the image object OBJ5 is determined as the positive direction of the rotation position θ, the operation vector Vtp is generated in the counterclockwise direction with respect to the center point 308. The sign of the second term on the left side of equation (1) is “+”. On the other hand, if the operation vector Vtp occurs in the clockwise direction with respect to the center point 308, the sign of the second term on the left side of equation (1) is “ -".

  Furthermore, as an example of a method for determining in which direction the operation vector Vtp is generated, determination based on the outer product of the operation vector Vtp and the vector Vs from the center point 308 of the image object OBJ5 to the eighth input point P8 is used. be able to. That is, in the example shown in FIG. 31, when the operation vector Vtp occurs in the counterclockwise direction, the outer product of the operation vector Vtp and the vector Vs takes a positive value, while the operation vector Vtp occurs in the clockwise direction. And the outer product of the operation vector Vtp and the vector Vs takes a negative value. Therefore, in which direction the operation vector Vtp is generated can be determined according to the sign of such an outer product.

  In the equation (2), the radial direction component Vr is defined as + (plus) when moving away from the center point 308 of the image object OBJ5 and − (minus) when approaching.

  Of course, for the straight line L9 passing through the center point 308 of the image object OBJ5 and the end point (the ninth input point P9) of the operation vector Vtp, the operation vector Vtp may be decomposed into a circumferential component and a radial component. . A straight line passing through the center point 308 and the intermediate point between the operation vectors Vtp may be used.

<Drawing process>
As described above, in game device 100A according to the present embodiment, a part of an image captured by a camera is extracted as an image object, and an image in which a plurality of extracted image objects are developed on the entire screen is displayed in real time. The Furthermore, when the user performs an operation while touching the touch pen 27 or the like on the screen, the image object changes in real time with a rotation angle and a size corresponding to the operation. Therefore, a drawing process for performing such image display will be described with reference to FIGS. 32 and 33. FIG.

  FIG. 32 is a schematic diagram for describing a drawing process of game device 100A according to the second embodiment of the present invention. FIG. 33 is a schematic diagram for describing an image object extraction process in game device 100A according to the second embodiment of the present invention.

  Referring to FIG. 32, game device 100A according to the present embodiment uses two layers 342 and 344 to generate a video signal for screen display. Each of the layers 342 and 344 is realized by forming in the main memory 32 a memory area having a size corresponding to at least the resolution of the lower LCD 12.

  The first layer 342 expands an image object extracted from an image (still image or moving image) captured by a camera or an image (still image or moving image) read from the memory card 28 (FIG. 2) or the like. This is a memory area for display.

  The CPU 31 (FIG. 2) develops the input image IMG input from any one of the inner camera 23, the outer camera 25, and the memory card 28, and extracts the image object OBJ5 from the input image IMG. Then, data obtained by developing the image object OBJ5 according to a predetermined rule is written in an area corresponding to the first layer 342 in the main memory 32. When a still image is input, it is only necessary to write it after raster data is developed. However, when a moving image is input, polygon processing or the like is performed in order to improve real-time display. May be used for rendering.

  The second layer 344 is a memory area for displaying an icon for accepting a user operation. The CPU 31 writes data for displaying necessary icons in an area corresponding to the second layer 344 in the main memory 32 in accordance with the function and operation mode selected by the user operation.

  An image obtained by combining the data stored in these layers 342 and 344 is displayed on the screen. In each of the layers 342 and 344, only pixels having data to be displayed are treated as effective, and pixels having no data to be displayed are treated as transparent. Therefore, for pixels handled as transparent in a certain layer, the data of the corresponding pixels in the lower layer is displayed on the screen.

  When the “take” icon 312 (FIG. 26) is selected, the CPU 31 stores the data stored in the first layer 342 in the storage data memory 34 (FIG. 2) or the like.

  As the above-described image object extraction processing, as shown in FIG. 33A, after extracting pixel data included in a predetermined region from the input image IMG, the extracted data is described above. The displayed size may be made variable by reducing or enlarging according to the reduction / enlargement ratio α.

  Alternatively, as another image object extraction process, as shown in FIG. 33 (b), an area for extracting pixel data from the input image IMG is reduced or enlarged according to the reduction / enlargement ratio α described above. May be. By adopting such processing, it is possible to reduce or enlarge the actual data (that is, the image of the subject TRG) contained in the image object while maintaining the same effective size of the image object.

<Processing procedure>
In the following, a processing procedure related to the “camera camera” according to the above-described embodiment will be described with reference to FIGS. 34 to 36. Each step shown in FIG. 34 to FIG. 36 is typically realized by the CPU 31 reading out the program stored in the memory card 29 to the main memory 32 and executing it.

(1. Function selection process)
Also in game device 100A according to the present embodiment, processing related to function selection similar to that in FIG. 17 described above is executed.

  In game device 100A according to the present embodiment, in step S8 shown in FIG. 17, as shown in FIG. 25, for example, when the function of “camera camera” is selected, the name “camera camera” and each process. The content (in the example shown in FIG. 25, a left-right symmetric mode) is displayed as a preview.

  On the other hand, if “camera camera” is selected in step S <b> 16, the CPU 31 executes processing according to the flowcharts shown in FIGS. 34 and 35.

  Since other steps are the same as those in the first embodiment, detailed description will not be repeated.

(2. “Kagami Camera” subroutine)
FIG. 34 and FIG. 35 are flowcharts showing a subroutine process executed when the “camera camera” is selected in step S16 shown in FIG.

  Referring to FIGS. 34 and 35, first, in step S600, CPU 31 initializes (zero-clears) the previous coordinate value and the current coordinate value, which are internal variables.

  In subsequent step S602, CPU 31 starts a drawing processing subroutine shown in FIG. This drawing processing subroutine is a process for displaying a screen with a “camera camera” as shown in FIGS. Note that the processing procedure shown in FIG. 36 is repeatedly executed at a predetermined cycle independently of the processing shown in FIGS. 34 and 35.

  In further subsequent step S604, the CPU 31 extracts pixel data included in a predetermined region (initial value) from the input image from the selected camera (the inner camera 23 or the outer camera 25). An image object (initial value) is generated. In further subsequent step S606, the CPU 31 generates display data in which the image object (initial value) generated in step S604 is expanded on the entire screen at a predetermined rotational position θ and reduction / enlargement ratio α, and the main memory 32 The area corresponding to the first layer 342 is written. Then, the process proceeds to step S608.

  In the subsequent step S608, the CPU 31 writes data for displaying the icons 302 to 314 shown in FIG. 26 in an area corresponding to the second layer 344 in the main memory 32. That is, the CPU 31 displays an icon for accepting a user operation on the lower LCD 12.

  As a result of the processing in steps S602 to S608 as described above, the initial screen of the “camera camera” mode is displayed.

  In subsequent step S610, CPU 31 determines whether touch position data is input from touch panel 13 via I / F circuit 42 or not. That is, the CPU 31 determines whether or not the user performs a touch operation with the touch pen 27 or the like. If touch position data has not been input (NO in step S610), the process of step S610 is repeated. On the other hand, if touch position data has been input (YES in step S610), the process proceeds to step S612.

  In step S <b> 612, the CPU 31 determines whether the coordinate value indicated by the touch position data is a value within the display range of the “right / left symmetrical” icon 302. That is, the CPU 31 determines whether or not the “symmetrical” icon 302 has been selected. If the coordinate value indicated by the touch position data is a value within the display range of “right / left symmetrical” icon 302 (YES in step S612), the process proceeds to step S614. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of “symmetrical” icon 302 (NO in step S612), the process proceeds to step S616.

  In step S614, the CPU 31 sets the internal flag to the “right / left symmetrical” mode. Then, the process returns to step S610.

  In step S <b> 616, the CPU 31 determines whether the coordinate value indicated by the touch position data is a value within the display range of the “triangle” icon 304. That is, the CPU 31 determines whether or not the “triangle” icon 304 has been selected. If the coordinate value indicated by the touch position data is a value within the display range of “triangle” icon 304 (YES in step S616), the process proceeds to step S618. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of “triangle” icon 304 (NO in step S616), the process proceeds to step S620.

  In step S618, the CPU 31 sets the internal flag to the “triangular” mode. Then, the process returns to step S610.

  In step S 620, CPU 31 determines whether the coordinate value indicated by the touch position data is a value within the display range of “square” icon 306. That is, the CPU 31 determines whether or not the “square” icon 306 has been selected. If the coordinate value indicated by the touch position data is a value within the display range of “square” icon 306 (YES in step S620), the process proceeds to step S622. On the other hand, if the coordinate value indicated by the touch position data is outside the display range of “square” icon 306 (NO in step S620), the process proceeds to step S624.

  In step S622, the CPU 31 sets the internal flag to the “square” mode. Then, the process returns to step S610.

  In step S624, the CPU 31 determines whether the coordinate value indicated by the touch position data is a value within the display range of the “take” icon 312. That is, the CPU 31 determines whether or not the “take” icon 312 has been selected. If the coordinate value indicated by the touch position data is within the display range of “take” icon 312 (YES in step S624), the process proceeds to step S626. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of “take” icon 312 (NO in step S624), the process proceeds to step S628.

  In step S626, the CPU 31 reads data stored in an area corresponding to the first layer 342 in the main memory 32, and writes it in the storage data memory 34 or the like. Then, the process returns to step S610.

  In step S628, the CPU 31 determines whether or not the coordinate value indicated by the touch position data is a value within the display range of the switching icon 314. That is, the CPU 31 determines whether or not the switching icon 314 has been selected. If the coordinate value indicated by the touch position data is a value within the display range of switching icon 314 (YES in step S628), the process proceeds to step S630. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of switching icon 314 (NO in step S628), the process proceeds to step S632.

  In step S <b> 630, the CPU 31 switches the camera used for image shooting between the inner camera 23 and the outer camera 25. That is, the CPU 31 switches the source of the input image between the inner camera 23 and the outer camera 25. Then, the process returns to step S610.

  In step S <b> 632, the CPU 31 determines whether the coordinate value indicated by the touch position data is a value within the display range of the “stop” icon 310. That is, the CPU 31 determines whether or not the “quit” icon 310 has been selected. If the coordinate value indicated by the touch position data is within the display range of “stop” icon 310 (YES in step S632), CPU 31 ends the drawing processing subroutine shown in FIG. 36 (step S634). This process is terminated. On the other hand, if the coordinate value indicated by the touch position data is a value outside the display range of “stop” icon 210 (NO in step S632), the process proceeds to step S636 shown in FIG. That is, the processing in step S636 and subsequent steps is executed when the user touches a position other than the icons 301 to 314 on the screen with the touch pen 27 or the like.

  In step S636, the CPU 31 determines whether a valid value other than zero is set for the current coordinate value. That is, the CPU 31 determines whether or not the user has touched a position other than the icons 301 to 314 on the screen with the touch pen 27 or the like in the previous calculation cycle.

  If a valid value other than zero is not set for the coordinate value this time (NO in step S636), the process proceeds to step S638. In step S638, the CPU 31 sets the coordinate value indicated by the touch position data as the previous coordinate value and the current coordinate value, respectively. Then, the process proceeds to step S650. That is, if the user has not performed an input operation for instructing rotation and / or size change of the image object in the previous calculation cycle, in the calculation cycle immediately after the input operation, the rotation position θ and the reduction / reduction of the image object are performed. The enlargement ratio α is not changed.

  On the other hand, if a valid value other than zero is set for the current coordinate value (YES in step S636), the process proceeds to step S640. In step S640, the CPU 31 sets the previous coordinate value to the current current coordinate value, and then sets the coordinate value indicated by the touch position data to the current coordinate value. Then, the process proceeds to step S642. That is, when any input operation is performed by the user during the previous calculation cycle to the current calculation cycle, processing relating to rotation and / or size change of the image object is executed.

  In step S642, the CPU 31 calculates an operation vector Vtp from the previous coordinate value to the current coordinate value. That is, a change in coordinate value input by an operation on the touch panel 13 is detected.

  In the subsequent step S644, the CPU 31 calculates a vector Vs from the center point of the arranged image object to the previous coordinate value. In further subsequent step S646, CPU 31 calculates the outer product of operation vector Vtp and vector Vs, and determines the rotation direction in which operation vector Vtp is generated based on the sign (positive or negative) of the calculated outer product. Then, the process proceeds to step S648.

  In step S648, the CPU 31 decomposes the operation vector Vtp into a circumferential component Vθ and a radial component Vr. That is, the circumferential component Vθ (first variation component) and the radial component Vr (second variation component) corresponding to the change in the coordinate value are acquired.

  In subsequent step S650, CPU 31 calculates rotation position θ and reduction / enlargement ratio α of the image object based on circumferential component Vθ and radial component Vr calculated in step S648, respectively. Then, the process proceeds to step S650.

  In step S650, the CPU 31 extracts image data by extracting pixel data included in an area corresponding to the set mode from the input image from the selected camera (the inner camera 23 or the outer camera 25). Update. In further subsequent step S652, the CPU 31 generates display data in which the image object updated in step S650 is expanded on the entire screen at the current rotation position θ and reduction / enlargement ratio α, and the first layer 342 in the main memory 32 is generated. Write in the area corresponding to. That is, the image included in the image object is displayed on the entire screen with the image object as the center. Then, the process proceeds to step S654.

  In step S654, the CPU 31 waits until the execution timing of the next calculation cycle. Thereafter, the process returns to step S610. By this iterative process, the display image obtained by developing is sequentially updated in accordance with the change in the rotation position (orientation) or reduction / enlargement ratio (size) of the image object.

(3. Drawing processing subroutine)
FIG. 36 is a flowchart showing a drawing process subroutine process to be executed in step S602 shown in FIG.

  Referring to FIG. 36, in step S700, CPU 31 combines the data stored in first layer 342 and second layer 344, respectively. Note that the data stored in the first layer 342 is updated as needed in accordance with the execution of the subroutine processing shown in FIGS. 34 and 35 described above.

  In further subsequent step S702, CPU 31 renders (renders) an image on lower LCD 12 based on the combined data. Then, the process returns to step S700.

  The subroutine processing shown in FIG. 36 is started in step S602 shown in FIG. 34, and the execution is ended in step S634 shown in FIG.

[Modification of Embodiment 2]
In the above-described second embodiment, as illustrated in FIG. 31, the processing for determining the rotation amount of the image object according to the circumferential component Vθ of the operation vector Vtp is illustrated, but with respect to the reference point of the object The object may be rotated according to the angle formed by both vertices of the operation vector Vtp.

  That is, in FIG. 31, the amount of change per unit period of the rotational position θ of the object is calculated according to the angle formed by the eighth input point P8 and the ninth input point P9 with respect to the center point 308 of the object OBJ5. May be. In other words, the change amount of the orientation of the object is determined according to the angle formed by the two coordinate values before and after the change of the coordinate value input with respect to the reference point.

  Since other processes are the same as those in the second embodiment described above, detailed description will not be repeated.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  11 Lower housing, 12 Lower LCD, 13 Touch panel, 14A-14K Operation buttons, 15A 1st LED, 15B 2nd LED, 15C 3rd LED, 16 Microphone hole, 21 Upper housing, 22 Upper LCD, 23 Inner camera, 24 sound Hole, 25 Outside camera, 26 4th LED, 27 Touch pen, 28, 29 Memory card, 32 Main memory, 33 Memory control circuit, 34 Storage data memory, 35 Preset data memory, 36, 37 Memory card I / F, 38 wireless communication module, 39 local communication module, 41 power supply circuit, 42 interface circuit (I / F circuit), 43 microphone, 44 amplifier, 100, 100A game device.

Claims (6)

An image processing program executed by a computer capable of using an input unit and a display unit, wherein the image processing program detects a change in coordinate values continuously input to the computer by an operation on the input unit Steps,
Depending on the locus on the display means corresponding to the change of the coordinate values, and table Shimesuru display step the object,
A direction determining step for determining a direction of the object according to a change in the coordinate value corresponding to a locus on the display unit after the object is displayed ;
Wherein the display step, in accordance with the trajectory on the display means corresponding to the change of the coordinate value after the orientation of the object is determined, that displays a different object from that of the object, an image processing program. The image processing program is stored in the computer.
The image processing program according to claim 1, further executing a control step of repeating display by the display step and determination by the orientation determination step while the coordinate value is changed. In the display step, an object is displayed at a position on the display unit corresponding to a predetermined coordinate value among coordinate values continuously input by an operation on the input unit,
Orientation of the object is determined based on the coordinate value is input after the coordinate values and the coordinate values corresponding to the object, an image processing program according to claim 1 or 2. The image processing program according to claim 3 , wherein the orientation of the object is changed in real time until a distance between a coordinate value corresponding to the object and a coordinate value input after the coordinate value becomes equal to or greater than a threshold value. An image processing apparatus in which input means and display means can be used,
Detecting means for detecting a change in coordinate values continuously input by an operation on the input means;
Depending on the locus on the display means corresponding to the change of the coordinate values, and a table Shimesuru object display means objects,
Direction determining means for determining the orientation of the object in accordance with a change in the coordinate value corresponding to a trajectory on the display means after the object is displayed ;
The display means, in accordance with the trajectory on the display means corresponding to the change of the coordinate value after the orientation of the object is determined, that displays a different object from that of the object, the image processing apparatus. A detection step of detecting a change in coordinate values continuously input by an operation on the input means;
Depending on the locus of the display means corresponding to the change of the coordinate values, and a table Shimesuru object display step the object,
A direction determining step of determining a direction of the object according to a change in the coordinate value corresponding to a locus on the display unit after the object is displayed ,
The object displaying step, in response to the locus on the display means corresponding to the change of the coordinate value after the orientation of the object is determined, that displays a different object from that of the object, an image processing method.

Images