JP6352766B2 - Information processing apparatus, information processing program, and information processing method - Google Patents

Description

  The present invention relates to an information processing apparatus, an information processing program, and an information processing method, and more particularly, to an information processing apparatus, an information processing program, and an information processing method that display, for example, characters handwritten using a touch panel on a display.

  An example of a conventional information processing apparatus of this type is disclosed in Patent Document 1. The image processing apparatus disclosed in Patent Document 1 displays an icon (button) or the like to which an enlargement or reduction function is assigned in order to perform an enlargement or reduction process on the entire screen. And the method of enlarging and reducing the whole screen when a user performs a predetermined operation after selecting the icon is disclosed.

JP 2006-331263 A;

  In this conventional information processing apparatus, when a handwritten character, figure, symbol, etc. drawn is corrected, if the character is small and the space between characters or line is narrow, the screen is enlarged and only the necessary part is corrected. A possible use is to restore the entire screen to its original size.

  That is, in the conventional information processing apparatus, in order to enlarge or reduce the screen, at least a step of selecting an enlargement button, a step of enlarging (setting an enlargement ratio), and a step of selecting a function for correction by user operation A step of correcting and a step of releasing the enlarged display are executed.

  As described above, in order to enlarge and correct the screen, it is necessary to perform many steps, and the user has a lot of trouble and the operation is troublesome.

  Therefore, a main object of the present invention is to provide a novel information processing apparatus, information processing program, and information processing method.

  Another object of the present invention is to provide an information processing apparatus, an information processing program, and an information processing method that can be easily corrected.

  A first invention is an information processing apparatus for displaying a handwritten image handwritten using a touch panel provided in association with a display unit on a display surface of the display unit, the coordinate acquisition unit, the first slide detection unit, Second slide detection means, range setting means, and enlarged display means are provided. The coordinate acquisition means acquires coordinates corresponding to the position on the display surface designated by the user's input operation. The first slide detection means detects the first slide by a plurality of touches based on the coordinates acquired by the coordinate acquisition means. The second slide detection means detects the second slide in a direction different from the first slide following the first slide based on the coordinates acquired by the coordinate acquisition means. The range setting means sets a designated range including a part or all of the handwritten image designated in the first slide when the second slide is detected by the second slide detection means. Then, when the second slide is detected by the second slide detection means, the enlargement means enlarges and displays the handwritten image included in the designated range according to the movement amount of the second slide in a state where it can be edited.

  According to the first invention, a designated range including part or all of the handwritten image designated in the first slide is set, and the designated range is edited when the second slide is detected by the second slide detecting means. Since it is in a possible state and is enlarged and displayed according to the amount of movement of the second slide, it is possible to enlarge and correct a part of the designated screen simply by sliding. That is, it can be easily corrected.

  The second invention is an information processing apparatus subordinate to the first invention, and further includes an enlargement canceling unit that cancels the enlarged display of the designated range when touched off after the second slide is finished.

  In the second invention, when the touch-off is performed after the second slide is finished, the enlarged display of the designated range is canceled, so that the drawn handwritten image is enlarged and corrected, and then easily restored to the original size. Can do.

  A third invention is an information processing apparatus subordinate to the first or second invention, and the range setting means sets the size of the designated range according to the locus of the first slide.

  According to the third aspect, since the size of the designated range is set according to the trajectory of the first slide, the designated range to be enlarged can be freely set by a user's touch input.

  A fourth invention is an information processing apparatus according to any one of the first to third inventions, and detects a predetermined enlargement ratio fixing operation after the second slide is detected by the second slide detecting means. The apparatus further includes a fixing operation detecting unit, and an enlarging rate fixing unit that fixes the enlarging rate of the designated range displayed in an enlarged manner by the enlarging unit when the enlargement rate fixing operation is detected by the fixing operation detecting unit.

  According to the fourth invention, when the enlargement ratio fixing operation is detected, the enlargement ratio of the designated range that is enlarged and displayed by the enlargement means is fixed, so that it becomes easier to correct the handwritten image in the enlarged display state, Usability of the information processing apparatus can be improved.

  A fifth invention is an information processing apparatus according to the fourth invention, and the enlargement ratio fixing operation includes an operation in which a plurality of touches continuously indicate the same position for a predetermined time.

  According to the fifth aspect, when a plurality of touches indicate the same position continuously for a predetermined time, the enlargement ratio of the designated range to be enlarged is fixed, so that the enlargement ratio of the designated range can be easily fixed. Can do.

  A sixth invention is an information processing apparatus according to the fourth invention, and the enlargement ratio fixing operation includes an operation of touching a specified range enlargedly displayed by the enlargement means separately from a plurality of touches.

  According to the sixth aspect of the present invention, the enlargement ratio of the designated range to be enlarged is fixed when touched separately from the plurality of touches in the designated range to be enlarged, so that the enlargement ratio of the designated range can be easily set. Can be fixed.

  A seventh invention is an information processing apparatus subordinate to the first to sixth inventions, and has a predetermined function for editing the range of the designated range in the vicinity of the designated range enlarged and displayed by the magnifying means. An edit icon display means for displaying an edit icon to be exhibited is further provided.

  According to the seventh invention, an edit icon that performs a predetermined function for editing the range of the designated range is displayed in the vicinity of the enlarged designated range, so that the handwritten image to be enlarged can be easily corrected. can do.

  An eighth invention is an information processing program for a computer that displays a handwritten image handwritten using a touch panel provided in association with the display means on the display surface of the display means, and indicates the computer by a user input operation A coordinate acquisition unit that acquires coordinates corresponding to the position on the display surface, a first slide detection unit that detects a first slide by a plurality of touches, and a coordinate acquisition unit based on the coordinates acquired by the coordinate acquisition unit; When the second slide is detected by the second slide detecting means and the second slide detecting means for detecting the second slide in a direction different from the first slide following the first slide based on the acquired coordinates. A range setting means for setting a specified range including a part or all of the handwritten image specified in the first slide, and a second When the second slide is detected by the ride detecting means can edit the handwritten image included in the specified range, to function as a magnifying means for magnify the image in accordance with the moving amount of the second slide.

  A ninth invention is an information processing method for a computer that displays a handwritten image handwritten using a touch panel provided in association with the display means on a display surface of the display means. The coordinates corresponding to the designated position on the display surface are acquired, the first slide by a plurality of touches is detected based on the acquired coordinates, and the first slide is detected following the first slide based on the acquired coordinates. A second slide in a direction different from one slide is detected, and when the second slide is detected, a designated range including a part or all of the handwritten image designated in the first slide is set, and the second When a slide is detected, the handwritten image included in the specified range is displayed in an enlarged manner according to the amount of movement of the second slide in a state where it can be edited.

  In each of the eighth and ninth inventions, similarly to the first invention, the drawn handwritten image can be easily enlarged.

  According to the present invention, it is possible to magnify and correct a part of the designated screen simply by sliding. That is, it can be easily corrected.

FIG. 1 is a block diagram showing an electrical configuration of an information processing apparatus according to the first embodiment of the present invention. 2A to 2D are illustrative views showing an operation example and a part of a change in the touch screen when a handwritten image is enlarged and corrected. FIGS. 3A to 3D are illustrations showing an example of an operation and a part of a change in the touch screen when the handwritten image is enlarged and corrected, following FIG. 2D. FIG. 4 is an illustrative view showing one example of a memory map of the RAM shown in FIG. FIG. 5 is an illustrative view for explaining setting of a designated range and expansion of the designated range using the main area 400 and the correction area 410 provided in the VRAM. FIG. 6 is a flowchart showing a part of an example of information processing of the CPU shown in FIG. FIG. 7 is another part of the information processing of the CPU shown in FIG. 1, and is a flowchart subsequent to FIG. FIG. 8 is a flowchart showing a part of information processing of the CPU in the second embodiment. FIGS. 9A and 9B are illustrative views showing an example of a touch screen when a handwritten image is enlarged and displayed in the third embodiment.

[First embodiment]
FIG. 1 is a block diagram showing an example of an electrical configuration of an information processing apparatus according to an embodiment of the present invention.

  Referring to FIG. 1, information processing apparatus 10 according to the first embodiment of the present invention includes a CPU 12. A RAM 14, a touch panel control circuit 16, and a drawing control circuit 18 are connected to the CPU 12 via a bus 30. A touch panel 20 is connected to the touch panel control circuit 16, and a display 22 is connected to the drawing control circuit 18.

  In the first embodiment, a case where the information processing apparatus 10 is applied to a tablet terminal will be described. However, the information processing apparatus 10 is applied not only to a tablet terminal but also to a relatively small information device or electronic device such as a smartphone or a PC. However, the present invention may be applied to a relatively large information device or electronic device such as an electronic blackboard. The information processing apparatus 10 draws (displays) handwritten characters, figures, symbols, and the like on the display 22 in accordance with handwriting input.

  In the first embodiment, a case where the touch panel 20 is used as an example of the input unit will be described. However, as an input unit other than the touch panel 20, for example, a touch pad may be used. In addition to the touch panel 20, the information processing apparatus 10 may be provided with a hardware key such as an operation panel or a hardware keyboard as an input means.

  Returning to FIG. 1, the CPU 12 governs overall control of the information processing apparatus 10. The RAM 14 is used as a work area and a buffer area for the CPU 12.

  The touch panel control circuit 16 applies necessary voltage and the like to the touch panel 20, detects a touch operation (touch input) within the touch effective range of the touch panel 20, and outputs touch coordinate data indicating the position of the touch input to the CPU 12. Output to.

  The touch panel 20 is a general-purpose touch panel, and an arbitrary system such as an electrostatic capacity system, an electromagnetic induction system, a resistance film system, and an infrared system can be used. In the first embodiment, as the touch panel 20, a capacitive touch panel is provided on the display surface of the display 22.

  The drawing control circuit 18 includes a GPU, a VRAM, and the like. Under the instruction of the CPU 12, the GPU displays a screen on the display 22 using handwritten input data 332 and image generation data 334 (see FIG. 6) stored in the RAM 14. Screen data for displaying (a touch screen 100 described later) is generated in the VRAM, and the generated screen is displayed on the display 22. As the display 22, for example, an LCD or an EL (Electro-Luminescence) display can be used.

  In the information processing apparatus 10 having such a configuration, in the handwriting input mode, the user uses the touch panel 20 to input characters, figures, symbols, and the like (hereinafter sometimes referred to as “characters”) by handwriting (touch input). Then, the touch panel control circuit 16 detects the touch input and outputs touch coordinate data corresponding to the touch position to the CPU 12. The CPU 12 draws (displays) handwritten characters on the display 22 based on the touch coordinate data output from the touch panel control circuit 16. That is, under the instruction of the CPU 12, handwritten characters and the like are drawn on the VRAM in the drawing control circuit 18, and image data corresponding to an image including the handwritten characters and the like drawn on the VRAM is output to the display 22. Therefore, an image including characters handwritten by the user is displayed on the display 22. Hereinafter, in this specification, an image including handwritten characters and the like is referred to as a “handwritten image” on the assumption that the user handwrites characters and the like.

  FIGS. 2A to 2D are illustrative views showing an example of operation when a handwritten image is enlarged and corrected, and a part of a change in the touch screen 100. FIG. FIGS. 3A to 3D are illustrative views showing an operation example and a part of the change of the touch screen 100 when the handwritten image following FIG. 2D is enlarged and corrected.

  For example, in the handwriting input mode, as shown in FIGS. 2A to 2D and FIGS. 3A to 3D, the touch screen 100 is displayed on the display 22. However, characters and the like are not drawn on the display 22 when the handwriting input mode is started. As described above, the touch panel 20 is provided on the display surface of the display 22 (the same applies to FIGS. 8 and 9). The same applies to the case where the touch screen 100 is displayed.

  Although illustration is omitted, on the touch screen 100, icons (function buttons) each for performing a predetermined function and icons (attribute buttons) for setting drawing attributes such as a pen icon and an eraser icon are displayed. . When the pen icon is selected (touched), the input mode is set, and characters including dots and lines can be handwritten using the user's fingers or a dedicated pen. When the eraser icon is selected, a mode for erasing the handwritten image is set, and the portion of the handwritten image that the user traces with a finger or a dedicated pen is erased. The attribute button is a button or icon for selecting (setting) the line type, line color, and line width (thickness). In addition, icons for selecting functions other than the above (opening, saving, restoring, etc. a new page) are also displayed.

  Note that these icons are displayed or hidden on the touch screen 100 in accordance with a user operation.

  For example, the user operates the touch panel 20 with fingers. The operation (input) using the touch panel 20 includes tap (short press), slide (drag), flick, long touch (long press), etc. In the first embodiment, these are “touch input” or simply Sometimes referred to as "input". Further, changing from a state where the touch panel 20 is not touched to a state where the touch panel 20 is touched is referred to as touch-on, and changing from a state where the touch panel 20 is touched to a state where the touch panel 20 is not touched is referred to as touch-off. For continuous touch input, that is, input by sliding or flicking, the touch panel 20 outputs touch coordinate data corresponding to the current touch position at a cycle shorter than a predetermined cycle. For example, the predetermined period is 1 to several frames, and one frame is 1/30 second or 1/60 second.

  In a general tablet terminal, when a user handwrites a character, a figure, a symbol, or the like, a line that follows a locus for handwritten input is displayed (drawn) on the touch screen 100. That is, the handwritten image is displayed on the touch screen 100.

  As can be seen from FIG. 2A, when a user handwrites a character or the like, it may be erroneously written. In this example, when the user writes Roman letters in alphabetical order from the upper left, “EFGH” is written on the second line, but “EYGH” is erroneously written. When correcting such an error, generally, when the user touches an eraser icon, the eraser function is executed, and an eraser cursor is displayed at a position where the user is touching with a finger. When the user traces the touch screen 100 with his / her finger, the eraser cursor is moved according to the movement of the finger (touch position), and the point or line (handwritten) of the portion where the eraser cursor (user's finger or dedicated pen) is moved. Image) is deleted. When the user touches the pen icon, the handwriting input mode is entered again, and the correct content (characters, etc.) is handwritten.

  However, due to restrictions on the size of the display 22 or the like, when a handwritten character is small and the character spacing or line spacing is narrow, even points or lines that do not need to be corrected may be erased.

  Therefore, a method of correcting the handwritten image by enlarging the screen is common. In this case, a step of selecting an enlargement function, a step of enlarging (setting an enlargement ratio), a step of selecting a function for correction, and a step of returning the enlarged image to the original size are executed by a user operation. Is done. In this way, many steps need to be executed, which increases the number of users. That is, the operation is troublesome.

  Therefore, in the first embodiment, the drawn handwritten image can be easily enlarged and corrected to return to the original size. This will be specifically described below.

  Briefly, in the first embodiment, when a predetermined slide is detected, the handwritten image included in the designated range designated by the slide is set in an editable state and designated by the slide. The handwritten image in the specified range is enlarged and displayed. Then, the handwritten image in the designated range displayed in an enlarged manner is corrected, and the handwritten image in the designated range is returned to the original size by releasing the finger (touch-off) that has performed the predetermined slide.

  As shown in FIG. 2B, after the user touches the touch screen 100 with two fingers (a plurality of touches), as shown in FIG. Slide linearly along the direction (first direction). In this way, when a linear slide is performed with a plurality of fingers, a mode for enlarging and correcting (hereinafter, sometimes referred to as “enlarged editing mode”) is set. Hereinafter, the slide for setting the enlarged editing mode is referred to as a first slide. Therefore, when the first slide is detected, the enlarged editing mode is set (shifted to). Here, an example is shown in which the user performs the first slide from the right to the left in the left-right direction of the touch screen 100 (display surface of the display 22) using the index finger and middle finger of the left hand. That is, the left-right direction is the first direction. Here, it is assumed that the first slide is performed so as to trace the “EYGH” line displayed on the touch screen 100.

  In the first embodiment, two fingers are used for the first slide, but three or more fingers may be used. Further, the plurality of touches described above are not limited to touches with fingers of the user, but also include touches with pointing tools such as a dedicated pen (touch pen). Further, after the user makes a plurality of touches on the touch screen 100, the user slides linearly along the first direction with some fingers (for example, one of the fingers when the fingers are touched with both hands). Also when performing, it detects as a 1st slide. In addition, the first slide is detected when a linear slide is performed with a plurality of fingers. The difference in direction (angle) from the first slide is detected when a second slide described later is detected. It is for detecting.

  Therefore, when the user touches and slides with one finger, the first slide is not detected, and other processes such as the pen mode and the eraser mode are performed according to the mode selected at that time. Even when the touch screen 100 (touch panel 20) is touched with a plurality of fingers, the first slide is not detected unless a linear slide is performed.

  As shown in FIG. 2D, following the first slide described above, the user slides in a direction (second direction) different from the first direction of the first slide. As described above, when a slide in a different direction is performed following the first slide, a mode for designating a magnification for magnification display (hereinafter sometimes referred to as “magnification designation mode”) is set in the magnification editing mode. The Hereinafter, the slide for setting the magnification designation mode is referred to as a second slide. Therefore, when the second slide is detected, the magnification designation mode is set (shifted to). Here, an example is shown in which the second slide is performed from the top to the bottom in the vertical direction of the touch screen 100 (display surface of the display 22). That is, the up-down direction is the second direction.

  Here, in the first embodiment, the case where the first direction is the left-right direction and the second direction is the up-down direction has been described as an example, but it is not necessary to be limited to this. For example, the user may perform a first slide from right to left and subsequently perform a second slide from bottom to top. The user who performs handwriting with the left hand may perform the first slide from the left to the right, and subsequently perform the second slide from the top to the bottom. Similarly, the user who performs handwriting with the left hand may perform the first slide from the left to the right, and subsequently perform the second slide from the bottom to the top.

  Moreover, although the example in which the first direction and the second direction are different by 90 ° is shown, it is not necessary to be limited to this. For example, the direction different from the first direction by 30 ° or more may be the second direction. The angle of the second direction with respect to the first direction may be set as appropriate in consideration of the usage mode of the user.

  When the second slide is detected, a designated range including part or all of the handwritten image drawn on the touch screen 100 is set according to the locus of the first slide. In the first embodiment, the designated range is a quadrangular range that is set to include all objects that intersect the trajectory of the first slide. In the example shown in FIGS. 2B to 2D, the designated range is set so as to include all “EYGH” of the handwritten image that intersects the locus of the first slide. For example, in the handwritten image intersecting with the locus of the first slide, the uppermost point, the lowermost point, the leftmost point, and the rightmost point are detected, and a rectangle including these points is detected. The range is set to the specified range. For example, the specified range is a vertical line of the display 22 passing through a straight line parallel to the left-right direction of the display 22 that passes through the uppermost point and the lowermost point, a leftmost point, and a rightmost point. Is set to a range that is a little larger than the rectangle defined by the straight line parallel to.

  In the first embodiment, a frame (hereinafter referred to as “enlarged frame”) 200 corresponding to the set designated range is displayed so that the user can visually recognize the designated range. However, the method for allowing the user to visually recognize the specified range should not be limited. As shown in FIG. 2D and the like, the designated range may be displayed with a solid-line enlarged frame 200, or the touch screen 100 other than the designated range may be grayed out.

  Further, as shown in FIG. 3A, the designated range is enlarged at an enlargement rate corresponding to the movement amount of the second slide. At this time, the enlargement frame 200 is also enlarged according to the size of the designated range.

  Then, after the second slide is detected, the second slide is stopped, and when the user's finger continues to touch the same position for a predetermined time (for example, 3 to 5 seconds), that is, for a long time longer than the predetermined time. When a tap (long press) is detected, the enlargement ratio is fixed. For example, a long tap detected for a predetermined time or longer after the second slide is detected is referred to as an enlargement ratio fixing operation. Therefore, when an enlargement factor fixing operation is detected, the enlargement factor of the specified range is fixed. For this reason, after the enlargement ratio of the designated range is fixed, the enlargement ratio of the designated area does not change unless the user slides a plurality of fingers that have moved in the first slide and the second slide unless touched off. Therefore, it is possible to prevent the designated range from fluctuating due to camera shake.

  When an enlargement ratio fixing operation is detected, an icon bar 202 is displayed in the vicinity of the enlarged designated range (enlarged frame 200) as shown in FIG.

  Here, the icon bar 202 includes various icons for selecting a function necessary for correcting the handwritten image included in the designated range. In the first embodiment, the icon bar 202 includes an icon 202a for the eraser function, an icon 202b for the pen function, and the like. Examples of other icons include icons for setting attributes.

  Since the eraser function and the pen function are as described above, a duplicate description is omitted.

  The operation (correction operation) for correcting the handwritten image included in the designated range is performed by touch input using a finger different from the finger that has performed the first slide and the second slide described above. In the first embodiment, since the first slide and the second slide are performed using the left hand finger, the correction operation is performed using the right hand finger.

  For example, when the icon 202a is selected, an eraser function is executed, and an eraser cursor is displayed at a position touched with a finger. Using this eraser function, as shown in FIG. 3B, the user erases “Y” written in error among “EYGH”. As described above, since the handwritten image within the designated range is enlarged, it is easy to delete the handwritten image, and the handwritten image that does not need to be deleted is hardly accidentally deleted.

  Subsequently, when the icon 202b is selected, the pen function is executed, and a character or the like is newly handwritten by performing touch input with the finger of the right hand within the designated range. Therefore, as shown in FIG. 3C, “F” is handwritten in the space where “Y” is erased. That is, the handwritten image is corrected.

  Thereafter, as shown in FIG. 3D, when a plurality of fingers of the left hand are touched off, the enlarged display of the designated range is canceled and the handwritten image of the designated range is returned to the original size. That is, the enlargement correction mode is terminated. At this time, for example, the input mode is set. Here, only the case where the enlarged display is canceled when a plurality of fingers of the left hand are touched off after completion of the correcting operation is described, but the fingers of the left hand are touched off during the correcting operation. In this case, the enlarged display of the specified range is canceled. That is, the correction operation can be interrupted.

  FIG. 4 shows an example of the memory map 300 of the RAM 14 shown in FIG. As shown in FIG. 4, the RAM 14 includes a program storage area 302 and a data storage area 304. The program storage area 302 stores an information processing program. The information processing program includes an input detection program 310, an image generation program 312, a display program 314, a first slide detection program 316, a second slide detection program 318, a range setting program 320, an enlargement ratio setting program 322, a correction program 324, and an enlargement release. A program 326 is included.

  The input detection program 310 acquires touch coordinate data about the position of the display surface of the display 22 indicated by the touch input on the touch panel 20 output from the touch panel control circuit 16 and stores it in the data storage area 304 in time series. It is. However, the input detection program 310 is also a program for detecting an input from a hardware keyboard connected to the information processing apparatus 10 or a hardware operation panel provided in the information processing apparatus 10.

  The image generation program 312 uses image generation data 334 and / or correction image data 342, which will be described later, or uses touch coordinate data detected according to the input detection program 310, so that an image corresponding to the touch screen 100 is obtained. It is a program for generating data. Specifically, when the image generation program 312 is executed, the GPU draws image data corresponding to the touch screen 100 in the VRAM in the drawing control circuit 18 under the instruction of the CPU 12. Here, the VRAM is provided with a main area 400 and a correction area 410, and the main area 400 is normally used. In addition, when the enlarged editing mode is set, a handwritten image included in the specified range is copied, a handwritten image included in the specified range is enlarged, or a handwritten image included in the specified range is corrected (edited). Therefore, the correction area 410 is used. The main area 400, the correction area 410, the expansion of the designated range, and the like will be described in detail later.

  The display program 314 is a program for outputting image data generated according to the image generation program 312 to the display 22. Accordingly, the touch screen 100 is displayed on the display 22. Further, the display program 314 displays the icon bar 202 on the touch screen 100 as necessary.

  The first slide detection program 316 is a program for detecting the first slide. Specifically, the first slide detection program 316 refers to touch coordinate data detected according to the input detection program 310 to determine whether there are a plurality of touches (touch inputs), and a part of the plurality of touches. Alternatively, it is determined whether there is a slide in the first direction as a whole. For example, the first slide detection program 316 uses the touch coordinates detected according to time series as a starting point, and the touch position indicated by the touch coordinates detected next is the touch position indicated by the touch coordinates detected previously. Calculate the vector as the end point. Then, it is determined whether there is a slide in the first direction depending on whether the calculated vector direction is along the first direction. The first slide detection program 316 is also a program for storing a touch coordinate data group (first slide data 336 to be described later) in the data storage area when the first slide is detected.

  The second slide detection program 318 is a program for detecting the second slide. Specifically, the second slide detection program 318 refers to the touch coordinate data detected according to the input detection program 310, and then follows the first slide in a second direction different from the first direction in the first slide. Determine if there is a slide to. For example, the second slide detection program 318 calculates a vector using the touch coordinates in the same manner as the first slide detection program 316, and moves in the second direction depending on whether or not the direction of the calculated vector is along the second direction. Determine if there are any slides. The second slide detection program 318 is also a program for storing a touch coordinate data group (second slide data 338 described later) in the data storage area when the second slide is detected.

  The range setting program 320 is a program for setting a designated range in accordance with the locus of the first slide when the second slide is detected by the second slide detection program 318. Specifically, the range setting program 320 refers to the handwritten input data 332 and the first slide data 336, and sets the specified range so that all handwritten images that intersect the trajectory of the first slide are included. Here, when the designated range is set by the range setting program 320, the image data included in the set designated range among the image data of the handwritten image drawn (stored) in the main area 400 according to the image generation program 312. Is copied, and the image data (correction image data 342) copied in the correction area 410 of the VRAM is stored. At this time, the correction image data 342 is stored in the same size as the copied image data.

  When the designated range (image data size) is large, the copy of the image data is reduced so that the correction image data 342 does not protrude from the correction area 410 even if it is enlarged. Data may be used. However, in this case, the ratio of the size of the image data for the handwritten image included in the designated range in the main area 400 that is the copy source and the size of the reduced image data is also stored in the data storage area 304. This is because it is necessary for returning the handwritten image in the designated range to the original size.

  The enlargement ratio setting program 322 is a program for setting the enlargement ratio of the handwritten image in the designated range according to the movement amount of the second slide when the second slide is detected by the second slide detection program 318. Specifically, the enlargement ratio setting program 322 refers to the second slide data 338, detects the start point and end point of the second slide, and calculates the movement amount of the second slide based on the start point and end point. Based on the calculated movement amount of the second slide, an enlargement ratio of the designated range is set. Thereafter, based on the enlargement ratio set by the enlargement ratio setting program 322, the display program 314 enlarges and displays the handwritten image included in the designated range.

  For example, FIG. 5A shows an example of the main area 400 provided in the VRAM, FIG. 5B shows an example of the correction area 410 provided in the VRAM, and FIG. 5C shows the correction area. An example in which the handwritten image included in the designated range is enlarged at 410 is shown.

  The main area 400 has a size corresponding to the display surface of the display 22, for example, and points and lines are drawn according to handwritten input data 332 described later. Therefore, image data having contents corresponding to the touch screen 100 shown in FIG. In FIG. 5A, a range indicated by a dotted square frame is provided as a specified range, and the position and size of the specified range are determined by points P and Q as described later.

  The correction area 410 is set to the same size as the main area 400. As described above, when the specified range is set, the image data of the handwritten image included in the specified range is copied, and a predetermined position in the correction area 410 is set. Is pasted. In this embodiment, the copied image data is pasted so that the point P in the specified range overlaps the upper left vertex of the correction area 410.

  The image data copied to the correction area 410 is enlarged according to the movement amount of the second slide. For example, FIG. 5C shows a state in which the image has been enlarged twice. The position of the point P is fixed, and the position of the point Q is changed. At this time, editing image data 336 described later is also updated (enlarged). In the enlarged editing mode, the image data copied to the correction area 410 and the enlarged image data are pasted on the front surface of the image data drawn in the main area 400. At this time, the copied image data and the enlarged image data are pasted so that the position of the point P overlaps with the image data in the designated range of the copy source.

  In the first embodiment, the main area 400 and the correction area 410 are set to have the same size, but need not be limited. In the correction area 410, since the image data is enlarged, it may be set larger than the main area 400.

  Returning to FIG. 4, the correction program 324 is a program for correcting an enlarged handwritten image in accordance with a user operation. Specifically, when the correction operation for the handwritten image included in the specified range is performed in a state where the handwritten image included in the specified range is displayed in an enlarged manner, the correction program 324 modifies the correction image according to the correction operation. The data 342 is updated, and accordingly, the image data stored in the correction area 410 shown in FIG. 5C is updated (corrected). The correction image data 342 stored in the correction area 410 is changed (corrected). Specifically, when the handwritten image is erased by the eraser function, the corresponding part or all of the correction image data 342 is erased, and when the pen function is handwritten, the character is detected according to the input detection program 310. The correction image data 342 is updated with the touch coordinate data. That is, the correction operation is performed using the correction image data 342. However, the eraser function, pen function, and the like are appropriately selected by the user.

  The enlargement canceling program 326 cancels the enlargement display of the handwritten image included in the designated range when the finger performing the first slide and the second slide is touched off while the designated range is enlarged and displayed (returns to the original). It is a program for. Specifically, the enlargement cancellation program 326 uses the touch coordinate data detected in accordance with the input detection program 310, and after the second slide has been performed, the finger that made the first slide and the second slide touched off. In this case, the handwritten image included in the designated range is returned to the original size. In the first embodiment, the correction image data 342 is restored (reduced) to the original size when it is copied to the correction area 410 based on the designated range data 340, and the correction area is accordingly changed. The image data stored (drawn) in 410 is also restored to its original size. Then, the correction image data 342 is overwritten at the position defined by the designated range data 340 in the image data of the main area. At this time, the handwritten input data 332 is updated according to the overwritten image data.

  Although not shown, the information processing program detects a touched icon and stores a program for executing a function assigned to the icon or image data of a handwritten image in a nonvolatile memory. This program is also stored.

  In the data storage area 304, touch coordinate data 330, handwriting input data 332, image generation data 334, first slide data 336, second slide data 338, designated range data 340, correction image data 342, enlargement ratio data 344, and the like. Is memorized.

  The touch coordinate data 330 is touch coordinate data detected (acquired) according to the input detection program 310, and is stored according to a time series.

  The handwritten input data 332 is a set of touch coordinate data for a character handwritten by the user, that is, a handwritten image. Specifically, the handwritten input data 332 is data of a table that manages a point by a tap or a line by a slide for each point or line. However, for the line, touch coordinate data corresponding to a plurality of touch inputs detected from touch-on to touch-off in the slide is stored (managed). Further, touch coordinate data for an instruction such as an icon or an arbitrary action is not included in the handwritten input data 332.

  Although detailed explanation is omitted, identification information is attached to each point or line so that the information can be identified, and attribute information (line type, line color, and line width information) is also managed for each point or line. Is done.

  The image generation data 334 is data such as polygon data and texture data for generating image data corresponding to various screens such as the touch screen 100. The image generation data 334 also includes image data for various icons displayed on the touch screen 100.

  The first slide data 336 is touch coordinate data regarding the trajectory of the first slide, and is stored for each slide of a plurality of touched fingers. The second slide data 338 is touch coordinate data for the locus of the second slide, and is stored for each slide of a plurality of touched fingers.

  The designated range data 340 is data for defining the position and size of the designated range. In the first embodiment, the designated range data 340 is composed of coordinate data for the upper left vertex (point P) and the lower right vertex (point Q) in the rectangular designated range. However, the designated range data 340 may be composed of coordinate data for the upper right vertex and the lower left vertex in the rectangular designated range.

  The correction image data 342 is image data obtained by copying image data included in the designated range set on the touch screen 100. As described above, when the copied image data is reduced, the correction image data 342 includes a size ratio.

  The enlargement factor data 344 is data for defining an enlargement factor for enlarging the image data (correction image data 342) of the handwritten image included in the designated range. The enlargement ratio set by the enlargement ratio setting program 322 is temporarily stored as enlargement ratio data 344. It should be noted that at the beginning of the correction image data 342 being stored, the enlargement ratio data 344 is set to the same magnification (one time).

  In the data storage area 304, other data necessary for executing the information processing program is stored, and a timer (counter) and a register necessary for executing the information processing program are provided.

  6 and 7 are flowcharts showing the enlargement display control process of the CPU 12 shown in FIG.

  When the drawing application is activated in the information processing apparatus 10, the CPU 12 sets the handwriting input mode according to a user instruction or default setting. Then, the CPU 12 starts the information processing shown in FIG. 6 and determines whether or not a plurality of touches are detected in step S1. Specifically, the CPU 12 acquires touch coordinate data indicating the position of the touch input on the touch panel 20 output from the touch panel control circuit 16, stores the touch coordinate data in the data storage area 304 in time series, and simultaneously detects touch coordinate data. Judge whether there is more than one.

  If “NO” in the step S1, that is, if a plurality of touches are not detected, a process corresponding to another operation is executed in a step S3, and the process returns to the step S1. For example, in step S3, a handwritten image is drawn on the display 22 in response to the user handwriting a character or the like. Further, in response to the user touching a predetermined icon, the function set for the icon is executed. At this time, if the icon is not displayed at the position indicated by the acquired touch coordinate data, the CPU 12 stores the touch coordinate data in the data storage area 304 as handwritten input data 332. Further, in the case of a slide by a plurality of touches, the touch coordinate data 330 detected at this time is not stored as the handwritten input data 332 because it is an action for shifting to the enlarged editing mode. However, the process (touch input detection process) of storing (detecting) the touch coordinate data as the handwritten input data 332 is executed in parallel with the information processing shown in FIGS.

  On the other hand, if “YES” in the step S1, that is, if a plurality of touches are detected, the touch position of each touch is detected (tracked) in a step S5, and the plurality of touches are slid in a step S7. Detect whether or not. Specifically, the CPU 12 refers to the acquired (detected) touch coordinate data 330 and determines whether or not the touch positions of a plurality of touches being tracked have changed.

  If “NO” in the step S7, that is, if the sliding is not performed by a plurality of touches, the process proceeds to the step S3. On the other hand, if “YES” in the step S7, that is, if a plurality of touches are slid, the first slide is detected in a step S9. At this time, the enlarged editing mode is set. However, as described above, the first slide is not detected if it is not a linear slide even if it is slid by a plurality of touches.

  Next, in step S11, the CPU 12 detects whether or not the plurality of touches have been slid in a direction different from the first slide (in this first embodiment, a direction different from the direction of the first slide by 90 °). Specifically, the CPU 12 refers to the acquired (detected) touch coordinate data 330 and determines whether or not the plurality of touches being tracked have changed in a second direction different from the first direction of the first slide. Judging.

  If “NO” in the step S11, that is, if a plurality of touches are not slid in a direction different from the first slide, the process proceeds to a step S3. On the other hand, if “YES” in the step S11, that is, if a plurality of touches are slid in different directions from the first slide, the second slide is detected in a step S13.

  Subsequently, in step S15, the locus of the first slide is stored. Specifically, the CPU 12 stores, as the first slide data 336, a touch coordinate data group from when “YES” is determined in step S1 (or S7) until immediately before “YES” is determined in step S11.

  In step S17, a specified range is set based on the locus of the first slide detected in step S15, and the enlarged frame 200 is displayed in the set specified range. At this time, the CPU 12 copies the image data included in the designated range among the image data stored (drawn) in the main area, stores it in the correction image data 342, and accordingly, in the correction area 410 of the VRAM. The copied image data is drawn. Then, the image data drawn in the correction area 410 is displayed in front of the image data drawn in the main area 400 and superimposed on the position of the specified range on the display 22.

  As shown in FIG. 7, in the next step S19, the movement amount of the second slide is detected. Specifically, the CPU 12 stores, as the second slide data 338, the touch coordinate data group after the second slide is detected in step S13, and the start point and end point (current position) of the second slide data 338. To calculate (detect) the amount of movement of the second slide. In the subsequent step S21, the enlargement ratio of the designated range is set based on the movement amount of the second slide detected in step S19. In step S23, the handwritten image in the designated range is enlarged and displayed based on the enlargement ratio set in step S21. Here, the image data in the specified range stored (drawn) in the correction area 410 is enlarged according to the enlargement ratio set in step S21.

  Next, in step S25, it is determined whether or not a plurality of touches are at the same position for a predetermined time. That is, the CPU 12 determines whether or not the touched position has moved for a long period of time (for example, 3 to 5 seconds) without moving or hardly moving.

  If “NO” in the step S25, that is, if a plurality of touches are moving, or if a plurality of touches are in the same position for a predetermined time, the process returns to the step S19. On the other hand, if “YES” in the step S25, that is, if it is detected that a plurality of touches are at the same position for a predetermined time, the enlargement ratio of the designated range is fixed in a step S27. That is, even if the touched position is moved, the CPU 12 does not change from the enlargement ratio of the designated range when it is determined “YES” in step S25 unless the touched position is touched off.

  Next, in step S29, it is determined whether or not there is a correction operation on the specified range of image data (correction image data 342). If “NO” in the step S29, that is, if there is no correcting operation on the specified range of image data (correcting image data 342), the process returns to the same step S29. On the other hand, if “YES” in the step S29, that is, if there is a correction operation on the image data (correction image data 342) in the designated range, the image data included in the designated range is edited in a step S31. Specifically, the CPU 12 corrects the correction image data 342 in accordance with a user operation, and updates the image data drawn in the correction area 410.

  Next, in step S33, it is determined whether a plurality of touches are detected. That is, in step S33, the CPU 12 refers to the touch coordinate data 330 and determines whether or not the plurality of fingers that have performed the first slide and the second slide are released from the touch panel 20 (touched off).

  If “YES” in the step S33, that is, if a plurality of touches are detected, the process returns to the step S29. On the other hand, if “NO” in the step S33, that is, if a plurality of touches are not detected, the enlarged display is canceled in a step S35. At this time, the CPU 12 ends the enlargement editing mode, returns the enlargement ratio of the correction image data 342 to the original size based on the designated range data 340, and uses the correction image data 342 for the image data of the main area. The image data in the specified range is overwritten, and the information processing ends.

  According to the first embodiment, when a second slide in a direction different from the first slide is detected following the first slide by a plurality of touches, one handwritten image designated in the first slide is detected. Since part or all of the screen is enlarged according to the amount of movement of the second slide, it is possible to enlarge and correct a part of the screen simply by sliding. Therefore, the drawn handwritten image can be easily corrected.

  Further, according to the first embodiment, when a plurality of fingers that have performed the first slide and the second slide are separated from the touch panel 20, the handwritten image included in the designated range is automatically returned to the original size. It is possible to save the trouble of restoring the enlarged handwritten image.

  Furthermore, according to the first embodiment, the size of the designated range is set according to the locus of the first slide, so that a handwritten image to be displayed in an enlarged manner can be freely set by a user's touch input.

  Further, according to the first embodiment, when a plurality of touches indicate the same position continuously for a predetermined time, the enlargement ratio of the designated range displayed in an enlarged manner is fixed. Even if a finger performing a plurality of touches moves, the enlarged frame 200 is not changed. Therefore, it becomes easy to correct the drawn handwritten image.

Furthermore, an icon that performs a predetermined function for correcting (editing) a handwritten image included in the specified range is displayed in the vicinity of the enlarged specified range, so that it becomes easy to correct the enlarged handwritten image. The usability of the information processing apparatus 10 can be improved.
[Second Embodiment]
Since the information processing apparatus 10 of the second embodiment is the same as the information processing apparatus 10 of the first embodiment except that the method for fixing the enlargement ratio of the designated range is different, the contents different from the first embodiment will be described. The redundant description will be omitted.

  Briefly, in the second embodiment, after the second slide is detected, a touch by a finger different from the finger that has performed the first slide and the second slide is detected within the designated range (enlarged frame 200). In such a case, the enlargement ratio of the specified range is fixed.

  FIG. 8 is a flowchart showing a part of information processing of the CPU in the second embodiment.

  Specifically, as shown in FIG. 8, the CPU 12 executes the process of step S41 in place of step S25 in the information processing shown in FIGS. Therefore, when executing the process of step S23, the CPU 12 determines whether or not a touch has been made within the specified range in step S41.

  If “NO” in the step S41, that is, if the touch is not made within the designated range, the process returns to the step S19. On the other hand, if “YES” in the step S41, that is, if the touch is made within the designated range, the process proceeds to a step S27.

  Since Steps S1 to S23 and Steps S27 to S35 are the same as the contents shown in the first embodiment, a duplicate description is omitted.

  In the second embodiment, similarly to the first embodiment, the drawn handwritten image can be easily corrected.

In the second embodiment, when the touch is detected within the designated range (enlarged frame 200) after the second slide is detected, the enlargement ratio is fixed. However, the present invention is not limited to this. There is no need. For example, the icon bar 202 is displayed in the vicinity of the enlargement frame 200 before the second slide is detected and the enlargement rate is fixed, and any icon on the icon bar 202 is detected after the second slide is detected. When (202a, 202b, etc.) is touched, it may be determined that correction (editing) has started, and the enlargement ratio may be fixed.
[Third embodiment]
The information processing apparatus 10 according to the third embodiment is the same as the information processing apparatus 10 according to the first embodiment except that the designated range setting method is different. Will be omitted.

  Briefly, in the third embodiment, the designated range is set so as to include a handwritten image sandwiched between a plurality of fingers performing the first slide.

  FIGS. 9A and 9B are illustrative views showing an example of the touch screen 100 when a handwritten image in the third embodiment is enlarged and corrected.

  Specifically, as shown in FIG. 9A, the user touches the touch screen 100 with two fingers (a plurality of touches). At this time, in the third embodiment, the user touches the left and right index fingers and middle fingers apart in the vertical direction. In the example shown in FIG. 9A, the first slide is performed from right to left in the left-right direction of the touch screen 100.

  For example, since the first slide is performed with two fingers, when the finger (touch position) that performed the first slide is separated by a predetermined distance or more, the first slide is separated from the first slide by a predetermined distance 2 or more. Two trajectories are included. That is, the input detection program 310 detects (acquires) touch coordinate data indicating two loci in which the positions of two touch inputs that are separated by a predetermined distance or more on the touch panel 20 have moved continuously as the first slide.

  In the third embodiment, the designated range is set based on two trajectories included in the first slide. Basically, the specified range is the highest point, the lowest point, the leftmost point, and the rightmost position among the plurality of points included in the two loci included in the first slide. It is set using the point to be. Specifically, the designated range includes the straight line parallel to the horizontal direction of the display 22 that passes through the uppermost point and the lowermost point, the leftmost point, and the rightmost point 22 on the display 22. Is set to a rectangular range defined by a straight line parallel to the vertical direction.

  However, when the specified range is set as described above, if there is a handwritten image (point or line) that intersects the side of the quadrangle that defines the specified range, The range that has been enlarged by translation of the sides is set as the specified range.

  Since the operation after the designated range is set is the same as the contents shown in the first embodiment, a duplicate description is omitted.

  According to the third embodiment, when the first slide is performed with two fingers separated by a predetermined distance or more in the vertical direction, the size of the designated range is determined according to the distance between the two fingers. Therefore, it is possible to freely set the size of the designated range simply by adjusting the distance between the two fingers touched in accordance with the range to be set when the user performs the first slide. Therefore, in addition to the effects of the first embodiment, the usability of the information processing apparatus 10 can be improved.

  In the above-described embodiment, the image data included in the specified range is copied as the correction image data 342 and pasted (drawn) in the correction area 410 of the VRAM for correction. There is no need to be limited. For example, when the information processing apparatus 10 has a character recognition function, characters included in the handwritten image are recognized. When a character recognized in the designated range is included, in addition to the image data of the handwritten image drawn in the main area 400, the character display position and the character type (information indicating which character is the character) Alternatively, the object information data indicating the character size or the like may be copied as the correction image data 342. In this case, when the image data included in the designated range is enlarged and displayed, the data indicating the size of the character included in the object information data is updated at the same magnification, and the data of the character display position is also updated. . In addition, at least one of the data indicating the character display position and the data indicating the character type is updated by the correction operation. After the correction operation is completed, the data indicating the character display position and the data indicating the character size are updated (returned to the original), and at least one of the character display position and the character type in the main area 400 is updated. Be changed. That is, the handwritten input data 332 is updated (overwritten) with the corrected (edited) content. In this case, if not only the current object information data but also the past multiple generations of object information data are stored, the undo function (return to the previous function) is executed to restore the state before correction. be able to.

  When the enlarged editing mode is set, the image data (handwritten input data 332) of the handwritten image drawn in the main area 400 of the VRAM may be locked so that editing cannot be performed. In this way, it is possible to prevent image data drawn in the main area 400 by mistake in the enlarged editing mode from being edited.

  Further, the third embodiment can be combined with the modes shown in the first embodiment and the second embodiment. In this case, the designated range setting method shown in the first embodiment and the designated range setting method shown in the third embodiment are selectively used according to the interval between the fingers that have performed the first slide.

  Furthermore, the specific numerical values, screen configurations, and the like given in the above-described embodiments are examples, and can be appropriately changed according to actual products.

10 ... Information processing device 12 ... CPU
14 ... RAM
16 ... Touch panel control circuit 18 ... Drawing control circuit 20 ... Touch panel 22 ... Display

Claims (9)

An information processing apparatus for displaying a handwritten image handwritten using a touch panel provided in association with a display unit on a display surface of the display unit,
Coordinate acquisition means for acquiring coordinates corresponding to a position on the display surface instructed by a user input operation;
First slide detection means for detecting a first slide by a plurality of touches based on the coordinates acquired by the coordinate acquisition means;
Second slide detection means for detecting a second slide in a direction different from the first slide following the first slide based on the coordinates acquired by the coordinate acquisition means;
Range setting means for setting a designated range including a part or all of the handwritten image designated in the first slide when the second slide is detected by the second slide detecting means, and the second slide An information processing apparatus comprising: an enlarging unit that magnifies and displays the handwritten image included in the designated range in an editable state according to the movement amount of the second slide when the second slide is detected by the detecting unit .   The information processing apparatus according to claim 1, further comprising an enlargement canceling unit that cancels the enlarged display of the designated range when the touch-off is performed after the second slide is finished.   The information processing apparatus according to claim 1, wherein the range setting unit sets the size of the designated range according to a trajectory of the first slide. A fixing operation detecting means for detecting a predetermined magnification fixing operation after the second slide is detected by the second slide detecting means;
4. The apparatus according to claim 1, further comprising: an enlargement ratio fixing means that fixes an enlargement ratio of the designated range displayed by the enlargement means when the enlargement ratio fixing operation is detected by the fixing operation detection means. The information processing apparatus according to any one of the above.   The information processing apparatus according to claim 4, wherein the enlargement ratio fixing operation includes an operation in which the plurality of touches continuously indicate the same position for a predetermined time.   The information processing apparatus according to claim 4, wherein the enlargement ratio fixing operation includes an operation of touching the designated range enlargedly displayed by the enlargement unit separately from the plurality of touches.   The edit icon display means for displaying the edit icon which exhibits the predetermined function for editing the inside of the range of the specified range in the vicinity of the specified range enlarged and displayed by the enlargement means. The information processing apparatus according to any one of the above. An information processing program for a computer that displays a handwritten image handwritten using a touch panel provided in association with a display means on a display surface of the display means, wherein the display is instructed by a user input operation. Coordinate acquisition means for acquiring coordinates corresponding to positions on the surface;
First slide detection means for detecting a first slide by a plurality of touches based on the coordinates acquired by the coordinate acquisition means;
Second slide detection means for detecting a second slide in a direction different from the first slide following the first slide based on the coordinates acquired by the coordinate acquisition means;
Range setting means for setting a designated range including a part or all of the handwritten image designated in the first slide when the second slide is detected by the second slide detecting means, and the second slide When the second slide is detected by the detection means, an information processing functioning as an enlargement means for enlarging and displaying the handwritten image included in the specified range in an editable state according to the movement amount of the second slide. program. A computer information processing method for displaying a handwritten image handwritten using a touch panel provided in association with a display means on a display surface of the display means,
The computer acquires (a) coordinates corresponding to a position on the display surface instructed by a user's input operation,
(B) detecting a first slide by a plurality of touches based on the coordinates acquired in the step (a);
(C) Based on the coordinates acquired in the step (a), following the first slide, a second slide in a direction different from the first slide is detected,
(D) When the second slide is detected in the step (c), a designated range including part or all of the handwritten image designated in the first slide in the step (b) is set; And (e) when the second slide is detected in the step (c), the handwritten image included in the specified range is displayed in an editable state according to the movement amount of the second slide. Information processing method.

Images