JP6462519B2 - Information processing apparatus, information processing program, and information processing method - Google Patents

Description

  The present invention relates to an information processing device, an information processing program, and an information processing method.

  An example of this type of information processing apparatus is disclosed in Patent Document 1. In the image forming apparatus disclosed in Patent Document 1, the images are previewed on the display unit of the operation unit before the printing process is performed, and the pages are aggregated by performing a pinch-in operation on the images of a plurality of pages. .

  Another example of this type of information processing apparatus is disclosed in Patent Document 2. The image display disclosed in Patent Document 2 has a function of printing a photographic image, a scanned image, or the like taken with a digital camera on a postcard or the like. And images such as illustrations are displayed on the touch panel display. In this image display, when a flick operation or a pinch-in operation is performed, a plurality of images that precede or follow the image displayed on the touch panel display unit are reduced according to the direction of the flick operation or the pinch-in operation. Displayed on the touch panel display.

JP 2014-188986 A JP 2013-175090 A

  However, the image forming apparatus disclosed in Japanese Patent Application Laid-Open No. 2004-228561 only performs page aggregation for a plurality of pages of preview images displayed on the display unit, and there is room for improvement.

  Moreover, in the image display of patent document 2, only the image before and behind the image currently displayed on the touchscreen display part is integrated and displayed, and similarly to patent document 1, there is room for improvement.

  Therefore, a main object of the present invention is to provide a novel information processing apparatus, information processing program, and information processing method.

  Another object of the present invention is to provide an information processing apparatus, an information processing program, and an information processing method capable of aggregating and displaying a desired plurality of images on one screen regardless of the currently displayed image. That is.

  A first invention is an information processing apparatus including touch input detection means, display means, total number detection means, classification means, and aggregation means. The touch input detection means is input means such as a touch panel or a touch pad, and detects touch input. The display means is provided in association with the touch input detection means, and displays an image on one screen for each page according to the touch input detected by the touch input detection means. For example, an image handwritten by a user, an image stored in a memory built in or connected to the information processing apparatus, and an image acquired from a computer that can communicate with the information processing apparatus are displayed on the display unit for each page. The total number detecting unit detects the total number of touch positions corresponding to the touch input detected by the touch input detecting unit. For example, the total number of touches when the user touches with the left hand, the right hand, or the fingers of both hands is detected. The classifying unit classifies the plurality of touch positions corresponding to the plurality of touch inputs detected by the touch input detection unit into two groups when the total number detected by the total number detection unit is equal to or greater than the first predetermined number. Specifically, the touch position touched with the left finger and the touch position touched with the right finger are grouped. The aggregation means includes a first reduced image obtained by reducing the first image of the page corresponding to the number of touch positions included in at least one of the groups when the positional relationship between the two groups classified by the classification means changes. And a second reduced image obtained by reducing the second image of the page corresponding to the number of touch positions included in the other group, and an aggregated image that is aggregated so as to fit on one screen is generated. For example, when the positional relationship between two groups changes, a plurality of pages specified by the number of touches are integrated into one page. The display means displays the aggregated image generated by the aggregation means on a single screen.

  According to the first invention, since the images corresponding to a plurality of pages are reduced and aggregated so as to fit on one screen according to the number of touches, it is intuitive regardless of the image currently displayed on the display means. By operation, a plurality of desired pages can be easily aggregated and displayed on one screen. Therefore, a desired plurality of pages can be easily confirmed.

  A second invention is dependent on the first invention, and the aggregating unit generates an aggregated image including at least a first reduced image and a second reduced image in response to the positions of the two groups being separated from each other. For example, a plurality of pages are combined into one page in response to sliding so that the left hand and the right hand are separated.

  According to the second invention, a plurality of desired pages can be aggregated and displayed on a single screen with a simple operation.

  A third invention is dependent on the first or second invention, and the aggregating unit corresponds to the first reduced image, the second reduced image, and the first image in accordance with the approach of the positions of the two groups. An aggregated image including one or more third reduced images obtained by reducing one or more third images corresponding to the page between the page and the page corresponding to the second image is generated.

  According to the third invention, not only the pages designated by the left hand and the right hand but also the pages between them can be aggregated and displayed on the display means so as to fit on one screen.

  A fourth invention is dependent on the first invention, and the aggregation means generates an aggregate image including a first reduced image and a second reduced image in response to the positions of the two groups approaching or separating. For example, the aggregating means may aggregate a plurality of pages designated with the left hand and the right hand so as to fit on one screen regardless of whether the positions of the two groups are approaching or separating. A plurality of pages designated by the left hand and the right hand may be aggregated so as to fit on one screen in accordance with the approach and separation of the positions of one group.

  According to the fourth aspect, the way of aggregation can be changed according to the direction in which the left hand, the right hand, or both hands are slid. Therefore, convenience can be improved.

  A fifth invention is dependent on the first or fourth invention, and the aggregation means includes a first reduced image, a second reduced image, and a page between the page corresponding to the first image and the page corresponding to the second image. An aggregated image including one or a plurality of third reduced images obtained by reducing one or a plurality of third images corresponding to is generated.

  According to the fifth aspect, it is possible to specify a range of a plurality of pages to be aggregated according to the number of left hand touches and the number of right hand touches.

  A sixth invention is dependent on the first to fifth inventions, and the information processing apparatus further includes state determination means and selection means. The state determination unit determines whether all of the predetermined number of touch positions are included in the predetermined range when the number of touch positions detected by the touch number detection unit is the second predetermined number. The selection unit selects a plurality of pages when the state determination unit determines that all of the predetermined number of touch positions are included in the predetermined range. The aggregation unit generates an aggregated image including a plurality of fourth reduced images obtained by reducing a plurality of images corresponding to the plurality of pages selected by the selection unit.

  According to the sixth aspect, it is possible to select a plurality of pages to be aggregated without depending on the number of touch positions, and to aggregate the selected plurality of pages.

  7th invention is provided in relation to the touch input detection means which detects a touch input, and a touch input detection means, and displays an image on one screen for every page according to the touch input detected by the touch input detection means An information processing program for an information processing device, comprising: a display unit that detects a total number of touch positions corresponding to the touch input detected by the touch input detection unit in a processor of the information processing device; A classification step for classifying a plurality of touch positions corresponding to a plurality of touch inputs detected by the touch input detection means into two groups when the total number detected in the step is a predetermined number or more; When the positional relationship of the group changes, the touch position included in at least one of the groups A first reduced image obtained by reducing the first image of the page corresponding to the number of the second image, and a second reduced image obtained by reducing the second image of the page corresponding to the number of touch positions included in the other group. An information processing program that executes an aggregation step of generating an aggregated image aggregated to fit on a screen and a step of displaying the aggregated image generated in the aggregation step on a display unit.

  An eighth invention is provided in association with a touch input detecting means for detecting a touch input and the touch input detecting means, and displays an image on a single screen for each page according to the touch input detected by the touch input detecting means. An information processing method for an information processing apparatus, comprising: a display means for detecting (a) a total number of touch positions corresponding to the touch input detected by the touch input detection means; and (b) detecting in step (a). When the total number is equal to or greater than the predetermined number, the plurality of touch positions corresponding to the plurality of touch inputs detected by the touch input detecting means are classified into two groups, and (c) the two classified in step (b) When the positional relationship of the group changes, the first image obtained by reducing the first image of the page corresponding to the number of touch positions included in at least one of the groups Including a small image and a second reduced image obtained by reducing the second image of the page corresponding to the number of touch positions included in the other group, generating an aggregated image that is aggregated to fit on one screen, and ( d) An information processing method for displaying the aggregated image generated in step (c) on the display means.

  In the seventh and eighth inventions, similarly to the first invention, a desired plurality of pages can be easily aggregated on a single screen by an intuitive operation regardless of the image currently displayed on the display means. Can be displayed.

  According to the present invention, the images corresponding to a plurality of pages are reduced and collected on one screen according to the number of touches, so that the desired operation can be performed with an intuitive operation regardless of the image currently displayed on the display means. Multiple pages can be easily aggregated and displayed on a single screen. For this reason, a desired page can be easily confirmed.

FIG. 1 is a block diagram showing an electrical configuration of an information processing apparatus according to the first embodiment of the present invention. FIG. 2 is an illustrative view showing one example of a touch screen displayed on the display shown in FIG. FIG. 3 is an illustrative view showing one example for explaining an aggregation operation when a plurality of pages are aggregated on the display shown in FIG. 1. FIG. 4 is an illustrative view showing one example of an aggregation screen displayed on the display shown in FIG. FIG. 5A is an illustrative view showing a distribution of a plurality of detected touch positions, and FIG. 5B is an illustrative view showing a state in which the plurality of touch positions are classified into two groups. FIG. 6 is an illustrative view showing one example of a memory map of the RAM shown in FIG. FIG. 7 is a flowchart showing a part of an example of processing in the edit mode of the CPU shown in FIG. FIG. 8 is a flowchart showing another part of the edit mode processing of the CPU shown in FIG. FIG. 9 is an illustrative view for explaining an aggregation operation when a plurality of pages are aggregated in the second embodiment. FIG. 10 is an illustrative view showing another example of the aggregation screen of the display shown in FIG. FIG. 11 is a flowchart showing a part of the edit mode processing of the CPU in the second embodiment and subsequent to FIG. FIG. 12 is a flowchart showing a part of the edit mode processing of the CPU in the third embodiment and following FIG. FIG. 13 is an illustrative view for explaining an operation method for selecting pages to be aggregated without depending on the number of touches when a plurality of pages are aggregated in the fourth embodiment. FIG. 14 is an illustrative view showing one example of a page selection screen displayed when pages to be collected are selected regardless of the number of touches in the fourth embodiment. FIG. 15 is an example of processing in the edit mode of the CPU in the fourth embodiment, and is a flow diagram for a portion changed from the edit mode processing in the first embodiment.

[First embodiment]
Referring to FIG. 1, information processing apparatus 10 according to the first embodiment of the present invention includes a CPU 12. A RAM 14, a touch panel control circuit 16, a drawing control circuit 18, and an HDD (hard disk drive) 24 are connected to the CPU 12 via a bus 30. A touch panel 20 is connected to the touch panel control circuit 16, and a display 22 is connected to the drawing control circuit 18.

  The information processing apparatus 10 according to the first embodiment is applied to various information devices or electronic devices such as a tablet terminal, a smartphone, a PC, an electronic desk (digital table), and an electronic blackboard.

  In the first embodiment, a case where the touch panel 20 is used as an example of an input unit will be described. However, a touch pad may be used instead of the touch panel 20. The information processing apparatus 10 may be provided with hardware operation buttons such as an operation panel or a hardware keyboard as other input means.

  Returning to FIG. 1, the CPU 12 governs overall control of the information processing apparatus 10. The RAM 14 is used as a work area and a buffer area for the CPU 12.

  The touch panel control circuit 16 applies a necessary voltage to the touch panel 20, detects a touch operation (touch input) within the touch effective range of the touch panel 20, and indicates a touch input position (touch position). The coordinate data is output to the CPU 12.

  The operation (input) using the touch panel 20 includes tap (short press), slide (drag), flick, long tap (long press), etc. In the first embodiment, these are “touch operation” or “ “Touch input” is a generic term. Further, changing from a state where the touch panel 20 is not touched to a state where the touch panel 20 is touched is referred to as touch-on (pen down), and changing from a state where the touch panel 20 is touched to a state where the touch panel 20 is not touched is referred to as touch-off (pen Say up). In response to continuous touch input, that is, input by sliding or flicking, the touch panel 20 outputs touch coordinate data corresponding to the current touch position at a cycle shorter than a predetermined cycle. For example, the predetermined period is 1 to several frames, and one frame is 1/30 second, 1/60 second or 1/120 second.

  The touch panel 20 is a general-purpose touch panel, and an arbitrary system such as a capacitance system, an electromagnetic induction system, and an infrared system can be used. In the first embodiment, as the touch panel 20, a capacitive touch panel is provided on the display surface of the display 22. However, the touch panel may not be provided on the display surface of the display 22.

  The user operates the touch panel 20 with fingers. However, the user can also operate with a dedicated pen. The touch panel 20 of the first embodiment is a multi-touch touch panel, and can detect a plurality of touch inputs simultaneously. Accordingly, when the touch panel 20 simultaneously detects a plurality of touch inputs, the touch panel 20 outputs touch coordinate data for each touch position corresponding to each touch input to the CPU 12.

  The drawing control circuit 18 includes a GPU, a VRAM, and the like. Under the instruction of the CPU 12, the GPU uses image data (drawing data 304b and image generation data 304c described later: see FIG. 6) stored in the RAM 14. Display image data to be displayed on the display 22 is generated in the VRAM, and the generated display image data is output to the display 22. As the display 22, for example, an LCD or an EL (Electro-Luminescence) display can be used.

  The HDD 24 is a non-volatile memory, and stores the operating system of the information processing apparatus 10 and various application software, and stores various data. In the first embodiment, a case where the HDD 24 is built in the information processing apparatus 10 is shown, but the HDD 24 may be provided outside the information processing apparatus 10 so as to be communicable. Further, instead of or together with the HDD 24, other nonvolatile storage media such as a flash memory, a storage medium such as a memory card or a memory stick, or a disk storage medium such as a CD or a DVD can be used. .

  FIG. 2 is an illustrative view showing one example of a touch screen 100 displayed on the display 22 shown in FIG. On the touch screen 100, an image of a character, a figure, or a symbol handwritten by the user, or an image that includes two or more of them in combination is displayed. Hereinafter, these images are referred to as handwritten images. However, when the drawing software (drawing application program) is executed in the information processing apparatus 10 and the edit mode is selected, the blank screen touch screen 100 is displayed on the display 22.

  In addition, although this 1st Example demonstrates the case where the handwritten image handwritten by the user is displayed on the touch screen 100, it does not need to be limited to this. For example, an image corresponding to image data stored in the HDD 24 of the information processing apparatus 10, image data acquired from a storage medium connected to the information processing apparatus 10, another information processing apparatus 10 connected communicably or a PC, and the like. May be displayed.

  Although detailed explanation is omitted, in edit mode, drawing a handwritten image, selecting a line color or fill color, erasing, copying, cutting, enlarging or reducing characters, figures or symbols, etc. Various processes (editing processes) can be executed. In this editing mode, a page can be added, the page can be moved, and data (image file) corresponding to the edited image can be stored in the HDD 24.

  Normally, the touch screen 100 is a screen for one page, and as described above, the page can be moved (another page is displayed) in accordance with a user operation. For example, the other page is an unedited blank page or an edited or already edited page on which a handwritten image has already been drawn.

  For example, when a desired page is confirmed after the editing operation has progressed and a plurality of pages have been created (edited), the user displays the touch screen 100 for the desired page on the display 22. For example, when it is desired to confirm a plurality of pages, the touch screen 100 for each of the plurality of pages is sequentially displayed on the display 22.

  For this reason, when there are a large number of pages to be confirmed, it is troublesome to display each of the large number of pages on the display 22 in order, and it takes time to confirm. Therefore, in the first embodiment, a plurality of pages are aggregated into one page (one screen) and displayed on the display 22. However, in the first embodiment, a desired plurality of pages can be easily aggregated by an intuitive operation.

  FIG. 3 is an illustrative view for explaining an example of an operation (hereinafter referred to as “aggregation operation”) performed when pages are aggregated on the touch screen 100 displayed on the display 22. FIG. 4 is an illustrative view showing one example of an aggregation screen 200 displayed when an aggregation operation is executed in the first embodiment. However, in FIG. 3, only a part of the user's hand is shown. In FIG. 3, the ellipse is hatched to indicate that the user's finger is touching the touch panel 20. These also apply to a second embodiment (FIG. 9) and a fourth embodiment (FIG. 13) described later.

  As shown in FIG. 3, the user touches the display surface of the display 22 (the detection surface of the touch panel 20), that is, the touch screen 100 with both hands. At this time, in the first embodiment, the user designates the top and bottom page numbers of consecutive pages to be aggregated using the left and right fingers. Subsequent to this touch operation, the user slides so as to bring both hands closer as indicated by the white arrows in FIG. That is, the user performs a touch operation with both hands so as to pinch in. In this way, the operation or action of touching with both hands and sliding to bring both hands closer is the aggregation operation in the first embodiment. However, when sliding so that both hands approach, it is not necessary to slide both hands, and you may slide so that one of the left hand and the right hand may approach the other.

  In the example shown in FIG. 3, the left index finger is touched, and the right index finger, middle finger, and ring finger are touched. That is, the number of touches on the left hand is 1, and the number of touches on the right hand is 3. In the first embodiment, each of the number of touches touched with the left hand and the number of touches touched with the right hand corresponds to a page number. Therefore, when an aggregation operation is performed as shown in FIG. 3, it is instructed to aggregate the third page from the first page. However, in the aggregation operation, it is only necessary to specify different page numbers for the left hand and the right hand, so the number of touches of the left hand and the right hand may be reversed.

  When the aggregation operation is performed as illustrated in FIG. 3, an aggregation screen 200 as illustrated in FIG. 4 is displayed on the display 22. The aggregate screen 200 may be displayed instead of the touch screen 100, or may be displayed on the front surface of the touch screen 100.

  As shown in FIG. 4, an image 202, an image 204, and an image 206 are displayed on the aggregation screen 200. The image 202 is a reduced image obtained by reducing the first page, the image 204 is a reduced image obtained by reducing the second page, and the image 206 is a reduced image obtained by reducing the third page. That is, the consolidated screen 200 is a consolidated image obtained by reducing the images of the first page to the third page and collecting them so as to fit on one page (one screen). The same applies to a case where a plurality of pages are aggregated so as to fit on one page (one screen).

  Although illustration is omitted, in the edit mode, the second page and the third page are also created, and when the second screen is instructed to be displayed on the touch screen 100 shown in FIG. When the touch screen 100 for the page is displayed and an instruction to display the third page is given, the touch screen 100 for the third page is displayed. However, the image of the second page corresponds to an image obtained by enlarging the image 204 over the entire display area of the display 22, and the image of the third page corresponds to an image obtained by enlarging the image 206 over the entire display area of the display 22.

  For example, on the aggregation screen 200, the reduced image having the smallest page number is displayed on the upper left, and the page number increases toward the aggregation screen 200 (display surface on the display 22) in the right direction and the downward direction. A plurality of reduced images corresponding to each page are arranged. However, the reduction ratio of the reduced image is determined in advance according to the number of pages to be aggregated.

  However, when the number of pages to be aggregated is 2, toward the aggregation screen 200, a reduced image of a page with a small page number is arranged on the left side, and a reduced image of a page with a large page number is arranged on the right side. .

  Next, a method for determining whether or not an aggregation operation has been performed will be described. In the first embodiment, as described above, in the aggregation operation, both hands touch and slide to bring both hands closer. At this time, a page number is designated for each of the left hand and the right hand. Therefore, when the page numbers of pages to be collected with the left hand and the right hand are designated, the minimum value of the total number of touch positions is 3, and the maximum value of the total number of touch positions is 9.

  First, when a touch input is detected, the total number of touch positions is detected, and it is determined whether the total number of touch positions is 3 or more. If the total number of touch positions is 2 or less, it is determined that the operation is not an aggregation operation, and another process (an editing process other than the aggregation process) corresponding to the touch input is executed. When the total number of touch positions is 3 or more, it is subsequently determined whether or not both hands have been slid so as to approach each other. Note that even when the total number of touch positions is 10 or more, it may be determined that the user does not perform an aggregation operation.

  As described above, since the page number is designated by the number of touches of the left hand and the number of touches of the right hand, when determining whether or not both hands have been slid so as to approach each other, the touch input of the left hand (touch position) A plurality of touch positions are classified into a group and a right hand touch input (touch position) group, and it is determined whether or not the two groups gradually approach.

  Here, a method for classifying a plurality of touch positions into two groups G1 and G2 will be described. For example, when the number of pages is designated with the left hand or the right hand, it is considered that the plurality of fingers touch-inputted with the left hand or the right hand are within a range of a predetermined length R (for example, 25 cm). This is a numerical value obtained empirically through experiments and the like. However, the predetermined length R is appropriately changed according to the size of the detection range of the touch panel 20 (display range of the display 22).

  Accordingly, one reference touch position P0 is arbitrarily determined from the detected plurality of touch positions, and the reference touch position P0 and another plurality of touch positions Pn (n = 1, 2,..., N−1). The distance dm from each of the above is calculated. However, the distance dm (m = 1, 2,..., N) is calculated according to Equation 1. In Equation 1, the touch coordinates of the reference touch position P0 are (x0, y0), and the touch coordinates of other touch positions Pn are (xn, yn).

[Equation 1]
dm = √ {(xn−x0) ² + (yn−y0) ² }
FIG. 5A is an illustrative view showing a distribution of a plurality of detected touch positions, and FIG. 5B is an illustrative view showing a state in which the plurality of touch positions are classified into two groups.

  FIG. 5A and FIG. 5B show a two-dimensional coordinate system set on the touch panel 20. For example, the top left vertex of the touch panel 20 is set to the origin O, the horizontal direction is the X axis direction, and the vertical direction is the Y axis direction. The right direction is the positive direction of the X axis, and the downward direction is the positive direction of the Y axis. Although illustration is omitted, for example, the coordinate system set on the touch panel 20 is the same as the coordinate system set on the display surface of the display 22. Further, in FIGS. 5A and 5B, the quadrilaterals indicated by the X axis, the Y axis, and the dotted line correspond to the entire detection range of the touch panel 20.

  For example, as shown in FIG. 5, when five touch positions are detected, the reference touch position P0 is arbitrarily determined from these five touch positions as described above. A plurality of other touch positions P1, P2, P3, and P4 are also determined. As described above, when the reference touch position P0 and a plurality of other touch positions Pn are determined, each touch position is tracked until it is touched off using a variable until it is determined whether or not an aggregation operation is performed ( Monitored). Subsequently, according to Equation 1, the distance dm between the reference touch position P0 and each of the other touch positions Pn is calculated.

  When the distance dm from the reference touch position P0 is equal to or less than the predetermined distance R, the other touch position Pn when the distance dm is calculated is determined to be the same group (for example, group G1) as the reference touch position P0. Is done. On the other hand, when the distance dm from the reference touch position P0 exceeds the predetermined distance R, another touch position Pn when the distance dm is calculated is determined to be another group (for example, group G2). Thus, according to the distance dm, the plurality of touch positions are classified into two groups. In the example shown in FIG. 5A, as shown in FIG. 5B, it is classified into two groups G1 and G2.

  Further, when there are a plurality of touch positions Pn classified into the group G2, it is determined whether or not the plurality of touch positions Pn are included in a range (predetermined range) of the predetermined distance R. Here, one touch position Pn is arbitrarily selected from the plurality of touch positions Pn, the distance dp between the selected touch position Pn and each of the remaining touch positions Pn is calculated, and all the distances dp are set to a predetermined distance R. It is determined whether or not: The method for calculating the distance dp is the same as the method for calculating the distance dm shown in Equation 1.

  If there is even one touch position where the distance dm exceeds the predetermined distance R, it is determined that the operation is not an aggregation operation because there are three or more groups. If there is no touch position where the distance dp exceeds the predetermined distance R, it is determined that the plurality of touch positions can be classified into the two groups G1 and G2.

  In the first embodiment, the reference touch position P0 is arbitrarily determined from a plurality of touch positions. However, when the left hand and the right hand are relatively close when touching with both hands, If the close touch position is determined as the reference touch position P0, it may be considered that the two groups G1 and G2 may not be correctly classified. Therefore, the reference touch position P0 may be determined as a touch position located on the rightmost (X coordinate is maximum) or left (X coordinate is minimum) among a plurality of touch positions.

  When the plurality of touch positions are classified into the two groups G1 and G2, it is determined whether or not the two groups G1 and G2 gradually approach. In the first embodiment, center coordinates (average coordinates) of touch positions included in each of the groups G1 and G2 are calculated every predetermined time (for example, several frames to several tens frames), and a distance dq between the centers is calculated. Then, it is determined whether or not the calculated distance dq is gradually shortened.

  When the distance dq between the centers does not change or the distance dq between the centers gradually increases, it is not determined that there is an aggregation operation. On the other hand, when the distance dq between the centers is gradually shortened, it is determined that the two groups G1 and G2 are gradually approaching, and it is determined that there is an aggregation operation.

  When it is determined that there is an aggregation operation, the number of touch positions (number of touches) K1 and K2 included in each of the two groups G1 and G2 is detected, and according to the number of touches K1 and K2 of each group G1 and G2. Thus, the aggregation process is executed. In the first embodiment, as described above, the page corresponding to the touch number K1 of one group (for example, group G1) and the page corresponding to the touch number K2 of the other group (for example, group G2), and those pages The pages between the pages are aggregated to fit on one screen (one page) and displayed on the display 22. That is, a plurality of pages from a page corresponding to one touch number to a page corresponding to the other touch number are integrated into one page. Therefore, as shown in FIG. 4, a plurality of pages specified by the number of left hand touches and the number of right hand touches are reduced at a reduction ratio corresponding to the number of pages, and an aggregate including reduced images of each of the plurality of pages. A screen 200 is displayed on the display 22.

  FIG. 6 is an illustrative view showing one example of a memory map 300 of the RAM 14 shown in FIG. As shown in FIG. 6, the RAM 14 includes a program storage area 302 and a data storage area 304. The program storage area 302 stores an information processing program such as a drawing application program executed by the information processing apparatus 10, and the drawing application program includes an input detection program 302a, an image generation program 302b, a display program 302c, and a total number detection program 302d. , A grouping program 302e and an aggregation program 302f. The drawing application program is read from the HDD 24 and stored in the RAM 14.

  The input detection program 302a is a program for detecting a touch input. The CPU 12 acquires touch coordinate data output from the touch panel 20 according to the input detection program 302a, and the acquired touch coordinate data is stored in the RAM 14 according to time series. To remember. However, as described above, when a hardware button is provided or when a hardware keyboard is connected, the input of the button or key is also detected according to the input detection program 302a.

  The image generation program 302b is a program for generating screen data for various display screens such as the touch screen 100 and the aggregate screen 200 described above. However, when generating the screen data, the image generation program 302b uses data on the handwritten image (drawing data 304b described later) and image generation data 304c described later. The screen data is generated on the VRAM by the GPU built in the drawing control circuit 18 under the instruction of the CPU 12.

  The display program 302c is a program for displaying a display screen corresponding to the screen data generated according to the image generation program 302b on the display 22, and the CPU 12 controls the drawing control circuit 18 to generate a screen generated on the VRAM. Data is output to the display 22.

  The total number detection program 302d is a program for detecting the total number N of touch positions. In accordance with the total number detection program 302d, the CPU 12 detects the number of touch coordinate data acquired in the same frame as the total number N of touch positions.

  The grouping program 302e is a program for classifying a plurality of touch positions into two groups G1 and G2 when the total number N of touch positions detected according to the total number detection program 302d is 3 or more. The method for classifying the plurality of touch positions into the two groups G1 and G2 is as described above.

  The aggregation program 302f determines whether or not there is an aggregation operation by determining whether or not the central coordinates of the two groups G1 and G2 classified according to the grouping program 302e are gradually approaching. This is a program for controlling the drawing control circuit 18 to aggregate a plurality of pages designated according to the number of left hand touches and the number of right hand touches into one page. The method of consolidating a plurality of pages into one page is as described above. In the drawing control circuit 18, a method of reducing each of a plurality of pages at a predetermined reduction ratio and displaying the reduced images side by side on a single screen is already well known, and is not an essential content of the present invention. Description is omitted.

  Although illustration is omitted, the program storage area 302 also stores a program for selecting and executing various functions in the edit mode processing.

  The data storage area 304 stores operation input data 304a, drawing data 304b, image generation data 304c, touch count data 304d, and aggregated page data 304e.

  The operation input data 304a is data in which touch coordinate data output from the touch panel 20 and acquired by the CPU 12 is stored in time series. However, the operation input data 304a may include operation data for hardware buttons or keys.

  The drawing data 304b is data about a handwritten image among the touch coordinate data included in the operation input data 304a, and is managed for each page. The image generation data 304c is data used when generating various screens such as the touch screen 100 and the aggregate screen 200, and includes polygon data, texture data, and the like. The image generation data 304 c is read from the HDD 24 and stored in the RAM 14.

  The touch number data 304d is numerical data regarding the touch numbers K1 and K2 of the touch positions belonging to the groups G1 and G2 when a plurality of touch positions are classified into two groups G1 and G2. The aggregated page data 304e is numerical data for each page number of a plurality of pages determined to be aggregated according to the touch numbers K1 and K2 when an aggregation operation is performed.

  In the data storage area 304, other data necessary for executing the drawing application program is also stored, and a counter (timer) and other flags required for executing the drawing application program are also provided.

  7 and 8 are flowcharts showing the edit mode processing of the CPU 12 shown in FIG. The edit mode process is executed when the drawing application is activated (executed).

  As shown in FIG. 7, when the CPU 12 starts the processing in the edit mode, it determines in step S1 whether there is a touch input. Here, the CPU 12 determines whether or not the touch input data of the current frame is included in the operation input data 304a in the data storage area 304. Although illustration is omitted, a blank page is displayed on the display 22 when processing in the edit mode is started. However, when a stored image file is read, a page that is being edited or has been edited is displayed on the display 22.

  If “NO” in the step S1, that is, if there is no touch input, the process returns to the same step S1. On the other hand, if “YES” in the step S1, that is, if there is a touch input, the total number N of touch positions is detected in a step S3. Here, the CPU 12 refers to the operation input data 304 a stored in the data storage area 304 and detects the number of touch coordinate data of the current frame.

  Although illustration is omitted, when the drawing application is activated, the CPU 12 acquires touch coordinate data output from the touch panel 20 and stores the data in the data storage area 304 in parallel with the edit mode process. Run.

  In a succeeding step S5, it is determined whether or not the total number N of touch positions is 3 or more. If “NO” in the step S5, that is, if the total number N of touch positions is 2 or less, another process corresponding to the touch input is executed in a step S7, and the process proceeds to the step S9. In step S7, an editing process other than the process of aggregating a plurality of pages is executed, a page is added, a page is moved, and an image file is saved in response to a touch input.

  In step S9, it is determined whether or not the process is finished. Here, the CPU 12 determines whether or not the user has instructed to end the editing mode process (drawing application). If “NO” in the step S9, that is, if not finished, the process returns to the step S1. On the other hand, if “YES” in the step S9, if it is finished, the editing mode processing is finished.

  If “YES” in the step S5, that is, if the total number N of touch positions is 3 or more, the distance between the reference touch position P0 and the plurality of other touch positions Pn is calculated in a step S11. However, in step S11, the CPU 12 arbitrarily determines a reference touch position P0 from a plurality of touch positions, and also determines a plurality of other touch positions Pn.

  In subsequent step S13, the plurality of touch positions are classified into groups included within a predetermined distance R (for example, 15 cm). In the next step S15, it is determined whether or not there are two groups. If “NO” in the step S15, that is, if one or more groups are present, it is determined whether or not the touch position has changed in a step S17. Here, the CPU 12 determines whether or not the touch position of the current frame is different from the touch position of the previous frame. However, if any one of the detected touch positions is changed, it is determined that the touch position has changed. As described above, after the reference touch position P0 and a plurality of other touch positions Pn are determined, each is tracked (monitored) using a variable until touch-off.

  If “NO” in the step S17, that is, if the touch position is not changed, the process returns to the same step S17. However, if the touch position does not change for a predetermined time or longer, the touch position may be changed, or a message indicating that touch-off should be performed once may be displayed, and the process may return to step S1. On the other hand, if “YES” in the step S17, that is, if the touch position is changed, the process returns to the step S3.

  If “YES” in the step S15, that is, if there are two groups, the touch numbers K1 and K2 of the groups G1 and G2 are detected in a step S19. At this time, touch number data 304d corresponding to the touch numbers K1 and K2 is stored in the data storage area 304, and aggregated page data 304e for pages to be aggregated (page numbers) is stored in the data storage area 304.

  In a succeeding step S21, it is determined whether or not the center coordinates of the two groups G1 and G2 are gradually approaching. In step S21, as described above, the CPU 12 calculates the distance dq between the central coordinates of the two groups every several frames or several tens of frames, and determines whether the distance dq is gradually shortened.

  If “NO” in the step S21, that is, if the center coordinates of the two groups G1 and G2 are not approaching, the process returns to the same step S21. On the other hand, if “YES” in the step S21, that is, if the central coordinates of the two groups G1 and G2 are gradually approaching, it is determined that there is an aggregation operation, and the page corresponding to the touch number K1 is determined in a step S23. The pages corresponding to the number of touches K2 and the pages between these pages are consolidated into one page, displayed on the display 22, and the process returns to step S1. However, in step S23, the CPU 12 refers to the aggregated page data 304e and acquires a page (page number) to be aggregated.

  According to the first embodiment, when a user performs a touch operation so as to pinch in with both hands, a page corresponding to the number of touches of the left hand, a page corresponding to the number of touches of the right hand, and a page between those pages are displayed as one page. Therefore, regardless of the page displayed on the display 22 when performing the aggregation operation, a plurality of desired pages can be easily aggregated into one page by an intuitive operation. Can be displayed. For this reason, a desired page can be easily confirmed.

  In the first embodiment, in order to determine the presence or absence of the aggregation operation, it is determined whether or not the center coordinates of the two classified groups G1 and G2 are gradually approaching. However, the present invention is not limited to this. There is no need. For example, a representative touch position may be determined from each of the two classified groups G1 and G2, and it may be determined whether the distance between the representative touch positions is gradually approaching. Further, instead of the distance dq between the center coordinates of the two groups G1 and G2, it may be determined whether at least one of the two-dimensional components of the center coordinates is approaching. This is the same when the representative touch position is determined.

  Further, in this first embodiment, when it is determined that there is an aggregation operation, the pages are aggregated and displayed. However, after it is determined that there is an aggregation operation and all fingers are touched off, The pages may be aggregated and displayed.

Furthermore, in the first embodiment, when the total number N of detected touch positions is 3 or more, the plurality of touch positions are classified into two groups G1 and G2. However, the present invention is not limited to this. Absent. For example, in the operation guide, when pages are collected, it is explained that the left hand and the right hand are touched while being shifted by a certain amount of time (for example, 2 to 3 seconds). The touch position corresponding to the touch input performed and the touch position corresponding to the touch input detected later in time may be classified into two groups G1 and G2.
[Second Embodiment]
In the information processing apparatus 10 of the second embodiment, when the two classified groups are gradually moving away from each other, the page corresponding to the touch number K1 and the page corresponding to the touch number K2 are aggregated, The same as in the first embodiment. Therefore, contents different from the first embodiment will be described, and overlapping contents will be briefly described or omitted.

  FIG. 9 is an illustrative view for explaining an aggregation operation in the second embodiment. FIG. 10 is an illustrative view showing another example of the aggregation screen when the aggregation operation is executed.

  As shown in FIG. 9, in the second embodiment, the touch screen 100 is touched with both hands, and the left hand or the right hand or both hands are moved so that the left hand and the right hand gradually move away (separate) as indicated by the white arrows. , The page corresponding to the number of left hand touches and the page corresponding to the number of right hand touches are combined into one page. That is, if the left and right hands are touched so as to pinch out, pages can be collected.

  In the example illustrated in FIG. 9, the number of touches on the left hand is “1” and the number of touches on the right hand is “3”, so the first page and the third page are collected. That is, the image corresponding to the first page is reduced, and the image corresponding to the third page is reduced, and each reduced image is arranged at a predetermined position.

  Accordingly, an aggregate screen 200 ′ as shown in FIG. 10 is displayed on the display 22. In this aggregation screen 200 ′, an image 202 that is a reduced image of the first page and an image 206 that is a reduced image of the third page are displayed side by side.

  In the second embodiment, two pages designated by each of the left hand and the right hand are aggregated. Therefore, when the pages are aggregated, a reduction ratio for reducing the image is determined in advance. In the second embodiment, since two pages designated by the left hand and the right hand are combined, an image with a smaller page number is displayed on the left side of the two pages, and the page number is displayed on the right side. A large image is displayed.

  In the second embodiment, as in the first embodiment, when the total number N of touch positions is a predetermined number (for example, 3) or more, the plurality of touch positions are classified into two groups G1 and G2. . Then, when the distance between the center coordinates of the two groups G1 and G2 gradually increases (separates), it is determined that there is an aggregation operation.

  Therefore, in the second embodiment, the aggregation program 302f is different from the first embodiment in that it determines whether the distance dq between the center coordinates of the two groups G1 and G2 becomes gradually longer (separated). However, as described above, in the second embodiment, the pages corresponding to the number of touches of the left hand and the pages corresponding to the number of touches of the right hand are aggregated into one page.

  FIG. 11 is a flowchart showing a part of the editing mode processing of the CPU 12 in the second embodiment and subsequent to FIG.

  As for the specific edit mode process, as shown in FIG. 11, in the edit mode process of the first embodiment shown in FIGS. 7 and 8, a part of the process in FIG. 8 is changed. Therefore, the same reference numerals are assigned to the same processes.

  As shown in FIG. 11, in the edit mode process of the second embodiment, when the CPU 12 detects the touch numbers K1 and K2 of each group in step S19, the central coordinates of the two groups G1 and G2 are detected in step S31. Determine whether is gradually moving away. Here, the CPU 12 calculates the distance between the center coordinates of the two groups G1 and G2 every several frames or several tens of frames, and determines whether the distance is gradually increased.

  If “NO” in the step S31, that is, if the center coordinates of the two groups G1 and G2 are not moved away, the process returns to the same step S31 as it is. On the other hand, if “YES” in the step S31, that is, if the center coordinates of the two groups are gradually moved away, in step S33, the page corresponding to the touch number K1 and the page corresponding to the touch number K2 are integrated into one page. And it displays on the display 22, and returns to step S1.

  According to the second embodiment, similarly to the first embodiment, two desired pages can be made into one page by an intuitive operation regardless of the page displayed on the display 22 when performing the aggregation operation. They can be easily aggregated and displayed on the display 22.

In the second embodiment, in order to determine the presence or absence of the aggregation operation, it is determined whether the central coordinates of the two classified groups G1 and G2 are gradually moving away from each other. However, the present invention is not limited to this. There is no need. For example, a representative touch position may be determined from each of the two classified groups G1 and G2, and it may be determined whether or not the distance between the representative touch positions is gradually increasing. Further, instead of the distance dq between the center coordinates of the two groups G1 and G2, it may be determined whether at least one of the two-dimensional components of the center coordinates is moving away. This is the same when the representative touch position is determined.
[Third embodiment]
In the third embodiment, when the two classified groups are gradually approaching, the page corresponding to the touch number K1, the page corresponding to the touch number K2, and the page between them are aggregated into one page, and classified. When the two groups are gradually moving away from each other, the page is the same as the first embodiment except that the page corresponding to the touch number K1 and the page corresponding to the touch number K2 are aggregated into one page. . Therefore, contents different from the first embodiment will be described, and overlapping contents will be briefly described or omitted.

  In this third embodiment, as shown in FIG. 3, when the user performs a touch operation with both hands so as to pinch in, as shown in FIG. An aggregate screen 200 in which pages corresponding to the numbers and pages between them are aggregated into one page is displayed on the display 22. On the other hand, as shown in FIG. 9, when the user performs a touch operation with both hands so as to pinch out, as shown in FIG. 10, the page corresponding to the number of left hand touches and the number of right hand touches are handled. Pages are consolidated into one page.

  Therefore, in the third embodiment, the aggregation program 302f determines whether or not the distance dq between the center coordinates of the two groups G1 and G2 gradually decreases, and also determines the distance dq between the center coordinates of the two groups G1 and G2. To see if it becomes longer. Then, when the distance dq is gradually shortened, the aggregation program 302f aggregates the page corresponding to the touch number K1, the page corresponding to the touch number K2, and the pages between them into one page, but the distance dq gradually increases. When it becomes long, the page corresponding to the touch number K1 and the page corresponding to the touch number K2 are integrated into one page.

  FIG. 12 is a part of the edit mode process in the third embodiment and is a flowchart subsequent to FIG.

  As for the specific edit mode process, as shown in FIG. 12, in the edit mode process of the first embodiment shown in FIGS. 7 and 8, the process shown in FIG. Is added. Therefore, the same reference numerals are assigned to the same processes.

  As shown in FIG. 12, when the CPU 12 detects the number of touches K1 and K2 of each group in step S19, it determines in step S21 whether the center coordinates of the two groups G1 and G2 are gradually approaching. If “YES” in the step S 21, the page corresponding to the touch number K 1, the page corresponding to the touch number K 2, and pages between those pages are aggregated into one page and displayed on the display 22 in step S 23. Return to step S1.

  On the other hand, if “NO” in the step S21, it is determined whether or not the central coordinates of the two groups G1 and G2 gradually move away in a step S31. If “NO” in the step S31, the process returns to the step S21. On the other hand, if “YES” in the step S31, the page corresponding to the touch number K1 and the page corresponding to the touch number K2 are aggregated and displayed on the display 22 in a step S33, and the process returns to the step S1.

  In the third embodiment, since the plurality of pages to be aggregated differ depending on whether the two groups G1 and G2 are gradually approaching or moving away, the aggregated page data 304e corresponding to the plurality of pages to be aggregated is When “YES” is determined in the step S21 or “YES” is determined in the step S31, the data is stored in the RAM 304 based on the touch numbers K1 and K2.

  In the third embodiment, similarly to the first embodiment, the desired two pages can be easily made into one page by an intuitive operation regardless of the page displayed on the display 22 when performing the aggregation operation. The data can be collected and displayed on the display 22.

Further, in the third embodiment, the desired two pages or three or more desired continuous pages can be consolidated into one page according to the direction in which the left hand, the right hand, or both hands are slid in the aggregation operation. Convenience is high.
[Fourth embodiment]
The fourth embodiment is the same as the first embodiment except that pages that cannot be specified by the number of touches can be further aggregated, so that different contents will be described and description of duplicate contents will be omitted, or I will briefly explain.

  FIG. 13 is an illustrative view for describing an operation method when a page to be aggregated is designated (selected) regardless of the number of touches, and a plurality of selected pages are aggregated into one page. FIG. 14 is an illustrative view showing one example of a page selection screen displayed on the display 22 when selecting a plurality of pages to be aggregated regardless of the number of touches.

  As shown in FIG. 13, when all the fingers of the left hand are touched and this state continues for a predetermined time (for example, 2 to 3 seconds), a process (function) for aggregating a plurality of pages regardless of the number of touches is executed. Then, a page selection screen 500 shown in FIG. 14 is displayed on the display 22.

  In the example shown in FIG. 13, the touch is made with the left hand, but the touch may be made with the right hand. Further, the page selection screen 500 may be displayed instead of the touch screen 100 or may be displayed so as to overlap the front surface of the touch screen 100.

  As shown in FIG. 14, the page selection screen 500 displays a plurality of icons 502 for selecting pages. In FIG. 14, the icons 502 from the first page (P1) to the second page (P20) are displayed. When the number of pages is less than 20, the number of icons 502 corresponding to the number of pages is displayed. Is done. Further, when the number of pages exceeds 20, for example, an area (part) where the icon 502 is displayed in the page selection screen 500 is scrolled, and the icon 502 is displayed so that the icons 502 on and after the 21st page can also be selected. Is done.

  For example, on the page selection screen 500, once the icon 502 is touched, the page corresponding to the touched icon 502 is selected, and when the icon 502 corresponding to the selected page is touched, the icon 502 is touched. The page corresponding to 502 is changed to a state where it is not selected. In FIG. 14, a state where a page corresponding to the icon 502 is selected is indicated by hatching the icon 502. The same applies to other icons 504, 506, and 508 described later.

  In addition, icons 504, 506, and 508 are displayed at the top of the page selection screen 500 (above the plurality of icons 502). An icon 504 is provided for selecting to combine the two pages in the selected state and the pages between them into one page. Therefore, when the two icons 502 are touched while the icon 504 is being touched, the two pages corresponding to the two icons 502 and the pages between them are selected as a plurality of pages. is there. The icon 506 is provided for selecting to combine a plurality of selected pages into one page. That is, the icons 504 and 506 are icons for selecting a page aggregation method.

  An icon 508 is provided for determining a selection of pages to be aggregated and a method of aggregation, consolidating the selected pages into one page according to the selected aggregation method, and displaying the pages on the display 22. Therefore, the icon 508 is not touched before it can be consolidated. The state where the touch cannot be performed means a state where the icon 508 is displayed in grayout (or translucent), for example, and no processing is executed even if the icon 508 is touched. Moreover, the state that can be aggregated is a state in which at least two pages are selected.

  Therefore, when the icon 508 is touched in the state shown in FIG. 14, although not shown, an aggregate screen in which eight pages from page 7 (P7) to page (P14) are aggregated is displayed on the display 22. .

  In the fourth embodiment, in order to detect that all fingers of the left hand or the right hand are touched, when the total number N of touch positions is 5, five touch positions are within a predetermined distance R range (predetermined range). ) Is determined. Specifically, one touch position is arbitrarily selected from the five touch positions, and the distance between the selected one touch position and each of the other four touch positions is calculated. If all the calculated distances are within the predetermined distance R, it is determined that all fingers of the left hand or right hand are touched.

  However, when the number of touches on the left hand and the number of touches on the right hand are combined when the touch is turned on, the total number N of touch positions may be 5, and the five touch positions may be within the range of the predetermined distance R. Therefore, in the fourth embodiment, it is determined whether or not the state in which the five touch positions are within the range of the predetermined distance R continues for a predetermined time or longer without changing the touch positions.

  Therefore, in the fourth example, the aggregation program 302f has a total number N of touch positions of 5 in addition to the aggregation process shown in the first example, and the five touch positions are predetermined without changing the touch positions. When the state of being within the range of the distance R continues for a predetermined time or longer, a process of selecting a plurality of pages regardless of the number of touches and collecting the selected plurality of pages into one page is executed.

  FIG. 15 shows a part of the edit mode process of the fourth embodiment. In the edit mode process shown in FIGS. 7 and 8, a plurality of pages are selected regardless of the number of touches, and the selected plurality of pages are selected. It is the flowchart which added the process for consolidating a page into one page. Therefore, in the following, processing different from the first embodiment will be described.

  As shown in FIG. 15, if “YES” in step S <b> 5 shown in FIG. 7, that is, if the total number N of touch positions is 3 or more, the total number N of touch positions is 5 in step S <b> 51. Determine if there is.

  If “NO” in the step S51, that is, if the total number N of touch positions is 3, 4 or 6 to 9, the process proceeds to a step S11 shown in FIG. On the other hand, if “YES” in the step S51, that is, if the total number N of touch positions is 5, a reference touch position is selected from the five touch positions in a step S53, and the reference touch position and other touches are selected. Calculate the distance to each of the positions.

  Subsequently, in step S55, it is determined whether or not the five touch positions are within the range of the predetermined distance R. If “NO” in the step S55, that is, if the five touch positions are not within the range of the predetermined distance R, the process proceeds to the step S13 shown in FIG. On the other hand, if “YES” in the step S55, that is, if the five touch positions are within the range of the predetermined distance R, it is determined whether or not there is a change in the touch position in a step S57.

  If “YES” in the step S57, that is, if there is a change in the touch position, the process returns to the step S3 shown in FIG. On the other hand, if “NO” in the step S57, that is, if there is no change in the touch position, it is determined whether or not a predetermined time (for example, 2 to 3 seconds) has elapsed in a step S59. Although not shown, the CPU 12 uses the timer to start counting time after “YES” is determined in step S55, and in step S59, the state where the five touch positions do not change continues for a predetermined time or more. Determine whether or not.

  If “NO” in the step S59, that is, if the predetermined time has not elapsed, the process returns to the step S57 as it is. On the other hand, if “YES” in the step S59, that is, if a predetermined time elapses, it is determined that a process of selecting pages to be aggregated regardless of the number of touches is executed, and in a step S61, as illustrated in FIG. A page selection screen 500 is displayed on the display 22.

  In a succeeding step S63, it is determined whether or not the determination is made. Here, the CPU 12 determines whether or not the icon 508 is touched. However, as described above, since the icon 508 cannot be touched unless at least two pages are selected, in this case, “NO” is determined in the step S63.

  If “NO” in the step S63, that is, if not determined, in a step S65, processing such as page selection or deselection is executed in accordance with a user operation, and the process returns to the step S61. In step S65, in response to the touch of the icon 502, the page corresponding to the icon 502 is selected or returned to the state where the page corresponding to the icon 502 is not selected. In step S65, the editing method corresponding to the touched icon 504 or 506 is selected in response to the touch of the icon 504 or 506, and the icon 504 or 506 corresponding to the touched icon 504 or 506 is selected. The editing method is not selected.

  On the other hand, if “YES” in the step S63, that is, if determined, it is determined whether or not it is an interpage selection in a step S67. Here, the CPU 12 determines whether or not the icon 504 is selected on the page selection screen 500.

  If “YES” in the step S67, that is, if it is an inter-page selection, the two selected pages and a page between them are integrated into one page and displayed on the display 22 in a step S69. Return to. On the other hand, if “NO” in the step S67, that is, if only the selected page is selected, only a plurality of selected pages are collected in one page in a step S71, displayed on the display 22, and the process returns to the step S1.

  According to the fourth embodiment, for pages that cannot be specified by the number of touches, a plurality of pages are selected without depending on the number of touches, and the selected pages are aggregated into one page. The number is not limited.

  In the fourth embodiment, when all fingers of the left hand or right hand are touched and the touch position remains unchanged for a predetermined time or more, a plurality of pages are selected regardless of the number of touches, The process of aggregating a plurality of selected pages is executed, but it is not necessary to be limited to this. For example, when all fingers of both hands are touched and the touch position does not change for more than a predetermined time, select the pages to be aggregated regardless of the number of touches, and select the selected pages as one page. You may make it perform the process aggregated. However, when all fingers of both hands are touched, even if the touch position does not change for a predetermined time or longer, the pages to be aggregated are selected regardless of the number of touches, and the selected pages are combined. You may perform the process integrated on a page.

  The modification of the fourth embodiment can also be applied to the second and third embodiments.

  Further, in the first to third embodiments, when the two classified groups G1 and G2 are gradually approaching, the page corresponding to the touch number K1, the page corresponding to the touch number K2, and the interval between them. The pages are aggregated into one page, and when the two classified groups G1 and G2 gradually move away, the page corresponding to the touch number K1 and the page corresponding to the touch number K2 are aggregated. The reverse may be possible.

  The screens and specific numerical values given in the above-described embodiments are examples, and can be appropriately changed according to the actual product. Moreover, when the same effect is acquired, the order of each step shown to the flowchart may be changed suitably.

10 ... Information processing device 12 ... CPU
14 ... RAM
DESCRIPTION OF SYMBOLS 16 ... Touch panel control circuit 18 ... Drawing control circuit 20 ... Touch panel 22 ... Display 24 ... HDD

Claims (8)

Touch input detection means for detecting touch input,
Display means provided in association with the touch input detection means, and displaying an image on a single screen for each page according to the touch input detected by the touch input detection means;
A total number detecting means for detecting the total number of touch positions corresponding to the touch input detected by the touch input detecting means;
Classification means for classifying a plurality of touch positions corresponding to a plurality of touch inputs detected by the touch input detection means into two groups when the total number detected by the total number detection means is a first predetermined number or more. And when the positional relationship between the two groups classified by the classification unit changes, at least a first reduced image obtained by reducing a first image of a page corresponding to the number of touch positions included in one of the groups, A second reduction image obtained by reducing the second image of the page corresponding to the number of touch positions included in the other group, and an aggregation unit that generates an aggregation image that is aggregated so as to fit on the one screen.
The information processing apparatus, wherein the display unit displays the aggregated image generated by the aggregation unit on the one screen.   The information processing apparatus according to claim 1, wherein the aggregation unit generates the aggregated image including the first reduced image and the second reduced image in response to the positions of the two groups being separated from each other.   The aggregating unit may determine whether the first reduced image, the second reduced image, the page corresponding to the first image, and the page corresponding to the second image according to the approach of the two groups. The information processing apparatus according to claim 1, wherein the aggregated image including one or a plurality of third reduced images obtained by reducing one or a plurality of third images corresponding to the page is generated.   The information processing apparatus according to claim 1, wherein the aggregation unit generates the aggregated image including the first reduced image and the second reduced image in response to the positions of the two groups approaching or separating from each other.   The aggregation means includes one or more third images corresponding to a page between the first reduced image, the second reduced image, and a page corresponding to the first image and a page corresponding to the second image. The information processing apparatus according to claim 1, wherein the aggregated image including one or a plurality of reduced third reduced images is generated. State determination means for determining whether all of the predetermined number of touch positions are included in a predetermined range when the number of touch positions detected by the touch number detection means is a second predetermined number; and the state determination When it is determined by the means that all of the predetermined number of touch positions are included in the predetermined range, the display apparatus further comprises selection means for selecting a plurality of pages.
6. The aggregated image according to claim 1, wherein the aggregation unit generates the aggregated image including a plurality of fourth reduced images obtained by reducing a plurality of images corresponding to a plurality of pages selected by the selection unit. Information processing device. Touch input detecting means for detecting a touch input, and display means provided in association with the touch input detecting means for displaying an image on a single screen for each page according to the touch input detected by the touch input detecting means. An information processing program for an information processing apparatus, comprising:
In the processor of the information processing apparatus,
A total number detecting step of detecting a total number of touch positions corresponding to the touch input detected by the touch input detecting means;
A classification step of classifying a plurality of touch positions corresponding to a plurality of touch inputs detected by the touch input detection means into two groups when the total number detected in the total number detection step is a predetermined number or more;
When the positional relationship between the two groups classified in the classification step changes, at least the first reduced image obtained by reducing the first image of the page corresponding to the number of touch positions included in one of the groups, and the other An aggregation step including a second reduced image obtained by reducing a second image of a page corresponding to the number of touch positions included in the group, and generating an aggregated image that is aggregated to fit on the one screen; and the aggregation step An information processing program for causing the display unit to display the aggregated image generated in step 1. Touch input detecting means for detecting a touch input, and display means provided in association with the touch input detecting means for displaying an image on a single screen for each page according to the touch input detected by the touch input detecting means. An information processing method for an information processing apparatus, comprising:
(A) detecting the total number of touch positions corresponding to the touch input detected by the touch input detection means;
(B) When the total number detected in the step (a) is a predetermined number or more, the plurality of touch positions corresponding to the plurality of touch inputs detected by the touch input detection means are classified into two groups,
(C) When the positional relationship between the two groups classified in step (b) changes, at least a first reduction obtained by reducing the first image of the page corresponding to the number of touch positions included in one of the groups An aggregated image including an image and a second reduced image obtained by reducing a second image of a page corresponding to the number of touch positions included in the other group, and aggregated to fit on the one screen; and (D) An information processing method for displaying the aggregated image generated in the step (c) on the display means.

Images