JP2019161639A - Image processing apparatus, program and image processing method - Google Patents

Abstract

To solve such the problem that it is difficult to correctly specify a desired area when an image obtained by scanning the entire original platen is displayed, in the case of specifying a repeat object area used in image repeat processing.SOLUTION: In an image processing apparatus, a document area is detected by performing image analysis processing with respect to a scan image, and a document image after tilt correction is obtained by executing extraction and tilt correction of the document image on the basis of the detected document area. The document image after the tilt correction and a frame indicating a repeat target area are displayed with the area corresponding to the document image after the tilt correction as the initial repeat target area, and a repeat target area specification screen for changing the position of the displayed frame is displayed on the basis of the instruction of the user. Then, an output image after repeat layout processing is generated by repetitively laying out an image of the repeat target area determined on the basis of the frame set in the screen within the specified sheet size, and print processing can be executed.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an image repeat process in which a part of a document image included in a scanned image is set as a repeat target image, and the repeat target image is repeatedly arranged and printed on one recording sheet. .

  Some image forming apparatuses such as copiers and multifunction machines have an image repeat printing function. This image repeat printing is a function of setting a part of an image (original image) of a single document read by a scanner as a repeat target image, and repeatedly arranging the repeat target image and printing it on a single recording sheet. In Patent Document 1, the user can select whether or not to add a margin between adjacent repeat target images when repeatedly arranged, and the user can set the number of repeats in the vertical direction and the number of repeats in the horizontal direction. And the like.

  In Patent Document 2, an image read by a scanner is displayed, a user designates a vertex of a rectangular frame on the displayed image, a portion corresponding to the rectangular frame is hollowed out, and the hollowed image is a repeat target. It is described that images are repeatedly arranged and printed.

JP 2004-248262 A JP 2011-055131 A

  On the other hand, when scanning a document placed on the scanner's document table, if the document size cannot be detected by the scanner's document size detection sensor, the entire document table is scanned and the scanned image is the same size as the document table. Will get. When the technique of Patent Document 2 is applied to the scan image obtained in this way, the scan image having the same size as the entire document table is displayed, and the user selects a desired area from the displayed scan image. Will do. However, when the size of the document placed on the document table is, for example, a business card size, it is considerably smaller than the size of the document table (for example, A3 size). Therefore, when the entire scanned image of the same size as the document table (for example, an A3 size image) is displayed on the screen, the area of the business card size included in the scanned image is displayed small, and the user Makes it difficult to specify the exact region you want to repeat. In addition, after the entire scanned image is displayed on the screen, it is possible to enlarge the designated portion based on the user's manual operation, and then specify the repeat target area. In that case, the user can select the desired portion. It is necessary to perform an enlargement display operation, which is troublesome.

  In order to solve the above-described problem, the image processing apparatus of the present invention detects an original area by executing image analysis processing on a scanned image, and extracts an original image and corrects an inclination based on the detected original area. And an extraction unit that obtains a document image after inclination correction by executing the above and a region corresponding to the document image after inclination correction obtained by the extraction unit as an initial repeat target region. First display means for displaying an image and a frame indicating the repeat target area and displaying a repeat target area designating screen for changing the position of the frame indicating the repeat target area based on a user's instruction; The repeat target area image determined based on the frame set on the repeat target area specifying screen is repeatedly laid out within the specified paper size. Ri, characterized in that it comprises a repeat layout means for creating an output image after the repeat layout process, and a print unit that executes print processing using the output image after the repeat layout process.

  According to the present invention, a document area is detected by executing image analysis processing on the read image, and the document image is cut out and tilt-corrected based on the document area, and the document image after the tilt correction is performed. By enlarging and displaying, it is easy for the user to specify the repeat target area.

It is an example of the whole system configuration. 2 is a diagram illustrating a hardware configuration example of an image forming apparatus. FIG. FIG. 6 is a flowchart illustrating image repeat processing according to the first exemplary embodiment. An example of a document to be scanned is shown. This is an example of an image having the same size as the document table size obtained as a result of reading the document placed on the document table. It is a figure which shows the example of a reading start screen. FIG. 10 is a diagram illustrating an example of a preview screen for previewing an image obtained by executing an image repeat layout process. FIG. 10 is a flowchart illustrating image repeat processing according to the second embodiment. It is a figure which shows the example of the default display of a repeat object area | region designation | designated screen. It is a figure which shows the example at the time of correcting the position of the frame which shows a repeat object area | region on a repeat object area | region designation | designated screen. It is a figure which shows the example of the preview screen which previews the image obtained by performing the layout process of an image repeat, after correcting the position of the frame which shows a repeat object area | region. FIG. 10 is a flowchart illustrating image repeat processing according to the third embodiment. FIG. 10 is a diagram illustrating a flowchart regarding image repeat processing according to a fourth embodiment. FIG. 20 is a diagram illustrating an example of initial display of a repeat target area designation screen when a face area is not detected in the fourth embodiment. FIG. 20 is a diagram illustrating an example of initial display of a repeat target area designation screen when a face area is detected in the fifth embodiment. FIG. 16 is a diagram illustrating an example of a repeat target area designation screen when a button for designating a document area is selected in the fifth embodiment.

  Hereinafter, embodiments according to the present invention will be described in detail with reference to the drawings. However, the components described in this embodiment are merely examples, and are not intended to limit the scope of the present invention thereto.

<System configuration>
FIG. 1 is a diagram showing the overall configuration of a system to which this embodiment can be applied. As shown in FIG. 1, an image forming apparatus (image processing apparatus) 100 is connected to a LAN 102 and can communicate with a terminal 101 such as a PC via an Internet 103 or the like. In realizing the present embodiment, the terminal 101 such as a PC is not necessarily required, and only the configuration of the image forming apparatus 100 may be used.

  An image forming apparatus (image processing apparatus) 100 is a multifunction peripheral (MFP) having a display / operation unit, a scanner unit, and a printer unit. An original (document, business card, photo for certificate, license) using the scanner unit. , Postcards, etc.) can be used as a scanning terminal. A display / operation unit such as a touch panel or a hard button displays a scanned image or a preview image of a layout processing result, or displays a user interface for inputting an instruction from the user. In the present embodiment, a repeat layout process (also referred to as an image repeat process) for repeatedly laying out an image in a region that is automatically extracted or manually designated from a scanned image within a single output document is executed. A preview image of the processing result is displayed on the screen. Then, when the user presses a print start button on the preview screen, print processing is executed using the printer unit.

  In this embodiment, an example in which the image forming apparatus 100 alone performs scan processing, repeat layout processing, and print processing will be described. However, even a system configured to perform part of the processing on another terminal 101 may be used. I do not care. For example, scan processing and repeat layout processing may be executed by the image forming apparatus 100, an image as a result of layout processing may be transmitted to another terminal 101 via the network, and the image may be printed from the other terminal 101. Good.

<Hardware Configuration of Image Forming Apparatus 100>
FIG. 2 is a block diagram illustrating a configuration of the image forming apparatus 100. The control unit 110 includes a CPU 111, a storage device 112 (ROM 117, RAM 118, HDD 119, etc.), a network I / F unit 113, a scanner I / F unit 114, a display / operation unit I / F unit 115, and a printer I / F unit 122. The system bus 116 is connected to be communicable with each other. The control unit 110 controls the overall operation of the image forming apparatus 100.

  The CPU 111 functions as means for executing each process (reading control, display control, printing control, etc.) in a flowchart described later by reading and executing a control program stored in the storage device 112. The storage device 112 stores and holds the program, image data, metadata, setting data, processing result data, and the like. The storage device 112 includes a ROM 117 that is a nonvolatile memory, a RAM 118 that is a volatile memory, and an HDD 119 that is a large-capacity storage area. The ROM 117 is a non-volatile memory that holds a control program and the like, and the CPU 111 reads and controls the control program. The RAM 118 is a volatile memory used as a temporary storage area such as a main memory or work area of the CPU 111.

  The network I / F unit 113 connects the control unit 110 (image forming apparatus 100) to the LAN 104 via the system bus 116. The network I / F unit 113 transmits image data to an external device on the LAN 104 and receives various types of information from the external device on the LAN 104.

  The scanner I / F unit 114 connects the scanner unit 120 and the control unit 110 via the system bus 116. The scanner unit 120 reads an image on a document to generate scan image data, and inputs the scan image data to the control unit 110 via the scanner I / F unit 114.

  The display / operation unit I / F unit 115 connects the display / operation unit 121 and the control unit 110 via the system bus 116. The display / operation unit 121 includes a liquid crystal display unit having a touch panel function, a keyboard, and the like.

  The printer I / F unit 122 connects the printer unit 123 and the control unit 110 via the system bus 116. The printer unit 123 receives the image data after layout processing generated by the CPU 111 via the printer I / F unit 122, and print processing on recording paper is performed using the received image data.

  As described above, the image forming apparatus 100 according to the present embodiment can provide an image processing function with the above hardware configuration.

<Image repeat processing function>
As an image processing function according to the present embodiment, an image repeat process (repeat layout process) will be described.

  The image forming apparatus 100 scans a document placed on a document table of the scanner unit 120 and acquires a scanned image. By performing image analysis processing on the acquired scanned image, document area detection, document area extraction, and tilt correction are performed, thereby obtaining a skew-corrected document image. The details of the document area detection process will be described later.

  Furthermore, the image forming apparatus 100 determines a layout for repeatedly arranging the skew-corrected document image in the output image corresponding to the designated paper size. Then, according to the determined layout, an original image is arranged to generate an image repeat processing result image, and a preview image is displayed on the UI of the display / operation unit. In addition, a print instruction for the image repeat processing result image can be received from the user through the display / operation unit.

  FIG. 3 is a flowchart illustrating details of the image repeat process according to the first embodiment. The CPU 111 of the image forming apparatus 100 functions as a processing unit that executes the processing of each step in FIG. 3 by loading the processing program stored in the ROM 117 into the RAM 118 and executing it. In this embodiment, a case where a business card as shown in FIG. 4 is scanned as a document to be scanned will be described. However, the type of the document is not limited to a business card, and a document of a fixed size or a non-standard size, a license Certificate pictures, various cards, postcards, etc.

  First, when the image repeat processing mode is specified by the user on the operation screen of the image forming apparatus 100, the operation screen is displayed in the touch panel display area 601 of FIG. In FIG. 6, the display / operation unit 121 includes a touch panel display area 601 and hard keys 602 (numeric keys, various processing start keys, and the like). The touch panel display area 601 displays a message prompting the user to set a document on the document table and start scanning, and a scan start button (software key) 603 for instructing the start of scanning.

  When the scan start button 603 is selected by the user, in step S301, the CPU 111 of the image forming apparatus performs processing for operating the scanner unit to acquire an image. When a business card as shown in FIG. 4 or a non-standard-size document is placed on the document table and scanned, the document size may not be automatically detected by the document size detection sensor. Therefore, in the image repeat process of the present embodiment, a scanned image having the same size as the document table is acquired with the entire document table being read. Reference numeral 400 in FIG. 4 is an example of a business card (original). The business card includes an area 401 in which a photograph or the like is written and an area 402 in which a character string such as a name or address is written. Assume that a scanned image 501 as shown in FIG. 5 is obtained as a result of scanning the business card on the document table. At this time, if the business card is randomly placed on the document table, the business card is scanned while being tilted with respect to the document table. Therefore, the scan image 501 includes the tilted business card image 502. Become.

  In step S302, the CPU 111 detects an original region by executing image analysis processing (original region detection processing) on the image acquired in step S301, cuts out a partial image of the detected original region, and corrects inclination. Process. As a result, it is possible to acquire an image obtained by cutting out the area of the business card image 502 included in the scanned image 501 acquired in S301 and correcting the inclination. The document area detection process and the inclination correction process can be realized using a known method. As a method for detecting a document area from a scanned image, for example, an edge strength image is obtained by applying a Sobel filter or the like to the scanned image, and a portion where pixels having a high edge strength are connected in a straight line is detected. It is sufficient to use a known method of detecting as Then, four vertices are specified based on the detected four sides of the document, and an image of the document region is cut out based on the specified four vertices (that is, a document image is extracted from the scanned image). At this time, if the image of the document region cut out from the scanned image is tilted, the document image is obtained as a document image after tilt correction by further performing tilt correction. In the tilt correction, for example, the tilt angle is estimated based on the coordinate values of the specified four vertices, and the image may be rotated in a direction in which the tilt angle is corrected. It should be noted that the document area image cutout process (document image extraction process) and the inclination correction process may be executed sequentially, or the cutout and the inclination correction may be performed simultaneously. For example, based on the coordinate values of the four vertices, by performing a predetermined projective transformation process on the pixels inside the rectangular area surrounded by the four vertices, pixel extraction and inclination correction in the rectangular area can be realized simultaneously. Is also possible.

  In step S303, the CPU 111 determines whether a document is detected based on the result of the document area detection process in step S302. If it is determined that the document has not been detected, the process advances to step S304 to display a message indicating that the document has not been detected and a message prompting the user to re-execute the document after placing it on the document table. 121 is displayed. If it is determined in step S303 that a document has been detected, the process proceeds to step S305.

  In step S305, the CPU 111 acquires information on the paper size of the designated output paper. When the paper size is not specified by the user, information on the default paper size (for example, A4 size) is acquired. In addition, when it is designated in advance that the paper in the manual feed tray is used, the user may be allowed to designate the paper size at this point.

  In step S306, the CPU 111 executes repeat layout processing for determining a position where the repeat target image is repeatedly laid out in the output paper based on the size of the repeat target image and the paper size information acquired in S305. Note that, as the repeat target image, first, a clipped image (original image after inclination correction) obtained as a result of performing the original area detection processing and the inclination correction processing in S302 is used. In the repeat layout process, the number of images that can be arranged when the repeat target image is arranged from the upper left of the output paper is calculated based on the vertical and horizontal sizes of the output paper and the size of the repeat target image. Next, it is calculated how many images can be arranged when the size of the repeat target image is rotated 90 degrees and arranged from the upper left of the output paper. Then, the number of arrangements with and without 90 ° rotation is compared, and the repeat target image is repeatedly laid out using the layout with the larger number of arrangements, whereby the image after the repeat process (ie, the output image used in the print process) ). If the number of arrangements with and without 90 ° rotation is the same, an output image is created with a layout in which the repeat target image is not rotated.

  In step S <b> 307, the CPU 111 creates a preview image of the output image created in step S <b> 306 and displays it on the preview screen of the display / operation unit 121. A preview screen displayed on the display / operation unit 121 will be described with reference to FIG. In FIG. 7, the display content displayed in the touch panel display area 601 in FIG. 6 is changed to a preview screen of the output image.

  In 705 of FIG. 7, a preview image of the output image created in step S306 is displayed. In addition, the number information 706 indicates how many repeat target images are laid out in the output image created in step S306. The example of FIG. 7 shows that 16 repeat target images are repeated in one output image.

  Reference numeral 707 denotes a number indicating the number of output images to be printed. When the user presses the plus button 709, the number of prints increases. When the user presses the minus button, the number of prints decreases. Each time the plus button or the minus button is clicked, the number of sheets may be increased or decreased by one, or the number of printed sheets 707 is continuously changed while the plus button or the minus button is held down. May be. The number of printed sheets 707 can also be input using the hard key 702.

  Reference numeral 710 denotes a pull-down menu capable of selecting whether the output image is printed in color or monochrome. In the default setting, “full color” is automatically selected when the repeat target image is color, and “monochrome” is automatically selected when the repeat target image is black and white. Using this color selection pull-down menu 710, the user can manually change full-color / monochrome printing settings. Note that, as described later in step S309, when the setting of full color printing / monochrome printing is changed, the preview image 705 is also changed according to the changed setting. For example, when the user changes the setting to black and white while full color is automatically selected, the preview image 705 is also changed to a black and white image preview in conjunction with it.

  In 711, the currently designated paper size is displayed. When the user presses the change button 712, a paper size change process is performed as described in step S311 described later. When the paper size is changed, based on the changed paper size and the size of the repeat target image, the repeat layout process of S306 is executed to recreate the output image, and the output image preview image 705 and the number information 706 are output. And update.

  When the repeat target area change button 713 is pressed by the user, a repeat target area designation screen as shown in FIG. 9 is displayed, and the user can correct the repeat target area to an area having a desired position and size. Details of the repeat target area designation screen in FIG. 9 will be described later in step S310.

  When the print start button 703 is pressed by the user, the printing process is started according to the current setting contents, as will be described later in step S312. When the return button 704 is pressed by the user, the screen returns to the screen of FIG.

  In step S308, the CPU 111 determines which of the buttons and pull-down menus displayed on the preview screen in FIG. 7 is designated by the user. If it is determined that the color selection pull-down menu 710 is instructed, the process proceeds to step S309. If it is determined that the repeat target area change button 713 is instructed, the process proceeds to step S310, and it is determined that the paper size change button 712 is instructed. The process proceeds to step S311, and if it is determined that the print start button 703 has been designated, the process proceeds to step S312.

  If it is determined in step S308 that the user instruction is a change in full color / monochrome setting in the color selection pull-down menu 710, in step S309, the CPU 111 determines the pull-down menu 710 based on the changed setting. The display is updated, and the process returns to step S307 to update the preview image 705 based on the changed setting. For example, when full-color printing is set and the setting is changed to monochrome printing using the pull-down menu 710, a monochrome preview image is created and the preview screen display is updated in step S307. Note that the monochrome preview image and the output image are not limited to the form created when the setting is changed to monochrome printing by the pull-down menu 710. For example, when a preview image is first created based on the output image created in the repeat layout process of S306 based on the image cut out in S302, a color preview image and a monochrome preview image may be created in advance. I do not care.

  If it is determined in step S308 that the user instruction is to press the repeat target area change button 713, in step S310, the CPU 111 determines a repeat target area designation screen for changing the repeat target area (FIG. 9). ) Is displayed in the touch panel display area.

  Details of the repeat target area designation screen in FIG. 9 will be described. In 905 of FIG. 9, a preview image of the cut-out image (original image after inclination correction) obtained as a result of performing the original area detection process and the inclination correction process in S302 is displayed. Further, a frame 906 indicating the position of the repeat target area at that time is displayed so as to overlap the cutout image. Note that the frame 906 indicating the position of the repeat target region is desirably displayed with a line such as a color (for example, red) that is easy to distinguish. Note that, at a time point before the repeat target area is changed based on a user instruction, a frame 906 is displayed with the document partial image detected and cut out in S302 as the repeat target area, as shown in FIG. The handlers 921, 922, 923, and 924 are handlers displayed at the vertices of the frame 906, and the user changes the position of the vertices of the frame using the handler to reduce or enlarge the repeat target area. Can do. The handlers 925, 926, 927, and 928 are handlers for the user to change the positions of the sides of the frame, and the repeat target area can be reduced or enlarged by operating these handlers. When any of the arrows 907, 908, 909, and 910 is pressed by the user, the displayed document partial image moves in the direction of the pressed arrow. That is, the position of the frame 906 is not moved, and the original partial image is relatively moved by using the arrows 907, 908, 909, and 910, so that it can be adjusted so as to be a desired clipping position by the user. . The movement of the document partial image is not limited to the operations of the arrows 907, 908, 909, and 910, but the user performs a touch and drag operation at a position outside the frame 906 and inside the preview image display area 905. It may be possible to move.

  A bar 911 is a bar indicating a display magnification state of an image displayed in the display area 905. If the bar 911 is on the right side, the bar 911 indicates that the image is enlarged. If the bar 911 is on the left side, the bar 911 indicates that the image is reduced. Show. When the user presses the button 912, the display magnification is reduced and displayed. When the user presses the button 913, the display magnification is increased and displayed. Note that the display magnification can be changed by directly dragging the bar 911 right and left. When the user presses the button 914, the display direction of the image displayed in the display area 905 is rotated by 90 degrees. When the user presses the button 915, the image displayed in the display area 905 is rotated counterclockwise by 0.5 degrees. When the user presses the button 916, the image displayed in the display area 905 is rotated clockwise by 0.5 degrees. In the present embodiment, the buttons 915 and 916 have been described with the rotation angle set in increments of 0.5 degrees, but the present invention is not limited to 0.5 degrees. The button 917 is a button for instructing to extend the frame 906 in the vertical direction. When the user presses the button 917, the position of the upper side of the frame 906 is moved upward by a predetermined number of pixels and the position of the lower side is changed. Move down a predetermined number of pixels. A button 918 is a button for instructing to shrink the frame 906 in the vertical direction. When the user presses the button 918, the position of the upper side of the frame 906 moves downward by a predetermined number of pixels and the position of the lower side moves upward. Move a predetermined number of pixels. A button 919 is a button for instructing to extend the frame 906 in the horizontal direction, and a button 920 is a button for instructing to shrink the frame 906 in the horizontal direction. When the user presses the button 904, the position of the frame changed in FIG. 9 is canceled and the screen returns to the screen in FIG.

  When the user presses the button 903, the repeat target area is determined based on the position of the frame 906 set at that time, and the repeat layout process in step S306 is executed based on the image of the repeat target area. . For example, it is assumed that the user wants to set only a photo area included in a business card image (original image) as a repeat target area. In that case, the user adjusts the positions of the vertex handlers 921 to 924 in the frame of FIG. 9 and changes them to the positions of the vertex handlers 1021 to 1024 in the frame of FIG. When the user presses the OK button in this state, the area surrounded by the frame in FIG. 10 is determined as the repeat target area, and the repeat layout process is executed again in step S306 using the image of the determined repeat target area. Is done. In step S307, the preview image of the output image obtained by the repeat layout process in S306 is displayed on the preview screen 1105 as shown in FIG. In 1106 of FIG. 11, number information indicating how many images of the repeat target area changed in FIG. 10 are laid out is displayed.

  In this embodiment, the repeat layout is described so that the image of the repeat target area is printed at a magnification of 100%. However, the magnification is not limited to 100%. For example, if the image magnification of the repeat target area can be specified on the screen of FIG. 9, the image repeat process can be performed while enlarging or reducing the image of the repeat target area. In that case, the repeat number calculation process in step S305 and the repeat layout process in step S308 may be performed in consideration of the designated magnification.

  If it is determined in step S308 that the user instruction is to press the paper size change button 712, a plurality of paper size candidates are presented (eg, standard sizes A4, A3, B4, B5, etc.) in step S311. And a paper size designated by the user is determined. The change of the paper size is not limited to the method of selecting from the standard sizes, and the user may be able to manually input a non-standard paper size (the vertical and horizontal sizes of the paper). If the paper size is changed in step S311, the paper size after the change is acquired in step S305, repeat layout processing is executed based on the changed paper size in step S306, and preview is executed in step S307. Display the screen.

  If it is determined in step S308 that the user instruction is to press the print start button 703, in step S312, the CPU 111 causes the printer unit 123 to perform printing using the output image created in step S306. To control.

  According to the first embodiment, on the repeat target area designation screen of FIG. 9, the original document partial image after tilt correction obtained in S302 is displayed instead of the scanned image of the entire original plate obtained in S301. If the scanned image of the entire document table is previewed as it is, the business card image included in the scanned image is displayed relatively small, which makes it difficult for the user to specify the area to be repeated. Since the document partial image obtained in S302 is displayed in a large size, the user can easily specify an area to be repeated. Furthermore, since the original document partial image after the tilt correction is displayed, the user can easily specify the area to be repeated accurately. Even if the document is tilted and scanned on the document table, it is corrected in S302, so that the user does not have to be careful not to tilt the document when placing the document on the document table.

  Further, in the preview screen shown in FIG. 7 displayed in S307, the original document partial image after tilt correction obtained in S302 is set as an initial repeat target image, the repeat layout process in S306 is executed, and an output image is created. A preview image of the output image is initially displayed. Therefore, if the user can accept the setting as it is, the user only has to press the print start button, and the repeat layout process can be easily executed.

  In the first embodiment, an example has been described in which when the user presses the scan start button on the operation screen of FIG. 6, the processing of S301 to S307 of FIG. 3 is executed and the preview screen of FIG. 7 is displayed. In the second embodiment, when the scan start button is pressed by the user on the operation screen of FIG. 6, the repeat target region is displayed by displaying the repeat target region designation screen of FIG. 9 before displaying the preview screen of FIG. 7. An example in which the user confirms and corrects will be described.

  Differences between the flowchart showing details of the image repeat process according to the second embodiment shown in FIG. 8 and the flowchart of the first embodiment shown in FIG. 3 will be described. In the second embodiment, when it is determined in step S303 in FIG. 8 that there is a document, the process proceeds to step S310, and the repeat target area designation screen in FIG. 9 is displayed. Then, after the repeat target area is determined on the repeat target area designation screen in FIG. 9, the processes of S305 to S307 are performed to display the preview screen.

  Note that the details of the processing in each step are the same as those in the first embodiment, and thus description thereof is omitted.

  As described above, according to the second embodiment, since the repeat target area designation screen of FIG. 9 is displayed before the preview screen of FIG. 7 is displayed, the user can confirm the repeat target area in advance, and further, if necessary. The repeat target area can be easily modified. Further, as in the first embodiment, on the repeat target area designating screen in FIG. 9, the original document partial image obtained in S302 is displayed instead of the scanned image of the entire original plate obtained in S301. This makes it easy to specify exactly the area you want to repeat.

  After the scan start button is pressed by the user on the operation screen of FIG. 6, in the touch panel display area, the preview screen of FIG. 7 is first displayed in the first embodiment, and the repeat target area designation screen of FIG. 9 is displayed in the second embodiment. The example to display first was demonstrated. In the third embodiment, an example of adaptively changing whether to display the preview screen in FIG. 7 first or the repeat target area designation screen in FIG. 9 according to the scanned document will be described.

  Details of the image repeat process according to the third embodiment will be described with reference to the flowchart of FIG. In FIG. 12, when it is determined that there is a document in step S303, the process proceeds to step S1201, and it is determined whether or not the document image detected in S302 satisfies a predetermined condition. If it is determined in S1201 that the predetermined condition is satisfied, the process proceeds to step S310 to display the repeat target area designation screen in FIG. On the other hand, if it is determined in S1201 that the predetermined condition is not satisfied, the processes of S305 to S307 are performed to display the preview screen of FIG.

  The predetermined condition used in the determination in step S1201 is, for example, whether or not the size of the document image detected in S302 is larger than a predetermined size (for example, A4 size). If the size of the document image is large, it is highly likely that a part of the document is cut out and used as a repeat target, so that the process proceeds to S310 and the repeat target area designation screen shown in FIG. 9 is displayed.

  Another example of the predetermined condition used in the determination in step S1201 will be described. For example, if the original image detected in S302 is subjected to region division processing for dividing into regions for each attribute such as text, photos, and tables, and a plurality of attribute regions are included, a predetermined condition is satisfied. judge. That is, when a plurality of attribute areas (for example, a text area and a photo area) are included in the document, it is highly likely that any one of the areas will be used as a repeat target. Display the target area specification screen.

  Note that the details of the processing in each step of S301 to S312 in FIG. 12 are the same as the processing of the corresponding step number in the first and second embodiments, and thus description thereof is omitted.

  In the second embodiment, the example in which the document area detected in S302 is displayed as the initial area of the repeat target area on the repeat target designation screen in FIG. 9 has been described. In the fourth embodiment, face area detection (photo area detection process including a human face) is further performed on the original image detected in S302, and the detected photo area is displayed as an initial area of the repeat target area. An example will be described.

  The difference between the flowchart showing details of the image repeat process according to the fourth embodiment shown in FIG. 13 and the flowchart of the second embodiment shown in FIG. 8 will be described. In the fourth embodiment, when it is determined that there is a document in step S303, the process proceeds to step S1301.

  In step S <b> 1301, the CPU 111 performs a detection process of a photographic area including a human face (that is, a face area) for the image in the document area detected in step S <b> 303. In the face area detection process, for example, a local feature amount is detected from an image, and the detected local feature amount and a feature amount of each part (eyes, nose, mouth, etc.) of the face held in advance are subjected to pattern matching. Thus, an area including a person's face is specified. Note that the method of face area detection processing is not limited to the above method, and other face area detection processing may be used.

  In step S1302, the CPU 111 determines whether a face area is detected by the face area detection process. If it is determined that a face area is detected (that is, there is a photo area including a human face), the process advances to step S1303. If it is determined that no face area has been detected (that is, there is no photo area including a human face), the process advances to step S1304.

  In step S1303, the CPU 111 determines an area to be an initial area of the repeat target area based on the face area detected in step S1301. In this embodiment, the initial region of the repeat target region is the entire photo region including the detected face, but is not limited to this. Note that the boundary of the photographic region may be determined using a straight line detection method based on Hough transform, or a method of detecting a photographic region by performing a labeling process on pixels other than white. Alternatively, with reference to the position of each part such as the eyes, nose, and mouth of the face, an area that is larger by a predetermined size may be used as the initial area. In addition to detecting a person's face, features such as a person's shoulder and chest may also be detected, and an area above the person's bust (that is, a bust-up area) may be used as an initial area. When the photograph area including the human face is determined as the initial area of the repeat target area in step S1303, the process proceeds to step S310. When a business card 400 including a face photograph area 401 as shown in FIG. 4 is scanned, the face photograph area is determined as an initial area in step S1303. Therefore, in step S310, the area (face photo area) within the frame surrounded by the vertex handlers 1021 to 1024 as shown in FIG. 10 is displayed as the initial area of the repeat target area.

  In step S1304, the CPU 111 determines the document area detected in step S302 as the initial area of the repeat target area. If the initial area of the repeat target area is determined in step S1304, the process proceeds to step S310. As shown in FIG. 14, when a business card that does not include a face photograph is scanned, the face area is not detected in step S1301, so the document area detected in step S302 is determined as the repeat target area. Therefore, in step S310, the area (document area) within the frame surrounded by the vertex handlers 1401 to 1404 as shown in FIG. 14 is displayed as the initial area of the repeat target area.

  As described above, in the fourth embodiment, the area initially displayed on the repeat target area designation screen is switched according to whether or not a face area is detected. The details of the processing in each step of S301 to S312 in FIG. 13 are the same as the processing of the corresponding step number in the first and second embodiments, and thus the description thereof is omitted.

  In the fourth embodiment, an example has been described in which, when a face area is detected from a document image, a photo area including a human face is displayed as an initial area of the repeat target area on the repeat target designation screen. In the fifth embodiment, another example of a repeat target designation screen displayed when a face area is detected will be described.

  In the fifth embodiment, similar to the flowchart of the fourth embodiment shown in FIG. 13, a photographic area including a human face is detected in step S1302, and the detected face area is determined as an initial area of the repeat target area in step S1303. To do. However, after that, the repeat target designation screen (FIG. 15) of the fifth embodiment displayed in step S310 is different from the repeat target designation screen (FIG. 10) of the fourth embodiment.

  FIG. 15 is an example of a repeat target area designation screen according to the fifth embodiment displayed when a face area is detected. Buttons 1503 and 1504 for switching repeat target area candidates are added to the repeat target area designation screen in FIG. Since the photo area including the face is determined as the initial area of the repeat target area in step S1303, the area 1501 is displayed as the initial repeat target area together with the vertex handler, and the button indicating that the face area is the target area 1503 is selected. At this time, the button 1504 is in a non-selected state, so that the partial area 1505 inside the document area 1502 is also shaded (or grayed out) so that it can be identified as an asymmetric area. Also good.

  When the user selects a button 1504 (or area 1705) for selecting a document area on the repeat area specification screen in FIG. 15, the CPU 111 sets the document area detected in S302 as a repeat target area. Control display switching. FIG. 16 shows an example of the repeat target area designation screen when the button 1504 is selected.

  In FIG. 16, the button 1604 for specifying the document area is selected, the button 1603 for specifying the face area is not selected, and the document area 1601 is displayed together with the vertex handler as the repeat target area. In the screen of FIG. 16, when the button 1603 for selecting the face area (or the internal area 1605 of the face area 1602) is selected by the user, the screen returns to the screen of FIG. 15, and the repeat target area is changed to the face area. Switch.

  As described above, in the fifth embodiment, when a face area is detected, the selection switching between the face area and the document area can be easily performed on the repeat target designation screen.

(Other examples)
The present invention supplies software (program) for realizing the functions of the above-described embodiments to a system or apparatus via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or apparatus executes the program. It is also realized by reading and executing.

Claims (12)

Extraction means for detecting a document area by executing image analysis processing on a scanned image, and performing document image extraction and tilt correction based on the detected document area to obtain a skew-corrected document image When,
The area corresponding to the original image after the inclination correction obtained by the extracting means is set as an initial repeat target area, and the original image after the inclination correction and a frame indicating the repeat target area are displayed, and the user's First display means for displaying a repeat target area designating screen for changing the position of a frame indicating the repeat target area based on the instruction;
Repeat layout means for creating an output image after repeat layout processing by repeatedly laying out an image of a repeat target area determined based on a frame set on the repeat target area specifying screen within a specified paper size ,
Printing means for executing a printing process using the output image after the repeat layout process;
An image processing apparatus comprising: A second display means for displaying a preview screen including a preview image of the output image created by the repeat layout means;
The image processing apparatus according to claim 1, wherein the first display unit displays the repeat target area designation screen when a change of the repeat target area is instructed by a user on the preview screen. . The repeat layout unit repeatedly lays out the original document image after the inclination correction obtained by the extraction unit as an image of an initial repeat target area within the designated paper size, so that the output after the repeat layout process is performed. Create an image,
The said 2nd display means displays initially the preview screen containing the preview image of the output image after the repeat layout process produced based on the image of the said initial repeat object area | region, The said display screen is characterized by the above-mentioned. Image processing apparatus. A second display means for displaying a preview screen including a preview image of the output image created by the repeat layout means;
The repeat target area designating screen displayed by the first display means is displayed before the preview screen displayed by the second display means,
The second display means uses the repeat target area image specified based on the frame determined on the repeat target area designation screen to generate a preview image of the output image after the repeat layout process created by the repeat layout means. The image processing apparatus according to claim 1, wherein a preview screen including Second display means for displaying a preview screen including a preview image of the output image created by the repeat layout means;
Determination means for determining whether or not the document image after inclination correction obtained by the extraction means satisfies a predetermined condition;
When it is determined by the determination means that the document image after the inclination correction satisfies the predetermined condition, the repeat target area designation screen is displayed by the first display means,
When the determination unit determines that the document image after the inclination correction does not satisfy the predetermined condition, the document image after the inclination correction obtained by the extraction unit is set as an initial repeat target region image, and The second display unit displays a preview screen including a preview image of an output image after the repeat layout process created by the repeat layout unit based on the image of the initial repeat target area. The image processing apparatus according to 1.   The image processing apparatus according to claim 5, wherein the determination unit determines that the predetermined condition is satisfied when a size of the document image after the inclination correction is larger than a predetermined size.   The image processing apparatus according to claim 5, wherein the determination unit determines that the predetermined condition is satisfied when a plurality of attribute areas are included in the document image after the inclination correction. A face detecting means for detecting a photo area including a human face from the original image after the tilt correction obtained by the extracting means;
When the photo area is not detected by the face detection means, the first display means sets the area corresponding to the original image after the inclination correction obtained by the extraction means as an initial repeat target area. A document image after skew correction and a frame indicating the repeat target area are displayed, and a repeat target area specifying screen for changing the position of the frame indicating the repeat target area based on a user instruction is displayed.
When the face detection unit detects the photographic region, the first display unit sets the photographic region detected by the face detection unit as an initial repeat target region and the document image after the tilt correction and the Displaying a frame indicating the repeat target area, and displaying a repeat target area designating screen for changing the position of the frame indicating the repeat target area based on a user instruction.
The image processing apparatus according to claim 1.   When the photographic area is detected by the face detection means, the first display means switches the repeat target area to an area corresponding to the original document image after the inclination correction obtained by the extraction means. The image processing apparatus according to claim 8, wherein a button is further displayed in the repeat target area designation screen.   The program for functioning a computer as each means of the image processing apparatus of any one of Claim 1 thru | or 9.   A computer-readable storage medium storing the program according to claim 10. An extraction step of detecting a document area by executing image analysis processing on the scanned image, and obtaining a document image after tilt correction by executing document image extraction and tilt correction based on the detected document area When,
The area corresponding to the original image after the inclination correction obtained in the extraction step is set as an initial repeat target area, and the original image after the inclination correction and a frame indicating the repeat target area are displayed, and the user's A first display step for displaying a repeat target area designating screen for changing the position of the frame indicating the repeat target area based on the instruction;
A repeat layout step of creating an output image after repeat layout processing by repeatedly laying out an image of a repeat target area determined based on a frame set on the repeat target area specifying screen within a specified paper size; and ,
A printing step of executing a printing process using the output image after the repeat layout process;
An image processing method comprising:

Images