JP2020191495A - Image processing device, control program and control method - Google Patents

Abstract

To perform reconstruction such that sentences are properly connected when extracting a portion of an image obtained by reading a document including characters such as newspaper.SOLUTION: An image formation apparatus 10 includes a CPU 80. The CPU 80 extracts an extraction image in a range including a plurality of first regions 162 in which the text is described and a second region 170 in which an element other than the text is described from an image of a document read by an image reading unit 26, sets the placement order of the plurality of first regions 162 in accordance with the writing direction of the text, and generates a clip image obtained by reconstructing the first type of individual images 188 corresponding to the plurality of first regions 162 and the second type of individual images 190 corresponding to the second region 170 into the prescribed shapes in accordance with the writing direction of the text and the placement order of the plurality of first regions 162.SELECTED DRAWING: Figure 6

Description

The present invention relates to an image processing device, a control program and a control method, and more particularly to an image processing device, a control program and a control method for generating a clip image obtained by extracting a part of an image obtained by reading a newspaper or the like.

An example of an image processing apparatus of the background technique is disclosed in Patent Document 1. In the image processing apparatus of this background technology, a mark indicating the position of a specific document block in an image obtained by reading a manuscript such as a newspaper is detected, and characters including characters are detected in the document image data included in the document block. The image part and the photographic image part in which the photographic image including the picture is present are discriminated, and the rectangular vector data in which the shape of the document block is reconstructed is created, and the character image part and the character image part and the character image part so as to fit in the rectangular vector data are created. The position of the photographic image section is set.

JP-A-2002-150306

However, in the image processing apparatus of the background technology, the order of the character image parts may not be accurately determined due to the inclusion of elements other than the text such as headings between the plurality of character image parts. If the order of the character image unit is determined incorrectly, the sentences will not be properly connected when the character image unit and the photographic image unit are reconstructed.

Therefore, a main object of the present invention is to provide a novel image processing device, control program and control method.

Another object of the present invention is an image processing device, which can be reconstructed so that sentences are appropriately connected when a part of an image obtained by reading a manuscript containing characters such as a newspaper is extracted. It is to provide a control program and a control method.

The first invention is an image processing apparatus, which includes an extraction means, a first setting means, a second setting means, and a generation means. The extraction means extracts an extracted image in a range including the plurality of first regions from the original image including the plurality of first regions in which the text is described and the second region in which elements other than the text are described. The first setting means sets the writing direction of the text. The second setting means sets the arrangement order of the plurality of first areas according to the writing direction of the text. The generation means includes a plurality of first type individual images corresponding to each of the plurality of first regions and a second type corresponding to the second region according to the writing direction of the text and the arrangement order of the plurality of first regions. A clip image obtained by reconstructing an individual image into a predetermined shape is generated.

The second invention is an image processing apparatus subordinate to the first invention, which is a display means for displaying an extracted image and a mark image indicating the arrangement order of a plurality of first regions included in the extracted image, and a display means. A second setting means is further provided with an operation detecting means for detecting a user operation, and when the operation detecting means detects a first type of user operation that specifies an arrangement order of a plurality of first regions included in the extracted image. Sets the arrangement order of a plurality of first regions according to the first type of user operation.

A third invention is an image processing apparatus subordinate to the second invention, in which the arrangement of at least one of a plurality of first-type individual images and a second-type individual image in a clip image is changed by an operation detecting means. When the second type of user operation is detected, at least one arrangement of the plurality of first type individual images and the second type individual images in the clip image is changed according to the second type user operation. A first change means is further provided.

The fourth invention is an image processing apparatus dependent on the second or third invention, in which at least one of a plurality of first type individual images and a second type individual image in a clip image is used by an operation detecting means. When a third type of user operation for changing the size is detected, at least one of a plurality of first type individual images and a second type individual image in the clip image is determined according to the third type user operation. A second changing means for changing the size is further provided.

The fifth invention is an image processing apparatus dependent on any one of the second to fourth inventions, and when the operation detecting means detects a fourth type of user operation for changing the outer shape of the clip image. In addition, a third changing means for changing the outer shape of the clip image according to the fourth type of user operation is further provided.

A sixth invention is an image processing apparatus subordinate to any one of the first to fifth inventions, and prohibits the arrangement of a plurality of first-type individual images and second-type individual images in a clip image. A third setting means for setting a prohibited range, which is a range, is further provided.

The seventh invention includes a plurality of first regions from an original image including a plurality of first regions in which the text is described and a second region in which elements other than the text are described in the processor of the image processing apparatus. Extraction of range A step to extract an image, a step to set the writing direction of the text, a step to set the arrangement order of a plurality of first areas according to the writing direction of the text, a step of setting the writing direction of the text and a plurality of A plurality of first-type individual images corresponding to each of the plurality of first regions and a second-type individual image corresponding to the second region are reconstructed into a predetermined shape according to the arrangement order of the first region. It is a control program of an image processor that executes a step of generating a clip image.

The eighth invention is (a) an extracted image of a range including a plurality of first regions from an original image including a plurality of first regions in which the text is described and a second region in which elements other than the text are described. The step of extracting, (b) the step of setting the writing direction of the text, (c) the step of setting the arrangement order of a plurality of first regions according to the writing direction of the text, and (d) the step of setting the text. A plurality of first-type individual images corresponding to each of the plurality of first regions and a second-type individual image corresponding to the second region are predetermined according to the writing direction and the arrangement order of the plurality of first regions. It is a control method of an image processing apparatus including a step of generating a clip image reconstructed into a shape.

According to the present invention, when a part of an image obtained by reading a manuscript containing characters such as newspapers is extracted, the sentences can be reconstructed so as to be appropriately connected.

The above-mentioned objectives, other objectives, features and advantages of the present invention will become more apparent from the detailed description of the following examples made with reference to the drawings.

FIG. 1 is an illustrated diagram showing a schematic configuration when the image forming apparatus according to the first embodiment of the present invention is viewed from the front. FIG. 2 is a block diagram showing an electrical configuration of the image forming apparatus shown in FIG. FIG. 3 is an illustrated diagram showing an example of the home screen of the image forming apparatus shown in FIG. FIG. 4 is an illustrated diagram showing an example of the extraction range setting screen. FIG. 5 is an illustrated diagram showing an example of a writing direction setting screen. FIG. 6 is an illustrated diagram showing an example of the ranking setting screen. FIG. 7 is an illustrated diagram showing another example of the ranking setting screen. FIG. 8 is an illustrated diagram showing an example of an image adjustment screen. FIG. 9 is an illustrated diagram showing another example of the image adjustment screen. FIG. 10 is an illustrated diagram showing another example of the image adjustment screen. FIG. 11 is an illustrated diagram showing another example of the ranking setting screen. FIG. 12 is a diagram showing an example of the memory map of the RAM shown in FIG. FIG. 13 is a flow chart showing a part of an example of CPU clipping processing shown in FIG. FIG. 14 is a flow diagram which is a part of the clipping process and follows FIG. FIG. 15 is a flow chart showing an example of the ranking setting process. FIG. 16 is a flow chart showing an example of image adjustment processing. FIG. 17 is an illustrated diagram showing an example of the prohibited range setting screen of the second embodiment. FIG. 18 is an illustrated diagram showing an example of the image adjustment screen of the second embodiment. FIG. 19 is a flow chart showing a part of an example of clipping processing of the second embodiment.

[First Example]
With reference to FIG. 1, the image processing apparatus according to the first embodiment of the present invention is an image forming apparatus 10 that forms an image on paper by an electrophotographic method. In this embodiment, the image forming apparatus 10 is a multifunction device (MFP: Multifunction Peripheral) having a copying function, a printer function, a scanner function, a facsimile function, and the like.

First, the basic configuration of the image forming apparatus 10 will be schematically described. As shown in FIG. 1, the image forming apparatus 10 includes an apparatus main body 12 and an image reading apparatus 14 arranged above the apparatus main body 12.

The image reading device 14 includes a document mounting table 16 formed of a transparent material such as platen glass. A document holding cover 18 can be opened and closed above the document placing table 16 via a hinge or the like. The document holding cover 18 is provided with an automatic document feeder (ADF: Auto Document Feeder) 24 that automatically feeds the documents placed on the document placing tray 20 one by one to the image reading position 22. Be done.

Further, the image reading device 14 includes an image reading unit 26 including a light source, a plurality of mirrors, an imaging lens, a line sensor, and the like. The image reading unit 26 exposes the surface of the document with a light source, and guides the reflected light reflected from the surface of the document to the imaging lens by a plurality of mirrors. Then, the reflected light is imaged on the light receiving element of the line sensor by the imaging lens. The line sensor detects the brightness and chromaticity of the reflected light imaged on the light receiving element, and generates image data based on the image of the surface of the document. As the line sensor, a CCD (Charge Coupled Device), a CIS (Contact Image Sensor), or the like is used.

The scanning unit including the light source and the plurality of mirrors is fixedly positioned below the image reading position 22 when reading the document fed by the ADF 24, and the document placed on the document mounting table 16 is placed. When reading, the image is moved in the sub-scanning direction (the left-right direction when the image forming apparatus 10 is viewed from the front).

The device main body 12 has a built-in control unit 28 including a CPU 80 and memories (RAM 84 and HDD 86) described later (see FIG. 2). The control unit 28 transmits a control signal to each part of the image forming apparatus 10 in response to an input operation (user operation) to the image forming apparatus 10, and causes the image forming apparatus 10 to perform various operations. The control unit 28 is also a control device for the image reading device 14 in order to control the entire image forming device 10.

Further, the image forming unit 30 and the like are built in the device main body 12. The image forming unit 30 includes an exposure unit 32, a developer 34, a photoconductor drum 36, a cleaner unit 38, a charger 40, an intermediate transfer belt unit 42, a transfer roller 44, a fixing unit 46, and the like, and is conveyed from a paper feed tray 48. An image is formed on the paper to be formed, and the image-formed paper is ejected to the output tray 52. As the printed image data for forming an image on the paper, the scanned image data read by the image reading unit 26, the image data transmitted from an external computer, or the like is used.

The image data handled by the image forming apparatus 10 corresponds to four color images of black (K), cyan (C), magenta (M), and yellow (Y). Therefore, each of the developer 34, the photoconductor drum 36, the cleaner unit 38, and the charger 40 is provided so as to form four types of latent images corresponding to each color, thereby forming four image stations. It is composed.

In such an apparatus main body 12, a first paper transport path L1 for sending the paper from the paper feed tray 48 to the paper discharge tray 52 via the resist roller 68, the transfer roller 44, and the fixing unit 46 is formed. To. Further, when double-sided printing is performed on paper, the paper after single-sided printing is completed and has passed through the fixing unit 46 is returned to the first paper transport path L1 on the upstream side of the transfer roller 44 in the paper transport direction. The second paper transport path L2 is formed. A plurality of transport rollers 66 for transporting paper in the paper transport direction are appropriately provided in the first paper transport path L1 and the second paper transport path L2.

When single-sided printing (image formation) is performed in the apparatus main body 12, the paper is guided one by one from the paper feed tray 48 to the first paper transport path L1 and resisted by the transport rollers provided in the first paper transport path L1. It is conveyed to the roller 68. Then, the resist roller 68 conveys the paper to the transfer roller 44 (transfer nip portion) at the timing when the tip of the paper and the tip of the image information on the intermediate transfer belt 54 match, and the toner image is transferred onto the paper. .. After that, by passing through the fixing unit 46 (fixing nip portion), the unfixed toner on the paper is melted and fixed by heat, and the paper is discharged onto the paper ejection tray 52.

On the other hand, when double-sided printing is performed, when the rear end of the paper that has passed through the fixing unit 46 reaches the transport roller 66 near the output tray 52 after single-sided printing is completed, the transport roller 66 is rotated in the reverse direction. As a result, the paper runs in the reverse direction and is guided to the second paper transport path L2. The paper guided to the second paper transport path L2 is conveyed by the transport roller 66 through the second paper transport path L2, and is guided to the first paper transport path L1 on the upstream side of the resist roller 68 in the paper transport direction. At this point, the front and back sides of the paper are reversed, and then the paper passes through the transfer roller 44 and the fixing unit 46 to print on the back side of the paper.

FIG. 2 is a block diagram showing an electrical configuration of the image forming apparatus 10 shown in FIG. With reference to FIG. 2, the image forming apparatus 10 includes a CPU 80. The CPU 80 is connected to the RAM 84, the HDD 86, the communication circuit 88, the input control circuit 90, the display control circuit 92, the image reading unit 26, and the image forming unit 30 via the bus 82. An input device 94 is connected to the input control circuit 90, and a display 96 is connected to the display control circuit 92.

The CPU 80 controls the overall control of the image forming apparatus 10. The RAM 84 is used as a work area and a buffer area of the CPU 80. The HDD 86 is the main storage device of the image forming apparatus 10, and stores various programs for controlling the operation of the image forming apparatus 10, and stores image data transmitted from an external computer via the communication circuit 88. Or, the scanned image data read by the image reading unit 26 is stored.

The communication circuit 88 is a communication circuit for connecting to a network such as LAN and the Internet, and communicates with an external computer by using a protocol such as TCP / IP according to an instruction from the CPU 80.

The input device 94 is provided on the front side of the document mounting table 16, and includes, for example, a touch panel. The touch panel is a general-purpose touch panel, and any type such as a capacitance method, an electromagnetic induction method, a resistance film method, and an infrared method can be used. Further, the touch panel may be provided on the display surface of the display 96, or may be provided separately from the display 96. However, a touch display in which the touch panel is integrally formed with the display 96 may be provided. When a touch panel is provided, software keys such as various buttons and icons are displayed on the display 96. Further, the input device 94 may include a hardware operation button or an operation key (hardware key).

The software key is, for example, a key or an icon reproduced by software on the display surface of the display 96. On the other hand, a hardware key is a key or push button provided as a physical device.

The display 96 is provided on the front side of the document mounting table 16. As the display 96, for example, an LCD or an EL (Electro-Luminescence) display can be used.

The input control circuit 90 outputs an operation signal or operation data corresponding to an input operation to the input device 94 to the CPU 80. When the input device 94 is a touch panel, the input control circuit 90 applies a voltage or the like required for the touch panel, detects a touch operation (touch input) within the effective touch range of the touch panel, and detects the touch operation (touch input). The touch coordinate data indicating the position of the touch input is output to the CPU 80. Further, when the input device 94 is a hardware key, the input control circuit 90 outputs an operation signal or operation data corresponding to the operation of the hardware key to the CPU 80.

The display control circuit 92 includes a GPU, a VRAM, and the like. Under the instruction of the CPU 80, the GPU displays display image data for displaying various screens on the display 96 using the image generation data stored in the RAM 84. It is generated in VRAM, and the generated display image data is output to the display 96. As an example, the display 134 displays a home screen 100 (see FIG. 3), which is a screen for selecting a desired job from various jobs that can be executed by the image forming apparatus 10. However, in this first embodiment, the job means copying (including scanning a document), facsimile (FAX), scanning, and the like.

Further, the image forming apparatus 10 of this embodiment has a clipping function (cutting function). The clipping function means a function of generating a clip image (cutout image) obtained by extracting a part of the image from an image (original image) of a manuscript containing characters such as newspapers and magazines.

Hereinafter, an operation example of the image forming apparatus 10 of this embodiment will be described with reference to FIGS. 3 to 11. When the main power of the image forming apparatus 10 is turned on and the standby state is in which each function can be executed, the home screen 100 as shown in FIG. 3 is displayed on the display 96 of the image forming apparatus 10. As described above, the home screen 100 is a screen for selecting various jobs. On the home screen 100, an image of a software key (icon) 102 for selecting each job such as copy, fax, scan, and clipping is displayed.

When any of the icons 102 is touched (selected) on the home screen 100, various setting screens for setting the operation of the job assigned to the selected icon 102 are displayed on the display 96. Hereinafter, a case where a clipping job (clipping mode) is selected will be described as an example.

However, as the original image used in the clipping job, a scanned image read by the image reading unit 26, an image transmitted from an external computer, or an image stored in the HDD 86 can be used. In this embodiment, a case where the scanned image read by the image reading unit 26 is used as the original image will be described as an example.

When the clipping job is selected on the home screen 100, a message urging the user to place the document on the document placing table 16 and a message urging the user to give a reading instruction are displayed on the display 96. The reading instruction is given, for example, by operating a start button provided on the display surface of the display 96. When the document is placed on the document mounting table 16 and a reading instruction is given, the image reading device 14 reads the entire image of the document placed on the document loading table 16 and converts the entire image of the document into the entire image of the document. The corresponding scanned image is generated. Then, the generated scanned image is set as the original image. However, when the document is larger than the readable area of the image reading device 14, the image of the portion of the entire image of the document included in the readable area of the image reading device 14 is generated as the scanned image. ..

Further, in the clipping job, a manuscript in which characters (text) are written on the surface is used. For example, newspapers, magazines, books, pamphlets, treatises, etc. are typical examples of manuscripts.

However, the main text of the description of the manuscript, excluding figures, tables, illustrations, photographs, headings, etc., is called the text, and the description of the manuscript includes figures, tables, illustrations, photographs, headings. Etc. are called elements other than the text.

The surface of the manuscript includes an area in which the text is described (hereinafter, referred to as "first area") and an area in which elements other than the text are described (hereinafter, referred to as "second area").

In addition, the text may be described by being divided into a plurality of paragraphs (blocks) by figures, tables, illustrations, photographs, headings, ruled lines, and the like. That is, the text may be divided into a plurality of blocks. In this case, each of the plurality of blocks becomes the first region.

When the original image is set, the extraction range setting screen 120 as shown in FIG. 4 is displayed on the display 96. The extraction range setting screen 120 is a screen for setting a range (extraction range) 124 to be extracted as a clip image from the original image. On the extraction range setting screen 120, a message prompting the user to set the extraction range and a preview image 122 corresponding to the original image are displayed.

On the extraction range setting screen 120, the extraction range 124 is set according to the input operation within the display range of the preview image 122. For example, as a method of setting the extraction range 124, the user may be able to specify (set) the range by touching two points in the display range of the preview image 122, or within the display range of the preview image 122. An image of a frame showing the extraction range 124 may be displayed so that the user can specify the range by changing or moving the size of the frame.

When the extraction range 124 is set, among the original images, the image in the range included in the extraction range 124 (hereinafter, referred to as “extracted image”) is extracted. That is, an extracted image is generated. When the extracted image is generated, the type of the region included in the extracted image is determined. As described above, since the surface of the document includes the first region and the second region, the extracted image may also include the first region and the second region. In addition, the extracted image may include a plurality of first regions and a plurality of second regions, respectively.

Therefore, when the extracted image is generated, the first region and the second region included in the extracted image are discriminated. Further, the type of the second region is determined for each type of the element included in the second region. Specifically, the heading and the element other than the heading are discriminated. Regarding specific examples of the method of discriminating between the first region and the second region included in the extracted image and the method of discriminating between the heading contained in the second region and a method other than the heading, Japanese Patent Application Laid-Open No. 2016-99793 by the present applicant. Please refer to it as it is described in the Gazette.

Further, when the extracted image is generated, the writing direction setting screen 140 as shown in FIG. 5 is displayed on the display 96. The writing direction setting screen 140 is a screen for setting the writing direction (direction in which characters are written) of the text included in the extracted image. On the writing direction setting screen 140, a message prompting the user to set the writing direction and an image of the icon 142 for selecting the writing direction are displayed. In general, there are vertical writing and horizontal writing in the writing direction of the text. Therefore, for example, the image of the icon 142 corresponding to each of the vertical writing and the horizontal writing is displayed on the writing direction setting screen 140.

When any of the icons 142 is touched on the writing direction setting screen 140, the writing direction of the text included in the extracted image is set. When the type of the area included in the extracted image is determined and the writing direction of the text is set, the order setting screen 160 is displayed on the display 96.

First, with reference to FIGS. 6 and 7, the order setting screen 160 when the writing direction of the text is set to vertical writing will be described as an example.

The order setting screen 160 is a screen for setting the arrangement order (arrangement order) of each first area 162 when the extracted image includes a plurality of first areas 162. That is, when the extracted image contains a plurality of blocks of the text, it is a screen for setting the arrangement order of each block.

On the order setting screen 160, a message prompting the user to set the arrangement order of the first area 162, a preview image 164 corresponding to the extracted image, an "OK" button 166, and a "reset" button 168 are displayed. In this embodiment, the case where the range corresponding to one article included in the newspaper article is set as the extraction range 124 is shown, and the extracted image (preview image 164) has five first regions 162 (162a to 162a). 162e) and three second regions 170 (170a-170c) are included.

However, in this embodiment, the second region 170a is a region in which a so-called heading is described, and is provided above the first regions 162a to 162e. Further, the second region 170b and the second region 170c are regions in which so-called middle headings are described, and are provided so as to divide the first regions 162a to 162d into left and right.

Further, the first regions 162a to 162e and the second regions 170a to 170c included in the preview image 164 are colored in different colors. For example, the first regions 162a to 162e are colored yellow, and the second regions 170a to 170c are colored green. Therefore, it is easy to distinguish between the first region and the second region.

Further, in the preview image 164, arrow images 172 (172a to 172e) and mark images 174 (174a to 174e) corresponding to the first regions 162a to 162e are displayed.

The arrow images 172a to 172e are images of arrows (indicating the writing direction) displayed so as to be superimposed on the front surface of the first regions 162a to 162e and from the beginning of the sentence to the end of the sentences of the first regions 162a to 162e. As shown in FIGS. 6 and 7, when the text is written vertically, the arrow image 172 has a substantially N-shape extending from the upper right portion of the first region 162 through the lower right portion and the upper left portion toward the lower left portion. It becomes an image of an arrow.

The mark images 174a to 174e are images in which numbers corresponding to the respective arrangement orders of the first regions 162a to 162e are displayed, and are displayed so as to be superimposed on the front surface of the first regions 162a to 162e on the sentence beginning side. As shown in FIGS. 6 and 7, when the text is written vertically, the mark image 174 is displayed in the upper right portion of the first area 162.

However, the initial arrangement order of each of the first regions 162a to 162e is automatically set according to the writing direction of the text set on the writing direction setting screen 140 and the position of the first regions 162a to 162e in the preview image 164. Is set to. Specifically, the first area 162 located on the sentence beginning side in the writing direction of the text has a higher placement order, and the first area 162 located on the sentence end side in the writing direction of the text has a lower placement order. For example, when the writing direction is vertical writing, when there are a plurality of first regions 162 having different vertical directions, the one located above has a higher arrangement order, and the first region 162 having the same vertical direction has. When there are a plurality of them, the one located on the right side has a higher arrangement order. That is, the first region 162 located at the upper right is the highest, and the first region 162 located at the lower left is the lowest.

However, in articles such as newspapers, the blocks of the text may be arranged in an order different from the writing direction of the text. In such a case, when the arrangement order of each first area 162 is set according to the writing direction of the text and the position of the first area 162, the sentences may not be connected properly.

Therefore, in the present embodiment, when the first type user operation for designating the arrangement order of the plurality of first areas 162 is detected on the order setting screen 160, the arrangement order of the first area 162 is changed (reset). ) I made it possible.

Specifically, when any of the mark images 174 is touched on the rank setting screen 160, the arrangement order of all or part of the first area 162 is erased, and the arrangement order corresponds to the erased first area 162. The numbers displayed on the mark image 174 are erased, and the mark image 174 becomes blank.

For example, when any of the mark images 174 is touched, the arrangement order of all the first regions 162 may be erased, or the first region 162 corresponding to the touched mark image 174 and its The arrangement order of the first region 162 lower than the first region 162 may be erased.

Further, the arrangement order of the first area 162 is reset by touching the mark image 174 corresponding to the first area 162 whose arrangement order has been erased. For example, in the first area 162 corresponding to the touched mark image 174, the highest arrangement order at that time is set. Therefore, the arrangement order of the first region 162 is set according to the order in which the mark image 174 is touched. When the arrangement order of the first area 162 is reset, a number that is a candidate for the arrangement order may be displayed on the mark image 174 corresponding to the first area 162 in which the arrangement order is not set. The placement order candidates are set in the same way as when the initial placement order is set. However, the numbers that are candidates for the placement order are displayed in a manner different from the numbers displayed on the mark image 174 in which the placement order has been set (for example, they are displayed lightly).

As described above, in the present embodiment, the operation of touching the mark image 174 corresponds to the first type of user operation. The numeric keypad may be displayed on the rank setting screen 160 so that a number indicating the placement rank can be input to the touched mark image 174.

The "OK" button 166 is assigned a function of determining the arrangement order of the first area 162. The "reset" button 168 is assigned a function of resetting the arrangement order of the first area 162.

When the "OK" button 166 is touched, the arrangement order of the first area 162 is fixed. However, the "OK" button 166 is disabled and cannot be selected in the state where the arrangement order of all or part of the first area 162 is erased. That is, in a state where the arrangement order of all or part of the first area 162 is erased, the arrangement order of the first area 162 cannot be determined. Although not shown, when the "OK" button 166 is disabled, the "OK" button 166 may be displayed in gray out (or translucent), or the "OK" button 166 may be touched. A message or the like urging the user to confirm the arrangement order of all the first regions 162 may be displayed. These things are the same for the "OK" button 206 described later.

When the "reset" button 168 is touched, the arrangement order of the first area 162 returns to the initial arrangement order. When the "reset" button 168 is touched, the arrangement order of all the first regions 162 may be deleted. The same applies to the “reset” button 208 described later.

When the "OK" button 166 is touched and the arrangement order of the first region 162 is determined, an image (individual image) cut out for each region included in the extracted image is generated. Specifically, an individual image corresponding to each of the first region 162 (first type individual image 188) and an individual image corresponding to each of the second region 170 (second type individual image 190) are generated. (See Fig. 8 etc.). Then, an image in which the two types of individual images 188 and 190 are rearranged (rearranged) so as to fit in a predetermined shape (for example, a rectangle) is automatically generated as a clip image.

When the clip image is generated, the image adjustment screen 180 as shown in FIGS. 8 to 10 is displayed on the display 96. The image adjustment screen 180 is a screen for confirming or adjusting a clip image. On the image adjustment screen 180, a message prompting the user to set the extraction range, a preview image 182 corresponding to the clip image, an "OK" button 184, and a "reset" button 186 are displayed.

In the preview image 182, two types of individual images 188 and 190 included in the clip image are displayed. In this embodiment, the preview image 182 displays the first type of individual images 188a to 188e corresponding to each of the first regions 162a to 162e. Further, in the preview image 182, the second type of individual images 190a to 190c corresponding to each of the second regions 170a to 170c are displayed. Each of the individual images 188 and 190 is arranged so as to fit in the outer frame 182a showing the outer shape of the clip image.

Further, in the initial layout of the clip image shown in FIG. 8, the area (margin) in which the individual images 188 and 190 are not displayed is not set.

However, the initial positions of the individual images 188 and 190 are automatically set according to the writing direction of the text set on the writing direction setting screen 140 and the arrangement order of the first type of individual images 188. There is. The arrangement order of the individual images 188 of the first type is the same as the arrangement order of the corresponding first area 162.

First, among the plurality of first-type individual images 188, those having a higher arrangement order are arranged on the sentence beginning side in the writing direction, and those having a lower arrangement order are arranged on the sentence end side in the writing direction. For example, when the text is written vertically, among the individual images 188 of the first type, those having a higher arrangement order are arranged above, and those having a lower arrangement order are arranged below. Further, among the first type of individual images 188, those having a higher arrangement order are arranged on the right side, and those having a lower arrangement order are arranged on the left side.

In addition, each of the second type of individual images 190a to 190c is arranged at the top, bottom, left, and right ends of the preview image 182 (clip image). For example, the second type of individual image 190 in which the heading is described is arranged at the end in the direction orthogonal to the writing direction of the heading. That is, the second type of individual image 190 corresponding to the horizontal heading is arranged at the upper and lower ends of the clip image. On the other hand, the second type of individual image 190 corresponding to the vertical heading is arranged at the left and right ends of the clip image.

However, in this embodiment, the respective positions of the individual images 188 and 190 are changed when a second type of user operation for changing the arrangement of the individual images 188 and 190 is detected.

Specifically, the individual images 188 and 190 are moved within the display range of the clip image (within the range of the outer frame 182a) by the slide (drag) operation.

FIG. 9 shows a state in which the second type of individual image 190a displayed at the upper end of the clip image in the state shown in FIG. 8 has been moved to the center in the vertical direction. At this time, as the second type of individual image 190a is moved, the other individual images 188 and 190 displayed in the destination range of the second type of individual image 190a may be moved in conjunction with each other. The size of other individual images 188 and 190 may be adjusted. Further, the first type individual images 188a to 188c and the second type individual images 190b displayed in the center in the vertical direction in the state shown in FIG. 8 are moved upward. That is, the second type of individual image 190a, the first type of individual images 188a to 188c, and the second type of individual image 190b are interchanged vertically. Here, the distance at which the first type of individual images 188a to 188c and the second type of individual images 190b are moved corresponds to the vertical dimensions of the second type of individual images 190a. Further, since the size of the space to which the second type of individual image 190b is moved and the size of the second type of individual image 190b are different, the vertical dimensions of the second type of individual image 190b are adjusted (here, the size of the vertical direction is adjusted). Will be expanded). Further, since the moved second type individual image 190a and a part of the second type individual image 190c overlap, the vertical dimension of the second type individual image 190c is adjusted (reduced).

As described above, in the present embodiment, the operation of sliding the individual images 188 and 190 corresponds to the second type of user operation.

Further, in this embodiment, the outer shape of the clip image is changed when a fourth type of user operation for changing the outer shape of the clip image is detected.

Specifically, the handle image 192 is displayed at a predetermined position on the outer frame 182a, and the outer shape of the clip image is changed by sliding the handle image 192.

The handle image 192 is, for example, a small rectangular or circular image, and is displayed at the corners (four corners) of the outer frame 182a, the midpoints of the sides of the outer frame 182a, and the like.

FIG. 10 shows a state in which the outer shape of the clip image is enlarged in the horizontal direction (horizontal direction) with respect to the state shown in FIG. At this time, as the outer shape of the clip image is changed, the individual images 188 and 190 are automatically rearranged so as to be within the range of the clip image. Further, the outer diameters of the individual images 188 and 190 may also be changed as the outer shape of the clip image is changed. In the example shown in FIG. 10, since the outer shape of the clip image is enlarged in the left-right direction, each of the individual images 188 and 190 is enlarged left and right according to the enlargement ratio of the outer shape of the clip image. At this time, the positions of the individual images 188 and 190 are adjusted so that the individual images 188 and 190 do not overlap each other.

Depending on the outer shape of the clip image after the change, an area (margin) in which the individual images 188 and 190 are not displayed may occur. In this case, the outer shape of the clip image may be automatically changed so that there is no margin, or the outer shape of the clip image may be not changed and the margin may be included as it is.

Further, although not shown, if the outer shape of the clip image is enlarged or reduced while maintaining the aspect ratio, the clip image may be enlarged or reduced as a whole. At this time, each of the individual images 188 and 190 is enlarged or reduced and the position is adjusted according to the change in the size of the outer shape of the clip image.

When the outer shape of the clip image is enlarged, the individual images 188 and 190 are moved in conjunction with each other, and the sizes of the individual images 188 and 190 are adjusted, but this is limited to this. There is no need. For example, when the outer shape of the clip image is enlarged, only the outer shape of the clip image may be enlarged without changing the positions and sizes of the individual images 188 and 190. That is, the margin portion may be intentionally set.

As described above, in the present embodiment, the operation of sliding the handle image 192 corresponds to the fourth type of user operation.

Further, when the individual images 188 and 190 are touched, the outer frame and the handle image are displayed, and the handle image corresponding to the individual images 188 and 190 is slid operation (third type user operation). In addition, the outer shapes of the individual images 188 and 190 may be individually changed.

Further, the individual images 188 and 190 may be deleted when the fifth type of user operation is detected on the image adjustment screen 180. For example, the individual images 188, 190 may be deleted by performing a specific operation (double tap) on the individual images 188, 190, or when the individual images 188, 190 are touched. , An icon for erasing the individual images 188,190 (erasing icon) is displayed in the vicinity of the touched individual images 188,190, and when the erasing icon is touched, the individual corresponding to the erasing icon is displayed. Images 188 and 190 may be erased.

The "OK" button 184 is assigned a function of ending the adjustment of the clip image. The "reset" button 186 is assigned a function of resetting the clip image. When the "reset" button 186 is touched, the clip image is initialized. When the clip image is initialized, it means that the outer shape of the clip image, the arrangement of the first type individual image 188 and the second type individual image 190, and the like are returned to the initial state. When the "OK" button 184 is touched, the latest clip image is stored in the HDD 86. When the "OK" button 184 is touched, the clip image may be stored in the HDD 86, or the clip image may be printed instead.

Next, the order setting screen 200 when the writing direction of the text is set to horizontal writing will be described with reference to FIG. Since the ranking setting screen 200 is basically the same as the ranking setting screen 160 when the writing direction of the text is set to vertical writing, the contents different from the ranking setting screen 160 will be explained and duplicated. The explanation will be omitted.

On the ranking setting screen 200, a preview image 204 including a plurality of first regions 202, an “OK” button 206, and a “reset” button 208 are displayed.

The preview image 204 includes two first regions 202 (202a to 202e) and four second regions 210 (210a to 210d). However, each of the second regions 210a to 210c is a region corresponding to a heading, and the second region 210d is a region corresponding to an illustration or a photograph. Further, each of the second regions 210 is colored according to the type of the corresponding element. For example, the second regions 210a to 210c corresponding to the headings and the second regions 210d corresponding to the illustrations or photographs are colored differently from each other. For example, the second regions 210a to 210c corresponding to the heading are colored green, and the second region 210d corresponding to the illustration or photograph is colored light blue. Therefore, it is easy to distinguish each type of the corresponding element in the second region.

When the text is written horizontally, the arrow image 212 is an image of a substantially Z-shaped arrow extending from the upper left portion of the first region 202 to the lower right portion through the upper right portion and the lower left portion. Further, the mark image 214 is displayed in the upper left portion of the first region 202.

In this embodiment, the case where the margin is not set in the initial layout of the clip image has been described as an example, but the present invention is not limited to this. For example, in the initial layout of the clip image, a margin area (margin area) may be set on at least one of the top, bottom, left, and right sides. In this case, the margin area is set by the user operation as in the case of the individual images 188, 190 and the like. It may be possible to move or change the outer shape of the margin area.

Further, the outer shape of the clip image may be set before the clip image in the initial state is generated. For example, a screen for selecting a standard paper size and paper orientation (portrait or landscape) is displayed on the display 96, and the outer shape of the clip image is adjusted to the selected paper size and paper orientation. It may be set.

Further, when the image transmitted from the external computer or the image stored in the HDD 86 is used as the original image, when the clipping job is selected on the home screen 100, the original image (original image) of the clip image is selected. A screen for selecting (original image selection screen) is displayed on the display 96. On the original image selection screen, a thumbnail image or the like corresponding to an image transmitted from an external computer or an image stored in the HDD 86 is displayed, and the original image is set (selected) by selecting (touching) the thumbnail image. ). When the original image is set, the extraction range setting screen 120 as shown in FIG. 4 is displayed. Since the processing after the extraction range setting screen 120 is displayed is the same as the processing content when the scanned image is used, the description thereof will be omitted.

The above-mentioned operation of the image forming apparatus 10 is realized by the CPU 80 executing the control program stored in the RAM 84. The specific processing will be described later with reference to a flow chart.

FIG. 12 is a diagram showing an example of the memory map 300 of the RAM 84 shown in FIG. The RAM 84 includes a program storage area 302 and a data storage area 304, and the control program of the image forming apparatus 10 is stored in the program storage area 302. However, since the image forming apparatus 10 includes the image reading apparatus 14, this control program includes the control program of the image reading apparatus 14.

As shown in FIG. 12, the control programs stored in the program storage area 302 are the display program 302a, the operation detection program 302b, the reading program 302c, the extraction program 302d, the writing direction setting program 302e, the discrimination program 302f, and the ranking setting program. It includes 302 g, an individual image generation program 302h, a clip image generation program 302i, an adjustment program 302j, and the like.

The display program 302a is a program for generating display image data corresponding to various screens to be displayed on the display 96 using image generation data including polygon data and texture data, and outputting the display image data to the display 96.

The operation detection program 302b is a program for detecting an input operation to the input device 94. For example, the operation detection program 302b is a program for acquiring the touch coordinate data output from the input control circuit 90 when the touch panel is operated and detecting that the software key displayed on the display 96 has been operated. Is. Further, the operation detection program 302b is a program for acquiring the operation data output from the input control circuit 90 when the hardware key is operated and detecting that the hardware key is operated.

The scanning program 302c is a program for scanning (scanning) an image of a document and outputting an image signal (image data) corresponding to the scanned image. When a clipping job is set, the scanning program 302c scans the entire image of the document placed on the document mounting table 16 and scans the image data of the scanned image corresponding to the entire image of the document. This is a program for output.

The extraction program 302d is a program for generating extracted image data corresponding to the extracted image included in the extraction range 124 from the original image according to the extraction range 124 set by the user.

The writing direction setting program 302e is a program for setting the writing direction of the text included in the extracted image.

The discrimination program 302f is a program for discriminating between the first region 162 and the second region 170 included in the extracted image. Further, the discrimination program 302f is also a program for discriminating the type of the second region 170 for each type of the element included in the second region 170.

The order setting program 302g is a program for automatically setting the arrangement order of the first area 162 according to the writing direction of the text and the position of the first area 162 included in the extracted image. The ranking setting program 302g is also a program for changing (resetting) the arrangement order of the first area 162 in response to the first type of user operation when the first type of user operation is detected. ..

The individual image generation program 302h cuts out the first type of individual image 188 corresponding to each of the first region 162 and the second type of individual image 190 corresponding to each of the second region 170 from the extracted image, and cuts out the individual image 188. , 190 is a program for generating individual image data corresponding to 190.

The clip image generation program 302i is a program for generating clip image data corresponding to a clip image obtained by reconstructing individual images 188 and 190 so as to fit in a predetermined shape.

The adjustment program 302j is a program for adjusting the clip image according to the input operation of the user. For example, the adjustment program 302j is a program for moving the display positions of the individual images 188 and 190 in response to the second type of user operation when the second type of user operation is detected. Further, the adjustment program 302j is also a program for changing the outer shape of the individual images 188 and 190 in response to the third type of user operation when the third type of user operation is detected. Further, the adjustment program 302j is also a program for changing the outer shape of the clip image according to the fourth type of user operation when the fourth type of user operation is detected.

Although not shown, the program storage area 302 also stores other programs for controlling the functions included in the image forming apparatus 10, such as a communication program and an image forming program.

Further, in the data storage area 304, image generation data 304a, operation data 304b, read image data 304c, extracted image data 304d, writing direction data 304e, individual image data 304f, arrangement order data 304g, and clip image data 304h are stored. Will be done.

The image generation data 304a is image data including polygon data, texture data, and the like for generating display image data for various screens displayed on the display 96. The image generation data 304a also includes image data of a software key and the like. The operation data 304b is touch coordinate data and / and operation data detected according to the operation detection program 302b.

The scanned image data 304c is image data output according to the scanning program 302c. When the clipping job is set, the image data of the scanned image corresponding to the entire image of the original is stored as the scanned image data 304c.

The extracted image data 304d is image data about the extracted image extracted from the original image according to the extraction program 302d.

The writing direction data 304e is data about the writing direction of the text set according to the writing direction setting program 302e. For example, the writing direction data 304e is data indicating that the text is written vertically or data indicating that the text is written horizontally.

The individual image data 304f is image data about the individual images 188 and 190 generated according to the individual image generation program 302h.

The arrangement order data 304g is data indicating the arrangement order of each of the individual images 188.

The clip image data 304h is image data about the clip image generated according to the clip image generation program 302i. The clip image data 304h is also image data about the clip image adjusted by the adjustment program 302j.

Although not shown, the data storage area 304 stores other data such as image generation data necessary for executing the control program, and other flags necessary for executing the control program. Or something.

FIG. 13 is a flow chart showing a part of an example of clipping processing of the CPU 80 shown in FIG. FIG. 14 is a flow diagram which is a part of the clipping process and follows FIG. When the user sets the clipping job, as shown in FIG. 13, the CPU 80 starts the clipping process, and in step S1, determines whether or not the original image is set. Here, when the scanned image is used as the original image, it is determined whether or not there is a scanning instruction. When the image transmitted from the external computer or the image stored in the HDD 86 is used as the original image, the original image selection screen is displayed to determine whether or not the original image has been selected.

If it is "NO" in step S1, that is, if it is determined that the original image is not set, the process returns to step S1. On the other hand, if "YES" in step S1, that is, when it is determined that the original image has been set, the original image is set in step S3, and the extraction range setting screen 120 is displayed on the display 96 in step S5. Then, in step S7, it is determined whether or not the extraction range 124 is set. If it is "NO" in step S7, that is, if it is determined that the extraction range 124 is not set, the process returns to step S7. On the other hand, if "YES" in step S7, that is, if it is determined that the extraction range 124 has been set, the writing direction setting screen 140 is displayed on the display 96 in step S9, and the extraction image is extracted in step S11. Judge whether the writing direction of the text included in is set.

If it is "NO" in step S11, that is, if it is determined that the writing direction of the text is not set, the process returns to step S11. On the other hand, if "YES" in step S11, that is, when it is determined that the writing direction of the text is set, the extracted image corresponding to the extraction range 124 is generated in step S13, and the extracted image is converted into the extracted image in step S15. The type of the included area is determined, the rank setting screen 160 is displayed on the display 96 in step S17, and the rank setting process is performed in step S19. The details of the ranking setting process will be described later.

Subsequently, in step S21, individual images 188 and 190 obtained by individually cutting out each of the regions included in the extracted image are generated, and the process proceeds to step S23 shown in FIG.

In step S23, a clip image reconstructed so that the individual images 188 and 190 fit into a predetermined shape is generated according to the set writing direction of the text and the arrangement order of the individual images 188, and in step S25, The image adjustment screen 180 is displayed on the display 96, the image adjustment process is performed in step S27, and the clipping process is completed. The details of the image adjustment process will be described later.

FIG. 15 is a flow chart showing an example of the ranking setting process of the CPU 80 shown in FIG. For example, the flow of the ranking setting process is a subroutine executed in step S19 of the clipping process described above.

As shown in FIG. 15, when the order setting process is started, the CPU 80 determines in step S31 whether or not to erase the arrangement order. Here, it is determined whether or not any mark image 174 is touched on the ranking setting screen 160.

If it is "NO" in step S31, that is, if it is determined that the arrangement order is not erased, the process proceeds to step S45 described later. On the other hand, if "YES" in step S31, that is, when it is determined that the arrangement order is to be deleted, the arrangement order is deleted in step S33. Here, the arrangement order of all or part of the first region 162 is erased.

Subsequently, in step S35, the initial value is set in the variable N (N = initial value). The variable N is a variable for identifying the number of the first region 162 included in the clip image. Further, the initial value is a numerical value corresponding to the highest arrangement order among the unset arrangement order in the state where the arrangement order of all or part of the first region 162 is erased.

Subsequently, in step S37, it is determined whether or not the arrangement order of any of the first area 162 of the first area 162 whose arrangement order has been erased has been reset. Here, it is determined whether or not the mark image 174 corresponding to the first region 162 whose arrangement order has been erased has been touched. If it is "NO" in step S37, that is, if it is determined that the arrangement order of the first region 162 is not reset, the process returns to step S37. On the other hand, if "YES" in step S37, that is, when it is determined that the arrangement order of the first area 162 has been reset, the arrangement order of the first area 162 selected by the user in step S39 is set to Nth place. Is set to, and in step S41, the variable N is added by 1 (N = N + 1), and in step S43, it is determined whether or not the variable N is the maximum value. Here, it is determined whether or not the arrangement order is set in all the first regions 162.

If it is "NO" in step S43, that is, if it is determined that the variable N is not the maximum value, the process returns to step S37. On the other hand, if "YES" in step S43, that is, if it is determined that the variable N is the maximum value, it is determined in step S45 whether or not to end the ranking setting process. Here, it is determined whether or not the "OK" button 166 is touched. If it is "NO" in step S45, that is, if it is determined that the ranking setting process is not completed, the process returns to step S31. On the other hand, if "YES" in step S45, that is, when it is determined that the rank setting process is finished, the flow of the rank setting process is ended and the process returns to the clipping process.

FIG. 16 is a flow chart showing an example of the image adjustment process of the CPU 80 shown in FIG. For example, the flow of this image adjustment process is a subroutine executed in step S27 of the clipping process described above.

As shown in FIG. 16, when the image adjustment process is started, the CPU 80 determines in step S51 whether or not the individual images 188 and 190 have been moved. Here, it is determined whether or not the individual images 188 and 190 have been slid. If "YES" in step S51, that is, if it is determined that the individual images 188 and 190 have been moved, the process proceeds to step S55. On the other hand, if it is "NO" in step S51, that is, if it is determined that the individual images 188 and 190 are not moved, it is determined in step S53 whether or not the outer shape of the clip image has been changed. If it is "NO" in step S53, that is, if it is determined that the outer shape of the clip image is not changed, the process proceeds to step S57 described later. On the other hand, if "YES" in step S53, that is, if it is determined that the outer shape of the clip image has been changed, the clip image is reconstructed in step S55.

Subsequently, in step S57, it is determined whether or not to redo the adjustment of the clip image. Here, it is determined whether or not the "reset" button 186 is touched on the image adjustment screen 180. If "YES" in step S57, that is, if it is determined that the adjustment of the clip image is to be redone, the clip image is initialized (returned to the state when it was generated in step S23) in step S59, and step S59. Return to S51. On the other hand, if the result is "NO" in step S57, that is, if it is determined that the clip image adjustment is not to be redone, it is determined in step S61 whether or not to end the image adjustment process. Here, it is determined whether or not the "OK" button 184 has been touched. If it is "NO" in step S61, that is, if it is determined that the image adjustment process is not completed, the process returns to step S51. On the other hand, if "YES" in step S61, that is, when it is determined that the image adjustment process is finished, the flow of the image adjustment process is ended and the process returns to the clipping process.

In this first embodiment, the writing direction of the text included in the clip image is set, the arrangement order of the plurality of first regions 162 including the text is set according to the set writing direction of the text, and the text is set. According to the arrangement order of the plurality of first regions 162 including the writing direction and the text, the first type of individual image 188 corresponding to each of the plurality of first regions 162 and the second type of individual in which elements other than the text are described. A clip image in which the image 190 is rearranged into a predetermined shape is generated. Therefore, when a part of the image obtained by reading a manuscript containing characters such as newspapers is extracted, the sentences can be reconstructed so as to be appropriately connected.

Further, according to the first embodiment, since the display 96 displays a screen including an image showing the arrangement order of the plurality of first areas 162, the user can confirm the arrangement order of the plurality of first areas 162. it can. Further, since the arrangement order of the plurality of first regions 162 can be changed according to the user operation, the sentences can be reconstructed so as to be connected more appropriately.

Further, according to the first embodiment, the positions of the individual images 188 and 190 included in the clip image can be changed according to the user operation, so that the clip image suitable for the user's preference can be generated. It is easy to use.

Furthermore, according to the first embodiment, the sizes of the individual images 188 and 190 included in the clip image can be changed according to the user operation, so that the clip image suitable for the user's preference is generated. It can be done and is easy to use.

Further, according to the first embodiment, since the outer shape of the clip image can be changed according to the user operation, it is possible to generate a clip image that suits the user's preference, which is convenient.

[Second Example]
Since the image forming apparatus 10 of the second embodiment is the same as that of the first embodiment except that a prohibited range is set for a part of the clip image, the contents different from those of the first embodiment will be described. , Duplicate explanations will be omitted.

In the second embodiment, before the clip image is generated, a prohibited range, which is a range for prohibiting the arrangement of individual images, is set in a part of the clip image.

In the second embodiment, the prohibited range screen 220 as shown in FIG. 17 is displayed on the display 96 before the clip image is generated. For example, the prohibited range screen 220 is displayed on the display 96 after the arrangement order of the first area 162 is determined.

The prohibited range screen 220 is a screen for setting a prohibited range 228, which is a range for prohibiting the arrangement of the individual images 188 and 190, in a part of the clip image. On the prohibited range screen 220, a message prompting the user to set the prohibited range 228, a preview image 222 corresponding to the outer shape (display range) of the clip image, an "OK" button 224, and a "reset" button 226 are displayed. Will be done.

On the prohibited range screen 220, the prohibited range 228 is set according to the input operation within the display range of the preview image 222. For example, as a method of setting the prohibited range 228, the user may be able to specify the range by touching two points in the display range of the preview image 222, or the prohibited range 228 may be set within the display range of the preview image 222. A frame indicating the above may be displayed so that the user can specify the range by changing or moving the size of the frame.

Further, in the display range of the preview image 222, the range other than the prohibited range 228 is the range (arrangeable range) 230 in which the individual images 188 and 190 can be arranged.

The "OK" button 224 is assigned a function of determining the prohibited range 228. The "reset" button 226 is assigned a function of resetting (initializing) the prohibited range 228.

When the "OK" button 224 is touched and the prohibited range 228 is determined, a clip image is generated and the image adjustment screen 240 as shown in FIG. 18 is displayed on the display 96.

As shown in FIG. 18, when the prohibited range 228 is set, the individual images 188 and 190 are not arranged in the prohibited range 228 but are arranged in the arrangeable range 230. Further, the individual images 188 and 190 cannot be moved to the prohibited range 228. When the outer shape of the clip image is changed, the prohibited range 228 is enlarged or reduced while maintaining the position, size, and range of the prohibited range 228 in the clip image. Since the basic configuration of the image adjustment screen 240 is the same as that of the image adjustment screen 180, detailed description thereof will be omitted.

Further, in the second embodiment, the control program further includes a program for setting a prohibited range and the like. Further, the prohibited range data is stored in the data storage area 304. The prohibited range data is a set of coordinate data indicating the prohibited range.

Hereinafter, the clipping process in the second embodiment will be described with reference to the flow chart. However, the same reference code is assigned to the same process as the clipping process described in the first embodiment, and the description is omitted for the duplicated contents. Or I will explain briefly.

FIG. 19 is a part of an example of clipping processing of the second embodiment, and is a flow chart following FIG. When the CPU 80 starts the clipping process, the individual images 188 and 190 are generated in step S21, the prohibited range screen 220 is displayed on the display 96 in step S71 shown in FIG. 19, and the prohibited range is changed in step S73. Determine if it has been set.

If it is "NO" in step S73, that is, if it is determined that the prohibited range is not set, the process proceeds to step S77. On the other hand, if "YES" in step S73, that is, when it is determined that the prohibited range has been set, the prohibited range is set in step S75, and it is determined in step S77 whether or not to determine the prohibited range. .. If it is "NO" in step S77, that is, if it is determined that the prohibited range is not determined, the process returns to step S73. On the other hand, if "YES" in step S77, that is, if it is determined that the prohibited range is determined, the process proceeds to step S23.

The contents of the processes up to step S21 and the processes after step S23 are the same as those in the first embodiment, and thus the description thereof will be omitted.

According to the second embodiment, since the prohibited range is set in a part of the clip image, the range in which the individual images 188 and 190 are not to be arranged, that is, the margin portion in the clip image can be set.

Further, according to the second embodiment, since the prohibited range 228 is set according to the touch input by the user, the range in which the individual images 188 and 190 are not desired to be arranged can be freely set by the user himself / herself.

The specific configuration and the like given in the above-described embodiment are examples, and can be appropriately changed according to the actual product. Further, each step of the flow chart shown in the above-described embodiment can be appropriately changed in the order of processing as long as the same result can be obtained.

Further, before the clip image is generated, either one of the first type individual image 188 and the second type individual image 190 included in the clip image may be displayed larger than the other. For example, the first type of individual image 188 may be displayed in a large size to make the text (character part) stand out, or the second type of individual image 190 may be displayed in a large size to make elements other than the text stand out. You may. In this case, which type of individual image should be displayed larger may be automatically proposed according to the number of individual images of each type or the size of the range, or the text or elements other than the text. A screen for selecting which of the above should be made prominent may be displayed on the display 96 so that the user can select the screen.

Further, when the clip image is generated or adjusted, the writing direction of the text included in the first type individual image 188 may be changed. Specifically, the text included in one type of individual image 188 may be separated for each character so that vertical writing can be changed to horizontal writing or horizontal writing can be changed to vertical writing. In this case, before the clip image is generated, a screen for selecting whether to change the writing direction of the text may be displayed on the display 96 so that the user can select it. Further, a button for changing the writing direction of the text may be displayed on the image adjustment screen.

Furthermore, when the clip image is generated or adjusted, the character spacing or line spacing in the text included in the first type of individual image 188 may be changed. For example, on the image adjustment screen, when the first type individual image 188 is touched, the character spacing or line spacing can be changed, or a button for changing the character spacing or line spacing is displayed. You may.

10 ... Image forming device 14 ... Image reading device 26 ... Image reading unit 80 ... CPU
84 ... RAM
94 ... Input device 96 ... Display

Claims (8)

An extraction means for extracting an extracted image of a range including the plurality of first regions from an original image including a plurality of first regions in which the text is described and a second region in which elements other than the text are described.
The first setting means for setting the writing direction of the text,
A second setting means for setting the arrangement order of the plurality of first regions according to the writing direction of the text, and the plurality of first regions according to the writing direction of the text and the arrangement order of the plurality of first regions. An image comprising a generation means for generating a clip image obtained by reconstructing a plurality of first-type individual images corresponding to each of one region and a second-type individual image corresponding to the second region into a predetermined shape. Processing equipment. A display means for displaying the extracted image and a mark image indicating the arrangement order of the plurality of first regions included in the extracted image, and an operation detecting means for detecting a user operation are further provided.
When the operation detecting means detects a first type of user operation that specifies the arrangement order of the plurality of first regions included in the extracted image, the second setting means is the first type of user. The image processing apparatus according to claim 1, wherein the arrangement order of the plurality of first regions is set according to the operation. When the operation detecting means detects a second type of user operation for changing the arrangement of at least one of the plurality of first type individual images and the second type of individual images in the clip image, the first type is described. 2. The second aspect of the present invention, further comprising a first changing means for changing the arrangement of at least one of the plurality of first type individual images and the second type of individual images in the clip image according to two types of user operations. Image processing equipment. When the operation detecting means detects a third type of user operation for changing the size of at least one of the plurality of first type individual images and the second type individual image in the clip image, the operation detecting means is used. The claim further comprises a second changing means for changing the size of at least one of the plurality of first type individual images and the second type of individual images in the clip image in response to a third type user operation. The image processing apparatus according to 2 or 3. When the operation detecting means detects a fourth type of user operation for changing the outer shape of the clip image, a third changing means for changing the outer shape of the clip image in response to the fourth type of user operation. The image processing apparatus according to any one of claims 2 to 4, further comprising. Any of claims 1 to 5, further comprising a third setting means for setting a prohibited range, which is a range for prohibiting the arrangement of the plurality of first type individual images and the second type individual image in the clip image. The image processing device described in Crab. For the processor of the image processing device
A step of extracting an extracted image of a range including the plurality of first regions from an original image including a plurality of first regions in which the text is described and a second region in which elements other than the text are described.
Steps to set the writing direction of the text and
A step of setting the arrangement order of the plurality of first regions according to the writing direction of the text, and
According to the writing direction of the text and the arrangement order of the plurality of first regions, a plurality of first type individual images corresponding to each of the plurality of first regions and a second type corresponding to the second region. A control program for an image processing device that executes a step of generating a clip image obtained by reconstructing an individual image into a predetermined shape. (A) A step of extracting an extracted image of a range including the plurality of first regions from an original image including a plurality of first regions in which the text is described and a second region in which elements other than the text are described. When,
(B) A step of setting the writing direction of the text and
(C) A step of setting the arrangement order of the plurality of first regions according to the writing direction of the text, and
(D) A plurality of first-type individual images corresponding to each of the plurality of first regions and a first type corresponding to the second region according to the writing direction of the text and the arrangement order of the plurality of first regions. A method for controlling an image processing device, which includes a step of generating a clip image in which two types of individual images are reconstructed into a predetermined shape.

Images