JP5206529B2 - Image processing apparatus, information processing apparatus, image reading apparatus, and program - Google Patents

Description

  The present invention relates to an image processing apparatus, an information processing apparatus, an image reading apparatus, and a program.

  For example, for an image read by an image reading apparatus, there is a technique called image area separation in which an image area is divided for each attribute such as a line, a character, a figure, or a photographic image included in the image (see, for example, Patent Document 1). . When an image corresponding to a connected component included in the entire image is expressed in a data format such as JPEG (Joint Photographic Experts Group), the entire circumscribed rectangular area of the connected component is a unit of elements constituting the image. It has come to be treated as.

JP-A-9-167233

  An object of the present invention is to prevent an image corresponding to a connected component in any circumscribed figure from becoming invisible even when a plurality of circumscribed figures that are circumscribed figures of the connected components overlap.

  In order to solve the above-described problem, an image processing apparatus according to claim 1 of the present application includes an extracting unit that extracts a connected component from image data in which a pixel value of each pixel is described, and a connected component extracted by the extracting unit. Storage means for storing image data corresponding to a unit of elements constituting the image, and one circumscribed figure region among circumscribed figures that are circumscribed by each connected component extracted by the extracting means, A circumscribed figure extracting unit that extracts a circumscribed figure that overlaps with a connected component in the other circumscribed figure, and a pixel that is not the connected component among the pixels included in each circumscribed figure extracted by the circumscribed figure extracting unit. A first processing means for performing a process of converting a pixel overlapping behind the pixel into a pixel meaning that the pixel is transmitted to the front surface of the own pixel; and one of the one extracted by the circumscribed figure extracting means Second processing means for performing processing for superimposing one circumscribed graphic on the front of the other circumscribed graphic so that the connected graphic region and the connected component in the other circumscribed graphic do not overlap when viewed from the front A circumscribed figure that circumscribes a connected component in at least one of the circumscribed figures extracted by the circumscribed figure extracting unit and includes all the extracted circumscribed figures, and identifies the circumscribed figure A third processing unit that performs processing for storing the image data corresponding to the one and the other connected component included in the storage unit as a unit of the element, the first processing unit, and the second processing unit. In accordance with a condition for selecting either the first processing means or the third processing means, the first processing means, the second processing means, or the third processing means is selected and selected. Processing hand In, characterized by comprising a process selecting means for causing the processing for the circumscribed figure extracted by the circumscribing figure extraction means.

  An image processing apparatus according to claim 2 of the present application specifies an operation state relating to whether or not priority is given to image quality and an operation state relating to whether or not priority is given to processing speed in the image processing apparatus according to claim 1. And a processing unit that selects the first processing unit when the operating state specified by the specifying unit is not an operating state that prioritizes the image quality of the image, and that is specified by the specifying unit. If the selected operation state is an operation state that prioritizes the image quality of the image and is not an operation state that prioritizes the processing speed, the second processing means is selected and the operation designated by the designation means When the state is an operation state giving priority to the image quality of the image and an operation state giving priority to the processing speed, or the area of the one circumscribed figure and the other by the second processing means If the Not circumscribed so as not to overlap and the connected components in the figures can be overlapped and the other of the circumscribed graphic and the one of the circumscribed figure above, and selects the third processing means.

  An image processing apparatus according to claim 3 of the present application is the image processing apparatus according to claim 1, further comprising designation means for designating an operation state relating to whether or not to limit the data amount of the image data. When an operation state that restricts the amount of image data is specified and the processing selection unit selects the third processing unit, the third processing unit selects the one and the other connected components. Corresponding image data is stored in the storage means as one unit of the element, at least one of the image data corresponding to the one or the other connected component is deleted, and the data of the image data is specified by the specifying means. When the processing selection means selects the third processing means when an operation state that does not limit the amount is specified, the third processing means And the image data corresponding to the other connected component is stored in the storage means as one unit of the element, and the one connected component and the other connected component are each stored in the storage means as one unit of the element. It is characterized by.

  According to a fourth aspect of the present invention, in the image processing apparatus according to the third aspect, the processing extracting unit is configured to operate when the operation state that restricts the data amount of the image data is specified by the specifying unit. When the third processing unit is extracted, the third processing unit stores the image data corresponding to the one and the other connected component in the storage unit as one unit of the element, Of the image data corresponding to the other connected component, the image data having the larger data amount is deleted from the storage means.

  An information processing apparatus according to claim 5 of the present application stores image data corresponding to the above-described image processing apparatus, operation means operated by a user, and connected components stored in the storage means of the image processing apparatus. A processing unit that performs processing corresponding to an operation in the operation unit using the image data as a unit of an element constituting the image is provided.

  An image reading apparatus according to claim 6 of the present application reads an image drawn on a recording medium and outputs image data in which pixel values of each pixel constituting the image are described; and the reading unit Extracting means for extracting connected components from the image data output from the storage, storage means for storing image data corresponding to the connected components extracted by the extracting means as a unit of elements constituting the image, and the extracting means A circumscribed figure extracting means for extracting a circumscribed figure in which a region of one circumscribed figure and a connected component in the other circumscribed figure overlap among the circumscribed figures that are circumscribed by each connected component extracted by Means that the pixels that are not the connected components among the pixels included in each circumscribed figure extracted by the extracting means are transmitted through the front surface of the self-pixel through the pixel that overlaps the self-pixel. The first processing means for performing the process of converting to a pixel and the circumscribed figure area extracted by the circumscribed figure extracting means and the connected component in the other circumscribed figure do not overlap when viewed from the front. Thus, circumscribing the connected component in at least one circumscribed figure extracted by the circumscribed figure extracting means, the second processing means for performing processing for superimposing one of the circumscribed figures on the front of the other circumscribed figure And the circumscribed figure which is a figure including all the extracted circumscribed figures is specified, and the image data corresponding to the one and the other connected components included in the specified circumscribed figure is set as one unit of the element In accordance with a condition for selecting any one of a third processing unit that performs processing to be stored in the storage unit, and the first processing unit, the second processing unit, or the third processing unit. Selecting the processing means, the second processing means, or the third processing means, and causing the selected processing means to perform processing on the circumscribed graphic extracted by the circumscribed graphic extracting means; It is characterized by comprising.

  According to a seventh aspect of the present invention, there is provided a program for extracting a connected component from image data in which a pixel value of each pixel is described, and image data corresponding to the connected component extracted by the extracting unit. Among a circumscribed figure and a circumscribed figure of one circumscribed figure among circumscribed figures that circumscribe each connected component extracted by the extracting means. Circumscribing figure extraction means for extracting circumscribing figures that overlap with the connected components of pixels, and pixels that are not connected components among pixels included in each of the circumscribed figures extracted by the circumscribing figure extraction means overlap behind the own pixels. A first processing means for performing a process of converting the pixel into a pixel which means that the pixel is transmitted to the front surface of the own pixel; and one circumscribed figure extracted by the circumscribed figure extracting means A second processing means for performing processing for superimposing one circumscribed graphic on the front of the other circumscribed graphic so that the region and the connected component in the other circumscribed graphic do not overlap when viewed from the front; A circumscribed figure that is circumscribed with at least one of the connected components in the circumscribed figure extracted by the circumscribed figure extracting means and that includes all the extracted circumscribed figures is identified, and is included in the identified circumscribed figure Third processing means for performing processing for storing the image data corresponding to the one and the other connected component in the storage means as one unit of the element, the first processing means, and the second processing means Or, according to the condition for selecting any of the third processing means, the first processing means, the second processing means, or the third processing means is selected, and the selected processing means ,Previous It is a program for implementing a process selecting means for causing the processing for the circumscribed figure extracted by the circumscribing figure extraction means.

According to the image processing apparatus of the first aspect of the present invention, an image corresponding to a connected component in any circumscribed figure can be seen even when a plurality of circumscribed figures that are circumscribed figures of the connected components overlap. It can be prevented from disappearing.
According to the image processing apparatus of the second aspect of the present invention, either the designated operation state is an operation state that prioritizes image quality or an operation state that prioritizes processing speed. The processing means can be selected so that the image corresponding to the connected component in the circumscribed figure is not invisible.
According to the image processing apparatus of the third aspect of the present invention, when the designated operation state is an operation state that restricts the data amount of the image data, the data amount of the image data can be reduced.
According to the image processing apparatus of the fourth aspect of the present invention, when the designated operation state is an operation state that restricts the data amount of the image data, the data amount of the image data can be reduced.
According to the information processing apparatus of the fifth aspect of the present invention, an image corresponding to a connected component in any circumscribed figure can be seen even when a plurality of circumscribed figures that are circumscribed figures of the connected components overlap. It can be prevented from disappearing.
According to the image reading apparatus of the sixth aspect of the present invention, an image corresponding to a connected component in any circumscribed figure can be seen even when a plurality of circumscribed figures that are circumscribed figures of the connected components overlap. It can be prevented from disappearing.
According to the program of claim 7 of the present invention, even when a plurality of circumscribed figures that are circumscribed figures of the connected components overlap, an image corresponding to the connected components in any of the circumscribed figures does not disappear. Can be.

It is a block diagram for demonstrating the hardware constitutions of an image processing apparatus. It is a block diagram which shows the functional structure of an information processing part. It is a figure showing the example of the several circumscribed rectangle which overlaps with the circumscribed rectangle which a connection component circumscribes. It is a figure for demonstrating the judgment of rearrangement. It is a figure which shows that order is assigned to each circumscribed rectangle. It is a figure for demonstrating an integrated area | region. It is a figure for demonstrating that an integrated area | region may overlap with another circumscribed rectangle. It is a flowchart for demonstrating the flow of operation | movement of CPU in an information processing part.

1. Definitions In the following embodiments, the “raster system” is a system that describes the pixel values of each pixel arranged in a grid pattern for each pixel.
A “raster image” is an image expressed in a raster format.
“Vector information” is information in which each element such as a line, a surface area, and a character to be drawn is defined in an abstract space, and a process of drawing each element is described by a numerical value or a mathematical expression. For example, a Bezier curve parameter is used for the description of the vector information.
The “vector method” is a method for drawing an element defined by vector information for each element. Specifically, the vector method means the coordinates of the start and end points of the line, color, thickness, how to bend, the color of the surface surrounded by the line, character code and character attributes (size and font), etc. This is a method expressed by a mathematical formula.
A “vector image” is an image expressed by a vector method.
“Vectorization” refers to converting a raster image into a vector image.
The “connected component” refers to a binary image corresponding to an image in which pixels having the same value are connected to each other to form one lump.
A “photographic image” refers to a raster image obtained by photographing natural objects mainly by an optical technique, and a raster image equivalent thereto, which is difficult to vectorize.

2. Configuration 2-1. Overall Configuration A configuration of an image processing apparatus 10 according to an embodiment of the present invention will be described.
FIG. 1 is a block diagram for explaining a hardware configuration of the image processing apparatus 10.
As shown in FIG. 1, the image processing apparatus 10 includes an information processing unit 1, a scanner 2, and an image forming unit 3. The inner side surrounded by a two-dot chain line in FIG. The CPU 11 controls each unit of the information processing unit 1 connected via the bus 19 by reading out and executing a computer program (hereinafter simply referred to as a program) stored in the ROM 12. The ROM 12 is a read-only nonvolatile storage device composed of a semiconductor element or the like. The ROM 12 stores various programs and BIOS (Basic Input / Output System). The RAM 13 is used as a work area when the CPU 11 executes a program. The RAM 13 stores data representing a vector image (hereinafter referred to as vector image data) and data representing a raster image (hereinafter referred to as raster image data). A VRAM (Video RAM) 14 is a RAM that stores raster image data. The input unit 15 is an interface with an external input device such as a scanner or a computer, and receives input of image data under the control of the CPU 11. The output unit 16 outputs the image data to an external device such as an image forming unit or a liquid crystal display medium under the control of the CPU 11.

2-2. Functional Configuration FIG. 2 is a block diagram illustrating a functional configuration of the information processing unit 1.
Each means surrounded by the two-dot chain line frame 11 a and the frame 11 b in FIG. 2 is realized by the CPU 11 of the information processing unit 1. The raster image data G0 is acquired by the acquisition unit 110, binarized by the connected component extraction unit 111, and a connected component is extracted from the image represented by the raster image data G0. The attribute determination unit 112 determines the attribute of the image in the image area including the extracted connected component.

  Here, FIG. 3A shows, as an example of the image, a binary image obtained by binarizing a raster image representing a photograph of the moment when the baseball player hits the ball with the bat. In the raster image before binarization, baseball players, bats, and balls to be drawn are drawn in the respective drawing colors, but after binarization, they are drawn in two colors of black or white. . The connected component extracting unit 111 extracts a connected component that is a region shown in black in the drawing from the binarized raster image data. Next, the attribute determination unit 112 includes the content of the raster image data before binarization corresponding to the connected component region extracted from the raster image data after binarization, for example, a histogram of pixel values or between adjacent pixel values. Depending on conditions such as the number of color changes, image attributes such as whether the image in the area is an image that can be vectorized, an image that can be converted to text, or an image corresponding to a photographic image Determine.

  Image data corresponding to an area determined as an image that can be vectorized by the attribute determining unit 112 is converted into vector image data by the attribute determining unit 112 and stored in the RAM 13. Further, the image data corresponding to the area determined as an image that can be converted into text by the attribute determination unit 112 is converted into a text code or the like by the attribute determination unit 112 and stored in the RAM 13. Each of these is stored as a unit of elements constituting the image, and is handled as a unit when processing is performed using image data.

  On the other hand, image data corresponding to an area determined as a photographic image by the attribute determination unit 112 is expressed in JPEG (Joint Photographic Experts Group) format by the attribute determination unit 112 and then stored in the RAM 13. In the JPEG format, the image is handled as a rectangle, so the image area of the image data stored in the RAM 13 is a circumscribed rectangle R1 circumscribed by the connected component D1 shown in FIG. Therefore, if images corresponding to a plurality of photographic images are close to each other, circumscribed rectangles of the respective images may overlap.

  For example, the circumscribed rectangles R5, R6, and R7 shown in FIG. 3B are overlapped with the other two circumscribed rectangles. In addition, the circumscribed rectangle R8 illustrated in FIG. 3C overlaps with the circumscribed rectangle R9, but does not overlap with the circumscribed rectangle R10 and the circumscribed rectangle R11. Further, in FIG. 3D, one circumscribed rectangle R12 is included in the other circumscribed rectangle R13, but such superposition may also occur. Thus, if the circumscribed rectangles overlap each other, one of the connected components (photographic images) in each circumscribed rectangle may not be visible. For example, as illustrated in FIG. 4B, when the circumscribed rectangle R1 is arranged in front of the circumscribed rectangle R2, the connected component (photographic image) in the circumscribed rectangle R2 is included in the circumscribed rectangle R1. It disappears because of the background pixels. Note that the front here refers to a front side for the user when a plurality of images have a hierarchical structure.

  The superposed circumscribed rectangle extracting means 113 extracts a circumscribed rectangle having a relationship such that one circumscribed rectangle region and a connected component in the other circumscribed rectangle overlap among a plurality of circumscribed rectangles. For example, in the example of FIG. 4B, the superposed circumscribed rectangle extracting means 113 extracts circumscribed rectangles R1 and R2. The superposed circumscribed rectangle extracting means 113 stores these circumscribed rectangles R1 and R2 in the RAM 13 in association with each other. Each of these is stored as a unit of elements constituting the image, and is handled as a unit when processing is performed using image data.

  The operation state designation unit 115 is a unit that designates the operation state of the image processing apparatus 10. The operation state is also called, for example, an operation mode, and is set by a user operation or judgment of the image processing apparatus 10 itself. Here, whether or not to give priority to each of the three items of “image quality”, “speed”, and “data size (data amount)” is set as the operation state. The processing selection unit 114 is a conversion unit 116 that is a first processing unit, a rearrangement unit 117 that is a second processing unit, or a third processing unit, depending on the operation state designation by the operation state designation unit 115. Is selected as a means for processing the circumscribed rectangle extracted by the superposed circumscribed rectangle extracting means 113.

  The process selection unit 114 selects any of the conversion unit 116, the rearrangement unit 117, and the integration unit 118 according to the following conditions. That is, the process selection unit 114 selects the conversion unit 116 when the operation state designated by the operation state designation unit 115 is not an operation state in which the image quality of the image is prioritized. Further, the process selecting unit 114 is a reordering unit when the operation state specified by the operation state specifying unit 115 is an operation state in which priority is given to the image quality of the image, and is not an operation state in which priority is given to the processing speed. 117 is selected. In addition, the process selection unit 114 is an operation state in which the operation state specified by the operation state specifying unit 115 is an operation state in which priority is given to the image quality of the image and an operation state in which priority is given to the processing speed, or rearrangement. When the means 117 cannot perform rearrangement so that one circumscribed rectangle region and the connected component in the other circumscribed rectangle do not overlap, the integration means 118 is selected.

  The converting unit 116 converts pixels that are not connected components (that is, background pixels) among pixels included in each of the two or more circumscribed rectangles extracted by the superposed circumscribed rectangle extracting unit 113 into pixels that overlap behind the own pixels. A process of converting into a pixel that means transmission through the front surface of the pixel is performed. An example of a method of transmitting a pixel overlapping behind the own pixel to the front of the own pixel is a method of converting to a PNG (Portable Network Graphics) format having an α channel.

The rearrangement unit 117 does not overlap the region of one circumscribed rectangle and the connected component in the other circumscribed rectangle among the two or more circumscribed rectangles extracted by the superposed circumscribed rectangle extracting unit 113 when viewed from the front. As described above, the process of superimposing one of the circumscribed rectangles on the front surface of the other circumscribed rectangle is performed.
FIG. 4A shows an example in which a circumscribed rectangle R2 is arranged at the lower right of the circumscribed rectangle R1. The image drawn on the circumscribed rectangle R2 is a raster image of a photograph of the moment when a soccer player kicks up the ball, and is represented by a connected component when binarized in the figure. The circumscribed rectangle R1 and the circumscribed rectangle R2 are overlapped in the overlapping region Rp. In this example, the superimposed region Rp includes a photographic image (connected component) in the circumscribed rectangle R2, but does not include a photographic image (connected component) in the circumscribed rectangle R1.
FIG. 5 is a diagram showing that the order is assigned to each circumscribed rectangle in the RAM 13. In the same figure, the order represents the front and back of the circumscribed rectangle, and the smaller the order value, the closer to the front, and the larger the order value, the closer to the back. FIG. 5A shows that the order “1” is assigned to the circumscribed rectangle R1, and the order “2” is assigned to the circumscribed rectangle R2. That is, in FIG. 5A, the circumscribed rectangle R1 is in front of the circumscribed rectangle R2. When the circumscribed rectangle R1 is in front of the circumscribed rectangle R2, as shown in FIG. 4B, the connected component (photographic image) in the circumscribed rectangle R2 becomes invisible due to the background pixels included in the circumscribed rectangle R1.

  On the other hand, FIG. 5B shows that the order “2” is assigned to the circumscribed rectangle R1 and the order “1” is assigned to the circumscribed rectangle R2. The circumscribed rectangle R1 is behind the circumscribed rectangle R2. In this case, as shown in FIG. 4C, the connected component (photographic image) in the circumscribed rectangle R2 is not invisible by the background pixels included in the circumscribed rectangle R1. The rearrangement unit 117 attempts to rearrange the circumscribed rectangles so that all the photographic images (connected components) of the overlapping part are displayed. Then, when the rearrangement means 117 has been rearranged, the rearrangement unit 117 stores the order representing the front and rear of each circumscribed rectangle at that time in the RAM 13 in association with the circumscribed rectangles R1 and R2. On the other hand, the rearrangement unit 117 can see the photographic images (connected components) included in any of the circumscribed rectangles when the rearrangement cannot be performed, that is, no matter how the circumscribed rectangles are replaced. When it disappears, the process selection means 114 is notified to that effect.

The integrating unit 118 is a rectangle that circumscribes at least one of the circumscribed rectangles of the two or more circumscribed rectangles extracted by the superimposed circumscribed rectangle extracting unit 113 and includes all the extracted circumscribed rectangles. A circumscribed rectangle is specified, and image data corresponding to one and the other connected components included in the specified circumscribed rectangle is stored in the RAM 13. This image data is stored as one unit of elements constituting the image, and is handled as one unit when processing is performed using the image data.
When the circumscribed rectangle R1a and the circumscribed rectangle R2a are arranged in a positional relationship as shown in FIG. 6A, a photograph in the circumscribed rectangle R1a is included in the overlapping region Rpa where these two circumscribed rectangles overlap. Both the image (connected component) and the photographic image (connected component) in the circumscribed rectangle R2a are included. Therefore, regardless of which circumscribed rectangle is set to the front, the photographic image of the circumscribed rectangle in the back cannot be seen. In this case, the integration unit 118 compares the xy coordinates of the four corners of the circumscribed rectangle R1a and the circumscribed rectangle R2a, and circumscribes the connected component in at least one of the circumscribed rectangles and includes a rectangle including all the circumscribed rectangles. It generates as integrated field R3a. Hereinafter, this process is referred to as “integrating circumscribed rectangles”, and the circumscribed rectangle to which all the connected components of each circumscribed rectangle are circumscribed is specified by this integration.

The integration unit 118 also integrates circumscribed rectangles even when the designated operation state is an operation state in which speed is prioritized. As a result, the circumscribed rectangle R1 and the circumscribed rectangle R2 having a positional relationship as shown in FIG. 6C are integrated.
FIG. 7 is a diagram for explaining that the integrated region integrated by the integration unit 118 may further overlap with other circumscribed rectangles. As shown in FIG. 7A, the integrated region R3 generated by integrating the circumscribed rectangle R1 and the circumscribed rectangle R2 includes regions Rs1, Rs2 (hereinafter referred to as these regions) that were not included in the circumscribed rectangles R1, R2. Is referred to as an additional area). Here, as shown in FIG. 7B, it is assumed that the circumscribed rectangle R4 is disposed in the vicinity of the circumscribed rectangles R1 and R2. In the circumscribed rectangle R4, a raster image of a photograph of the moment when the baseball player throws the ball is drawn. The circumscribed rectangle R1 and the circumscribed rectangle R4 do not overlap each other, and the circumscribed rectangle R2 and the circumscribed rectangle R4 do not overlap each other. However, since the additional region Rs2 is added to the integrated region R3, and a part of the additional region Rs2 and the circumscribed rectangle R4 overlap, the integrated region R3 and the circumscribed rectangle R4 overlap each other. Therefore, every time an integrated region is generated, processing is performed so that the superimposed circumscribed rectangle extracting unit 113 newly determines the superimposed relationship of circumscribed rectangles.

3. Operation FIG. 8 is a flowchart for explaining the flow of operation when the CPU 11 in the information processing unit 1 executes a program.
In FIG. 8, first, raster image data G0 transmitted from the scanner 2 is received by the input unit 15 and input to the CPU 11 via the bus 19. That is, the CPU 11 acquires raster image data G0 and temporarily stores it in the RAM 13 (step S101). Next, the CPU 11 compares each pixel of the acquired raster image data with a predetermined threshold value, and obtains binary image data composed of binary values of a pixel that exceeds the threshold value and a pixel that does not exceed the threshold value. Generate (step S102). Next, based on the binary image data generated in step S <b> 102, the CPU 11 performs a labeling process in which adjacent pixels among “pixels exceeding the threshold” are labeled (step S <b> 103). Next, based on the result of the labeling process, the CPU 11 extracts a group of pixels with the same label, that is, a connected component, and specifies a rectangle that circumscribes the connected component, that is, a circumscribed rectangle. (Step S104).

  When each circumscribed rectangle is specified in step S104, the CPU 11 starts sequential processing for each circumscribed rectangle. First, the CPU 11 checks whether or not there are circumscribed rectangles that overlap each other among the circumscribed rectangles to be determined. If there are circumscribed rectangles that overlap each other, the CPU 11 further determines one of the circumscribed rectangles. A circumscribing rectangle having a relationship such that the connected component in the other circumscribing rectangle and the other circumscribing rectangle overlap is extracted (step S105). As a result, one or a plurality of sets of circumscribed rectangles having a relationship in which the region of one circumscribed rectangle overlaps the connected components in the other circumscribed rectangle are extracted. If it is determined that there is no circumscribed rectangle having such a relationship (step S105; NO), the CPU 11 advances the process to step S115. On the other hand, when it is determined that there is a circumscribed rectangle having such a relationship (step S105; YES), the CPU 11 checks the operation state at that time (step S106).

  Then, the CPU 11 determines whether or not the operation state is an operation state that prioritizes image quality (step S107). If it is determined that the operation state is not an operation state that prioritizes image quality (step S107; NO), the CPU 11 converts all of the set of circumscribed rectangles extracted in step S105 into a PNG format having an α channel. (Step S108) Then, the process returns to Step S105, and the next set of circumscribed rectangles is set as a processing target. On the other hand, when determining that the operation state designated in step S106 is an operation state in which image quality is given priority (step S107; YES), the CPU 11 advances the process to step S109.

  In step S109, the CPU 11 determines whether or not the operation state is an operation state that prioritizes the processing speed. When it is determined that the designated operation state is an operation state in which the processing speed is prioritized (step S109; YES), the CPU 11 determines an integrated region in which all of the set of circumscribed rectangles extracted in step S105 are integrated. These are generated in front of these circumscribed rectangles (step S112). As a result, the circumscribed rectangles before being integrated are assigned and stored in the order corresponding to the back of the integrated area, and thus are hidden by the integrated area and cannot be seen. Thereafter, the CPU 11 returns the process to step S105, and sets the next set of circumscribed rectangles as the processing target.

  On the other hand, when it is determined that the operation state is not an operation state in which the processing speed is prioritized (step S109; NO), the CPU 11 is a region of one circumscribed rectangle among the set of circumscribed rectangles extracted in step S105. In order to prevent the connected components in the other circumscribed rectangle from overlapping each other when viewed from the front, an attempt is made to superimpose one circumscribed rectangle on the front of the other circumscribed rectangle (step S110). If the rearrangement has been completed (step S111; YES), the CPU 11 stores the order representing the front and rear of each circumscribed rectangle in the RAM 13 in association with these circumscribed rectangles. Then, the CPU 11 returns the process to step S105 and sets the next set of circumscribed rectangles as the processing target. On the other hand, when the rearrangement unit 117 cannot perform the rearrangement (step S111; NO), the CPU 11 advances the process to step S112 and integrates the circumscribed rectangles.

  After the processing of step S112, the CPU 11 determines whether or not the operation state is an operation state that prioritizes the data size of the image data (step S113). Here, “prioritize the data size of the image data” means that the storage capacity required when the image data is stored in the storage medium is kept small. If the CPU 11 determines that the operation state is not an operation state that prioritizes the data size of the image data (step S113; NO), the CPU 11 returns to the process of step S105 and sets the next set of circumscribed rectangles as the processing target. On the other hand, when it is determined that the operation state is an operation state that prioritizes the data size of the image data (step S113; YES), the CPU 11 deletes all circumscribed rectangles that are the basis of the generated integrated region (step S114). Thereafter, the process returns to step S105. That is, in the example of FIGS. 6A and 6B, the image data corresponding to the connected component included in the circumscribed rectangle R3a that is the integrated region is included in the circumscribed rectangles R1a and R2a while being stored in the RAM 13. The image data corresponding to the connected component is erased from the RAM 13.

  As the above processing proceeds, image data corresponding to the connected component included in each circumscribed rectangle is stored in the RAM 13 as one unit of elements constituting the image. Therefore, it is possible to perform processing using these individual image data. For example, the operation means operated by the user and the image data corresponding to the stored connected component as a unit of the elements constituting the image, and processing according to the operation on the operation means using the image data It is possible to perform processing using these individual image data by an information processing apparatus including the means.

4). Modification The above is the description of the embodiment, but the contents of this embodiment can be modified as follows. Further, the following modifications may be combined.
(1) In the above-described embodiment, when the CPU 11 determines that the operation state is an operation state that prioritizes the data size of the image data, the CPU 11 deletes all circumscribed rectangles that are the basis of the generated integrated region. However, the circumscribed rectangle deleted by the CPU 11 may be a part. For example, the data sizes of all the circumscribed rectangles that are the basis of the generated integrated region may be compared, and the circumscribed rectangle having the largest data size may be selected and deleted. As a result, the circumscribed rectangle having the smallest data size can be reused by cutting out from the integrated area.

The generation of the integrated area and the deletion of the circumscribed rectangle that is the basis of the integrated area may be performed simultaneously.
Further, it is not necessary to determine whether or not the operation state is an operation state that prioritizes the data size of the image data. In this case, the data that is the basis of integration may be deleted without fail, or an order corresponding to the back of the integration area may be assigned and stored.

(2) In the above-described embodiment, when the superposition circumscribed rectangle extracting unit 113 determines the superposition relationship of a plurality of circumscribed rectangles, all the two or more circumscribed rectangles that overlap each other are associated. Then, when the superposition relationship is determined and the superposition is performed, the two circumscribed rectangles selected may be processed. Even in this case, the adjustment processing is sequentially performed by the inner means surrounded by the frame 11b in FIG. 2, and further superimposition determination is performed for the subsequent circumscribed rectangle group. The order is assigned so that the photographic images are displayed, and the photographic images are individually stored in the RAM 13 so that they can be processed individually.

(3) In the above-described embodiment, the information processing unit 1 is built in the image processing apparatus 10, but the information processing unit 1 may be realized by a personal computer.
2 is a function realized by the CPU 11 of the information processing unit 1, but these means may be realized by other than the CPU 11. For example, each of these means may be realized by a dedicated image processor.

(4) Even if the figure that circumscribes the connected component is not a rectangle, the figure does not matter as long as it is a figure that circumscribes the connected component.

DESCRIPTION OF SYMBOLS 1 ... Information processing part, 2 ... Scanner, 3 ... Image forming part, 10 ... Image processing apparatus, 11 ... CPU, 12 ... ROM, 13 ... RAM, 15 ... Input part, 16 ... Output part, 19 ... Bus, 110 ... Obtaining means 111 ... Connected component extracting means 112 ... Attribute determining means 113 ... Superposed circumscribed rectangle extracting means 114 ... Process selecting means 115 ... Operating state specifying means 116 ... Converting means 117 ... Sorting means 118 ... Integration means.

Claims (7)

Extracting means for extracting a connected component from image data in which a pixel value of each pixel is described;
Storage means for storing image data corresponding to the connected component extracted by the extraction means as a unit of elements constituting the image;
A circumscribed figure extracting means for extracting a circumscribed figure in which a region of one circumscribed figure and a connected component in the other circumscribed figure are overlapped among the circumscribed figures in which each connected component extracted by the extracting means is circumscribed,
Of the pixels included in each circumscribed graphic extracted by the circumscribed graphic extracting means, a pixel that is not the connected component is converted into a pixel that means that a pixel overlapping behind the own pixel is transmitted to the front of the own pixel. First processing means for performing processing;
One circumscribing figure of the other circumscribing figure is not overlapped so that the area of one circumscribing figure extracted by the circumscribing figure extracting means and the connected component in the other circumscribing figure do not overlap when viewed from the front. Second processing means for performing processing to be superimposed on the front surface;
A circumscribed figure that is circumscribed with a connected component in at least one of the circumscribed figures extracted by the circumscribed figure extracting means and that includes all the extracted circumscribed figures is specified and included in the identified circumscribed figure Third processing means for performing processing for storing the image data corresponding to the one and the other connected components in the storage means as one unit of the element;
The first processing means, the second processing means, or the third processing according to a condition for selecting any one of the first processing means, the second processing means, and the third processing means. An image processing apparatus comprising: processing selecting means for selecting any of the means and causing the selected processing means to perform processing on the circumscribed graphic extracted by the circumscribed graphic extracting means. A designating unit for designating an operation state regarding whether or not to prioritize image quality and an operation state regarding whether or not to prioritize processing speed;
The processing selection means includes
If the operating state specified by the specifying means is not an operating state that prioritizes the image quality of the image, the first processing means is selected,
If the operating state specified by the specifying means is an operating state that prioritizes image quality and is not an operating state that prioritizes processing speed, the second processing means is selected,
When the operating state specified by the specifying means is an operating state that prioritizes the image quality of the image and an operating state that prioritizes the processing speed, or the one circumscribed figure by the second processing means Selecting the third processing means when the one circumscribed figure and the other circumscribed figure cannot be overlaid so that the connected component in the other circumscribed figure does not overlap with the connected component in the other circumscribed figure. The image processing apparatus according to claim 1. A designation means for designating an operation state related to whether or not to limit the amount of image data;
When the processing selecting unit selects the third processing unit when an operation state that restricts the data amount of the image data is specified by the specifying unit, the third processing unit selects the one and the other Image data corresponding to the connected component is stored in the storage means as one unit of the element, and at least one of the image data corresponding to the one or the other connected component is deleted,
When the processing selecting unit selects the third processing unit when an operation state that does not limit the amount of image data is specified by the specifying unit, the third processing unit selects the one and the other The image data corresponding to the connected component is stored in the storage means as one unit of the element, and the one connected component and the other connected component are each stored in the storage means as one unit of the element. The image processing apparatus according to claim 1. When the processing extracting unit extracts the third processing unit when an operation state that restricts the data amount of the image data is specified by the specifying unit, the third processing unit extracts the one and the other The image data corresponding to the connected component is stored in the storage means as one unit of the element, and the image data having the larger data amount among the image data corresponding to the one or the other connected component is stored in the storage means. The image processing apparatus according to claim 3, wherein the image processing apparatus is deleted from the image processing apparatus. An image processing apparatus according to any one of claims 1 to 4,
An operation means operated by a user;
Processing means for performing processing in accordance with an operation in the operation means using the image data, with the image data corresponding to the connected component stored in the storage means of the image processing apparatus as a unit of an element constituting the image. An information processing apparatus comprising the information processing apparatus. Reading means for reading an image drawn on a recording medium and outputting image data in which pixel values of respective pixels constituting the image are described;
Extraction means for extracting a connected component from the image data output from the reading means;
Storage means for storing image data corresponding to the connected component extracted by the extraction means as a unit of elements constituting the image;
A circumscribed figure extracting means for extracting a circumscribed figure in which a region of one circumscribed figure and a connected component in the other circumscribed figure are overlapped among the circumscribed figures in which each connected component extracted by the extracting means is circumscribed,
Of the pixels included in each circumscribed graphic extracted by the circumscribed graphic extracting means, a pixel that is not the connected component is converted into a pixel that means that a pixel overlapping behind the own pixel is transmitted to the front of the own pixel. First processing means for performing processing;
One circumscribing figure of the other circumscribing figure is not overlapped so that the area of one circumscribing figure extracted by the circumscribing figure extracting means and the connected component in the other circumscribing figure do not overlap when viewed from the front. Second processing means for performing processing to be superimposed on the front surface;
A circumscribed figure that is circumscribed with a connected component in at least one of the circumscribed figures extracted by the circumscribed figure extracting means and that includes all the extracted circumscribed figures is specified and included in the identified circumscribed figure Third processing means for performing processing for storing the image data corresponding to the one and the other connected components in the storage means as one unit of the element;
The first processing means, the second processing means, or the third processing according to a condition for selecting any one of the first processing means, the second processing means, and the third processing means. An image reading apparatus comprising: processing selecting means for selecting any of the means and causing the selected processing means to perform processing on the circumscribed graphic extracted by the circumscribed graphic extracting means. Computer
Extracting means for extracting a connected component from image data in which a pixel value of each pixel is described;
Storage means for storing image data corresponding to the connected component extracted by the extraction means as a unit of elements constituting the image;
A circumscribed figure extracting means for extracting a circumscribed figure in which a region of one circumscribed figure and a connected component in the other circumscribed figure are overlapped among the circumscribed figures in which each connected component extracted by the extracting means is circumscribed,
Of the pixels included in each circumscribed graphic extracted by the circumscribed graphic extracting means, a pixel that is not the connected component is converted into a pixel that means that a pixel overlapping behind the own pixel is transmitted to the front of the own pixel. First processing means for performing processing;
One circumscribing figure of the other circumscribing figure is not overlapped so that the area of one circumscribing figure extracted by the circumscribing figure extracting means and the connected component in the other circumscribing figure do not overlap when viewed from the front. Second processing means for performing processing to be superimposed on the front surface;
A circumscribed figure that is circumscribed with a connected component in at least one of the circumscribed figures extracted by the circumscribed figure extracting means and that includes all the extracted circumscribed figures is specified and included in the identified circumscribed figure Third processing means for performing processing for storing the image data corresponding to the one and the other connected components in the storage means as one unit of the element;
The first processing means, the second processing means, or the third processing according to a condition for selecting any one of the first processing means, the second processing means, and the third processing means. A program for selecting one of the means and causing the selected processing means to execute as processing selection means for performing processing on the circumscribed graphic extracted by the circumscribed graphic extracting means.

Images