JP5991737B2 - Image reading apparatus and control method thereof - Google Patents

Description

  The present invention relates to a technique for reading an image of an object.

  There are several methods for reading images of a plurality of originals by image reading technology. For example, multiple originals are placed side by side on a platen and images of these originals (hereinafter referred to as original images) are read at once, or multiple originals are set on an ADF (automatic document feeder). There is a method for reading original images one by one.

  In the above-described reading method, it is difficult to give predetermined information to the read document image or group a plurality of document images. When information is added or grouped, prescanning is performed before reading a document image, and information is indirectly added to the prescanned image, which complicates the operation.

  Patent Document 1 discloses a technique for storing original images in the same format and adding predetermined information to the original images when simultaneously reading original images from a plurality of originals having different sizes and shapes. According to this technique, it is possible not only to read original images of the same size from originals having different sizes and shapes, but also to add predetermined information.

  However, the technique of Patent Document 1 requires that all originals be arranged on an original plate so that the originals do not overlap each other, and the number of originals that can be read at one time is limited by the size of the reading table. Further, since the original images are individually digitized and the same information is given to all, the read original images are processed as one group. In other words, Patent Document 1 does not consider processing and storing a plurality of document images divided into a plurality of groups.

JP 2007-110339 A

The present invention is effectively reads an image of a plurality of objects, and an object thereof is to group the images of a plurality of objects read.

  The present invention has the following configuration as one means for achieving the above object.

An image reading apparatus according to the present invention is newly added to the reading table from a reading table on which an object is placed, an imaging unit that continuously images the reading table, and a captured image obtained by the imaging unit. When detecting the position and size of the object image representing the placed object and acquiring the object image, and when a new object image is acquired by the acquisition means, the new object Judgment means for judging whether or not the object image is to be superimposed on any of the other object images acquired before the new object image from the respective positions and sizes, and the new object by the judging means When it is determined that an object image is to be superimposed on one of the other object images, the new object image and another object image determined to be superimposed are grouped, and the determination unit performs the new object image. The object image is If you do not want with any superimposition of the object image is characterized by having a grouping means to exclude grouping the new object image.

  According to the present invention, it is possible to efficiently read images of a plurality of objects and group the read object images.

1 is a diagram illustrating an overview of an image reading apparatus according to an embodiment. 1 is a block diagram illustrating a configuration example of an image reading apparatus. FIG. 3 is a block diagram illustrating a functional configuration example of an image reading apparatus. The figure which shows the example of a relationship between the arrangement | positioning of a target object, and the storage method of a target object image. 3 is a flowchart for explaining a target image reading process according to the first embodiment. The figure explaining an application example. The figure explaining the process which adds additional information. 9 is a flowchart for explaining object image reading processing according to the second embodiment. FIG. 6 is a diagram illustrating grouping processing according to the second embodiment. 10 is a flowchart for explaining a target image reading process according to the third embodiment.

  Hereinafter, image processing according to an embodiment of the present invention will be described in detail with reference to the drawings.

[Overview of the device]
In the embodiment, an image reading apparatus that reads an image of an object to be read (arranged in size and shape) arranged upward on a reading table is assumed. Moreover, in an Example, the shape of a target object demonstrates as a general rectangular shape. However, the object may be, for example, a thick object, a three-dimensional object, or a cloth. The shape of the object may be, for example, a round shape, a shape including a curve, or a three-dimensional shape. That is, any shape may be used as long as the image reading apparatus of the embodiment can read an image. Note that the object includes a printed material such as a document.

  FIG. 1 shows an overview of the image reading apparatus 100 of the embodiment. The image reading apparatus 100 includes a reading table 100a and an imaging projection unit 100b. The imaging projection unit 100b includes an imaging unit for reading an image of an object placed on the reading table 100a, and a user interface (UI) that displays an image of the read object (hereinafter referred to as an object image) and operation buttons. ) Is projected onto the reading table 100a.

  In FIG. 1, rectangles denoted by reference numerals 103a to 103c indicate objects placed on the reading table 100b or projected object images. FIG. 1 shows an example in which the imaging projection unit 100b projects a Save button 100c as an example of the UI. Note that a hand indicated by reference numeral 102 is a user's hand operating the image reading apparatus 100.

[Device configuration]
An example of the configuration of the image reading apparatus 100 is shown in the block diagram of FIG. The CPU 200 executes a program stored in the ROM 202 and comprehensively controls each device connected via the system bus 203. In addition to the operating system (OS), programs and device drivers related to the processing of the embodiment are stored in the ROM 202. The CPU 200 loads a program or the like from the ROM 202 to the RAM 201, which is a work memory, and executes it. Note that the OS, program, device driver, and the like may be stored in the storage 207, for example. In that case, after the power is turned on, the OS, program, device driver, and the like are loaded into the RAM 201 via the storage interface (I / F) 206 and executed by the CPU 200.

  The display I / F 204 converts an image or UI into a signal that can be processed by the projector 209 (projection unit) according to the control of the CPU 200. The input I / F 205 receives an image signal output from the image sensor 208 (imaging unit) and converts the image signal into image data that can be processed by the image reading apparatus 100. The storage I / F 206 mutually converts a data format that can be processed by the image reading apparatus 100 and a data format to be stored in the storage 207.

  The storage 207 is a storage device having a storage capacity capable of storing a large amount of object images read and digitized by the image reading device 100, and is, for example, a hard disk drive (HDD) or a solid state drive (SSD). As the storage 207, for example, a disk drive or USB memory connected to a serial bus I / F (not shown) provided in the image reading apparatus 100, a recording medium such as a server device connected via a network I / F, A recording device can be used.

[Functional configuration of the device]
A functional configuration example of the image reading apparatus 100 is shown in the block diagram of FIG. Functions of the image acquisition unit 300, the object detection unit 301, the operation detection unit 302, the object image reading unit 303, the image processing unit 304, the display control unit 305, the group determination unit 306, the accumulation control unit 307, and the like illustrated in FIG. This is realized by the CPU 200 executing the program.

  The image acquisition unit 300 acquires an image captured by the image sensor 208 and stores the acquired image in a predetermined area of the RAM 201. For example, it is assumed that an image captured by the image sensor 208 mainly includes a reading table 100a, objects 103a to 103c, and a hand 102 as shown in FIG.

  The object detection unit 301 analyzes the image stored in the RAM 201, detects the object placed on the reading table 100a, and detects position / size information indicating the position and size of the object. The data is output to 303 and the group determination unit 306. When the object is thick, a three-dimensional object, a cloth, or a three-dimensional shape of the object, the size of the object corresponds to the projected area with respect to the reading table 100a.

  The operation detection unit 302 analyzes the image stored in the RAM 201, detects the user's hand 102, detects a user operation from the movement of the hand 102, and outputs operation information indicating the detection result to the accumulation control unit 307. .

  The object image reading unit 303 uses the position / size information input from the object detection unit 301 to read in detail the image of the object placed on the reading table 100a via the image acquisition unit 300. The read object image is output to the image processing unit 304 and the accumulation control unit 307.

  The image processing unit 304 converts the object image input from the object image reading unit 303 into a display image having a displayable size, and outputs the conversion result image to the display control unit 305. Further, the object image is analyzed to extract meta information from the object image, and the extracted meta information is output to the accumulation control unit 307.

  The display control unit 305 generates an image signal of a group boundary image (to be described later) according to the display image input from the image processing unit 304 and the group information input from the group determination unit 306, and outputs the image signal to the projector 209.

  The group determination unit 306 uses the position / size information input from the object detection unit 301 to determine grouping of object images, and displays group information indicating the determination result as a display control unit 305 and an accumulation control unit. Output to 307. Although details will be described later, the grouping is determined based on the overlapping state and arrangement of the objects.

  The accumulation control unit 307 stores the object image and meta information in the storage 207. At this time, as will be described in detail later, the storage method is changed in accordance with the operation information input from the operation detection unit 302 and the group information input from the group determination unit 306.

[Object image reading processing]
In the following, an example in which a plurality of objects are sequentially placed on the reading table 100a by the user, the object images are read, grouped as the user intends, and the object images are stored (accumulated). explain.

  FIG. 4 shows an example of the relationship between the arrangement of the object and the object image storage method, and the object image reading process according to the first embodiment will be described with reference to the flowchart of FIG. In the first embodiment, a case where the size of the object is sufficiently smaller than the size of the reading table 100a will be described.

  When the image reading apparatus 100 is turned on or a reading start button (not shown) is pressed, the object image reading process is started. At the start of the object image reading process, the display control unit 305 outputs an image signal representing a UI such as the save button 100c to the projector 208.

  The image acquisition unit 300 sequentially acquires images from the image sensor 208, and stores the acquired images in the RAM 201 (S100). The operation detection unit 302 detects the movement of the hand 102 on the reading table 101a (S101), and if any movement is detected, the object detection unit 301 determines whether a new object is placed on the reading table 100a. Is determined (S102).

  Detection of a new object is performed based on the background difference of the image. For example, an image of the reading table 100a on which nothing is placed is an initial background image Img0, and an image after the movement of the hand 102 is detected is Img1. When the difference between the background image Img0 and the image Img1 is obtained, it is possible to detect whether or not a new object N1 is placed on the reading table 100a.

  The same applies when a new object N2 is placed. In this case, the object N2 can be detected by obtaining the difference between the background image Img1 and the image Img2 using the image Img1 including the object N1 as a background image. In addition to detecting the placement of the object only by the background difference, if the image processing unit 304 analyzes the layout and content of the object and feeds back the result to the object detection unit 301, the accuracy can be improved. The placement of the object can be detected.

  When the placement of a new object is detected, the object detection unit 301 extracts the object region based on the background difference, detects the position and size of the object on the reading table 100a, and detects the detected position / size. Information is generated (S103). The object image reading unit 303 reads the object image in detail from the object region in accordance with the position / size information input from the object detection unit 301 (S104).

  Next, the group determination unit 306 determines the overlapping state of the objects based on the position / size information input from the object detection unit 301 (S107). If there is an overlap, grouping processing is performed, group information is generated as a processing result, and the group information is output to the display control unit 305 and the accumulation control unit 307 (S108). In the first embodiment, the objects superimposed on the reading table 100a are grouped as the same group. Note that the grouping process is not performed when there are no superimposed objects.

In the example of FIG. 4A, the superimposed objects A1 and A2, the superimposed objects B1, B2, B3, and B4, and the superimposed objects C1, C2, and C3 are grouped, respectively. . The grouping in the first embodiment also corresponds to group nesting (inclusion relationship) when a plurality of groups exist. The inclusion relation of the group is determined based on whether the positional information of the group has a predetermined positional relation, and is performed as follows, for example.
(1) Compare the distance between groups with a predetermined threshold,
(2) Compare the y-coordinate of the object with the largest y-coordinate in each group.

In the example of FIG. 4 (B), the distance between the group G _B of the object A1, Group G _A and the object B1 of A2, B2, B3, B4 is less than a predetermined threshold value, y-coordinate of the object A1 since y-coordinate of the object B1 than smaller, group G _B is a child group of the group G _a. On the other hand, since the distance between the group G _C and the group G _B of the objects C1, C2, and C3 exceeds a predetermined threshold, the group G _C becomes an independent group.

In the example of FIG. 4C, the distance between the group G _C and the group G _B is equal to or less than a predetermined threshold, and the y coordinate of the object C1 is smaller than the y coordinate of the object B1. _C child group of the group G _B, and becomes grandchild group of the group G _a.

Next, the display control unit 305 generates an image representing a group boundary indicating grouping of the object images (hereinafter referred to as a group boundary image) based on the group information input from the group determination unit 306, and the group boundary image The image signal is output to the projector 209 (S109). In the example of FIG. 4 (A), the group boundary image 400 indicating a group G _A, group boundary image 401 indicating a group G _B, the group boundary image 402 indicating a group G _C is generated and displayed.

Similarly, in the example of FIG. 4 (B), the group boundary image 403 indicating a group G _A, group boundary image 405 showing the child group G _B, the group boundary image 402 indicating a group G _C is generated and displayed. Further, in the example of FIG. 4 (C), the group boundary image 406 indicating a group G _A, group boundary image 407 showing the child group G _B, the group boundary image 408 showing a grandchild group G _C is generated and displayed.

  By displaying the group boundary by such a group boundary image, the user can intuitively understand how the images of the objects placed on the reading table 100a are grouped and stored.

  On the other hand, when the placement of a new object is not detected in step S102, the operation detection unit 302 detects whether or not a user instruction is input (S105). The user instruction detected by the operation detection unit 302 is an operation of touching the save button 100c projected by the projector 209. When the touch of the save button 100c is detected, the accumulation control unit 307 stores the image data of the object images grouped based on the group information input from the group determination unit 306 in the storage 207 (S106).

  In the example of FIG. 4A, three folders corresponding to the three groups are created, and the image data of the object image corresponding to each folder is stored.

In the example of FIG. 4 (B), two folders corresponding to the groups G _A and G _C are created, and the image data of the object image corresponding to each folder is stored. Furthermore, create a folder child group G _B in the folder of the group G _A, and stores the image data of the object image of the child group G _B in the Firuda.

In the example of FIG. 4 (C), the Create a folder corresponding to the group G _A, and stores the image data of the object image group G _A to the folder. Furthermore, create a folder child group G _B in the folder of the group G _A, and stores the image data of the object image of the child group G _B in the Firuda. Furthermore, create a folder grandchildren group G _C in a folder of the child group G _B, and stores the image data of the object image grandchild group G _C to the Firuda.

  After the process of step S106 or S109, or when the placement of a new object and the input of a user instruction are not detected, the display control unit 305 displays an image representing a continuation / end button for the object image reading process The signal is output to the projector 208 (S110). The continuation / end button for the object image reading process is displayed instead of the save button 100c.

  The operation detection unit 302 detects the touch of the continuation / end button of the object image reading process (S111), and when the continuation button is touched, returns the process to step S100 to continue the object image reading process. . If the end button is touched, the object image reading process ends. Note that the object image reading process may be ended by a user operation of a reading end button (not shown), similarly to the start of the object image reading process by the user operation of the reading start button.

  As described above, the user can instruct a method of storing a plurality of object images by grouping the objects on the reading table 100a. In addition, the grouping instructed is fed back by the superimposed display of the group boundary image, and the user can check how the plurality of object images are grouped and stored to change the arrangement of the objects. it can. Accordingly, it is possible to realize an intuitive operation with less burden on the user.

  In the above, the example in which the images of the objects placed on the reading table 101a are grouped has been described. However, if there is no overlap between multiple objects placed on the reading table 101a, does the user want to handle these objects individually or whether to read all the objects as one image as in the past? Is difficult to distinguish. Therefore, when a plurality of objects are arranged on the reading table and no objects overlap, the group determination unit 306 does not perform group determination (holds) and prompts the user to determine whether grouping is necessary. The display control unit 305 may output the display.

  Further, in this embodiment, the order in which the objects are placed is not particularly considered, but when the new object is detected by the object detection unit 301, what number the object is placed in? The order information may be held in the RAM 201. The stored order information may be used by the accumulation control unit 307 to determine the order of saving. Further, if order information is given and stored together with the read image of the object, for example, when printing is performed, it can be used for an extended function such that printing can be performed in the order.

[Application example]
When the functions of the image processing unit 304 are expanded, the following functions can be realized. For example, the image processing unit 304 reads monetary information included in an object image such as a receipt or a form using an optical character recognition (OCR) technique, and displays the total amount of monetary information included in the object image. That is, it is possible to realize a function of extracting information from the object image and displaying the extracted information for each group collectively. The information to be extracted is not limited to monetary information, but may be any information as long as it is meaningful to be collected, such as quantity information of articles.

  An application example will be described with reference to FIG. As shown in FIG. 6A, the total amount of monetary information included in the group 700 object image is displayed as a display 701, and the total amount of monetary information included in the group 702 object image is displayed as a display 703. To do. The display 704 is the total amount of money information included in all the objects placed on the reading table 100a. The amount information is stored in the storage 207 together with the object image as part of the group information (for example, part of the folder name) or as part of the group (for example, text data).

  FIG. 6B shows another application example using the image recognition technology. As shown in FIG. 6 (B), keywords are extracted from the object images included in the group 705, the keyword of the group stored in the storage 207 from the past is matched, and information indicating the related group is obtained. indicate. In the example of FIG. 6B, information 706 and 707 indicating related groups are displayed with the touch operation of the object group 705 being triggered.

  The user touches the information 706 or 707 indicating the related group when grouping the object images of the group 705 to be newly read into related groups read immediately before from the past. This touch information is input to the group determination unit 306, and is output to the display control unit 305 and the accumulation control unit 307 as information indicating a target group for grouping the object images of the group 705.

  According to such an operation, the image data of the object image to be newly read can be grouped with the image data of the object image read immediately before from the past, and can be easily stored in the same place.

  Although details of the UI for executing the above function are not shown, the menu screen is displayed on the reading table 100a by the display control unit 305 and the projector 208, and the user executes the above function by operating the menu screen. Instruct.

[Granting information]
Next, an example of adding additional information as group information will be described. The group determination unit 306 determines whether or not they are the same group based on the overlapping arrangement of the objects. At that time, the group determination unit 306 determines the overlapping state of the objects in each group, and specifies specific information that identifies the object arranged at the top. Is output to the accumulation control unit 307.

The process of adding additional information will be described with reference to FIG. In the example of FIG. 7 (A), the object placed at the top in the group G _X 500 is P0. In addition, the object placed at the top of the group G _Y 501 is P7. That is, the group determination unit 306 outputs identification information that identifies the object P0 for the group G _X 500, and outputs identification information that identifies the object P7 for the group G _Y 501.

Accumulation control unit 307 creates a folder corresponding to the group G _X, and stores the image data of the group G _X of the object image P0, P1, P2, P3, P4 to the Firuda. Furthermore, (confer information showing a representative image in the object image P0) specific information to set the object image P0 to the representative image of the group G _X shown. It also creates a folder corresponding to the group G _Y, stores the image data of the group G _Y of the object image P5, P6, P7, P8 in the folder. Further, to set the object image P7 indicating the specific information to the representative image of the group G _Y.

FIG. 7 (B) is a diagram for explaining group nesting determination and addition of additional information.Group G _G1502 and group G _Z2 503 are arranged, and the distance between both groups is equal to or smaller than a predetermined threshold value. And the case where the y coordinate of the target object P0 is larger than the y coordinate of the target objects P2-P9 is shown. That is, the group G _Z2 503 is determined as a child group of G _Z1 502. In this case, accumulation control section 307 creates a folder corresponding to the group G _Z, and stores the image data of the object image P0~P9 to the folder. Further, the object images P0 and P1 included in the group G _Z1 including the object image P1 indicated by the specific information are set as the representative images of the group G _Z.

  In this way, additional information is given to the group (in this example, a representative image is set) in consideration of the overlap of objects and the arrangement of each group.

  In the above, in order to improve the operability for the user, the object is placed upward on the reading table 100a on which an image can be projected, the object image is scanned (or photographed) from above, and grouping is performed. The example in which the determination result is projected onto the reading table 100a has been described. However, the user's operability is a little worse, such as using other display units because the grouping determination result cannot be displayed on the reading table, but the object is placed downward and the object is scanned (or photographed) from below. Then, the object image may be acquired. Even in that case, it is possible to determine the grouping based on the overlapping state of the objects.

  The image reading process according to the second embodiment of the present invention will be described below. Note that the same reference numerals in the second embodiment denote the same parts as in the first embodiment, and a detailed description thereof will be omitted.

  In the first embodiment, the case where the size of the object is sufficiently smaller than the size of the reading table 100a has been described. However, there are also objects that are larger than the size of the reading table 100a. In the case of a size in which a plurality of objects cannot be juxtaposed on the reading table 100a, the objects placed on the reading table 100a are overlapped with each other and are all processed as the same group. For example, when the reading table 100a is A3 size, a plurality of A4 size objects cannot be grouped and juxtaposed on the reading table 100a.

  In the second embodiment, an example will be described in which it is possible to instruct grouping and storage methods of object images when a plurality of objects cannot be grouped and juxtaposed on the reading table 100a.

  The object image reading process of the second embodiment will be described with reference to the flowchart of FIG. The processes in steps S100 to S106 and S109 to S111 are the same as those in the first embodiment, and detailed description thereof is omitted.

  When the reading of the object image (S104) ends, the image processing unit 304 detects the direction of the object (S121). The orientation of the object can be detected using, for example, position / size information and the object image. That is, the edge of the object is detected by image processing, the short side and the long side of the object are determined, and the direction parallel to the long side is set as the direction of the object. Alternatively, the orientation of the object can be detected more accurately by performing the layout and character recognition of the object and detecting the orientation of the object based on the layout direction and the character sequence.

  Next, the group determination unit 306 determines whether the orientations of the objects juxtaposed on the reading table 100a are the same (S122), and branches the process based on the determination result. However, when the number of objects placed on the reading table 100a is one, the determination result is “No”, and the group determination unit 306 executes the second grouping process (S124). However, since there is only one object placed on the reading table 100a, the process proceeds to the next process (S109) without being grouped.

  The group determination unit 306 performs a first grouping process (S123) when the orientations of the plurality of objects placed on the reading table 100a are the same, and performs a plurality of objects placed on the reading table 100a. If the directions are different, the second grouping process (S124) is executed.

  The grouping process according to the second embodiment will be described with reference to FIG. FIG. 9A shows the first grouping process (S123) in the case where the orientations of the objects are the same, and the reading table 100a is divided into several regions (in the example shown in the figure, divided into two in the x direction). Group objects with center coordinates of objects in the region. Objects whose center coordinates are located in other areas are grouped into other groups. At that time, the display control unit 305 displays group displays 600 and 601 and a boundary line 602 to indicate the group boundaries.

  FIG. 9 (B) shows the second grouping process (S124) when the orientations of the objects are different, grouping the objects with the orientation of the objects in the x-axis direction, and the orientation of the objects in the y-axis direction. Group objects into different groups. At that time, the display control unit 305 displays group displays 603 and 604 to indicate group boundaries.

  As described above, even when the two grouping processes are switched depending on the direction of the object, the size of the object is larger than the reading table 100a, and a plurality of objects cannot be grouped and juxtaposed. It is possible to instruct how to group and store images.

  The image reading process according to the third embodiment of the present invention will be described below. Note that the same reference numerals in the third embodiment denote the same parts as in the first and second embodiments, and a detailed description thereof will be omitted.

  In the third embodiment, the size of the target object is acquired, and switching between the target image reading process of the first embodiment or the target image reading process of the second embodiment is performed based on the acquired target size. An example will be described. For example, when the object is a three-dimensional object, as described above, the size of the object corresponds to the projected area with respect to the reading table 100a.

  The object image reading process of the third embodiment will be described with reference to the flowchart of FIG. The processes in steps S100 to S111 and S121 to S124 are the same as those in the first embodiment, and detailed description thereof is omitted.

When reading of the object image (S104) ends, the image processing unit 304 refers to the position / size information, and the object detection unit 301 determines the size of the object with respect to the size of the reading table 100a (S131). . This determination is performed by, for example, the following equation. When the calculated area ratio is equal to or less than a predetermined ratio, it is determined that the size of the object is smaller than the size of the reading table 100a.
A _D / A _P ≤ Th… (1)
Where A _D is the area of the object (projected area),
A _P is the area of the reading table 100a (area where the image can be read),
Th is a predetermined ratio (threshold value, for example, 0.4).

  For example, when the reading table 100a is A3 size, it is determined that an object of B5 size or less is small, and an object of A4 size or more is determined to be large. If the size of the object is small, the process proceeds to step S107, and the same process as in the first embodiment is executed. If the size of the object is large, the process proceeds to step S121, and the same process as in the second embodiment is executed.

  In this way, the processing can be switched according to the size of the reading table 100a and the size of the object.

[Other Examples]
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

Claims (21)

A reading table on which the object is placed;
Imaging means for continuously imaging the reading table;
An acquisition means for detecting the position and size of an object image representing an object newly placed on the reading table and acquiring the object image from the captured image obtained by the imaging means;
When a new object image is acquired by the acquisition unit, whether or not the new object image is superimposed on any of the other object images acquired before the new object image, Judging means for judging from the position and size of
When the determination unit determines that the new object image is to be superimposed on one of the other object images, the new object image is grouped with the other object image determined to be superimposed. ,
Grouping means for excluding the new object image from the grouping object when the new object image does not overlap with any of the other object images by the determining means;
An image reading apparatus comprising: A projection unit having the reading table as a projection plane;
The projection control means for projecting an image representing a boundary of objects belonging to the same group using the projection means each time the new object image is obtained by the obtaining means. the image reading apparatus according to 1.   Furthermore, when there is a predetermined instruction from the user, it has an accumulation control means for storing each object image acquired by the acquisition means before the instruction in a predetermined storage device for each group. The image reading apparatus according to claim 1.   Means for displaying a message prompting the user to determine whether or not to group the object images of the plurality of objects when the determining means determines that the plurality of objects to be placed on the reading table do not overlap each other; The image reading apparatus according to claim 1, further comprising: A reading table on which the object is placed;
Imaging means for continuously imaging the reading table;
An acquisition means for detecting the position and size of an object image representing an object newly placed on the reading table and acquiring the object image from the captured image obtained by the imaging means;
When a new object image is acquired by the acquisition unit, a determination unit that determines in which of a plurality of preset regions the center coordinates of the new object image are located;
Other than the other objects placed on the reading table, the object representing the center coordinates in the same area as the area determined by the determining means as having the center coordinates of the new object image. Grouping means for grouping the target image and the new target image ;
An image reading apparatus comprising: A reading table on which the object is placed;
Imaging means for continuously imaging the reading table;
An acquisition means for detecting the position and size of an object image representing an object newly placed on the reading table and acquiring the object image from the captured image obtained by the imaging means;
Determining means for determining the orientation of the new object image acquired by the acquiring means;
Among the other objects placed on the reading table, another object image representing an object in the same direction as the direction determined by the determination unit as the direction of the new object image, and the new object Grouping means for grouping various object images ;
An image reading apparatus comprising: A reading table on which the object is placed;
Reading means for reading an image including an object placed on the reading table;
Grouping means for grouping a plurality of images read from the plurality of objects by the reading means based on the arrangement of the plurality of objects placed on the reading table indicated by the image read by the reading means. When,
The images of the objects to be grouped among the plurality of images read from the plurality of objects based on the superimposed state of the plurality of objects placed on the reading table shown in the image read by the reading means. A determination means for determining
The grouping means performs the grouping according to the determination result of the determination means,
When there are a plurality of groups of images of the objects to be grouped, the determination unit is based on the distance between the groups and the position of each group on the reading table indicated by the image read by the reading unit. An image reading apparatus that determines an inclusion relationship between the plurality of groups. A reading table on which the object is placed;
Reading means for reading an image including an object placed on the reading table;
Grouping means for grouping a plurality of images read from the plurality of objects by the reading means based on the arrangement of the plurality of objects placed on the reading table indicated by the image read by the reading means. When,
Determining means for determining grouping of a plurality of images read from the plurality of objects based on a superimposed state of the plurality of objects placed on the reading table shown in the image read by the reading means; Have
When there are a plurality of groups of images of the objects to be grouped, the determination unit is based on the distance between the groups and the position of each group on the reading table indicated by the image read by the reading unit. , Determining the inclusion relationship of the plurality of groups,
The image reading apparatus according to claim 1, wherein the grouping unit performs the grouping according to a determination result of the determination unit. A reading table on which the object is placed;
Reading means for reading an image including an object placed on the reading table;
Grouping means for grouping a plurality of images read from the plurality of objects by the reading means based on the arrangement of the plurality of objects placed on the reading table indicated by the image read by the reading means. When,
Grouping of a plurality of images read from the plurality of objects is determined based on a ratio of the area of the object placed on the reading table and the area of the reading table indicated in the image read by the reading unit. Determination means for
The determination means determines an image of the objects to be grouped based on a superimposed state of a plurality of objects placed on the reading table when the ratio is equal to or less than a predetermined ratio, and the ratio is the predetermined ratio. If it exceeds, determine the images of the objects to be grouped based on the center coordinates or orientation of the plurality of objects placed on the reading table,
The image reading apparatus according to claim 1, wherein the grouping unit performs the grouping according to a determination result of the determination unit.   The image reading apparatus according to claim 7, further comprising display control means for displaying information representing the determination result on the reading table. Furthermore, it has extraction means for extracting predetermined information from the image of the object, and collecting the extracted information for each group of images of the object,
The image reading apparatus according to claim 10, wherein the display control unit displays information collected for each group on the reading table for each group. Furthermore, it has an acquisition means for extracting a keyword from the image of the object and acquiring information representing a group that matches the extracted keyword,
The image reading apparatus according to claim 11, wherein the display control unit displays the acquired information on the reading table. Furthermore, it has an input means for inputting a user instruction for instructing information representing the group displayed on the reading table,
The image reading apparatus according to claim 12, wherein the determination unit sets a group indicated by the user instruction as a group to which an image of an object from which the keyword is extracted is grouped. A method for controlling an image reading apparatus, comprising: a reading table on which an object is placed; and an imaging unit that continuously images the reading table;
An acquisition step in which the acquisition unit detects the position and size of the target image representing the target newly placed on the reading table from the captured image obtained by the imaging unit, and acquires the target image. When,
Whether or not the new object image is superimposed on any of the other object images acquired before the new object image when the determination unit acquires a new object image in the acquisition process Or a determination step for determining from each position and size;
Grouping means
When it is determined in the determination step that the new object image is to be superimposed with any of the other object images, the new object image is grouped with the other object image determined to be superimposed. ,
A grouping step of excluding the new target image from the grouping target when the new target image is not superimposed on any of the other target images by the determination step;
An image reading apparatus control method comprising: A method for controlling an image reading apparatus, comprising: a reading table on which an object is placed; and an imaging unit that continuously images the reading table;
An acquisition step in which the acquisition unit detects the position and size of the target image representing the target newly placed on the reading table from the captured image obtained by the imaging unit, and acquires the target image. When,
When the determination unit acquires a new object image by the acquisition step, the determination unit determines whether the center coordinates of the new object image are within a plurality of preset regions. When,
The grouping means has center coordinates in the same area as the area determined by the determination step that the center coordinates of the new object image are present among the other objects placed on the reading table. A grouping step of grouping another object image representing an object and the new object image ;
An image reading apparatus control method comprising: A method for controlling an image reading apparatus, comprising: a reading table on which an object is placed; and an imaging unit that continuously images the reading table;
An acquisition step in which the acquisition unit detects the position and size of the target image representing the target newly placed on the reading table from the captured image obtained by the imaging unit, and acquires the target image. When,
A determination step of determining a direction of the new object image acquired by the acquisition step;
Another object in which the grouping means represents an object in the same direction as the direction determined as the direction of the new object image by the determination step among the other objects placed on the reading table . A grouping step of grouping the image and the new object image ;
An image reading apparatus control method comprising: A method for controlling an image reading apparatus having a reading table on which an object is placed,
A reading step for reading an image including an object placed on the reading table;
A grouping unit groups a plurality of images read from the plurality of objects by the reading step based on the arrangement of the plurality of objects placed on the reading table indicated in the image read by the reading step. Grouping process to
The determination unit groups the plurality of images read from the plurality of objects based on the superimposed state of the plurality of objects placed on the reading table indicated in the image read in the reading step. A determination step of determining an image of the object,
The grouping step performs the grouping according to the determination result of the determination step,
In the determination step, when there are a plurality of groups of images of the objects to be grouped, based on the distance between the groups and the position of each group on the reading table indicated in the image read in the reading step. A method for controlling an image reading apparatus, wherein an inclusion relationship between the plurality of groups is determined. A method for controlling an image reading apparatus having a reading table on which an object is placed,
A reading step for reading an image including an object placed on the reading table;
A grouping unit groups a plurality of images read from the plurality of objects by the reading step based on the arrangement of the plurality of objects placed on the reading table indicated in the image read by the reading step. Grouping process to
A determination unit determines grouping of a plurality of images read from the plurality of objects based on a superimposed state of the plurality of objects placed on the reading table indicated in the image read in the reading step. A determination step,
In the determination step, when there are a plurality of groups of images of the objects to be grouped, based on the distance between the groups and the position of each group on the reading table indicated in the image read in the reading step. , Determining the inclusion relationship of the plurality of groups,
In the grouping step, the grouping is performed according to the determination result of the determination step. A method for controlling an image reading apparatus having a reading table on which an object is placed,
A reading step for reading an image including an object placed on the reading table;
A grouping unit groups a plurality of images read from the plurality of objects by the reading step based on the arrangement of the plurality of objects placed on the reading table indicated in the image read by the reading step. Grouping process to
Based on the ratio of the area of the object placed on the reading table and the area of the reading table indicated by the image read in the reading process, the determination unit is configured to calculate a plurality of images read from the plurality of objects. A determination step for determining grouping,
In the determination step, when the ratio is equal to or less than a predetermined ratio, images of the objects to be grouped are determined based on a superimposed state of a plurality of objects mounted on the reading table, and the ratio is the predetermined ratio. If it exceeds, determine the images of the objects to be grouped based on the center coordinates or orientation of the plurality of objects placed on the reading table,
In the grouping step, the grouping is performed according to the determination result of the determination step.   The program for making a computer perform each process of the control method of any one of Claim 14 thru | or 19. A computer-readable recording medium on which the program according to claim 20 is recorded.

Images