JP6716014B2 - Image capturing apparatus, control method, and control program - Google Patents

Description

The present disclosure relates to an image capturing device, and more particularly to an image capturing device that captures a document being conveyed.

An image capturing apparatus such as a scanner that conveys a document placed on a document table and captures an image may perform a process of making a user confirm whether or not the captured image is appropriate.

2. Description of the Related Art There is known a processing device that, when an abnormal image different from a normal image is detected, generates metadata for the abnormal image and displays the abnormal image based on the metadata. This processing device changes whether to display the input image as it is or to display it based on the metadata, depending on whether the output image includes metadata. Reference 1).

JP, 2008-283494, A

However, in the invention of Patent Document 1, it is not considered that the user confirms the image during capturing of the image data, and the user only confirms the captured image after capturing all the images. could not.

An object of an image capturing device, a control method, and a control program is to allow a user to easily confirm an image while capturing image data, even with a small amount of hardware resources.

An image pickup device according to one aspect of the present invention has a communication unit capable of communicating with an external storage device, an image pickup unit that picks up a plurality of conveyed documents and outputs image data, and an abnormality exists in the image data. An abnormality determining unit that determines whether or not the abnormality determining unit determines whether or not the image data determined by the abnormality determining unit is transmitted to the external storage device by the communication unit, and the abnormality determining unit determines that there is an abnormality in the image data. Is received from the external storage device by the communication unit, a storage unit that stores abnormal image data, a display unit that displays an image based on the abnormal image data stored in the storage unit, and an abnormality exists in the image A determination result acquisition unit that acquires a user determination result regarding whether or not the determination result acquisition unit acquires the user determination result indicating that there is no abnormality, and stores the abnormal image data from the storage unit. delete.

Further, an image pickup device according to one aspect of the present invention includes a communication unit that can communicate with an external storage device, an image pickup unit that picks up a plurality of conveyed originals and outputs image data, and an abnormal image data. Based on the abnormality determination unit that determines whether or not there is, a storage unit that stores the abnormal image data of the image data that is determined to be abnormal by the abnormality determination unit, and the abnormal image data that is stored in the storage unit A display unit that displays an image, a determination result acquisition unit that acquires a user determination result regarding whether or not there is an abnormality in the image, and if a user determination result that there is no abnormality is acquired, the abnormal image data is communicated. And a control unit that deletes the abnormal image data used for display on the display unit from the storage unit by transmitting the abnormal image data to the external storage device.

Further, a control method according to one aspect of the present invention captures a plurality of conveyed originals, outputs image data, determines whether or not there is an abnormality in the image data, and outputs the determined image data to an external device. The abnormal image data that is transmitted to the storage device and is determined to be abnormal among the image data is received from the external storage device, the abnormal image data is stored, and the image is displayed based on the stored abnormal image data, This includes deleting the stored abnormal image data when acquiring the user determination result regarding whether or not there is an abnormality in the image and acquiring the user determination result indicating that there is no abnormality.

Further, the control method according to one aspect of the present invention is configured to capture images of a plurality of conveyed originals, output image data, determine whether or not there is an abnormality in the image data, and determine whether or not the image data is abnormal. The abnormal image data determined to be present is stored, the image is displayed based on the stored abnormal image data, the user determination result regarding whether or not there is an abnormality in the image is acquired, and When the user determination result is acquired, the abnormal image data is transmitted to the external storage device, and the abnormal image data used for display is deleted.

The control program according to one aspect of the present invention captures a plurality of conveyed originals, outputs image data, determines whether or not there is an abnormality in the image data, and outputs the determined image data to an external device. The abnormal image data that is transmitted to the storage device and is determined to be abnormal among the image data is received from the external storage device, the abnormal image data is stored, and the image is displayed based on the stored abnormal image data, When the user determination result regarding whether or not there is an abnormality in the image is acquired, and when the user determination result indicating that there is no abnormality is acquired, the computer is made to delete the stored abnormal image data.

Further, the control program according to one aspect of the present invention captures a plurality of conveyed originals, outputs image data, determines whether or not there is an abnormality in the image data, and determines whether or not there is an abnormality in the image data. The abnormal image data determined to be present is stored, the image is displayed based on the stored abnormal image data, the user determination result regarding whether or not there is an abnormality in the image is acquired, and When the user determination result is acquired, the computer is made to transmit the abnormal image data to the external storage device and delete the abnormal image data used for display.

According to the present embodiment, the image capturing apparatus, the control method, and the control program enable the user to easily confirm the image while capturing the image data even with a small amount of hardware resources.

The objects and advantages of the invention will be realized and obtained by means of the components and combinations particularly pointed out in the claims. Both the foregoing general description and the following detailed description are exemplary and explanatory and do not limit the invention described in the claims.

1 is a diagram showing an image processing system 1 according to an embodiment. 2 is a block diagram showing a schematic configuration of the image pickup device 100. FIG. It is a figure which shows schematic structure of the memory|storage device 180 and CPU190. It is a figure which shows an example of the page information table 300. It is a schematic diagram of operation in an imaging priority mode. 6 is a flowchart showing an example of an operation of image pickup processing 101. It is a figure which shows the structure of the 1st buffer 401 and the 2nd buffer 402. 6 is a flowchart showing an example of an operation of user determination processing 102. 9 is a flowchart showing an example of the process of step S306 of FIG. 8. It is a schematic diagram of an operation in the user determination priority mode. 6 is a flowchart showing an example of an operation of image pickup processing 101. 6 is a flowchart showing an example of an operation of user determination processing 102. 13 is a flowchart showing an example of the process of step S801 in FIG. 10 is a flowchart showing an example of the operation of step S401 in FIG. 9. It is a figure which shows an example of a display of an image and detailed state data. 7 is a flowchart illustrating an example of threshold value changing processing. It is a block diagram which shows schematic structure of the image pick-up device 600 which concerns on other embodiment.

Hereinafter, an image pickup device according to one aspect of the present disclosure will be described with reference to the drawings. However, it should be noted that the technical scope of the present disclosure is not limited to those embodiments and covers the inventions described in the claims and equivalents thereof.

<First Embodiment>
FIG. 1 is a diagram showing an image processing system 1 according to the present embodiment.

The image processing system 1 includes an image capturing device 100 and an external storage device 200. The image pickup device 100 includes a document table 110, a display device 120, and the like. The external storage device 200 is, for example, a PC (personal computer), a server device, or the like.

The document table 110 included in the image capturing apparatus 100 is a table on which a plurality of documents to be imaged (scanned) can be placed. The display device 120 is an example of a display unit. The display device 120 has a display including liquid crystal, organic EL (Electro-Luminescence), and the like, and an interface circuit that outputs image data to the display, and displays the image data on the display.

FIG. 2 is a block diagram showing a schematic configuration of the image pickup device 100.

The image capturing apparatus 100 further includes an input device 130, an image capturing device 140, an AFE (Analog Front End) 150, an interface device 170, a storage device 180, a CPU 190, and the like, in addition to the above-described configuration.

The input device 130 detects a user's operation on the display device 120, and outputs the detected content as a signal at predetermined intervals. Further, the display device 120 and the input device 130 may be integrally configured like a touch panel.

The image pickup device 140 has a reduction optical system type image pickup sensor including an image pickup element composed of a CCD (Charge Coupled Device) arranged in a substantially straight line in the main scanning direction. The image sensor images a document, generates an analog image signal corresponding to each of RGB colors, and outputs the analog image signal. Instead of the CCD, a CIS (Contact Image Sensor) of the same-magnification optical system that includes an image sensor made of CMOS (Complementary Metal Oxide Semiconductor) can also be used.

The AFE 150 converts each analog value output from the imaging device 140 into a digital value to generate pixel data, and generates and outputs image data configured from each generated pixel data. The imaging device 140 and the AFE 150 are an example of an imaging unit.

The interface device 170 is an example of a communication unit capable of communicating with the external storage device 200. The interface device 170 has, for example, an interface circuit conforming to a serial bus such as USB, and is electrically connected to the external storage device 200 and the like to transmit and receive a captured image and various information. Further, instead of the interface device 170, a communication unit having an antenna for transmitting/receiving a wireless signal and a wireless communication interface circuit for transmitting/receiving a signal through a wireless communication line according to a predetermined communication protocol may be used. The predetermined communication protocol is, for example, a wireless LAN (Local Area Network).

The storage device 180 includes a memory device such as a RAM (Random Access Memory) and a ROM (Read Only Memory), a fixed disk device such as a hard disk, or a portable storage device such as a flexible disk and an optical disk. The storage device 180 also includes a first buffer 401 that stores image data generated by the AFE 150, and a second buffer 402 that stores image data received from the external storage device 200 via the interface device 170. Further, the storage device 180 stores computer programs, databases, tables, etc. used for various processes of the image capturing apparatus 100. The computer program may be installed in the storage device 180 from a computer-readable portable recording medium using a known setup program or the like. The portable recording medium is, for example, a CD-ROM (compact disk read only memory), a DVD-ROM (digital versatile disk read only memory), or the like.

The CPU 190 is an example of a control unit. The CPU 190 operates based on a program stored in the storage device 180 in advance. A DSP (digital signal processor), an LSI (large scale integration), or the like may be used instead of the CPU 190. Further, instead of the CPU 190, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or the like may be used. Further, the CPU 190 may be a general-purpose processor.

The CPU 190 is connected to the display device 120, the input device 130, the imaging device 140, the AFE 150, the interface device 170, the storage device 180, and the like, and controls each of these units.

FIG. 3 is a diagram showing a schematic configuration of the storage device 180 and the CPU 190.

As shown in FIG. 3, the storage device 180 stores programs such as an abnormality determination program 181, a transmission/reception control program 182, a display control program 183, a determination result acquisition program 184, and a threshold value change program 185. Each of these programs is a functional module implemented by software operating on the processor. The CPU 190 reads each program stored in the storage device 180, and operates according to each read program, whereby the abnormality determination unit 191, the transmission/reception control unit 192, the display control unit 193, the determination result acquisition unit 194, and the threshold value change unit 195. And so on.

FIG. 4 is a diagram showing an example of the page information table 300.

The page information table 300 is used for managing the state of the image data generated by the imaging device 140 and the AFE 150. As shown in FIG. 4, items such as page number data, status data, detailed status data, storage location data, and user determination data are registered in the page information table 300 in association with each other. The page information table 300 is stored in the storage device 180.

The page number data indicates the page of the document placed on the document table 110 and imaged by the imaging device 140. Normally, page numbers are sequentially given from 1.

The state data indicates a determination result by the abnormality determination unit 191 regarding whether or not the image data generated by the AFE 150 has an abnormality, and takes a value of “normal” or “abnormal”.

The detailed state data indicates details of the state determined by the abnormality determination unit 191, and when the state data is “abnormal”, it can take values of “blank paper”, “crop failure”, and/or “image missing/cornered”. .. Further, when the status data is “normal”, the detailed status data may have no value or may take a value “close to blank”.

Here, “blank paper” indicates that the ratio of white pixels to all pixels of the image data (blank frequency) is equal to or greater than a predetermined threshold A. “Close to a blank sheet” indicates a case where a relation of threshold value A>blank sheet frequency≧threshold value B is established with a predetermined threshold value B smaller than the threshold value A.

"Crop failure" indicates that the shape of the original portion extracted from the image data is not rectangular. As an example of a method for determining a crop failure, edge detection is first performed on image data, and then the four sides of a rectangle matching the edge detection result are calculated by the least square method or the like. Then, when the rectangle deviation frequency indicating the magnitude of the deviation between the edge detection result and the calculated four sides of the rectangle is equal to or greater than the predetermined threshold value C, it is determined as “crop failure”. "Image loss/corner breakage" indicates a case where a relationship of threshold C>rectangle deviation frequency≧threshold D is established with a predetermined threshold D smaller than the threshold C.

The storage location data indicates a location where abnormal image data, which is image data determined by the abnormality determination unit 191 as status data to be "abnormal", is stored, and indicates "image" of the image capturing apparatus 100, or It takes a value of “external” indicating the external storage device 200.

The user determination data indicates whether or not the user has performed determination on the image data, and has a value of “done” indicating that the image data has been determined or a value of “−” indicating that the image data has not been determined.

The operation of the image capturing device 100 will be described below. The operation of the image capturing apparatus 100 includes an image capturing priority mode and a user determination priority mode. The imaging priority mode will be described with reference to FIGS. 5 to 9, and the user determination priority mode will be described with reference to FIGS. 10 to 12. The image capturing apparatus 100 has both an image capturing priority mode and a user determination priority mode, and may be appropriately switched and operated according to a user's designation or the like. The image capturing apparatus 100 may have only the image capturing priority mode or only the user determination priority mode.

<Imaging priority mode>
FIG. 5 is a diagram showing an outline of the operation of the image pickup apparatus 100 in the image pickup priority mode. The image capturing priority mode is a mode in which when the abnormality determining unit 191 determines that the image data is abnormal, the image capturing of the document is prioritized and processed rather than the confirmation of the image data generated by capturing the image of the document.

As shown in FIG. 5, in the image pickup priority mode, in the image pickup apparatus 100, the CPU 190 processes the image pickup processing 101 and the user determination processing 102 so as to proceed in parallel.

In the imaging process 101, the document is imaged by the imaging device 140, converted into digital data by the AFE 150, and temporarily stored in the first buffer 401. The image data temporarily stored in the first buffer 401 is sequentially transmitted to the external storage device 200 via the interface device 170 after the abnormality determination unit 191 determines the abnormality. In the imaging priority mode, for example, even when the abnormality determination unit 191 determines that there is an abnormality, the image data is once transmitted to the external storage device 200. Further, in principle, the image data once transmitted to the external storage device 200 is erased from the first buffer 401, and an area for storing the subsequent image data is secured. In principle, the above process is repeated until there are no more originals.

In the user determination process 102, image data determined to be abnormal based on the state data stored in the page information table 300 is received from the external storage device 200 via the interface device 170 in principle, and the second data is received. The buffer 402 is sequentially temporarily stored. The image data temporarily stored in the second buffer 402 is displayed on the display device 120, and preparations are made for the user determination. When the user determination is received, the image data displayed on the display device 120 is erased from the second buffer 402, and an area for storing the subsequent image data is secured. In principle, the above process is repeated until there is no image data determined to be abnormal.

FIG. 6 is a flowchart showing an example of the operation of the imaging process 101.

Hereinafter, an example of the operation of the image capturing process 101 of the image capturing apparatus 100 will be described with reference to the flowchart shown in FIG. The operation flow described below is executed mainly by the CPU 190 in cooperation with each element of the image capturing apparatus 100 based on a program stored in the storage device 180 in advance.

First, the transmission/reception control unit 192 sets the initial value of the page number n of the document imaged by the imaging device 140 to 1 (step S201).

Next, the image capturing device 140 and the AFE 150 capture an image of one of a plurality of documents conveyed from the document table (step S202), and output the generated image data.

Next, the transmission/reception control unit 192 stores the output image data in the first buffer 401 (step S203).

Next, the abnormality determination unit 191 determines whether or not the image data stored in the first buffer 401 has an abnormality of “blank paper”, “crop failure”, and/or “image loss/corner break” ( Step S204). Further, the abnormality determination unit 191 may determine a “close to blank” state.

When the image data is normal, that is, when there is no abnormality (Y in step S205), the transmission/reception control unit 192 transmits the image data determined by the abnormality determination unit 191 to the external storage device 200 by the interface device 170 (step S206). ). The image data that the abnormality determination unit 191 has determined to be normal may be referred to as normal image data. Further, the transmission/reception control unit 192 creates an entry of page number=n and status=“normal” in the page information table 300. When the abnormality determination unit 191 determines that it is “close to a blank sheet”, the transmission/reception control unit 192 also includes a value of state detail=“close to a blank sheet” in this entry. The transmission/reception control unit 192 also deletes the image data transmitted to the external storage device 200 from the first buffer 401 of the storage device 180 (step S207).

When the image data is abnormal (N in step S205), the transmission/reception control unit 192 transmits the image data determined by the abnormality determination unit 191 to the external storage device 200 by the interface device 170 (step S210). The transmission/reception control unit 192 also determines whether or not there is a free space for the next image data in the first buffer 401 of the storage device 180 (step S211).

When there is no free space for the next image data (N in step S211), the transmission/reception control unit 192 determines in the page information table 300 that the page number=n, the state=“abnormal”, and the state details=the state determined by the abnormality determination unit 191. , Details, storage location=“external” entry is generated (step S212). At this time, the transmission/reception control unit 192 may store the coordinate value of the part where the image is missing or the corner is broken in this entry if the state details=“image missing/corner broken”. The transmission/reception control unit 192 also deletes the transmitted image data from the first buffer 401 of the storage device 180 (step S207). This allows the user to easily confirm the image while the image data is being captured, even with a small amount of hardware resources.

If there is a space (Y in step S211), the transmission/reception control unit 192 sets the page information table 300 to the page number=n, the state=“abnormal”, the state details=details of the state determined by the abnormality determination unit 191, and the storage location= An entry for "apparatus" is generated (step S213). However, the transmission/reception control unit 192 does not execute step S207. That is, the transmission/reception control unit 192 does not delete the transmitted image data from the first buffer 401 of the storage device 180.

FIG. 7A shows an example of the first buffer 401 when the image data transmitted in step S207 is deleted. FIG. 7A shows a state in which the normal image data of the first page is deleted from the first buffer 401 and the abnormal image data of the second and third pages are stored in the first buffer 401. The first buffer 401 of this embodiment has a storage area for four pages.

After step S207 or S213, the transmission/reception control unit 192 determines whether or not there is a document on the document table 110.

If there is a document (Y in step S208), the transmission/reception control unit 192 adds 1 to the page number n of the document imaged by the imaging device 140, and the process returns to step S202. If there is no document (N in step S208), the imaging process 101 ends the operation.

FIG. 8 is a flowchart showing an example of the operation of the user determination processing 102.

Hereinafter, an example of the operation of the user determination processing 102 of the image capturing apparatus 100 will be described with reference to the flowchart shown in FIG. The operation flow described below is executed mainly by the CPU 190 in cooperation with each element of the image capturing apparatus 100 based on a program stored in the storage device 180 in advance.

First, the transmission/reception control unit 192 sets the initial value of the page number m of the document handled by the user determination processing 102 to 1 (step S301).

Next, the transmission/reception control unit 192 reads out the status data of the entry of page number=m from the page information table 300 (step S302). If the entry with page number=m does not exist, the transmission/reception control unit 192 suspends the process until the entry is generated. If the state is "normal" (N in step S303), the process proceeds to step S308.

If the state is "abnormal" (Y in step S303), the transmission/reception control unit 192 determines the storage location data of the same entry (step S304). If the storage location is “external”, the transmission/reception control unit 192 requests the external storage device 200 for the abnormal image data of page number=n. When the interface device 170 receives the requested image data, the transmission/reception control unit 192 stores the requested image data in the second buffer 402 of the storage device 180 (step S305). If the storage location is “apparatus”, the abnormal image data is stored in the first buffer 401 of the storage device 180, so the transmission/reception control unit 192 does not execute the process of step S305.

FIG. 7B shows an example of the second buffer 402 when abnormal image data is stored in step S305. FIG. 7B shows a state in which the abnormal image data on the fifth page is stored in the second buffer 402. Although the second buffer 402 of this embodiment has a storage area for two pages, the storage area may be one page or more than two pages.

Next, the display control unit 193 and the determination result acquisition unit 194 display an image based on the abnormal image data stored in the first buffer 401 or the second buffer 402, and whether or not there is an abnormality in the displayed image. Acquires the user determination result regarding. Next, the transmission/reception control unit 192 executes processing according to the user determination result (above, step S306). The process of step S306 will be described later with reference to FIG.

Next, the transmission/reception control unit 192 deletes the abnormal image data from the storage device 180 according to the value of the storage location data determined in step S304 (step S307). That is, the abnormal image data is deleted from the first buffer 401 if the storage location is “apparatus” and from the second buffer 402 if the storage location is “external”. By this processing, the abnormal image data is deleted from the first buffer 401 or the second buffer 402 regardless of whether the user determination result is “normal” or “abnormal”. This allows the user to easily confirm the image while the image data is being captured, even with a small amount of hardware resources.

After N or S307 in step S303, the transmission/reception control unit 192 determines the maximum value of the page number n of the document imaged by the imaging process 101, that is, the page number of the document imaged at that time (the imaging process 101 is completed. If it is, the image pickup document number is referred to and it is determined whether or not the value is larger than m (step S308). The maximum value of the page number n can be obtained by referring to the page information table 300, for example.

If the maximum value of the page number n is larger than m, image data that can be processed by the user determination process 102 exists, so 1 is added to m (step S309), the process returns to step S302, and the same process is performed for new image data. To execute.

When the maximum value of the page number n is m or less (N in step S308), since there is no image data that can be processed by the user determination process 102, the transmission/reception control unit 192 ends the image capturing process of all the documents by the image capturing process 101. It is determined whether or not (step S310). When the imaging process is not completed (N in step S310), the process returns to step S308 to wait for the generation of image data by the imaging process 101. If the image capturing process has ended (Y in step S310), the process of the user determination process 102 ends.

FIG. 9 is a flowchart showing an example of the process of step S306 of FIG.

First, the display control unit 193 displays an image on the display device 120 based on the abnormal image data stored in the storage device 180 (step S401). The abnormal image data is read from the first buffer 401 of the storage device 180 if the storage location read in step S304 is “device”, and from the second buffer 402 of the storage device 180 if “external”.

Next, the determination result acquisition unit 194 acquires the user determination result regarding whether or not there is an abnormality in the displayed image from the input device 130 (step S402), and determines whether the page number=m entry in the page information table 300. The user determination column is set to "completed" (step S403).

Next, if the user determination result is "abnormal" (Y in step S404), the transmission/reception control unit 192 executes processing for dealing with the abnormality (step S405), and ends the user determination processing. As a process for dealing with the abnormality, it is possible to issue a command to the external storage device 200 to delete the image data determined to be abnormal. Further, after the series of image capturing processes 101 is completed, the user is prompted to re-image the document corresponding to the image data determined to be abnormal, and the newly imaged normal image data replaces the image data determined to be abnormal. It is possible. Further, in order to cancel the series of imaging processing 101, the imaging by the imaging processing 101 is stopped, the image data stored in the storage device 180 is deleted, and the image data transmitted to the external storage device 200 is deleted. It is also possible to issue a command to 200. The processing for handling the abnormality is not limited to these, and may be other processing. Note that the image capturing process 101 may stop the image capturing depending on the user's instruction, regardless of the user determination result.

If the user determination result is “normal” (N in step S404), the transmission/reception control unit 192 ends the user determination process without executing the process of step S405.

<User judgment priority mode>
FIG. 10 is a schematic diagram of the operation in the user determination priority mode. The user determination priority mode refers to a mode of processing in which, when the abnormality determination unit 191 determines that the image data is abnormal, the confirmation of the image data generated by imaging the document is prioritized over the image capturing of the document. When operating in the user determination priority mode, the second buffer 402 is unnecessary.

As shown in FIG. 10, in the user determination priority mode, in the image capturing apparatus 100, the CPU 190 performs the image capturing process 701 and the user determining process 702 in parallel.

In the imaging process 701, the document is imaged by the imaging device 140, converted into digital data by the AFE 150, and temporarily stored in the first buffer 401. Regarding the image data temporarily stored in the first buffer 401, after the abnormality determination unit 191 has performed an abnormality determination, the image data determined to be normal are sequentially transmitted to the external storage device 200 via the interface device 170. The image data temporarily stored in the first buffer 401 is deleted. When it is determined that the image data is abnormal, the process is temporarily suspended until the determination by the user determination process 702 is executed, the determination execution is detected, and then the process of the next document is performed. In principle, the above process is repeated until there are no more originals.

In the user determination process 702, the image data determined to be abnormal is displayed on the display device 120, and preparations are made to receive the user determination. When the user determination is performed and the image data is determined to be normal, the image data is transmitted to the external storage device 200 via the interface device 170, and the image data temporarily stored in the first buffer 401 is deleted. In principle, the above process is repeated until there are no more originals.

FIG. 11 is a flowchart showing an example of the operation of the imaging process 701.

Hereinafter, an example of the operation of the image capturing process 701 of the image capturing apparatus 100 will be described with reference to the flowchart shown in FIG. The same processes as those in FIG. 6 are designated by the same reference numerals and the description thereof will be omitted.

First, the transmission/reception control unit 192, the imaging device 140, and the abnormality determination unit 191 execute the processes of steps S201 to S204.

When the image data is normal, that is, when there is no abnormality (Y in step S205), the transmission/reception control unit 192 executes the process of step S206.

If the image data is abnormal (N in step S205), the transmission/reception control unit 192 confirms in the page information table 300 whether or not the image data determined by the abnormality determination unit 191 has been determined by the user in the user determination process. (Step S701). If the determination has not been made, the transmission/reception control unit 192 suspends the processing of the image pickup processing until the determination of the image data by the user is completed (N in step S701).

After step S206 or S701, the transmission/reception control unit 192 executes the processing of steps S208 and S209, and when step S208 is N, the imaging processing 701 ends the operation.

FIG. 12 is a flowchart showing an example of the operation of the user determination processing 702. The same processes as those in FIG. 8 are designated by the same reference numerals and the description thereof will be omitted.

First, the transmission/reception control unit 192, the display control unit 193, and the determination result acquisition unit 194 execute the processes of steps S301 to S303. If step S303 is Y, that is, if the state is "abnormal", the transmission/reception control unit 192, the display control unit 193, and the determination result acquisition unit 194 execute the determination by the user (step S801). The process of step S801 will be described later with reference to FIG.

Next, the transmission/reception control unit 192 deletes the abnormal image data transmitted from the first buffer 401 of the storage device 180 to the external storage device 200 (step S802).

After N or S801 in step S303, the transmission/reception control unit 192 performs the process of step S310. When the imaging process is not completed (N in step S310), 1 is added to m (step S309), and the process returns to step S302. If the image capturing process has ended (Y in step S310), the process of the user determination process 702 ends.

FIG. 13 is a flowchart showing an example of the process of step S801 in FIG. The same processes as those in FIG. 9 are designated by the same reference numerals and the description thereof will be omitted.

First, the processes of steps S401 to S403 of FIG. 9 are executed.

If the user determination result is "abnormal" (Y in step S901), a process for dealing with the abnormality is executed (step S902), and the user determination process ends. The process for dealing with the abnormality is similar to the process of step S405 of FIG.

If the user determination result is “normal” (N in step S901), the transmission/reception control unit 192 transmits the image data determined by the user to be “normal” from the first buffer 401 to the external storage device 200 by the interface device 170. (Step S903). This ends the user determination process.

As described above in detail, by operating in accordance with the flowcharts shown in FIGS. 6, 8, 9, and 11 to 13, the image capturing apparatus 100 allows the user to use less hardware resources while capturing image data. It also allows you to easily check images. As described above, the image capturing apparatus 100 has both the image capturing priority mode and the user determination priority mode, but since only one mode can be executed at a time, which mode is selected by the user in the initial setting or the like. It is configured so that you can choose whether to use. Further, the image capturing apparatus 100 may have only the image capturing priority mode or only the user determination priority mode, but in the case of having only the user determination priority mode, it is not necessary to provide the second buffer.

<First Modification>
Hereinafter, the first modification of the first embodiment will be described with reference to FIGS. 14 and 15. FIG. 14 is a flow chart showing a display method for the user at the time of user determination, and FIG. 15 is a view showing a display example.

In the first modification, the method of displaying to the user (step S401 in FIG. 9) at the time of user determination is changed according to the detailed state data of the image data. The configuration and other processing flow of the image capturing apparatus in the first modified example are the same as those in the first embodiment.

First, the transmission/reception control unit 192 reads out the detailed state data of the entry of page number=m from the page information table 300 (step S501).

The display control unit 193 determines the display portion of the image corresponding to the image data of page number=m according to the value of the detailed state data, that is, according to the type of abnormality determined by the abnormality determination unit 191 (step S502). ). For example, when the state details are "blank" or "crop failure", the display control unit 193 determines to display the entire image (step S503). When the state details are “image missing/folded corner”, the display control unit 193 determines to display a part of the image, for example, a portion where an abnormality mainly occurs (step S504).

Next, the display control unit 193 displays an image and detailed state data corresponding to the image data of page number=m on the display device 120 based on the determined content (step S505). FIG. 15 shows an example of display of images and detailed state data. Fig. 15 is an example when the value of the detailed condition data is "Image missing/cornered" and m=3. "We recognized that the image on the 3rd page had image missing/cornered. "??" and the enlarged image 502 of the bent portion are displayed on the display device 120. This completes the series of processes.

As described in detail above, when the operation is performed according to the contents shown in the first modified example, the display portion of the image is determined according to the type of abnormality of the abnormal image data, so that the determination by the user can be facilitated. is there.

Note that the processing of the first modified example is executed only for abnormal image data, but the processing may be executed by regarding image data of state=“normal” and state detail=“close to blank” as abnormal image data. ..

<Second Modification>
The second modification of the first embodiment will be described below with reference to FIG. FIG. 16 is a flowchart showing the threshold value changing process based on the result of the user determination. The process of FIG. 16 is a process executed when the user determination result is not “abnormal” in step S404 of FIG. 9 or step S901 of FIG. That is, this is a process that is executed when the user determines that the abnormal image data that the abnormality determination unit 191 has determined to be “abnormal” is “normal”.

In the second modified example, based on the result of the user determination process, feedback is performed so that the abnormality determination unit changes the threshold for determining whether or not the image data is abnormal, and the image data to be selected by the user is selected. I am trying to be more accurate. The configuration of the image capturing apparatus and the other processing flow in the second modified example are the same as those in the first embodiment.

First, the threshold changing unit 195 displays on the display device 120 a message inquiring whether or not to reflect the criteria determined by the user to the criteria (threshold for determination) determined by the abnormality determination unit 191 (step S601). An example of the message in the case of detailed state=“image missing/folded corner” is “Do you want to keep this frequency without image missing/folded corner?”. Next, the threshold changing unit 195 acquires the answer from the user from the input device 130.

If the answer is to change the criterion (Y in step S602), the threshold changing unit 195 changes the threshold used by the abnormality determining unit to determine whether or not the image data has abnormality (step S603). .. In the example when the above message is displayed, the threshold D in the determination using the rectangular deviation frequency is increased.

When the answer is that the standard is not changed (N in step S602), the threshold value changing unit 195 does not execute the process of step S603. This completes the threshold value changing process.

As described above in detail, when the abnormality determination unit 191 and the user determination result are different when operating in accordance with the contents shown in the second modified example, the determination criterion by the abnormality determination unit 191 should be close to the determination criterion of the user. Is possible.

Note that the processing of the second modified example is executed only for abnormal image data, but the processing may be executed by regarding image data of state=“normal” and state detail=“close to blank” as abnormal image data. ..

<Second Embodiment>
FIG. 17 is a block diagram showing a schematic configuration of an image pickup device 600 according to another embodiment.

The processing circuit 690 is used in place of the CPU 190 of the image capturing apparatus 100, and executes abnormality determination processing, transmission/reception control processing, display control processing, determination result acquisition processing, and threshold value change processing instead of the CPU 190. The processing circuit 690 includes an abnormality determination circuit 691, a transmission/reception control circuit 692, a display control circuit 693, a determination result acquisition circuit 694, a threshold value change circuit 695, and the like. An LSI, DSP, ASIC, FPGA, or the like may be used as the processing circuit 690.

The abnormality determination circuit 691 is an example of an abnormality determination unit, and has the same function as the abnormality determination unit 191. The abnormality determination circuit 691 determines whether or not the image data generated by the AFE 150 has an abnormality.

The transmission/reception control circuit 692 is an example of a transmission/reception control unit, and has the same function as the transmission/reception control unit 192. The transmission/reception control circuit 692 controls the interface device 170 and the like to execute transmission/reception of image data and the like with the external storage device 200.

The display control circuit 693 is an example of a display control unit and has a function similar to that of the display control unit 193. The display control circuit 693 controls the display device 120 and the like so as to display image data and the like.

The determination result acquisition circuit 694 is an example of the determination result acquisition unit, and has the same function as the determination result acquisition unit 194. The determination result acquisition circuit 694 acquires from the input device 130 a user determination result regarding whether or not there is an abnormality in the displayed image.

The threshold changing circuit 695 is an example of the threshold changing unit and has the same function as the threshold changing unit 195. The threshold value changing circuit 695 reflects the judgment criterion by the user on the judgment criterion (determination threshold value) by the abnormality judging circuit 691.

1 Image Processing System 100, 600 Image Imaging Device 101, 701 Imaging Process 102, 702 User Determination Process 120 Display Device 130 Input Device 140 Imaging Device 170 Interface Device 180 Storage Device 191 Abnormality Determination Section 192 Transmission/Reception Control Section 193 Display Control Section 194 Determination Result acquisition unit 195 Threshold change unit 200 External storage device 401 First buffer 402 Second buffer

Claims (9)

A communication unit capable of communicating with an external storage device;
An imaging unit that images a plurality of conveyed originals and outputs image data,
An abnormality determination unit that determines whether or not there is an abnormality in the image data,
The image data determined by the abnormality determination unit is transmitted to the external storage device by the communication unit, and the abnormal image data of the image data determined to be abnormal by the abnormality determination unit is transmitted to the external unit by the communication unit. A control unit for receiving from the storage device,
A storage unit for storing the abnormal image data,
A display unit that displays an image based on the abnormal image data stored in the storage unit;
A determination result acquisition unit that acquires a user determination result regarding whether or not there is an abnormality in the image,
The control unit deletes the abnormal image data from the storage unit when the determination result acquisition unit acquires the user determination result indicating that there is no abnormality.
An image pickup device characterized by the above. The control unit, if the free space of the storage unit is equal to or more than a predetermined amount, leaves the abnormal image data determined to be abnormal by the abnormality determination unit in the storage unit,
The display unit displays an image based on the abnormal image data stored in the storage unit,
The image capturing apparatus according to claim 1, wherein the control unit does not receive the abnormal image data from the external storage device. A communication unit capable of communicating with an external storage device;
An imaging unit that images a plurality of conveyed originals and outputs image data,
An abnormality determination unit that determines whether or not there is an abnormality in the image data,
Of the image data, a storage unit that stores abnormal image data determined to be abnormal by the abnormality determination unit,
A display unit that displays an image based on the abnormal image data stored in the storage unit;
A determination result acquisition unit that acquires a user determination result regarding whether or not there is an abnormality in the image,
When the user determination result indicating that there is no abnormality is acquired, the abnormal image data is transmitted to the external storage device by the communication unit, and the abnormal image data used for the display of the display unit is output from the storage unit. Control part to be deleted,
An image pickup device comprising: The image capturing apparatus according to claim 3, wherein the image capturing unit temporarily stops capturing an image of a new document until the determination result acquiring unit acquires the user determination result. When the user determination result indicating that there is no abnormality is acquired, the abnormality determination unit further includes a threshold value changing unit that changes a threshold value used for determining whether or not there is an abnormality in the image data. The image pickup device according to any one of 4 above. The image capturing apparatus according to claim 1, wherein the display unit determines the display portion of the image according to the type of abnormality determined by the abnormality determination unit. The image pickup device according to claim 1, wherein the display unit displays the type of abnormality determined by the abnormality determination unit. A method for controlling an image pickup device capable of communicating with an external storage device, comprising:
Images of multiple conveyed documents are captured and image data is output.
Determine whether there is an abnormality in the image data,
The determined image data is transmitted to the external storage device, and out of the image data, abnormal image data determined to be abnormal is received from the external storage device,
Storing the abnormal image data,
Displaying an image based on the stored abnormal image data,
Obtaining a user determination result regarding whether or not there is an abnormality in the image,
When the user determination result indicating that there is no abnormality is acquired, the stored abnormal image data is deleted,
A control method characterized by the above. A computer control program capable of communicating with an external storage device,
Images of multiple conveyed documents are captured and image data is output.
Determine whether there is an abnormality in the image data,
The determined image data is transmitted to the external storage device, and out of the image data, abnormal image data determined to be abnormal is received from the external storage device,
Storing the abnormal image data,
Displaying an image based on the stored abnormal image data,
Obtaining a user determination result regarding whether or not there is an abnormality in the image,
When the user determination result indicating that there is no abnormality is acquired, the stored abnormal image data is deleted,
A control program that causes a computer to execute the above.

Images