JP5550309B2 - Image processing apparatus and display control method - Google Patents

Description

  The present invention relates to an image processing apparatus having a document table for placing a document, and reading the image of the document to generate image data.

  There is an image processing apparatus that photographs the lower surface of a document table and displays the photographed image data (for example, Patent Document 1). As a result, the user can confirm whether the document is correctly placed on the document table.

JP-A-10-126577

  By photographing a document and displaying the photographed image, it is easy to check whether the document is correctly placed on the document table, but there is a problem that the contents of the document can be seen by others. For example, if the background image processing device is located in a store such as a convenience store, and the user tries to copy a license or resident's card using the image processing device, the personal information described there May be projected and seen by other users.

  The present invention makes it possible to confirm that a document is correctly placed on the document table, and prevents the contents of the document from being displayed and viewed by others.

An image processing apparatus according to the present invention has an original table on which an original is placed, reads an image of the original and generates image data, and shoots an image of the original on the original table Image capturing means for generating image data, determination means for determining the type of the document from the captured image data, recognition means for recognizing the position of the document on the document table from the captured image data , and recognition by the recognition means Generating means for generating image data for displaying an image showing the original corresponding to the type determined by the determining means at a position corresponding to the determined position; and the image data generated by the generating means Display means for displaying.

A display control method according to the present invention is a display control method that can be executed by an image processing apparatus that has a document table for placing a document and reads an image of the document to generate image data. A photographing step in which photographing means of the processing device photographs a document on the document table to generate photographed image data; a determination step in which the image processing device determines the type of the document from the photographed image data; A recognition step in which the image processing device recognizes the position of the document on the document table from the captured image data, and a determination step in which the image processing device corresponds to the position recognized in the recognition step. A generation step of generating an image data for displaying an image showing the original corresponding to the type of the image; and the image processing device is generated in the generation step. And having a display step of displaying on the display means image data.

  According to the present invention, it is possible to confirm that the document is correctly placed on the document table, while preventing the contents of the document from being displayed and viewed by others.

It is a figure which shows the structure of an image processing apparatus. FIG. 2 is a diagram illustrating the appearance of a scanner unit 202, an operation unit 203, a display unit 204, and a photographing unit 205. 3 is a diagram illustrating an internal configuration of a preview generation unit 220. FIG. It is a figure which shows an example of the preview display based on preview image data. 6 is a flowchart illustrating processing for performing a preview display, which is performed under the control of a CPU 207. It is a figure which shows the internal structure of the preview production | generation part 220 in 2nd Embodiment. 10 is a flowchart illustrating processing for performing preview display in the second embodiment, which is performed under the control of a CPU 207.

  FIG. 1 is a diagram showing the configuration of an image processing apparatus to which the present invention can be applied. The image processing apparatus 100 reads various types of originals such as paper, cards, and books placed on a not-illustrated original table, generates raster image data indicating an image on the original, and uses the raster image data as recording paper. To print. Further, the image processing apparatus 100 receives PDL (Page Description Language) data via a network, performs PDL processing, and prints raster image data obtained by the PDL processing on recording paper. Furthermore, the image processing apparatus 100 may have a function of transmitting image data generated from a document or PDL data to another apparatus via a network. In this embodiment, the manuscript indicates a rectangular object to be read and includes a driver's license and a resident's card.

  The image processing apparatus is a multi-function machine that can execute a plurality of different functions such as a copy function, a print function, a scan function, and a FAX function in parallel. The internal bus 200 electrically connects various processing units necessary for executing these functions.

  The communication unit 201 is a processing unit that connects to a communication medium such as the network 20 and executes data transmission / reception with an external device. The network 20 is the Internet or a LAN. In addition, the communication unit 201 may be connected to a public telephone line to perform FAX communication, or may be connected to a USB memory device to perform data communication.

  A scanner unit 202 is a processing unit that optically reads a document placed on a document table and converts an image on the document into an electrical image signal (image data). Section, a reading lighting control section, and the like. When the contact image sensor reads a document, the reading drive unit conveys the contact image sensor, and the reading lighting control unit controls lighting of the LEDs inside the contact image sensor. At that time, a photo sensor in the contact image sensor optically reads an image on the document and converts the image into an electrical image signal (image data).

  The operation unit 203 is a processing unit that receives an instruction from a user, and includes a hard key, a touch panel, and the like. When the user inputs a reading instruction on the operation unit 203, the image processing apparatus 100 operates the scanner unit 202 so as to read the image of the document. A security preview mode described below can be set via the operation unit 203.

  The display unit 204 is a processing unit that displays the state of the image processing apparatus 100, preview image data generated by a preview generation unit 220 described later, and the like, and includes a liquid crystal panel or a liquid crystal touch panel. This liquid crystal touch panel may also function as the operation unit 203. The user can instruct execution of a copy function, a scan function, a FAX function, etc. by operating the operation panel while viewing the preview image displayed on the display unit 204 or after viewing the preview image.

  The image capturing unit 205 is a processing unit that captures a side read by the scanner unit 202 among the documents placed on the document table, and illuminates the document, a lens for collecting reflected light from the document and focusing it, It consists of a two-dimensional CCD sensor. A lens, a two-dimensional CCD sensor, and the like are installed so as to focus on a plane area including the lower surface of the document table. Photographing is performed at a predetermined interval of about 15 times per second, and the photographed image data is output frame by frame in synchronization therewith. The number of frame image data per second may be increased or decreased according to the required display quality level.

  FIG. 2 is a diagram illustrating the appearance of the scanner unit 202, the operation unit 203, the display unit 204, and the imaging unit 205. FIG. 2A shows that the pressure plate 211 is open in the scanner unit 202 and the document can be placed on the document table 212. FIG. 2B shows how the photographing unit 205 is installed on the document table 212 with the pressure plate 211 not shown. As described above, the photographing unit 205 photographs the entire lower surface of the document table 212.

  In FIG. 1, a printer unit 206 is a processing unit that prints image data temporarily stored in the image processing apparatus 100 as a visible image on recording paper, and includes a laser beam printer or an inkjet printer. The The printer unit 206 prints raster image data temporarily stored in the image processing apparatus 100 on a recording sheet prepared in advance with a predetermined output resolution.

  A CPU (central processing unit) 207 is a processing unit that controls data transfer between the processing units of the image processing apparatus 100 and performs image processing on image data. The CPU 207 executes data transfer control and image processing by sequentially executing programs stored in the ROM 208 or the RAM 209.

  A ROM 208 is a non-volatile memory, and is a storage unit that holds a program describing image data handling and image processing control executed by the image processing apparatus 100.

  A RAM 209 is a volatile memory, and is a storage unit that temporarily stores a program describing the control of the image processing apparatus 100 and image data.

  The image processing unit 210 is a processing unit that performs scan system image processing, print system image processing, communication system image processing, and the like on image data in the image processing apparatus 100. The image processing unit 210 scans the image data received from the scanner unit 202 at the time of scanning, such as shading correction, gamma processing, binarization processing, halftone processing, and RGB to CMYK color space conversion. Image processing that matches the characteristics of The image processing unit 210 performs image processing suitable for the characteristics of the printer unit 206 such as resolution conversion, smoothing, and density correction on the image data stored in the RAM 209 or the like during printing. Furthermore, the image processing unit 210 performs image processing suitable for communication characteristics, such as resolution conversion and color space conversion, on the image data transmitted and received by the communication unit 201 during image data communication.

  The preview generation unit 220 is a processing unit that generates preview image data based on the captured image data generated by the imaging unit 205.

  FIG. 3 is a diagram illustrating an internal configuration of the preview generation unit 220. The preview generation unit 220 generates preview image data 302 from the captured image data 301.

  The vertex detection unit 221 is a processing unit that detects the vertex position of the document on the document table and recognizes the position of the document.

  Here, the vertex detection process will be described. The following two features are used as a method for obtaining the coordinates of the four vertices of the document. First, when the pressure plate is opened, there is a density difference between the document area and the other areas. When the illumination unit irradiates the document so that the photographing unit 205 captures the document, the reflected light is present in the document area, but the light almost passes through the glass plate of the document table in the area other than the document area. The other areas are darker than the original area. Second, since the focus of the camera of the photographing unit 205 is set so as to match the surface of the document table, the focus is not achieved in a region other than the region of the document, and the contrast becomes low.

  From these two characteristics, the outline of the document can be obtained by performing edge enhancement processing of the spatial filter on the captured image data. In order to detect the vertex from the outline of the document, a feature point extraction technique known in the image processing technology field may be used. However, the operator's hand attached to the document may overlap the contour of the document as a result of the edge enhancement processing. In this case, if three vertices are obtained from the four vertices of the document, the remaining one point can be obtained by a simple calculation based on the geometrical properties of the rectangle. Thus, the vertex detection unit 221 generates information indicating the vertex position of the document (hereinafter, vertex position information).

  In FIG. 3, a vertical direction detection unit 223 is a processing unit that detects which side is up in the outline of a document and recognizes the vertical direction of the document.

  Here, the up / down detection process will be described. If the vertex coordinates of the original are detected, the area of the original is also found, and the following processing may be performed on the area. In order to determine the top and bottom of a document containing text, the document portion of the photographed image data is rotated by 90 degrees to create four types of image data, and character recognition processing is performed on each image data. By determining that the image data having the highest recognition rate among the four types of image data is the image data in which the orientation of the document is correct, the upper and lower sides can be detected. In order to determine the top and bottom of a document containing a human face, the document portion of the captured image data is rotated by 90 degrees to create four types of image data, and face recognition processing is performed on each image data. Apply. By determining that the image data with the highest degree of recognition is image data in which the orientation of the document is correct, the top and bottom can be detected. For the face recognition process, a method known in the technical field such as a digital camera may be used. Thus, the vertical direction detection unit 223 generates information indicating the vertical direction of the document (hereinafter, vertical direction information).

  In FIG. 3, a frame generation unit 222 is a processing unit that generates document frame image data from the vertex position information generated by the vertex detection unit 221. The orientation information adding unit 224 generates image data indicating the orientation of the document with characters, codes, marks, etc. based on the vertex position information generated by the vertex detection unit 221 and the vertical direction information generated by the vertical direction detection unit 223. A processing unit to be generated.

  The image synthesis unit 225 is a processing unit that synthesizes the image data generated by the frame generation unit 222, the image data generated by the orientation information addition unit 224, and the captured image data to generate preview image data 302. At this time, the image composition unit 225 generates preview image data 302 so that the document frame is arranged at a position corresponding to the vertex position information, and characters indicating the orientation of the document are arranged inside the document frame. By displaying characters indicating the orientation of the document in the preview display, the user can easily adjust the orientation when placing the document on the document table.

  Note that the image composition unit 225 may generate preview image data using image data representing a document table or image data representing a paper size prepared in advance, instead of captured image data.

  FIG. 4 is a diagram showing an example of a preview display based on preview image data. 4A shows a preview display of the document displayed on the display unit 204, and FIG. 4B shows a state where the document is placed on the document table 212. FIG.

  The user places a document such as a license on the document table 212 with the platen 211 opened (FIG. 4B). Then, a preview screen is displayed on the display unit 204 so that the vertical direction of the document and the position on the document table can be understood (FIG. 4A). Further, when the user moves the document on the document table 212, the image 400 indicating the document also moves following the document.

  In the preview display of FIG. 4A, the photographed image by the photographing unit 205 is not displayed as it is. Instead, on the basis of the preview image data generated by the image composition unit 225, the CPU 207 displays a rectangular frame indicating the position of the original and characters indicating the vertical direction of the original (“original”), and the character is inside the rectangular frame. To be displayed on the display unit 204 so as to be within the range. In addition, as long as it shows the up-down direction, not only a character but a code | symbol, a mark, etc. may be sufficient. In the preview display, the image indicating the document table and the image indicating the paper size may be displayed based on image data prepared in advance different from the captured image data.

  FIG. 5 is a flowchart showing processing for preview display, which is performed under the control of the CPU 207. When the user opens the pressure plate 211, a pressure plate open / close sensor in the scanner unit 202 detects this and notifies the CPU 207 that the pressure plate has been opened. Then, processing based on the flowchart of FIG. 5 is executed under the control of the CPU 207.

  In step S <b> 501, the photographing unit 205 photographs a document from below the document table 212. In step S502, the CPU 207 determines whether the security preview mode is set. Note that the user can selectively set the security preview mode on or off using the operation unit 203. Further, the security preview mode may be set from another device via the network or the like by receiving a command for instructing on or off of the security preview mode via the network or the like.

  When the security preview mode is not set, in step S503, the CPU 207 controls to transfer the captured image data generated by the imaging unit 205 to the display unit 204, and the display unit 204 is based on the captured image data. Perform preview display. The captured image data is transferred by a direct memory access controller (not shown). The direct memory access controller is set by the CPU 207. When not in the security preview mode, an image taken from below the document table is directly displayed on the display unit 204. Accordingly, the user can use the copy function, the scan function, or the FAX function while confirming the content of the document through the preview display.

  When the security preview mode is set, in step S504, the CPU 207 controls to transfer the captured image data generated by the imaging unit 205 to the preview generation unit 220. The captured image data is transferred by a direct memory access controller (not shown). The direct memory access controller is set by the CPU 207.

  Thereafter, in step S505, the vertex detection unit 221 attempts to detect the vertex position of the document. In step S506, the vertex detection unit 221 determines whether the positions of the four vertices of the document have been detected. If the positions of the four vertices of the document can be detected, the vertical direction detection unit 223 tries to detect the vertical direction of the document in step S507. In step S507, the frame generation unit 222 recognizes the size of the document image based on the document position information, and generates image data of the document frame corresponding to the size.

  In step S508, the vertical direction detection unit 223 determines whether the vertical direction of the document has been detected. If the vertical direction of the original can be detected, the orientation information adding unit 224 generates image data indicating the orientation of the original in step S509. The orientation information adding unit 224 calculates from which angle the document is inclined and which is above from the vertical direction information generated by the vertical direction detection unit 223 and the vertex position information generated by the vertex detection unit 221. Based on the calculation result, the character image data “original” is rotated, and image data indicating the orientation of the original is generated.

  In step S509, the image composition unit 225 generates preview image data based on the image data generated by the frame generation unit 222 and the image data generated by the orientation information addition unit 224. Furthermore, in step S509, the CPU 207 controls to transfer the preview image data generated by the preview generation unit 220 to the display unit 204, and the display unit 204 executes a preview display based on the preview image data.

  On the other hand, if the vertical direction of the document cannot be detected, the image composition unit 225 generates preview image data only from the image data generated by the frame generation unit 222 in step S510. In step S510, the CPU 207 controls to transfer the preview image data generated by the preview generation unit 220 to the display unit 204, and the display unit 204 executes a preview display based on the preview image data.

  In step S511, the CPU 207 waits until the next shooting timing. When shooting 15 frames per second, the shooting timing is 1000/15 msec.

  In this way, in the security preview mode, the contents of the document cannot be seen in the preview display, so that it is possible to prevent others from stealing the contents of the document. Even if the manuscript includes character information such as name and address and image information such as a face photo, the contents are not displayed.

  On the other hand, since the outline and vertical direction of the document are displayed, the user can set the print position on the printing paper even when copying a non-standard size document such as a license, insurance card, passport, or withholding slip. Can be confirmed. This prevents document set errors.

  Next, a second embodiment will be described. In the above embodiment, the position, size, and orientation of the document are detected from the photographed image data, and characters indicating the document frame and the orientation of the document are displayed in the preview display. In the second embodiment, the type of document is specified from the captured image data, and a standard image for preview prepared in advance corresponding to the type is replaced with the document image. As a result, an image closer to the actual manuscript is displayed in the preview display, but important information such as personal information described in the manuscript is not displayed, thus providing a more convenient preview display while improving security. can do.

  FIG. 6 is a diagram illustrating an internal configuration of the preview generation unit 220 according to the second embodiment.

  The vertex detection unit 221 in FIG. 6 is the same as the vertex detection unit 221 in FIG. The pattern file group 601 is a file describing characteristics of each of a plurality of types of assumed documents. A file is prepared for each type of document. The pattern selection unit 602 is a processing unit that detects the size of the document from the vertex position information generated by the vertex detection unit 221 and selects a pattern file that matches the size. At this time, one or more pattern files are selected.

  The pattern matching unit 603 sequentially compares the captured image data 301 and one or more pattern files selected by the pattern selection unit 602, and uses the pattern matching technique to determine the matching rate between each pattern file and the captured image data. It is a processing part to output. The determination unit 604 is a processing unit that determines the type of document based on the matching rate output from the pattern matching unit 603. The determining unit 604 generates information (type specifying information) indicating the determined type.

  The standard image data group 605 is a plurality of image data prepared in advance for a plurality of types of documents. Each type of document can be identified. The selection unit 606 selects standard image data corresponding to the determined type based on the type specifying information generated by the determination unit 604.

  The drawing unit 607 generates preview image data 302 based on the captured image data and the standard image data selected by the selection unit 606. At this time, the drawing unit 607 draws the standard image so as to be arranged at the position and angle indicated by the vertex position information, and generates preview image data 302.

  Note that the drawing unit 607 may generate preview image data using image data representing a document table or image data representing a paper size prepared in advance, instead of captured image data.

  The pattern file group 601 and the standard image data group 605 may be stored in a non-volatile memory inside the preview generation unit 220, or may be stored in the ROM 208 in FIG.

  FIG. 7 is a flowchart showing processing for performing preview display in the second embodiment, which is performed under the control of the CPU 207. When the user opens the pressure plate 211, a pressure plate open / close sensor in the scanner unit 202 detects this and notifies the CPU 207 that the pressure plate has been opened. Then, processing based on the flowchart of FIG. 7 is executed under the control of the CPU 207.

  In step S <b> 701, the photographing unit 205 photographs a document from below the document table 212. In step S702, the CPU 207 determines whether the security preview mode is set. Note that the user can specify whether the security preview mode is on or off using the operation unit 203.

  When the security preview mode is not set, in step S703, the CPU 207 controls to transfer the captured image data generated by the imaging unit 205 to the display unit 204, and the display unit 204 is based on the captured image data. Perform preview display. The captured image data is transferred by a direct memory access controller (not shown). The direct memory access controller is set by the CPU 207. When not in the security preview mode, an image taken from below the document table is directly displayed on the display unit 204. Accordingly, the user can use the copy function, the scan function, or the FAX function while confirming the content of the document through the preview display.

  When the security preview mode is set, in step S704, the CPU 207 controls to transfer the captured image data generated by the imaging unit 205 to the preview generation unit 220. The captured image data is transferred by a direct memory access controller (not shown). The direct memory access controller is set by the CPU 207.

  Thereafter, in step S705, the vertex detection unit 221 attempts to detect the vertex position of the document. In step S706, the vertex detection unit 221 determines whether the positions of the four vertices of the document have been detected. If the positions of the four vertices of the document can be detected, then in step S707, the pattern selection unit 602 detects the size of the document based on the vertex position information generated by the vertex detection unit 221, and the size is determined. A pattern file suitable for the size is selected from the pattern file group 601. In step S708, the pattern matching unit 603 sequentially compares the captured image data and one or a plurality of pattern files selected by the pattern selection unit 602 using a pattern matching method, and outputs the matching rate of each pattern file.

  In step S709, the determination unit 604 determines the type of document based on the matching rate output by the pattern matching unit 603. The determination unit 604 sets the type corresponding to the pattern file with the highest matching rate as the type of document. However, if the matching rate of all the pattern files does not exceed a predetermined value, it is determined that the type of document has not been specified.

  When the document type is specified, the selection unit 606 selects standard image data corresponding to the type specification information from the standard image data group 605 in step S710, and the drawing unit 607 is selected by the selection unit 606. Preview image data is generated from the standard image data. In step S710, the CPU 207 controls to transfer the preview image data generated by the preview generation unit 220 to the display unit 204, and the display unit 204 executes a preview display based on the preview image data.

  If the type of document is not specified, in step S711, the drawing unit 607 executes processing similar to that of the frame generation unit 222 in FIG. 3, and the document from the vertex position information generated by the vertex detection unit 221. Frame image data is generated. Furthermore, in step S711, the CPU 207 controls to transfer the preview image data generated by the preview generation unit 220 to the display unit 204, and the display unit 204 executes a preview display based on the preview image data.

  In step S712, the CPU 207 waits until the next shooting timing. When shooting 15 frames per second, the shooting timing is 1000/15 msec.

  In this way, when the type of document can be specified, a standard image that can identify the type of document is displayed, thereby providing a preview display that is more user-friendly while improving security.

  It is also possible to combine the embodiment based on FIG. 3 and the embodiment based on FIG. In the second embodiment, when the type of document cannot be specified, only the document frame is displayed. However, using the vertical direction detection unit 223 and the orientation information addition unit 224 of FIG. 3, instead of displaying only the document frame, characters indicating the document frame and the document orientation may be displayed.

  In the second embodiment, a standard image that can identify the type of document is displayed. However, preview image data may be generated so that characters that can identify the type of document are displayed. For example, for a well-known manuscript such as a license, the text “License” is displayed.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

DESCRIPTION OF SYMBOLS 20 Network 100 Image processing apparatus 201 Communication part 202 Scanner part 203 Operation part 204 Display part 205 Image | photographing part 206 Printer part 207 CPU
208 ROM
209 RAM
210 Image processing unit 211 Pressure plate 212 Document table 220 Preview generation unit 221 Vertex detection unit 222 Frame generation unit 223 Vertical direction detection unit 224 Orientation information addition unit 225 Image composition unit 601 Pattern file group 602 Pattern selection unit 603 Pattern matching unit 604 Determination unit 605 Standard image data group 606 Selection unit 607 Drawing unit

Claims (9)

An image processing apparatus that has a document table for placing a document and reads the image of the document to generate image data,
Photographing means for photographing a document on the document table and generating photographed image data;
Determining means for determining the type of the document from the captured image data;
The recognition unit for recognizing the position of the document on the document table from the photographed image data, and the document corresponding to the type determined by the determination unit are shown at a position corresponding to the position recognized by the recognition unit. Generating means for generating image data for displaying an image;
An image processing apparatus comprising: display means for displaying the image data generated by the generating means. Size recognition means for recognizing the size of the document from the captured image data;
The generation means displays an image showing the original in a size corresponding to the size recognized by the size recognition means at a position corresponding to the position on the original plate recognized by the recognition means. The image processing apparatus according to claim 1, wherein image data for generating the image data is generated.   The image processing apparatus according to claim 1, wherein the image showing the document is an image showing the frame of the document, or an image showing the frame of the document and the vertical direction of the document. .   The image showing the original corresponding to the type determined by the determining unit is an image showing a character indicating the type determined by the determining unit, or an image that can identify the type determined by the determining unit. The image processing apparatus according to claim 1, wherein the image processing apparatus is provided. A setting unit capable of selectively setting display of the image data generated by the generation unit and display of the captured image data;
The display means displays the image data generated by the generating means when the display of the image data generated by the generating means is set, and displays the image data generated by the generating means. The image processing apparatus according to claim 1, wherein the captured image data is displayed.   6. The generation unit according to claim 1, wherein the generation unit generates image data for displaying an image showing the original and an image showing the paper size based on image data showing the paper size. The image processing apparatus according to any one of the above.   The said determination means determines the pattern file corresponding to the said picked-up image data, and determines the kind corresponding to the said pattern file as a kind of said original document. Image processing apparatus. A display control method that can be executed by an image processing apparatus that has an original table for placing an original and reads an image of the original to generate image data,
A photographing step in which the photographing unit of the image processing device photographs a document on the document table to generate photographed image data;
A determination step in which the image processing apparatus determines the type of the document from the captured image data;
A recognition step in which the image processing device recognizes the position of the document on the document table from the captured image data;
A generation step for generating image data for displaying an image showing the original corresponding to the type determined in the determination step at a position corresponding to the position recognized in the recognition step by the image processing apparatus;
A display control method, comprising: a display step in which the image processing device displays the image data generated in the generation step on a display unit. A program having a document table for placing a document and readable by a computer of an image processing apparatus that reads the image of the document and generates image data,
A photographing step for photographing a document on the document table by a photographing unit;
A determination step for determining the type of the document from captured image data generated by shooting the document;
A recognition step of recognizing the position of the document on the document table from captured image data generated by photographing the document;
A generation step for generating image data for displaying an image showing the original corresponding to the type determined in the determination step at a position corresponding to the position recognized in the recognition step;
A program that causes the computer to execute a display step of causing the display means to display the image data generated in the generation step.

Images