JP2007122392A - Device, method, and program for image processing, and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device, method, and program for image processing, and a storage medium capable of easily searching for a target document to be transmitted out of a large amount of documents. <P>SOLUTION: A multifunctional printer is provided with a scanner part 101, a printer part 102, an operation part 103, a modem 104, a network controller part 105, a device for image processing 106, an HDD 107, a memory 108, a transmitting/receiving part 109, a character recognition part 110, and a search part 112, and is further provided with a dictionary 111 for character recognition connected to the character recognition part 110, and a dictionary 113 for search connected to the search part 112. After dividing each of the plurality of the documents by pages and by regions of the respective pages, a plurality of regions are searched on the basis of a predetermined search keyword. Based on the search result, the region and its page and document with maximum scores as the number of hits of search by the predetermined keyword are selected. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing apparatus and method, a program, and a storage medium, and more particularly, to an image processing apparatus and method, a program, and a storage medium that transmit read image data.

In recent years, the digitization of documents has progressed with the spread of scanners. A multi-function printer (MFP) is also equipped with a box function for storing scanned image data, and also has a function for transmitting by mail or file transmission (FTP (File Transfer Protocol), SMB (Server Message Block), etc.). It has become like this.
JP 2002-059593 A

  However, in the conventional technique, it is difficult to find a target document from the box, and in particular, when a large number of documents exist in the box, it is extremely difficult to search for a target document to be transmitted.

  An object of the present invention is to provide an image processing apparatus and method, a program, and a storage medium that can easily find a target document to be transmitted from a large number of documents.

  In order to achieve the above object, an image processing apparatus according to claim 1 is an image processing apparatus that retrieves predetermined data from a plurality of data stored in a data storage unit. And a search means for searching for the plurality of partial areas based on predetermined search information after dividing each partial area of each page, and a reconstruction means for reconfiguring the plurality of data based on the search results It is characterized by providing.

  The image processing method according to claim 7 is an image processing method for retrieving predetermined data from a plurality of data stored in a data storage unit, wherein each of the plurality of data is classified for each page and for each partial region of each page. And a search step for searching for the plurality of partial areas based on predetermined search information, and a reconstruction step for reconfiguring the plurality of data based on the search results.

  An image processing program according to claim 13 is an image processing program for retrieving predetermined data from a plurality of data stored in a data storage unit, and divides each of the plurality of data into pages and partial areas of each page. And a computer that executes a search module that searches the plurality of partial areas based on predetermined search information and a reconfiguration module that reconfigures the plurality of data based on the search results. .

  A computer-readable storage medium according to a twelfth aspect stores the program according to the eleventh aspect.

  According to the present invention, first, a plurality of partial areas are searched based on predetermined search information after each of a plurality of data is divided into pages and partial areas of each page. Since a plurality of data is reconstructed based on the search result, the target document can be easily searched from a large number of documents.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram schematically showing a configuration of a multifunction printer (MFP) including an image processing apparatus according to an embodiment of the present invention.

  In FIG. 1, a multifunction printer (also referred to as an MFP or a multifunction device) includes a scanner unit 101, a printer unit 102, an operation unit 103, a modem 104, a network controller unit 105, an image processing device 106, an HDD 107, a memory 108, and a transmission / reception unit. 109, a character recognition unit 110, and a search unit 112, which are connected by a system bus. The MFP further includes a character recognition dictionary 111 connected to the character recognition unit 110 and a search dictionary 113 connected to the search unit 112.

  The scanner unit 101 captures an image. The printer unit 102 performs copying and printing from a computer or the like. The operation unit 103 operates the MFP and is usually a liquid crystal display with a touch panel. The modem 104 is used at the time of fax transmission / reception. You can connect to the public line from here. The network controller unit 105 is normally connected to the LAN using Ethernet (registered trademark).

  The image processing unit 106 performs processing such as mutual conversion between color space conversions such as YCbCr and RGB, and image compression / decompression such as JPEG and MMR. A hard disk drive (HDD) 107 (data storage unit) is used as an area for temporarily storing images read from the scanner unit 101 and storing data for the storage function of the MFP. The memory 108 is used as a work area when image processing is performed. The transmission / reception unit 109 operates the network controller unit 105 to perform actual transmission / reception processing when transmitting / receiving a file. The character recognition unit 110 identifies a character region from the image data developed on the memory 108 and performs character recognition processing.

  The character recognition dictionary 111 is used by the character recognition unit and may be placed on a normal DRAM or a ROM. The search unit 112 searches the character string output by the character recognition unit 110 using the search keyword input from the operation unit, and calculates the score of the page. The search dictionary 113 is used by the search unit 112.

1. Accumulation of Documents by Scanning The accumulation function of the MFP can accumulate scanned images, images received by fax, images by receiving functions such as mail, images by PDL, and the like. A receiving function such as mail is received via a network interface, and an image by PDL is received via an interface directly connected to a computer such as a network interface or USB.

  Here, a case where an image read from the scanner unit 101 is stored in the HDD 107 will be described.

  It is assumed that the operation unit 103 is operated to call a storage function, and a document is set in an ADF (Auto Document Feeder). Further, it is assumed that 24-bit full color is set as the image capture mode.

  When the start button is pressed, the scanner unit 101 operates, the image processing unit 106 performs gamma correction and JPEG compression image processing, and the image is stored in the HDD 107. If there is an empty area in the HDD 107 and there is a next document in the ADF, the next page scan operation is repeated to scan all pages of the document. If there is no free space in the HDD 107, a message such as “HDD is full” is displayed on the operation unit 103, and the processing is interrupted.

  When all the pages have been read, the document data shown in FIG.

2. Search Data Generation for Stored Document Data When the scan by the scanner unit 101 is completed, the document data shown in FIG. At this time, since only image data and date data are added, a process of adding data such as layout data, text code, title, and summary is performed. This process is executed by the configuration shown in FIG.

  FIG. 3 is a diagram for explaining an operation for performing data processing on the document data of FIG.

  In FIG. 3, a page image 201 is document data read by the scanner unit 101 and is compressed by JPEG. The HDD reading unit 202 reads JPEG data 201 recorded in the HDD and sends code data to the JPEG decompression unit 203. The JPEG decompression unit 203 decodes the received JPEG data, generates a YCbCr raster image, and transmits it to the image binarization unit 204. The image binarization unit 204 extracts only the luminance component (Y component) from the received YCbCr raster image, binarizes it based on a predetermined threshold value, and outputs binary image data 205. From the obtained binary image data 205, the area identification unit 206 detects the distribution of the circumscribed rectangle of the character, combines the circumscribed rectangle, and the like to generate the layout data 207, as in normal character recognition.

  For example, when the binary image data 205 is the image shown on the left side of FIG. 14, it is shown on the right side of FIG. 14 by determining connected black pixels or taking histograms in the horizontal and vertical directions. As shown in FIG. A known technique can be used for the area division processing. Based on such region segmentation results (for example, the right side of FIG. 14 or FIG. 15A), a tree-type data structure (for example, FIG. 15B) showing the arrangement structure of each nested region is created. And stored as layout data 207.

  The character recognition unit 208 performs character recognition processing using information on the character area included in the binary image 205 and the layout data 207 to generate text code data 209. The HDD writing unit 210 writes layout data 207 and text code data 209 to the HDD 107, and generates layout data 211 and text code data 212 on the HDD 107.

  The above is the processing for the image for one page in one document. By performing this process on all pages, the document data structure shown in FIG.

  In FIG. 3, an HDD reading unit 202, a JPEG decompression unit 203, an image binarization unit 204, and an area identification unit 206 correspond to the image processing unit 106 in FIG. 1, and a character recognition unit 208 is a character recognition unit in FIG. Corresponds to 110.

3. Title Information Generation FIG. 5 is a block diagram illustrating an operation for performing a title addition process on the document data of FIG.

  The document title is generated from the layout data and text code data of the first page. The document data 301 is the same as the document data in FIG. 4 and is taken from the scanner unit 101 and includes each page image, layout data, and text code data. From this document data, the HDD reading unit 302 reads the layout data 303 and the text code data 304 included in the page data of the first page. The title generation unit 305 generates a title 306 from the layout data and text code data. As a method for generating the title 306, for example, one line of character code data is extracted from the text code of the character area existing at the top, and is used as the title. Also, there is a method of searching for a character area including a character string described by the largest character from layout data and text code data and using it as a title. The HDD writing unit 307 adds the generated title 306 to the document information of the HDD 107. As a result, document data 308 is generated in the HDD 107. In FIG. 5, an HDD reading unit 302, a title generation unit 305, and an HDD writing unit 307 correspond to the image processing unit 106 in FIG.

4). Summary Data Generation FIG. 6 is a block diagram schematically showing an operation of performing summary data addition processing on the document data generated by the processing of FIG.

  In FIG. 6, the summary data is generated by using a text code obtained by excluding a text code that is not a body such as characters in a table from all text code data of all pages.

  The document data 401 is the same as the document data 306 in FIG. 5 and is taken from the scanner, and includes each page image, layout data, and text code data. From this document data, the HDD reading unit 402 first reads layout data 403 and text code data 404 included in the page data of each page. The text extraction unit 405 uses the layout data and the text code data to generate body text 406 excluding non-body parts such as characters in the table and captions of the chart. The summary generation unit 407 generates summary data 408 from the input body text information. The HDD writing unit 409 adds the generated summary data 409 to the document data in the HDD 107. As a result, document data 410 is generated in the HDD. As a result, the document data with search information shown in FIG.

  In FIG. 6, an HDD reading unit 402, a text extracting unit 405, a summary generating unit 407, and an HDD writing unit 409 correspond to the image processing unit 106 in FIG.

5. Search / Transmission Function FIG. 8 is a diagram for explaining the operation of performing the document data search process of FIG.

  By the processing so far, a plurality of document data is stored in the HDD 107, and “ABC” is input from the operation unit 103 as a search keyword.

  In FIG. 8, a search unit 506 obtains the score of each document as follows using a search keyword and search conditions (limited to color images only) input from the operation unit.

  The document data 501 is a search target and includes each page image, layout data, and text code data. First, the HDD reading unit 502 reads the layout data 503 and the text code data 504 included in the page data of each page from the document data 501. The search unit 506 uses the layout data 503, the text code data 504, and the search query 505 input from the operation unit to obtain a search result score 507 for each character area included in each page. The search query 505 is generated using search information including a search keyword and a search condition (limited to color images only) input from the operation unit. Here, the score 507 is the number of times the search keyword has been hit. An example of the result is shown in FIG.

  This processing is performed for all documents, and a search score 507 for each document is obtained (reconstruction means). As a result, the one shown in FIG. 10 is obtained.

  Next, the search results are sent together in one file. Here, a case will be described in which text and image data are transmitted in the PDF format that can be included in one file.

  According to FIG. 10, since the score per document is larger in document 1 than in document 5, information on document 1 is arranged at the top of the search result page, and information on document 5 is arranged thereafter. As a search result of the document 1, since the area score of the area 3 of the page 2 is the highest, a partial image of this area is cut out from the page image and arranged on the search page. As a search result of the document 5, the area 1 of the page 2 is selected. The title of each document is also placed on the search page. In the case of the search result as shown in FIG. 10, a search page as shown in FIG. 11 is generated. All pages of document 1 and document 5 are arranged after the search page. In the title portion of each document in the search page, link information to the first page of each document is embedded. Also, link information to the page including the image is embedded in the partial image in the search page. The actual transmission file format is as shown in FIG. By embedding the link information in this way, when the file is opened on the receiving side, the target page can be referred to by following the link information.

  The PDF file generated in this way is transmitted to a file server or the like using the transmission / reception unit 109 in FIG.

  In the above embodiment, all pages of the document hit by the search are transmitted. However, when the MFP also operates as a Web server, not all pages of the hit document are attached. A URL that can access the document may be attached. An example of the transmission file in this case is shown in FIG.

  According to the present embodiment, each of a plurality of documents is divided into pages and regions of each page, and a plurality of regions are searched based on a predetermined search keyword. An area having the highest score, which is the number of hits for a search by keyword, and its page and its document are selected.

  Another object of the present invention is to supply a storage medium (or recording medium) in which a program code of software for realizing the functions of the above-described embodiments is recorded to a system or apparatus, and to perform computer (or CPU or MPU) of the system or apparatus. Needless to say, this is also achieved by reading and executing the program code stored in the storage medium.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an operating system (OS) or the like running on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. It goes without saying that the case where the CPU or the like provided in the card or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  The above-described program only needs to be able to realize the functions of the above-described embodiments by a computer, and the form includes forms such as object code, a program executed by an interpreter, and script data supplied to the OS. But you can.

  As a recording medium for supplying the program, for example, RAM, NV-RAM, floppy (registered trademark) disk, optical disk, magneto-optical disk, CD-ROM, MO, CD-R, CD-RW, DVD (DVD-ROM, DVD-RAM, DVD-RW, DVD + RW), magnetic tape, non-volatile memory card, other ROM, etc. may be used as long as they can store the above programs. Alternatively, the program is supplied by downloading from another computer or database (not shown) connected to the Internet, a commercial network, a local area network, or the like.

1 is a block diagram schematically showing a configuration of a multifunction printer (MFP) including an image processing apparatus according to an embodiment of the present invention. It is a figure explaining the document data accumulate | stored in HDD in FIG. It is a figure explaining the operation | movement which performs a data process to the document data of FIG. It is a figure explaining the document data produced | generated by the data processing of FIG. FIG. 5 is a block diagram illustrating an operation for performing a title addition process on the document data of FIG. 4. FIG. 6 is a block diagram schematically showing an operation of performing summary data addition processing on the document data of FIG. 5. It is a figure explaining the document data produced | generated by the summary data addition process of FIG. It is a figure explaining the operation | movement which performs the search process of the document data of FIG. It is a figure which shows an example of the result of the search process of FIG. It is a figure which shows an example of the result of the search process of FIG. 8, and shows the case where all the documents are object. It is a figure explaining the search page as a result of the search process of FIG. It is a figure explaining the transmission file format as a result of the search process of FIG. It is a figure explaining the transmission file format as a result of the search process of FIG. 8, and shows the case where accessible URL is attached. It is a figure which shows an example of an area | region division process. It is a figure explaining the layout data based on a region division process result.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Scanner part 102 Printer part 103 Operation part 104 Modem 105 Network controller part 106 Image processing part 107 Storage part 108 Memory 109 Transmission / reception part 110 Character recognition part 111 Character recognition dictionary 112 Search part 113 Search dictionary

Claims (14)

In an image processing apparatus that retrieves predetermined data from a plurality of data stored in a data storage unit,
Search means for searching for the plurality of partial areas based on predetermined search information after dividing each of the plurality of data for each page and each partial area of each page, and the plurality of data based on the search results An image processing apparatus comprising: reconstruction means for reconfiguring the image processing apparatus.   The image processing apparatus according to claim 1, wherein the search information includes a search keyword.   3. The image processing apparatus according to claim 2, wherein the reconstruction unit selects a partial area having the largest number of search hits based on the predetermined search keyword, its page, and its data.   The image processing apparatus according to claim 2, wherein the reconfiguration unit selects a page having the largest number of search hits according to the predetermined search keyword and its data.   The image processing apparatus according to claim 2, wherein the reconstruction unit selects data having the largest number of search hits based on the search keyword.   The image processing apparatus according to claim 1, wherein the data is document data. In an image processing method for retrieving predetermined data from a plurality of data stored in a data storage unit,
A search step of searching each of the plurality of partial areas based on predetermined search information after dividing each of the plurality of data for each page and each partial area of each page, and the plurality of data based on the search result An image processing method comprising: a reconstruction step for reconstructing the image.   The image processing method according to claim 7, wherein the search information includes a search keyword.   8. The image processing method according to claim 7, wherein the reconstructing step selects the partial area having the largest number of search hits by the search keyword, its page, and its data.   8. The image processing method according to claim 7, wherein the reconstructing step selects a page having the largest number of search hits according to the predetermined search keyword and its data.   8. The image processing method according to claim 7, wherein the reconstruction step selects data having the largest number of search hits based on the predetermined search keyword.   12. The image processing method according to claim 7, wherein the data is document data. In an image processing program for retrieving predetermined data from a plurality of data stored in a data storage unit,
A search module that searches the plurality of partial areas based on predetermined search information after dividing each of the plurality of data into pages and partial areas of each page, and the plurality of data based on the search results An image processing program for causing a computer to execute a reconstruction module for reconfiguring the image.   A computer-readable storage medium storing the program according to claim 11.

Images