JP5071539B2 - Image search apparatus, image reading apparatus, image search system, database generation method, and database generation program - Google Patents

Description

  The present invention relates to an image search device, an image reading device, an image search system, a database generation method, and a database generation program, and more particularly to an image search device and an image reading device that generate a database for storing images read by the image reading device, and the like The present invention relates to a database generation method and a database generation program executed by the image search apparatus.

  In recent years, the storage capacity of servers has increased, and many images can be stored. When storing many images, it is necessary to store them in a database, and for that purpose, information for searching for images is required. Japanese Patent Application Laid-Open No. 2007-12024 describes an image search apparatus that determines similarity based on image feature amounts and searches for images. However, when comparing the entire images, there is a problem that the processing load for the search is heavy because the area to be compared is large.

On the other hand, with the advancement of network technology, it is expected that an image search apparatus including a database and an image reading apparatus to which an image to be searched is input are connected via a network. In this case, the image input to the image reading device must be transmitted to the image search device via the network. However, since the amount of image data is relatively large, there is a problem that the communication load when transmitting an image increases.
JP 2007-12024 A

  The present invention has been made to solve the above-described problems, and one of the objects of the present invention is to provide an image search apparatus that reduces the amount of image data to be transmitted and received in order to search for an image. .

  Another object of the present invention is to provide an original reading apparatus in which the amount of data of an image transmitted and received for searching for an image is reduced.

  Still another object of the present invention is to provide an image search system that reduces the data amount of an image transmitted and received for searching for an image.

  Still another object of the present invention is to provide a database generation method and a database generation program that reduce the data amount of images transmitted and received for searching for images.

  In order to achieve the above object, according to one aspect of the present invention, an image search device is an image search device that can communicate with an image reading device, and can store a plurality of registered images; A plurality of registered images stored in the common image extracting means for extracting a common region including images that are the same or similar between the plurality of registered images, and determining a non-common region other than the common region as a search region Search area determining means for performing search area information transmitting means for transmitting search area information indicating the position of the search area in the image to the image reading apparatus, and partial images received from the image reading apparatus are stored in the storage means. A comparison unit that compares the reference image corresponding to the search area of each of the plurality of registered images, and a registration in which the reference image is the same as or similar to the partial image among the plurality of registered images as a result of comparison by the comparison unit A transmission requesting unit for requesting transmission of a document image when there is no image, and a registration unit for storing the document image received from the image reading device in the storage unit as a registered image in response to a request from the transmission requesting unit. Prepare.

  According to this aspect, a plurality of registered images are compared, a common region including images that are the same or similar between the plurality of registered images is extracted, and search region information that indicates a position in the image of a search region other than the common region Is transmitted to the image reading device, the partial image received from the image reading device is compared with the reference image corresponding to the search area of each of the plurality of registered images, and the reference image is the same as the partial image among the plurality of registered images or If there is no similar registered image, transmission of the document image is requested, and the document image received from the image reading apparatus is stored as the registered image. For this reason, whether or not there is a registered image that is the same as or similar to the document image is determined by comparing the partial image corresponding to the search area of the document image with the reference images of the plurality of registered images. Can be searched. Further, since the image forming apparatus transmits the partial image for searching, it is not necessary to transmit the entire document image, and the amount of data to be transmitted can be reduced. As a result, it is possible to provide an image search device capable of reducing the amount of data of images transmitted and received for searching for images.

  Preferably, the common area extraction unit extracts an area where a predetermined feature element is common among a plurality of registered images as a common area.

  According to this aspect, since a plurality of images are compared with a predetermined feature element, the accuracy of extracting the common area can be improved.

  Preferably, as a result of comparison by the comparison unit, when there is a registered image whose partial image is the same as or similar to the reference image among the plurality of registered images, a search result transmitting unit that transmits the registered image to the image reading device, Further prepare.

  According to another aspect of the present invention, an image reading apparatus includes a document reading unit that outputs a document image obtained by reading a document, and a search area determined by search area information received from the image search apparatus among the output document images. A partial image transmission means for transmitting a partial image obtained by cutting out the image portion to the image search device, and a document image for transmitting a document image to the image search device when a transmission request is received from the image search device in response to the transmission of the partial image Transmitting means.

  According to this aspect, a partial image obtained by cutting out the search area portion of the document image is transmitted to the image search device, and when a transmission request is received from the image search device, the document image is transmitted to the image search device. For this reason, since the partial image cut out from the document image is transmitted to the image search device, it is possible to provide a document reading device capable of reducing the data amount of the image transmitted and received for searching the image.

  According to still another aspect of the present invention, the image search system is an image search system including an image search device and an image reading device, and the image search device includes storage means capable of storing a plurality of registered images; A common area extracting means for comparing a plurality of registered images stored in the storage means and extracting a common area including the same or similar images among the plurality of registered images, and a search area for non-common areas other than the common area A search area determining means for determining the search area, search area information transmitting means for transmitting search area information indicating the position of the search area in the image to the image reading apparatus, and storing the partial image received from the image reading apparatus in the storage means. A comparison means for comparing with a reference image corresponding to a search area of each of the plurality of registered images, and as a result of comparison by the comparison means, the reference image is the same as the partial image among the plurality of registered images, or When there is no similar registered image, transmission request means for requesting transmission of the document image, and registration means for storing the document image received from the image reading device in the storage means as a registered image in response to a request by the transmission request means And an image reading apparatus that cuts out a portion of a search area determined by search area information received from the image search apparatus from a document reading unit that outputs a document image obtained by reading a document. A partial image transmission unit that transmits a partial image to the image search device; and a document image transmission unit that transmits a document image to the image search device when a transmission request is received from the image search device in response to the transmission of the partial image. Prepare.

  If this situation is followed, the image search system which can reduce the data amount of the image transmitted / received in order to search an image can be provided.

  According to still another aspect of the present invention, the database generation method is a database generation method executed by an image search device capable of communicating with the image reading device, and the image search device can store a plurality of registered images. A database generation method comprising: comparing a plurality of registered images stored in the storage unit and extracting a common area including images that are the same or similar between the plurality of registered images; A step of determining a non-common area other than the area as a search area, a step of transmitting search area information indicating a position in the image of the search area to the image reading apparatus in response to a request from the image reading apparatus, and an image reading apparatus A step of comparing the partial image received from the reference image corresponding to the search area of each of the plurality of registered images stored in the storage unit and the step of comparing As a result of the comparison, if a registered image whose reference image is the same as or similar to the partial image does not exist among the plurality of registered images, a step of requesting the image reading apparatus to transmit the document image and a request by the transmission request unit Storing a document image received from the image reading apparatus as a registered image in a storage unit.

  If this aspect is followed, the database production | generation method which can reduce the data amount of the image transmitted / received in order to search an image can be provided.

  According to still another aspect of the present invention, the database generation program is a database generation program executed by a computer that controls an image search device that can communicate with the image reading device, and the image search device includes a plurality of registered images. The database generation program compares a plurality of registered images stored in the storage unit and extracts a common area including the same or similar images among the plurality of registered images. A step of determining a non-common area other than the common area as a search area; and transmitting search area information indicating a position of the search area in the image to the image reading apparatus in response to a request from the image reading apparatus; The reference image corresponding to the search area of each of the plurality of registered images stored in the storage means is the partial image received from the image reading device. A step of comparing and a step of requesting the image reading device to transmit a document image when there is no registered image whose reference image is the same as or similar to the partial image among the plurality of registered images as a result of the comparison in the comparing step; And causing the computer to execute a step of storing the document image received from the image reading device in the storage unit as a registered image in response to a request from the transmission request unit.

  If this aspect is followed, the database production | generation program which can reduce the data amount of the image transmitted / received in order to search an image can be provided.

1 is a diagram showing an overall outline of an image search system in an embodiment of the present invention. 1 is a perspective view showing an appearance of an MFP. 2 is a block diagram illustrating an example of a hardware configuration of an MFP. FIG. It is a block diagram which shows an example of the hardware constitutions of a search server. It is a block diagram which shows an example of the outline | summary of the function which CPU with which a search server is provided. 2 is a block diagram illustrating an example of an overview of functions of a CPU included in an MFP. FIG. It is a flowchart which shows an example of the flow of a database production | generation process. 5 is a flowchart illustrating an example of a flow of document image registration processing.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  FIG. 1 is a diagram showing an overall outline of an image search system according to an embodiment of the present invention. Referring to FIG. 1, an image search system 1 includes a multi-function peripheral (hereinafter referred to as “MFP”) 100, 100 </ b> A to 100 </ b> D each connected to a network 3, and a search connected to the Internet 5. Server 200.

  MFPs 100, 100 </ b> A to 100 </ b> D are examples of image reading apparatuses and have a plurality of functions such as a scanner function, a printer function, a copy function, and a facsimile function.

  The network 3 is a local area network (LAN), regardless of whether it is wired or wireless. MFPs 100, 100 </ b> A to 100 </ b> D can communicate with each other via network 3, and further can communicate with search server 200 via network 3 and Internet 5. The network 3 is not limited to the LAN, and may be the Internet, a wide area network (WAN), a public switched telephone network, or the like.

  The search server 200 is a general computer and is an example of an image search device. In the present embodiment, search server 200 stores a plurality of images as a database, registers images transmitted from MFPs 100, 100A to 100D in the database, and transmits them from MFPs 100, 100A to 100D. Search the database based on images.

  MFPs 100 and 100A to 100D have the same functions. Therefore, here, the functions of MFP 100 will be described as an example.

  FIG. 2 is a perspective view showing the appearance of the MFP. FIG. 3 is a block diagram illustrating an example of the hardware configuration of the MFP. 2 and 3, MFP 100 includes information processing unit 101, facsimile unit 27, communication control unit 28, automatic document feeder (ADF) 21, document reading unit 22, and image processing unit 23. An image forming unit 24, a paper feeding unit 25, and a post-processing unit 26. Further, the MFP 100 includes an operation panel 11 used as a user interface on the upper surface.

  The information processing unit 101 includes a central processing unit (CPU) 111, a ROM (Read Only Memory) 112 that stores programs executed by the CPU 111, a RAM (Random Access Memory) 113 used as a work area of the CPU 111, A hard disk drive (HDD) 114 for storing data in a nonvolatile manner, a display unit 115, an operation unit 116, a network interface (I / F) 117, and an external storage device 118 are included. The CPU 111 is connected to the ROM 112, RAM 113, HDD 114, display unit 115, operation unit 116, network I / F 117, and external storage device 118, and controls the entire information processing unit 101. The CPU 111 is connected to the facsimile unit 27, the communication control unit 28, the ADF 21, the document reading unit 22, the image processing unit 23, the image forming unit 24, the paper feeding unit 25, and the post-processing unit 26, and controls the entire MFP 1. .

  The ADF 21 handles a plurality of documents mounted on the document table, and sequentially conveys them one by one to the document reading unit 22. When the document reading unit 22 reads one side of the document, the ADF 21 conveys the document to the document reading unit 22 to read the surface. Further, when both sides of the document are read by the document reading unit 22, the ADF 21 conveys the document to the document reading unit 22 to read the front surface, turns the document over, conveys the document to the document reading unit 22, and reads the back surface. Make it. The document reading unit 22 optically reads image information such as photographs, characters, pictures, and the like from the document, acquires image data, and outputs the image data to the image processing unit 23.

  The image processing unit 23 is controlled by the CPU 111 and performs image processing on image data based on an instruction from the CPU 111. The image data includes any of image data output by the document reading unit 22 reading the document, image data included in a print job received from another computer via the network I / F 117, and any of the other MFPs 100A to 100D via the network I / F 117. Image data received from the camera and image data stored in the HDD 114. The image processing includes, for example, an enlargement process for enlarging an image, a reduction process for reducing an image, a synthesis process for synthesizing a plurality of images to generate one image, a rotation process for rotating an image to change the direction, and the like. . The image processing unit 23 outputs the processed image data to the image forming unit 24.

  The paper feed unit 25 has a plurality of paper feed trays, and supplies the sheets stored in the designated paper feed tray to the image forming unit 24 one by one. Each of the plurality of paper feed trays stores a paper sheet of a size selected from a plurality of paper sheets in a direction selected from a plurality of directions. Here, the paper feed unit 25 has four first to fourth paper feed trays, the first paper feed tray stores A4 size paper in the vertical direction, and the second paper feed tray is A4 size paper. The paper is stored in the horizontal direction, the third paper supply tray stores the A3 size paper in the vertical direction, and the fourth paper supply tray stores the B5 size paper in the horizontal direction. In addition, when duplex printing is designated, the paper feeding unit 25 reverses the paper conveyed to the image forming unit 24 and conveys the paper again to the image forming unit 24 in order to form images on both sides of the paper.

  The image forming unit 24 forms an image on a sheet conveyed from the sheet feeding unit 25 based on the image data input from the image processing unit 23.

  The post-processing unit 26 discharges the paper on which the image is formed. The post-processing unit 26 includes a plurality of paper discharge trays and includes a sorting unit, a punch hole processing unit, and a staple processing unit. The sorting unit sorts and outputs a plurality of sheets on which images are formed to a plurality of paper discharge trays. The punch hole processing unit opens a punch hole in the paper. The staple processing unit performs staple processing to collect a plurality of sheets on which images are formed.

  The display unit 115 is a display device such as a liquid crystal display (LCD) or an organic ELD (Electro Luminescence Display), and displays an instruction menu for the user, information about acquired image data, and the like. The operation unit 116 includes a plurality of keys, and accepts input of various instructions, data such as characters and numbers by user operations corresponding to the keys. Operation unit 116 further includes a touch panel provided on display unit 115. The display unit 115 and the operation unit 116 constitute the operation panel 11.

  The network I / F 117 is an interface for communicating with a communication protocol such as TCP (Transmission Control Protocol) or UDP (User Datagram Protocol), and communicates with the search server 200 via the network 3 and the Internet 5. Further, it communicates with other MFPs 100 </ b> A to 100 </ b> D connected to the network 3.

  The external storage device 118 is loaded with a CD-ROM (Compact Disk Read Only Memory) 119. The CPU 111 can access the CD-ROM 119 via the external storage device 118, and can execute a program stored in the CD-ROM 119 by loading it into the RAM 113. Note that the program executed by the CPU 111 is not limited to the program stored in the CD-ROM 119, but may be a program stored in another storage medium, a program stored in the HDD 116, or a network I / O. The program may be written in the HDD 114 by another computer connected to the network 3 via F117.

  The storage medium for storing the program is not limited to the CD-ROM 119, but an optical disc (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile Disc)), IC card, optical card, mask ROM, A semiconductor memory such as an EPROM (Erasable Programmable ROM) or an EEPROM (Electrically Erasable and Programmable ROM) may be used.

  The facsimile unit 27 is connected to the PSTN 13 and transmits facsimile data to the PSTN 13 or receives facsimile data from the PSTN 13. The facsimile unit 27 converts the received facsimile data into print data that can be printed by the image forming unit 24 and outputs the print data to the image forming unit 24. As a result, the image forming unit 24 prints the facsimile data received by the facsimile unit 27 on paper. In addition, the facsimile unit 27 converts the data stored in the HDD 114 into facsimile data, and transmits the facsimile data to a facsimile machine connected to the PSTN 13.

  FIG. 4 is a block diagram illustrating an example of a hardware configuration of the search server. Referring to FIG. 4, search server 200 includes a CPU 201 for controlling the entire search server 200, a ROM 202 for storing programs executed by CPU 201, a RAM 203 used as a work area for CPU 201, and a search A network I / F 204 for connecting the server 200 to the network, an HDD 205 as a large-capacity storage device, a display unit 206, an operation unit 207 for accepting user operation input, and an external storage in which the CD-ROM 209 is mounted. Device 208.

  The HDD 205 stores a plurality of images. The CPU 201 forms a database for managing a plurality of images stored in the HDD 205. In the present embodiment, the database formed by the CPU 201 classifies a plurality of images by type. The type of image classified by the database is the type of document that is the source of the image. The type of manuscript is, for example, a magazine name, meeting material, minutes, report, etc. for a magazine.

  A CD-ROM 209 is attached to the external storage device 208. The CD-ROM 209 stores an application search program that can be executed by the CPU 201. The CPU 201 controls the external storage device 208 to read the application search program from the CD-ROM 209 and store the read application search program in the RAM 203. Load and execute.

  The recording medium for storing the application search program is not limited to the CD-ROM 209, and is a flexible disk, a cassette tape, an optical disk (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile Disc)), IC A semiconductor memory such as a card, an optical card, a mask ROM, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically EPROM) may be used. Further, the CPU 201 downloads an application search program from another computer connected to the Internet 5 and stores it in the HDD 205, or the other computer writes the application search program in the HDD 205 so that the application stored in the HDD 205 is stored. The search program may be loaded into the RAM 203 and executed by the CPU 201. The program here includes not only a program directly executable by the CPU 201 but also a source program, a compressed program, an encrypted program, and the like.

  In image search system 1 according to the present embodiment, a document image obtained by reading a document with any of MFPs 100, 100 </ b> A to 100 </ b> D is registered in a database formed in search server 200. Further, the database formed in the search server 200 is searched based on the document image obtained by reading the document with any of the MFPs 100, 100A to 100D. Since MFPs 100 and 100A to 100D have the same functions, an example will be described here in which a document image is read by MFP 100 and a document image is registered in search server 200 or a database is searched based on the document image. A plurality of images stored in the HDD 205 are referred to as registered images.

  FIG. 5 is a block diagram illustrating an example of an overview of functions of a CPU included in the search server. The functions shown in FIG. 5 are formed in the CPU 201 when the CPU 201 included in the search server 200 executes a database generation program stored in the ROM 202, the HDD 205, or the CD-ROM 209.

  Referring to FIG. 5, the CPU 201 extracts a common area including a common area that includes the same or similar images among a plurality of registered images, a search area determination unit 253 that determines a search area, and search area information. A search area information transmission unit 255 that transmits a partial image received from the MFP 100, a comparison unit 259 that compares a partial image received with a reference image corresponding to the search area of each of the plurality of images, and a registration image transmission unit 261 that transmits a registration image. A transmission request unit 263 that requests transmission of a document image, a document image reception unit 265 that receives a document image, and a registration unit 267 that stores the document image in a database.

  The common area extraction unit 251 compares a plurality of registered images stored in the HDD 205 and extracts a common area including the same or similar images between the plurality of registered images. Since the plurality of registered images stored in the HDD 205 are classified according to the type of document, the common area extraction unit 251 compares the plurality of registered images classified into the type for each document type. The common area extraction unit 251 extracts, as a common area, an area in which predetermined feature elements included in images are the same or similar among a plurality of registered images. Here, the feature element is the contour of the image included in the registered image. Therefore, the common area extraction unit 251 converts each of the plurality of registered images into an edge image, and compares the plurality of edge images, thereby sharing a rectangular area including the same or similar line drawing between the plurality of edge images. Extract as a region. An edge image is a differential image obtained by converting each of a plurality of pixels included in a registered image into a difference from an adjacent pixel. However, when the common area extraction unit 251 cannot extract a common area that is common among all of the plurality of registered images classified into the same type, a predetermined ratio of the plurality of registered images classified into the same type A region including the same or similar images among the number of registered images may be set as a common region. The predetermined ratio may be determined in advance.

  The common area extraction unit 251 outputs the position of the extracted common area in the registered image to the search area determination unit 253 and the comparison unit 259. Since the common area extraction unit 251 extracts a common area for each document type, the common area extraction unit 251 outputs a set of the document type and the common area to the search area determination unit 253.

  The search area determination unit 253 receives a set of the document type and the common area from the common area extraction unit 251. The search area determination unit 253 determines a non-common area other than the common area in the image as a search area based on the position of the common area input from the common area extraction unit 251 in the registered image. The search area determination unit 253 outputs a set of the document type and search area information indicating the position of the search area in the image to the search area information transmission unit 255 and the comparison unit 259.

  The search area information transmission unit 255 receives a set of the document type and the search area information from the search area determination unit 253, and receives a request for the search area information from the MFP 100 here from any of the MFPs 100 and 100A to 100D. In response, the search area information is transmitted via the network I / F 204. The search area information request includes the document type, and the search area information transmission unit 255 transmits the search area information paired with the document type included in the search area information request.

  Here, the MFP 100 will be described. FIG. 6 is a block diagram illustrating an example of an overview of functions of a CPU included in the MFP. The functions shown in FIG. 6 are formed in the CPU 111 when the CPU 111 provided in the MFP 100 executes a document image registration program stored in the ROM 112, the HDD 114, or the CD-ROM 119. The document image registration program is a part of the database generation program.

  Referring to FIG. 6, CPU 111 includes a document image receiving unit 51 that receives a document image, a search region information receiving unit 55 that receives search region information from search server 200, and a partial image cutout that cuts out a partial image from a document image. Unit 53, partial image transmission unit 57 that transmits a partial image to search server 200, search result reception unit 59 that receives a search result, document image transmission unit 61 that transmits a document image to search server 200, and search results And a search result display unit 63 for displaying.

  The document image receiving unit 51 controls the document reading unit 22 to cause the document reading unit 22 to read a document according to a user operation, and receives a document image output by the document reading unit 22 reading the document. When the user places a document, for example, a magazine, on the document table of the document reading unit 22 and presses a start key provided in the operation unit 116, a reading instruction is accepted. When the document image receiving unit 51 receives the reading instruction, the document reading unit 51 causes the document reading unit 22 to read the document. The document image receiving unit 51 receives the document image output from the document reading unit 22 and outputs the received document image to the partial image cutting unit 53 and the document image transmitting unit 61.

  The search area information receiving unit 55 displays a type selection screen for selecting the type of document on the display unit 115, and if the user inputs an operation for selecting the type of document to the operation unit 116, Accept type. The search area information receiving unit 55 transmits a request for search area information including the accepted document type to the search server 200 via the network I / F 117. The search server 200 that receives the search area information request returns search area information that is paired with the type of document included in the search area information request, so that the search area information receiving unit 55 uses the network I / F 117. And control area information is received from the search server 200. The search area information receiving unit 55 outputs the received search area information to the partial image cutout unit 53.

  The partial image cutout unit 53 cuts out a partial image of an area specified by the search area information input from the search area information receiving unit 55 from the original image from the original image input from the original image receiving unit 51. The partial image cutout unit 53 outputs the partial image cut out from the document image to the partial image transmission unit 57.

  The partial image transmission unit 57 transmits the partial image input from the partial image cutout unit 53 to the search server 200 via the network I / F 117. The partial image transmission unit 57 outputs a signal indicating that the partial image has been transmitted to the search server 200 to the search result reception unit 59.

  Returning to FIG. 5, when the network I / F 204 receives a partial image from the MFP 100, the partial image receiving unit 257 provided in the CPU 201 acquires the partial image. The partial image reception unit 257 outputs the partial image received by the network I / F 204 to the comparison unit 259.

  The comparison unit 259 receives a set of document type and search region information from the search region determination unit 253 and receives a partial image from the partial image reception unit 257. The comparison unit 259 sets a plurality of registered images classified by the type of document input from the search area determination unit 253 among the plurality of registered images stored in the HDD 205 as processing target images. The comparison unit 259 compares the partial image input from the partial image reception unit with a plurality of processing target images. The portion to be compared with the processing target image is a portion of the search region specified by the search region information input from the search region determination unit 253 in the processing target image. Hereinafter, a part of the registered image corresponding to the search area specified by the search area information is referred to as a reference image.

  The comparison unit 259 compares the partial image with each of a plurality of reference images. The comparison unit 259 compares a predetermined feature element of the partial image with a predetermined feature element of the reference image. The feature element is a contour of an image included in the image. Therefore, the comparison unit 259 converts the partial image and the reference image into edge images, respectively, and compares the edge image obtained by converting the partial image with the edge image obtained by converting the reference image. The comparison unit 259 determines whether or not the edge image obtained by converting the partial image and the edge image obtained by converting the reference image are the same or similar. Both may be completely the same, but some may be different. Similarity includes the case where the ratio of different parts to the same part is equal to or less than a predetermined value, and includes the case where the shapes are the same or similar and the sizes are different.

  If there is a registered image in which the edge image of the reference image is the same as or similar to the edge image of the partial image among the plurality of registered images, the comparing unit 259 outputs the registered image to the registered image transmitting unit 261. If no such registered image exists, a transmission request instruction is output to the transmission request unit 263.

  When a registered image is input from comparing unit 259, registered image transmission unit 261 transmits the registered image to MFP 100 that has transmitted the partial image via network I / F 117.

  When a transmission request instruction is input from comparison unit 259, transmission request unit 263 transmits a transmission request for requesting transmission of a document image to MFP 100 that has transmitted the partial image via network I / F 117. Transmission request unit 263 outputs a signal indicating that the transmission request has been transmitted to MFP 100 to document image receiving unit 265.

  After receiving a signal indicating that a transmission request is transmitted to MFP 100 from transmission request unit 263, document image receiving unit 265 controls network I / F 117 to receive the document image transmitted by MFP 100. Document image receiving unit 265 outputs the received document image to registration unit 267.

  The registration unit 267 stores the document image input from the document image receiving unit 265 in the HDD 114. At this time, the search area information transmission unit 255 classifies the document into the document types included in the search area information request received from the MFP 100 and stores the registered images.

  Referring to FIG. 6 again, the search result receiving unit 59 controls the network I / F 117 after the signal indicating that the partial image is transmitted from the partial image transmitting unit 57 to the search server 200, and performs the search. A search result is received from the server 200. The search result is either a registered image or a transmission request. When receiving a registered image as a search result, the search result receiving unit 59 outputs the registered image to the search result display unit 63. When receiving a transmission request as a search result, the search result receiving unit 59 sends the transmission request to the document image transmitting unit 61 and the search result. The data is output to the display unit 63.

  The search result display unit 63 displays the registered image on the display unit 115 when the registered image is input from the search result receiving unit 59. Thus, it is possible to notify the user that a registered image that is the same as or similar to the original image is stored in search server 200 with respect to the original read by MFP 100 by the user. Therefore, the user who has read the document to MFP 100 for registration in the database can know that it is not necessary to newly register the document image of the document in the database. As a result, document images of the same document can be prevented from being registered twice, and user scan operations for registering document images can be prevented from being duplicated, thereby reducing unnecessary operations by the user. Can do. In addition, a user who causes MFP 100 to read a document to search the database can check the search result.

  When a transmission instruction is input from the search result receiving unit 59, the search result display unit 63 displays a message on the display unit 115 in order to continue the reading operation for the user. The message is, for example, “Please scan the next page of the document”. For example, when the document is composed of a plurality of pages, the user can repeat the operation of causing the document reading unit 22 to sequentially read the documents of the plurality of pages. Thus, a plurality of document images constituting the document are sequentially read by the document reading unit 22, and a plurality of document images are received by the document image receiving unit 51, and a plurality of document images are received from the document image receiving unit 51 to the document image transmitting unit 61. Original images are sequentially output.

  When a transmission instruction is input from the search result receiving unit 59, the document image transmitting unit 61 transmits the document image input from the document image receiving unit 51 to the search server 200 via the network I / F 117. When a plurality of document images are sequentially input from the document image transmission unit 61, the document image transmission unit 61 transmits the images to the search server 200 as a single file. Note that a plurality of document images input in order from the document image transmission unit 61 may be transmitted to the search server 200 in the input order.

  FIG. 7 is a flowchart illustrating an example of the flow of database generation processing. The database generation process is a process executed by the CPU 201 when the CPU 201 included in the search server 200 executes a database generation program stored in the ROM 202, the HDD 205, or the CD-ROM 209.

  Referring to FIG. 7, CPU 201 determines whether a request for search area information has been received (step S51). If network I / F 204 receives a request for search area information from one of MFPs 100, 100A to 100D, it determines that a request for search area information has been received. The process waits until a search area information request is received (NO in step S51). When a search area information request is received (YES in step S51), the process proceeds to step S52. Here, a case where a search area information request is received from MFP 100 will be described as an example.

  In step S 52, the search area information is transmitted via network I / F 117 to MFP 100 that has transmitted the request for the search area information. Then, it is determined whether or not a partial image has been received (step S53). The network I / F 204 is in a standby state until it receives a partial image from the MFP 100 that transmitted the search area information (NO in step S53). When the partial image is received (YES in step S53), the process proceeds to step S54.

  In step S54, from the registered images stored in the HDD 205, a registered image in which the partial image received in step S53 and the reference image of the portion corresponding to the search area are the same or similar is extracted. If a registered image whose reference image is the same as or similar to the partial image is extracted, the process proceeds to step S55, and if not, the process proceeds to step S56.

  In step S55, the extracted registered image is transmitted to MFP 100 that has transmitted the partial image via network I / F 117, and the process ends.

  On the other hand, in step S56, a transmission request is transmitted to MFP 100 that has transmitted the partial image via network I / F 117. In next step S57, the network I / F 117 is in a standby state until it receives a document image from MFP 100 that has transmitted a transmission request (NO in step S57). When a document image is received (YES in step S57), the process is performed. Proceed to S58. In step S58, the received document image is stored in HDD 116, and the process ends.

  FIG. 8 is a flowchart showing an example of the flow of document image registration processing. The document image registration process is a process executed by CPU 111 when CPU 111 provided in MFP 100 executes a document image registration program stored in ROM 112, HDD 114, or CD-ROM 119.

  Referring to FIG. 8, CPU 111 determines whether a registration instruction has been accepted (step S01). If the user presses a key assigned with a registration instruction in advance on operation unit 116, the registration instruction is accepted. The process waits until a registration instruction is accepted (NO in step S01). If a registration instruction is accepted (YES in step S01), the process proceeds to step S02.

  In step S02, it is determined whether a document reading instruction has been accepted. When the user presses the step start key of the operation unit 116, a reading instruction is accepted. The process waits until a reading instruction is accepted (NO in step S02). If a reading instruction is accepted (YES in step S02), the process proceeds to step S03. In step S03, the original reading unit 22 is caused to read the original, and the original image output by the original reading unit 22 is acquired.

  In the next step S 04, a search area information request is transmitted to the search server 200. The search server 200 that receives the request for the search area information returns the search area information. In the next step S05, it is determined whether or not the search area information has been received. The process waits until the search area information is received (NO in step S05). When the search area information is received (YES in step S05), the process proceeds to step S06.

  In step S06, the partial image is transmitted to search server 200. Of the document image acquired in step S03, the search area specified by the search area information received in step S05 is cut out from the document image, and the cut-out partial image is sent to the search server 200 via the network I / F 117. Send.

  In the next step S07, it is determined whether a search result is received from the search server. The process waits until a search result is received (NO in step S07). When the search result is received (YES in step S07), the process proceeds to step S08. In step S08, the process branches depending on the received search result. If a transmission request is received as a search result, the process proceeds to step S09. If a registered image is received as a search result, the process proceeds to step S14.

  In step S09, a message is displayed on display unit 115. The message is, for example, “Please scan the next page of the document”. For example, when the document is composed of a plurality of pages, the user repeats an operation of causing the document reading unit 22 to sequentially read a plurality of pages of the document.

  In the next step S10, it is determined whether a document reading instruction has been accepted. When the user presses the step start key of the operation unit 116, a reading instruction is accepted. If a reading instruction is accepted (YES in step S10), the process proceeds to step S11. If not, the process proceeds to step S12. In step S12, it is determined whether an end instruction has been accepted. If the user presses a stop key provided in the operation unit 116, an end instruction is accepted. If an end instruction is accepted (YES in step S12), the process proceeds to step S13. If not, the process returns to step S10.

  In step S11, the original reading unit 22 is caused to read the original, the original image output by the original reading unit 22 is acquired, and the process returns to step S10. When step S11 is repeatedly executed, a plurality of pages of document images constituting the document are sequentially read by the document reading unit 22 to obtain a plurality of document images.

  If an end instruction is accepted in step S12 (YES in step S12), the document image is transmitted to the search server 200 via the network I / F 117 in step S13, and the process ends. The document image includes at least the document image acquired in step S03, and includes one or more document images acquired in step S11 when step S11 is executed.

  On the other hand, in step S14, the received registered image is displayed on the display unit 115, and the process ends. Thus, the user can be notified that the same registered image as the original image is stored in search server 200 for the original read by MFP 100 by user. For this reason, the user can know that it is not necessary to newly register the original image of the original in the database. As a result, it is possible to avoid registering duplicate document images of the same document, and to reduce unnecessary operations by the user by preventing duplicate scan operations for registering document images by the user. it can.

  As described above, in the image search system 1 according to the present embodiment, the search server 200 compares a plurality of registered images stored in the HDD 205 and includes the same or similar images among the plurality of registered images. An area is extracted, and in response to a request from MFP 100, search area information indicating the position of the search area other than the common area in the image is transmitted to MFP 100. When the MFP 100 receives an instruction to register a document image obtained by reading a document in the search server 200, the MFP 100 acquires a search area from the search server 200 and searches the partial image cut from the document image for the search server 200. Send to. In search server 200, the partial image received from MFP 100 is compared with the reference image corresponding to the search area of each of the plurality of registered images, and among the plurality of registered images, the registered image whose reference image is the same as or similar to the partial image. Is not present, a transmission request is transmitted to MFP 100, and a document image received from MFP 100 is stored in HDD 205.

  Therefore, since it is determined using the partial image corresponding to the search area of the document image whether or not a registered image that is the same as or similar to the document image read by MFP 100 exists in HDD 205 of search server 200. It is possible to efficiently search a plurality of document images stored in. Further, since MFP 100 transmits a partial image corresponding to the search area without transmitting the entire original image for search, the amount of data to be transmitted can be reduced and network resources can be used effectively. Further, when the document image has confidential information, it is not necessary to transmit all of the document image for the search, so that the number of times of transmitting the confidential information can be reduced as much as possible.

  In addition, although the image search system 1 was demonstrated in embodiment mentioned above, it cannot be overemphasized that invention can be grasped | ascertained as a database generation method and a database generation program for making a computer perform the process shown in FIG.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  1 image search system, 3 network, 5 internet, 11 operation panel, 21 ADF, 22 document reading unit, 23 image processing unit, 24 image forming unit, 25 paper feeding unit, 26 post-processing unit, 27 facsimile unit, 28 communication control , 51 Document image receiving unit, 53 Partial image cutting unit, 55 Search area information receiving unit, 57 Partial image transmitting unit, 59 Search result receiving unit, 61 Document image transmitting unit, 63 Search result display unit, 100, 100A˜ 100D MFP, 101 information processing unit, 111 CPU, 112 ROM, 113 RAM, 114 HDD, 115 display unit, 116 operation unit, 117 network I / F, 118 external storage device, 119 CD-ROM, 200 search server, 201 CPU 202 ROM, 203 RAM, 204 Network I / F, 205 HDD, 206 display unit, 207 operation unit, 208 external storage device, 209 CD-ROM, 251 common region extraction unit, 253 search region determination unit, 255 search region information transmission unit, 257 partial image reception unit, 259 comparison 261 registration image transmission unit, 263 transmission request unit, 265 document image reception unit, 267 registration unit.

Claims (7)

An image search device capable of communicating with an image reading device,
Storage means capable of storing a plurality of registered images;
A common area extracting means for comparing a plurality of registered images stored in the storage means and extracting a common area including images that are the same or similar between the plurality of registered images;
Search area determining means for determining a non-common area other than the common area as a search area;
Search area information transmitting means for transmitting search area information indicating the position of the search area in the image to the image reading device;
Comparing means for comparing the partial image received from the image reading device with a reference image corresponding to the search area of each of a plurality of registered images stored in the storage means;
As a result of comparison by the comparison means, if there is no registered image in which the reference image is the same as or similar to the partial image among the plurality of registered images, a transmission request means for requesting transmission of the document image;
An image search device comprising: a registration unit that stores a document image received from the image reading device in the storage unit as a registered image in response to a request from the transmission request unit.   The image search apparatus according to claim 1, wherein the common area extraction unit extracts a common area that has a predetermined feature element among a plurality of registered images.   As a result of comparison by the comparison means, if there is a registered image in which the partial image is the same as or similar to the reference image among the plurality of registered images, search result transmitting means for transmitting the registered image to the image reading device The image search device according to claim 1, further comprising: Document reading means for outputting a document image obtained by scanning a document;
A partial image transmission means for transmitting, to the image search device, a partial image obtained by cutting out a portion of a search region determined by search region information received from an image search device from the output document image;
An image reading apparatus comprising: a document image transmission unit configured to transmit the document image to the image search device when a transmission request is received from the image search device in response to the transmission of the partial image. An image search system including an image search device and an image reading device,
The image search device includes:
Storage means capable of storing a plurality of registered images;
A common area extracting means for comparing a plurality of registered images stored in the storage means and extracting a common area including images that are the same or similar between the plurality of registered images;
Search area determining means for determining a non-common area other than the common area as a search area;
Search area information transmitting means for transmitting search area information indicating the position of the search area in the image to the image reading device;
Comparing means for comparing the partial image received from the image reading device with a reference image corresponding to the search area of each of a plurality of registered images stored in the storage means;
As a result of comparison by the comparison means, if there is no registered image in which the reference image is the same as or similar to the partial image among the plurality of registered images, a transmission request means for requesting transmission of the document image;
Registration means for storing a document image received from the image reading device in the storage means as a registered image in response to a request by the transmission request means;
The image reading apparatus includes a document reading unit that outputs a document image obtained by reading a document;
A partial image transmission means for transmitting, to the image search device, a partial image obtained by cutting out a portion of the search area determined by the search area information received from the image search device from the output document image;
An image search system comprising: a document image transmission unit configured to transmit the document image to the image search device when a transmission request is received from the image search device in response to the transmission of the partial image. A database generation method executed by an image search apparatus capable of communicating with an image reading apparatus,
The image search device includes storage means capable of storing a plurality of registered images,
The database generation method includes:
Comparing a plurality of registered images stored in the storage means and extracting a common region including images that are the same or similar between the plurality of registered images; and
Determining a non-common area other than the common area as a search area;
Transmitting search area information indicating a position in the image of the search area to the image reading apparatus in response to a request from the image reading apparatus;
Comparing a partial image received from the image reading device with a reference image corresponding to the search area of each of a plurality of registered images stored in the storage means;
A step of requesting the image reading device to transmit the document image when the reference image is the same as or similar to the partial image among the plurality of registered images as a result of the comparison in the comparing step; When,
Storing a document image received from the image reading device in the storage unit as a registered image in response to a request from the transmission request unit. A database generation program that is executed by a computer that controls an image search apparatus that can communicate with an image reading apparatus,
The image search device includes storage means capable of storing a plurality of registered images,
The database generation program is:
Comparing a plurality of registered images stored in the storage means and extracting a common region including images that are the same or similar between the plurality of registered images; and
Determining a non-common area other than the common area as a search area;
Transmitting search area information indicating a position in the image of the search area to the image reading apparatus in response to a request from the image reading apparatus;
Comparing a partial image received from the image reading device with a reference image corresponding to the search area of each of a plurality of registered images stored in the storage means;
A step of requesting the image reading device to transmit the document image when the reference image is the same as or similar to the partial image among the plurality of registered images as a result of the comparison in the comparing step; When,
A database generation program for causing the computer to execute a step of storing a document image received from the image reading device in the storage unit as a registered image in response to a request from the transmission request unit.

Images