JP2009069933A - Image processor, image processing method, and image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To change a rule to add an index by image data. <P>SOLUTION: An MFP is provided with: image data acquisition parts (S03, S04) for acquiring image data; an object extraction part (S07) for extracting an object from the image data; an index application part (S08) for applying an index name preliminarily associated with the attributes of the extracted object to the object; an index information creation part (S09) for creating index information including a hierarchy into which the attributes of the extracted object are preliminarily classified in at least one hierarchy, the position of the extracted object in the image data and the added index name; and an index information adding part (S12) for adding the created index information to the image data. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image processing device, an image processing method, and an image processing program, and more particularly to an image processing device, an image processing method, and an image processing program for adding an index to an object included in image data.

  In recent years, a technique for adding an index called a bookmark to an arbitrary position in data is known. For example, if data is stored in a PDF (Portable Document Format) format, a bookmark can be added. In order to assign a bookmark to data, an application program must be started, and the user must perform an operation of designating a position in the data for giving the bookmark. On the other hand, there is a desire to add a bookmark to a plurality of data of the same type according to the same rule.

  Japanese Patent Application Laid-Open No. 2007-26100 obtains the number of the first page of a chapter in a document from data described in PDL (Page Description Language) received from a PC, and reflects the obtained first page number. An image processing apparatus that converts PDL data into PDF format data is described.

According to this technique, bookmarks can be assigned to all documents with the same rules. However, it is desirable to change the rule for adding a bookmark depending on the type of document.
JP 2007-26100 A

  The present invention has been made to solve the above-described problems, and one of the objects of the present invention is to provide an image processing apparatus capable of changing a rule for adding an index according to image data.

  Another object of the present invention is to provide an image processing method capable of changing a rule for adding an index according to image data.

  Still another object of the present invention is to provide an image processing program capable of changing a rule for adding an index according to image data.

  In order to achieve the above-described object, according to one aspect of the present invention, an image processing apparatus includes: an image data acquisition unit that acquires image data; an object extraction unit that extracts an object from image data; Index assigning means for giving an object an index name associated with the attribute of the object in advance, a hierarchy in which the attribute of the extracted object is classified in advance in at least one hierarchy, and the extracted object Index information generating means for generating index information including a position in image data and an assigned index name, and index information adding means for adding the generated index information to image data.

  According to this aspect, an object is extracted from image data, an index name associated with the attribute of the object in advance is given to the extracted object, and the attribute of the extracted object in at least one hierarchy is Index information including the classified hierarchy, the position of the object in the image data, and the assigned index name is generated and added to the image data. For this reason, if an attribute of an object and a hierarchy in which it is classified are determined, an index is added to the image data. As a result, it is possible to provide an image processing apparatus capable of changing a rule for adding an index according to image data.

  Preferably, a correspondence table storage unit that stores a correspondence table including at least one correspondence record in which an index name and an object attribute are associated, and a plurality of at least one object attribute classified into any one of at least one hierarchy Pattern storage means for storing types of patterns, and selection means for selecting any one of a plurality of types of stored patterns as a target pattern, wherein the object extraction means includes the selected target pattern The attribute object included in the image data is extracted from the image data, the index assigning means assigns the extracted object an index name associated with the attribute of the object by the correspondence table, and the index information generating means extracts Attribute of the specified object There acquires hierarchy that are classified by the selected target pattern.

  According to this aspect, a correspondence table including a correspondence record in which an index name and an attribute of an object are associated, and a plurality of types of patterns in which the attribute of the object is classified into one of at least one hierarchy are stored. Any one of the types of patterns is selected as a target pattern, an object having an attribute included in the selected target pattern is extracted from the image data, and the extracted object is associated with the attribute of the object through a correspondence table. And the hierarchy classified by the target pattern from which the attribute of the extracted object is selected is acquired. For this reason, when any one of a plurality of types of patterns is selected, an index can be added to the image data according to a rule defined by the selected target pattern.

  Preferably, the apparatus further includes a storage destination receiving unit that receives a storage destination of the acquired image data, the plurality of types of patterns are associated with any of the plurality of storage destinations, and the selection unit is configured to include the plurality of types of patterns. A pattern associated with the accepted storage destination is selected as a target pattern.

  According to this aspect, when the storage destination of the image data is received, the pattern associated with the received storage destination is selected as the target pattern. For this reason, simply by inputting an operation for designating a storage destination, a rule for adding an index is automatically selected.

  Preferably, operation receiving means for receiving an operation input by the user is further provided, and the selection means selects a pattern specified by the operation received by the operation receiving means from among a plurality of types of patterns.

  According to this aspect, since the target pattern is specified by an operation input by the user from among a plurality of types of patterns, a rule for adding an index can be determined by a simple operation of selecting a pattern.

  Preferably, correspondence table storage means for storing a correspondence table including at least one correspondence record that associates an index name and an attribute of an object, reference data acquisition means for acquiring reference data, and included in the acquired reference data Index information extraction means for extracting all index information, and a hierarchy in which attributes associated with the index name and the correspondence table are classified based on the hierarchy and index name respectively included in all the extracted index information A target pattern generation unit that generates a target pattern to be defined, the object extraction unit extracts an object having an attribute included in the generated target pattern from the image data, and the indexing unit includes the extracted object The object The index name assigned to the attribute associated with the correspondence table, the index information generating means, the attribute of the extracted object, and acquires the hierarchy that are classified by the generated target pattern.

  According to this aspect, a correspondence table including at least one correspondence record that associates an index name with an attribute of an object is stored, and when the reference data is acquired, all indexes included in the acquired reference data Information is extracted, and a target pattern that defines a hierarchy in which attributes associated with the index name and the correspondence table are classified is generated based on the hierarchy and the index name respectively included in all the extracted index information. . Then, an attribute object included in the generated target pattern is extracted from the image data, and an index name associated with the attribute of the object by the correspondence table is given to the extracted object, and the extracted object attribute Hierarchies classified by the target pattern for which is generated are acquired. For this reason, since the target pattern is generated when the reference data is acquired, it is possible to easily determine a rule for adding an index.

  Preferably, reference data acquisition means for acquiring reference data, index information extraction means for extracting all index information included in the acquired reference data, and position information included in each of the extracted index information An attribute discriminating unit for discriminating attributes of all the specified objects, and a correspondence table generating unit for generating a correspondence table for associating the attributes discriminated with all the index names respectively included in all the extracted index information; A target pattern generating means for generating a target pattern that defines a hierarchy in which attributes associated with the index name and the correspondence table are classified based on the hierarchy and index name respectively included in all the extracted index information; Further equipped with The object extraction means extracts an object having an attribute included in the generated target pattern from the image data, and the index assigning means assigns an index name associated with the attribute of the object by the correspondence table to the extracted object. Then, the index information generation means acquires a hierarchy in which the attribute of the extracted object is classified according to the generated target pattern.

  According to this aspect, reference data is acquired, all index information included in the acquired reference data is extracted, and attributes of all objects specified by position information included in all the extracted index information respectively Is created, and a correspondence table is created to associate the identified attributes with all the index names included in all the extracted index information, and the hierarchy and index names included in all the extracted index information respectively. Based on this, a target pattern is generated that defines a hierarchy into which attributes associated with the index name and correspondence table are classified. Then, an attribute object included in the generated target pattern is extracted from the image data, an index name associated with the attribute of the object by the correspondence table is given to the extracted object, and the attribute of the extracted object is The hierarchy classified by the generated target pattern is acquired. For this reason, since the target pattern is generated when the reference data is acquired, it is possible to easily determine a rule for adding an index.

  Preferably, a storage destination reception unit that receives a storage destination of the acquired image data is further provided, and the reference data acquisition unit acquires data already stored in the received storage destination as reference data.

  Preferably, operation receiving means for receiving an operation input by the user is further provided, and the reference data acquiring means acquires data specified by the operation received by the operation receiving means as reference data.

  According to another aspect of the present invention, an image processing method includes a step of acquiring image data, a step of extracting an object from the image data, and an index associated with the extracted object in advance with an attribute of the object. An index comprising a step of assigning a name, a hierarchy in which attributes of the extracted object are classified in advance in at least one hierarchy, a position in the image data of the extracted object, and an assigned index name Generating information, and adding the generated index information to the image data.

  If this aspect is followed, the image processing method which can change the rule which adds an index with image data can be provided.

  According to still another aspect of the present invention, an image processing program is associated in advance with an attribute of an object, the step of acquiring image data, the step of extracting an object from the image data, and the extracted object. The step of assigning an index name, a hierarchy in which attributes of the extracted object are classified in advance in at least one hierarchy, a position in the image data of the extracted object, and an assigned index name are included. A step of generating index information and a step of adding the generated index information to image data are executed by a computer.

  If this aspect is followed, the image processing program which can change the rule which adds an index with image data can be provided.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  FIG. 1 is a diagram showing an overall outline of a data conversion system according to one embodiment of the present invention. Referring to FIG. 1, a data conversion system 1 includes a multi-function peripheral (hereinafter referred to as “MFP”) 3, 4, a personal computer (hereinafter referred to as “PC”) 200, and a server 300 connected to a network 2. ,including.

  The PC 200 and the server 300 are general computers. MFPs (Multi Function Peripherals) 3 and 4 have a plurality of functions such as a scanner function, a printer function, a copy function, and a facsimile function, and function as an image processing apparatus.

  The network 2 is a local area network (LAN), and the connection form may be wired or wireless. The network 2 is not limited to a LAN, and may be a wide area network (WAN), a public switched telephone network (PSTN), or the like.

  Since the hardware configurations and functions of the MFPs 3 and 4 are the same, the MFP 3 will be described as an example in the following description unless otherwise specified. FIG. 2 is a block diagram illustrating an example of a hardware configuration of the MFP. Referring to FIG. 2, MFP 3 includes a main circuit 101, and main circuit 101 is connected to ADF 10, image reading unit 20, image forming unit 30, paper feeding unit 40, and facsimile unit 50. . The main circuit 101 includes a central processing unit (CPU) 111, a RAM (Random Access Memory) 112 used as a work area of the CPU 111, and an EEPROM (Electronically Erasable Programmable Read Only Memory) for storing programs executed by the CPU 111. ) 113, a display unit 114, an operation unit 115, a hard disk drive (HDD) 116 as a mass storage device, and a data communication control unit 117.

  The CPU 111 is connected to the display unit 114, the operation unit 115, the HDD 116, and the data communication control unit 117, and controls the entire main circuit 101. The CPU 111 is connected to the ADF 10, the image reading unit 20, the image forming unit 30, the paper feeding unit 40, and the facsimile unit 50, and controls the entire MFP 3.

  The display unit 114 is a display such as a liquid crystal display (LCD) or an organic ELD (Electro Luminescence Display), and displays an instruction menu for the user, information about acquired image data, and the like. The operation unit 115 includes a plurality of keys, and accepts input of various instructions, data such as characters and numbers by user operations corresponding to the keys. The operation unit 115 includes a touch panel provided on the display unit 114. The display unit 114 and the operation unit 115 constitute an operation panel.

  The data communication control unit 117 includes a LAN terminal 118 that is an interface for communicating with a communication protocol such as TCP (Transmission Control Protocol) or UDP (User Datagram Protocol), and a serial interface terminal 119 for serial communication. The data communication control unit 117 transmits / receives data to / from an external device connected to the LAN terminal 118 or the serial interface terminal 119 in accordance with an instruction from the CPU 111.

  When a LAN cable for connecting to the network 2 is connected to the LAN terminal 118, the data communication control unit 117 can communicate with the PC 200 or the server 300 via the LAN terminal 118.

  Further, the CPU 111 controls the data communication control unit 117 to read a program to be executed by the CPU 111 from the memory card 119A, and stores the read program in the RAM 112 and executes it. A recording medium for storing a program to be executed by the CPU 111 is not limited to the memory card 119A, but a flexible disk, a cassette tape, an optical disk (CD-ROM (Compact Disc-Read Only Memory) / MO (Magnetic Optical Disc)). It may be a medium such as a semiconductor memory such as / MD (Mini Disc) / DVD (Digital VerSatile Disc)), IC card, optical card, mask ROM, EPROM (EraSable Programmable ROM), or EEPROM (Electronically EPROM). Further, the CPU 111 downloads a program from a computer connected to the Internet and stores it in the HDD 116, or loads the program stored in the HDD 116 into the RAM 112 so that the computer connected to the Internet writes the program in the HDD 116. Then, it may be executed by the CPU 111. The program here includes not only a program directly executable by the CPU 111 but also a source program, a compressed program, an encrypted program, and the like.

  The facsimile unit 50 is connected to the public switched telephone network (PSTN) 7 and transmits facsimile data to the PSTN 7 or receives facsimile data from the PSTN 7. The facsimile unit 50 stores the received facsimile data in the HDD 116, or the image forming unit 30 prints the facsimile data on paper. Further, the facsimile unit 50 converts the data stored in the HDD 116 into facsimile data, and outputs the facsimile data to a facsimile machine connected to the PSTN 7 or another MFP. As a result, the data stored in HDD 116 can be output to a facsimile machine or another MFP.

  FIG. 3 is a functional block diagram showing an example of the functions of the CPU provided in the MFP together with information stored in the HDD. Referring to FIG. 3, CPU 111 includes an operation receiving unit 151 for receiving an operation input by the user to operation unit 115, a pattern selecting unit 155 for selecting one of a plurality of patterns, and image data. An image data acquisition unit 153 for acquiring an object, an object extraction unit 157 for extracting an object from the image data, an index assignment unit 159 for assigning an index name to the object, and an index for generating index information An information generation unit 161 and a data conversion unit 163 for converting the format of the image data into PDF are included.

  The HDD 116 stores a pattern table 191 that includes a plurality of pattern records that define a pattern, and a correspondence table 193 that includes a plurality of correspondence records that associate index names with object attributes.

  FIG. 4 is a diagram illustrating an example of a pattern table. Referring to FIG. 4, pattern table 191 includes a plurality of pattern records. A pattern record defines a pattern. The pattern is associated with at least one area (BOX) of the HDD 116, and defines to which of the at least one hierarchy each of the plurality of attributes of the object is assigned. Here, the highest hierarchy is the first hierarchy and the lower hierarchy of the first hierarchy is the second hierarchy.

  Specifically, the pattern record includes items of a pattern name, a storage location, a first hierarchy, and a second hierarchy. In the pattern name item, a name given to the pattern is set. In the storage location item, identification information for identifying at least one area (BOX) included in the HDD 116 with which the pattern is associated, a folder name is set here. In the items of the first hierarchy and the second hierarchy, attributes of objects assigned to the first hierarchy and the second hierarchy are set. The storage destination may be identification information for identifying at least one area (BOX) included in the storage device included in the server 300.

  Here, the object will be described. The object is a portion included in the image data, and includes, for example, a page area for one page, an image area representing a photograph or a figure, and a modified character area representing a modified character. The modified character is, for example, an underlined character, a character surrounded by a line, a character whose background color is different from the background color of other characters, or the like. The attribute of the object is “page break” for the page area, “image” for the image area, and “modifier character” for the modifier character area. Further, the object may include a character area in which characters are represented, and the attribute may be “character”. In this case, the modified character area is included in the character area. The object may include a handwritten character area in which a handwritten character is represented, and its attribute may be “handwritten character”. In this case, the handwritten character area is included in the character area.

  For example, the pattern whose pattern name is “pattern 1” is associated with an area identified by “folder A” among a plurality of areas of the HDD 116, and the object attribute “page break” is assigned to the first layer. The attribute “image” of the object is assigned to the second hierarchy. The pattern whose pattern name is “Pattern 2” is associated with the area identified by “Folder B” among the plurality of areas of the HDD 116, and the object attribute “qualifying character” is assigned to the first layer. The object attribute is not assigned to the second hierarchy.

  Here, an example is shown in which the pattern has two layers of the first layer and the second layer, but the number of layers is not limited to this and may be one layer or more.

  FIG. 5 is a diagram illustrating an example of the correspondence table. Referring to FIG. 5, correspondence table 193 includes a plurality of correspondence records. The corresponding record associates the index name with the attribute of the object. The index name is character information given for each attribute of the object. Here, the index name “PAGE” is associated with the attribute “page break” of the object, the index name “PICT” is associated with the attribute “image” of the object, and the index name is associated with the attribute “qualifying character” of the object. Associate "MARKER".

  Returning to FIG. 3, the operation reception unit 151 receives an operation input by the user to the operation unit 115. The image data acquisition unit 153 acquires image data and outputs the acquired image data to the object extraction unit 157 and the data conversion unit 163. When the user inputs a document reading instruction for reading a document image to the operation unit 115, the image data acquisition unit 153 receives the document reading instruction from the operation reception unit 151. Then, the image data acquisition unit 153 acquires the image data output by the image reading unit 20 by reading the document image from the image reading unit 20.

  Further, when the data communication control unit 117 receives print data from the PC 200, the image data acquisition unit 153 acquires the print data that the data communication control unit 117 receives from the PC 200 from the data communication control unit 117 as image data. In this case, the image data acquisition unit 153 notifies the pattern selection unit 155 that the print data has been received.

  In addition, when the data communication control unit 117 receives image data from the PC 200 using the FTP (File Transfer Protocol) communication protocol, the data communication control unit 117 acquires the image data received from the PC 200 from the data communication control unit 117. In this case, since the data communication control unit 117 receives the storage location information indicating the storage location of the image data from the PC 200, the image data acquisition unit 153 receives the image data from the pattern selection unit 155 and the storage location thereof. Notify information.

  The pattern selection unit 155 selects one of the plurality of patterns, and outputs the pattern record of the selected pattern to the object extraction unit 157 and the index assignment unit 159. Specifically, when the user inputs an operation for designating the image data storage destination to the operation unit 115, the pattern selection unit 155 receives the image data storage destination from the operation reception unit 151. Here, the storage destination is a folder name for specifying a plurality of areas (BOX) of the HDD 116.

  When the pattern selection unit 155 receives the image data storage destination from the operation reception unit 151, the pattern selection unit 155 searches the pattern table 191 and extracts a pattern record in which the received storage destination folder name is set in the storage location item. Thereby, a pattern is selected.

  Note that the user may select one of a plurality of patterns. In this case, the pattern selection unit 155 reads the pattern table 191 from the HDD 116 and displays a list of pattern names on the display unit 114. When the user inputs an operation for instructing one pattern name from the list of pattern names to the operation unit 115, the instruction is received by the operation reception unit 151. The pattern selection unit 155 searches the pattern table 191 and extracts a pattern record having a pattern name specified by the instruction received by the operation reception unit 151.

  In addition, when a notification that print data has been received from the image data acquisition unit 153 is input, the pattern selection unit 155 acquires a predetermined storage location for the received print data. Furthermore, the pattern selection unit 155 acquires the storage destination from the image data acquisition unit 153 when the image data acquisition unit 153 receives the image data and the storage destination information is notified.

  When acquiring the storage destination, the pattern selection unit 155 searches the pattern table 191 and extracts a pattern record in which the received storage destination folder name is set in the storage location item.

  The object extraction unit 157 extracts object attributes set in the items of the first layer and the second layer included in the pattern record input from the pattern selection unit 155. Then, the object extraction unit 157 extracts the extracted attribute object from the image data input from the image data acquisition unit 153. For example, when a pattern record whose pattern name is “pattern 1” is input, all page areas and image areas are extracted from the image data as objects. When there are a plurality of page areas in the image data, all of the plurality of page areas are extracted, and when there are a plurality of image areas in the image data, all of the plurality of image areas are extracted. The object extraction unit 157 outputs a set of position information in the image data of the extracted object and its attribute to the index assignment unit 159. When a plurality of objects are extracted, the same number of sets of position information and attributes as the number of extracted objects are output. The position information in the image data of the object indicates the start position of the object. Since the object is rectangular, the position information is the position in the image data of the upper left vertex as the position information of the object.

  The index assigning unit 159 receives a set of object position information and attributes from the object extracting unit 157. The index assigning unit 159 refers to the correspondence table 193 stored in the HDD 116, extracts the correspondence record of the input attribute, and acquires the index name included in the extracted correspondence record. Then, the acquired index name is associated with the position information. Thereby, the index name is associated with the object specified by the position information. When a plurality of sets of position information and attributes are input from the object extraction unit 157, the index assigning unit 159 sets the index name as a new index name to which a serial number is assigned so that the index name does not overlap. For example, when there are a plurality of page areas, the index name “PAGE1” is associated with the first page area, and the index name “PAGE2” is associated with the next page area.

  The index assigning unit 159 outputs the combination of the index name and the attribute to the index information generating unit 161. When a plurality of pairs of position information and attributes are input from the object extraction unit 157, the index assigning unit 159 outputs the same number of pairs of index names and attributes as the number of input pairs to the index information generation unit 161. .

  The index information generation unit 161 receives a pattern record from the pattern selection unit 155 and a pair of an index name and an attribute from the index assignment unit 159. The index information generation unit 161 generates index information in which a pair of an index name and an attribute is assigned to a hierarchy in which an attribute included in the pair is defined by a pattern record. When a plurality of pairs of index names and attributes are input from the index assigning unit 159, the index information generating unit 161 assigns all the pairs to the hierarchy in which the attributes included in each pair are defined by the pattern record. Index information is generated. The index information generation unit 161 outputs the generated index information to the data conversion unit 163.

  The data conversion unit 163 converts the image data input from the image data acquisition unit 153 into a PDF format. The data conversion unit 163 includes an index information addition unit 165. The index information adding unit 165 adds index information input from the index information generating unit 161 to the image data subjected to format conversion. The data conversion unit 163 stores the image data that has undergone format conversion and index information added to the storage location acquired by the pattern selection unit 155.

  FIG. 6 is a flowchart illustrating an example of the flow of data conversion processing. The data conversion process is a process executed by the CPU 111 when the CPU 111 executes a data conversion program. Referring to FIG. 6, CPU 111 determines whether a document reading instruction has been accepted (step S01). If a document reading instruction is accepted, the process proceeds to step S02; otherwise, the process proceeds to step S04.

  In step S02, it is determined whether a storage destination has been accepted. The process waits until the storage destination is accepted (NO in step S02). If the storage destination is accepted, the process proceeds to step S03. A list of folders is displayed on the display unit 114. If any of the folders displayed in the list is designated by the user, the designated folder is accepted as a storage destination. In step S03, the document reading unit 20 reads the document image, and the process proceeds to step S6. Since the image reading unit 20 outputs the image data, the image data is acquired.

  On the other hand, in step S04, it is determined whether or not data has been received. If data is received, the process proceeds to step S05; otherwise, the process returns to step S01. When print data is received from the PC 200, or when image data is received from the PC 200 using the FTP communication protocol, the process proceeds to step S05.

  In step S05, the storage destination is determined. Here, when print data is received from the PC 200, the storage location is determined in advance. When image data is received from the PC 200 using the FTP communication protocol, the storage location is determined to be received from the PC 200.

  In step S06, the target pattern associated with the storage destination is selected from the target pattern table 191. The storage destination is the storage destination accepted in step S02 when the process proceeds from step S03, and the storage destination determined in step S05 when the process proceeds from step S05. When the pattern record including the folder name of the storage folder is selected from the pattern records included in the pattern table 191, the target pattern is determined by the first layer item and the second layer item of the pattern record. For example, when the storage destination is “Folder A”, a pattern record having a pattern name “Pattern 1” is specified, and the attribute “Page break” is arranged in the first hierarchy defined by the pattern record, and the second hierarchy is assigned. A pattern in which the attribute “image” is arranged is selected as a target pattern.

  In the next step S07, an object is extracted from the image data. An object having an attribute included in the target pattern generated in step S06 is extracted. For example, when the storage destination is “Folder A”, the target pattern has the attribute “page break” in the first hierarchy and the attribute “image” in the second hierarchy, so the page area of the attribute “page break” and the attribute “image” An image area is extracted.

  In step S08, an index name is assigned. One of the objects extracted in step S07 is set as a processing target, and an index name associated with the attribute of the processing target object in the correspondence table 193 is given to the processing target object. When an object name has already been assigned to an object having the same attribute, an index name is assigned as a new index name with a serial number. This is to prevent multiple assignment of the same index name.

  Next, index information is generated (step S08). The hierarchy that is associated with the attribute of the object to be processed by the pattern record is acquired, and index information that associates the top position information in the image data of the object, the object name given in step S08, and the hierarchy is obtained. Generate.

  In the next step S10, it is determined whether there is an object to be processed that has not yet been processed. If there is an unprocessed object, the process returns to step S08; otherwise, the process proceeds to step S11. In step S11, the image data acquired in step S03 or the image data received in step S04 is converted into a PDF format. Then, the index information generated in step S09 is added to the image data whose data format has been converted. Then, the image data to which the index information is added is stored in the storage destination. The storage location is a storage location designated by the user when step S02 is executed, and when the step S05 is executed, the print data is received by a predetermined storage location or FTP. This is a storage destination for the received image data together with the image data.

  FIG. 7 is a first diagram illustrating an example of a document image. Referring to FIG. 7, the document image is composed of three sheets. Here, it is assumed that the first document image includes one photograph, the second document image includes two photographs, and the third document image includes one photograph. When this document image is read by the image reading unit 20 of the MFP 3, image data of a volume corresponding to three pages is output from the image reading unit 20.

  FIG. 8 is a first diagram illustrating an example of index information. The index information shown in FIG. 8 indicates the index information generated when the MFP 3 is instructed to read the original image shown in FIG. 7 and store it in the folder whose folder name is “folder A”. Referring to FIG. 8, index names “PAGE1”, “PAGE2”, and “PAGE3” associated with the top positions of the first to third pages of image data are arranged in the first layer. Also, the index name “PICT1” associated with the top position of the image area included in the first page is arranged in the second hierarchy below the index name “PAGE1” of the first hierarchy, and the index name of the first hierarchy Index names “PICT2” and “PICT3” respectively associated with the top positions of the two image areas included in the second page are arranged in the second hierarchy below “PAGE2”. The index name “PICT4” associated with the top position of the image area included in the third page is arranged in the second layer below “PAGE3”.

  FIG. 9 is a second diagram illustrating an example of a document image. Referring to FIG. 9, the document image is composed of three sheets. Here, the first document image includes two modifiers, the second document image includes three modifiers, and the third document image includes two modifiers. And When this original image is read by the MFP 3, image data of a volume for three pages is output.

  FIG. 10 is a second diagram illustrating an example of index information. The index information illustrated in FIG. 9 indicates index information generated when the MFP 3 is input with an instruction to read the document image illustrated in FIG. 9 and store the folder name in “folder B”. Referring to FIG. 10, seven index names “MARKER1” to “MARKER7” associated with the head position of the modified character area included in the image data are arranged in the first layer. “MARKER1” and “MARKER2” are associated with the leading positions of the two modifier character areas included in the first page, and “MARKER3” to “MARKER5” are the leading positions of the three modifier character areas included in the second page. “MARKER6” and “MARKER7” are respectively associated with the leading positions of the two modified character areas included in the third page.

  As described above, the MFP 3 according to the present embodiment has a correspondence table 193 including correspondence records in which index names and object attributes are associated with each other, and a plurality of types in which the object attributes are classified into at least one hierarchy. A pattern table 191 including patterns is stored in the HDD 116, and when any one of a plurality of types of patterns is selected as a target pattern, an object having an attribute included in the selected target pattern is extracted from the image data. Then, the extracted object is given an index name associated with the attribute of the object by the correspondence table, and the hierarchy in which the attribute of the extracted object is classified by the selected target pattern is acquired. Then, index information including the acquired hierarchy, the position of the object in the image data, and the assigned index name is generated and added to the image data. For this reason, when any one of a plurality of types of patterns included in the previously stored pattern table 191 is selected, index information is added to the image data. As a result, the rule for adding an index can be changed depending on the image data.

  Each of the plurality of types of patterns included in the pattern table 191 is associated with one of a plurality of areas of the HDD 116, and when the image data storage destination is received, the pattern associated with the received storage destination. Is selected as the target pattern. For this reason, simply by inputting an operation for designating a storage destination, a rule for adding an index is automatically selected.

  Further, when any of a plurality of types of patterns included in the pattern table 191 is selected by the user, index information is generated according to the selected pattern and added to the image data. Therefore, it is possible to determine a rule for adding an index with a simple operation of selecting a pattern.

<First Modification>
The MFP 3 in the first modification generates an index information pattern based on image data (hereinafter referred to as “reference data”) already stored in the image data storage destination. Therefore, the MFP 3 in the first modification need not store the pattern table 191.

  FIG. 11 is a functional block diagram showing an overview of the functions of the CPU provided in the MFP 3 in the first modification, together with information stored in the HDD. 3 differs from the functional block diagram shown in FIG. 3 in that the pattern table 191 is not stored in the HDD 116, the pattern selection unit 155 is deleted, the reference data acquisition unit 171, the index information extraction unit 173, and the target. The pattern generation unit 175 is added. Hereinafter, differences from the functional block diagram shown in FIG. 3 will be mainly described.

  Referring to FIG. 11, when the storage destination of the image data is received from the operation reception unit 151, the reference data acquisition unit 171 acquires the reference data already stored in the storage destination. When a plurality of pieces of image data are stored in the storage destination received from the operation receiving unit 151, one arbitrarily selected may be used as the reference data. Then, the reference data is read from the HDD 116 and output to the index information extraction unit 173.

  The index information extraction unit 173 extracts index information from the reference data acquired by the reference data acquisition unit 171. Then, the extracted index information is output to the target pattern generation unit 175.

  The target pattern generation unit 175 generates a target pattern that defines a hierarchy in which attributes associated with the index name and the correspondence table 193 are classified based on the hierarchy and the index name respectively included in the index information. Then, the target pattern generation unit 175 outputs the generated target pattern to the object extraction unit 157 and the index information generation unit 161. Specifically, first, the corresponding record including the index name arranged in the first hierarchy of the index information is extracted from the correspondence table 193, and the attribute included in the extracted corresponding record is arranged in the first hierarchy. If the index information includes the second hierarchy lower than the first hierarchy, the corresponding record including the index name arranged in the second hierarchy is extracted from the correspondence table 193, and the attribute included in the extracted corresponding record is the first attribute. Arranged in two layers. If the lower hierarchy is included in the index information, the corresponding record including the index name arranged in the hierarchy is extracted from the correspondence table 193, and the attribute included in the extracted corresponding record is arranged in the hierarchy.

  FIG. 12 is a first diagram illustrating an example of the target pattern. The target pattern shown in FIG. 12 is generated from the index information shown in FIG. FIG. 13 is a second diagram illustrating an example of the target pattern. The target pattern shown in FIG. 13 is generated from the index information shown in FIG.

  FIG. 14 is a flowchart illustrating an example of the flow of data conversion processing in the first modification. The difference from the data conversion process shown in FIG. 6 is that step S21 to step S23 are executed instead of step S06. Since other processes are the same as those shown in FIG. 6, the description will not be repeated here.

  In step S21, reference data is determined from the storage destinations. The storage destination is the storage destination accepted in step S02 when the process proceeds from step S03, and the storage destination determined in step S05 when the process proceeds from step S05.

  In the next step S22, index information is extracted from the reference data. Then, in the next step S23, a hierarchy in which attributes associated with the index name and the association table 193 are classified is defined based on the hierarchy and the index name respectively included in the index information extracted from the reference data in step S22. Generate the target pattern.

  As described above, the MFP 3 in the first modified example stores the correspondence table 193 including the correspondence record in which the index name and the attribute of the object are associated with each other, and is acquired when the reference data is acquired. All the index information included in the reference data is extracted, and the attribute associated with the index name and the correspondence table is classified based on the hierarchy and the index name respectively included in all the extracted index information Generate a target pattern that defines Then, an attribute object included in the generated target pattern is extracted from the image data, and an index name associated with the attribute of the object by the correspondence table 193 is given to the extracted object. The hierarchy classified by the target pattern for which the attribute is generated is acquired. Further, index information including the acquired hierarchy, the position of the object in the image data, and the assigned index name is generated and added to the image data. For this reason, since the target pattern is generated based on the reference data and the index information when the reference data is acquired, it is not necessary to store the pattern table 191 and the rule for assigning the index can be determined.

  Further, when the storage destination of the image data is received, data already stored in the received storage destination is acquired as reference data. Therefore, a rule for assigning an index is determined by a simple operation for specifying the storage destination. be able to.

  In addition, when an operation input by the user is received, data specified by the received operation is acquired as reference data. Therefore, a rule for assigning an index can be determined by a simple operation for specifying reference data. .

<Second Modification>
The MFP 3 in the second modified example generates an index information pattern and an index name based on image data (reference data) already stored in the image data storage destination. Therefore, the MFP 3 in the second modification need not store the pattern table 191 and the correspondence table 193 in the HDD 116.

  FIG. 15 is a functional block diagram showing an overview of the functions of the CPU provided in the MFP 3 in the second modified example. 11 differs from the functional block diagram shown in FIG. 11 in that the correspondence table 193 is not stored in the HDD 116, the target pattern generation unit 175A is changed, an attribute determination unit 181 and a correspondence table generation unit 183 are added. Is a point. Hereinafter, differences from the functional block diagram shown in FIG. 11 will be mainly described.

  Referring to FIG. 15, index information extraction unit 173 outputs the index information extracted from the reference data acquired by reference data acquisition unit 171 to target pattern generation unit 175A, attribute determination unit 181 and correspondence table generation unit 183. The reference data is output to the attribute determination unit 181.

  The attribute determination unit 181 analyzes the reference data based on the index information and determines the attribute for each object. Then, the attribute determining unit 181 outputs the index name and the determined attribute to the correspondence table generating unit 183. Specifically, the attribute of the area starting from the position in the reference data associated with the index name arranged in the first hierarchy of the index information is determined. A known technique may be used to determine the attribute. If the area starting from the position in the reference data is an area where a photograph is represented or an area where a figure is represented, the attribute of the object is judged as "image", and if it is an area where a modified character is represented, the object Is determined as a “qualified character area”. Next, if the index information includes the second hierarchy lower than the first hierarchy, the attribute of the area starting from the position in the reference data associated with the index name arranged in the second hierarchy is determined. If a lower hierarchy is included in the index information, the attribute of the area starting from the position in the reference data associated with the index name arranged in that hierarchy is determined.

  The correspondence table generation unit 183 generates a correspondence table including a correspondence record including a pair of an index name and an attribute input from the attribute determination unit 181, and temporarily stores the generated correspondence table in the RAM 112. Thereby, a correspondence table similar to the correspondence table shown in FIG. 5 is generated. The correspondence table generation unit 183 outputs the generated correspondence table to the target pattern generation unit 175A and the index assignment unit 159.

  The target pattern generation unit 175A defines a hierarchy in which attributes associated with the index name and the association table input from the correspondence table generation unit 183 are classified based on the hierarchy and the index name respectively included in the index information. Is generated. Then, the target pattern generation unit 175A outputs the generated target pattern to the object extraction unit 157 and the index information generation unit 161. Specifically, first, a corresponding record including the index name arranged in the first layer of the index information is extracted from the correspondence table input from the correspondence table generating unit 183, and the attribute included in the extracted corresponding record is the first attribute. Arrange in one layer. If the index information includes the second hierarchy lower than the first hierarchy, the correspondence record including the index name arranged in the second hierarchy is extracted from the correspondence table input from the correspondence table generation unit 183 and extracted. The attributes included in the corresponding record are arranged in the second hierarchy. If the lower hierarchy is included in the index information, the corresponding record including the index name arranged in that hierarchy is extracted from the corresponding table input from the corresponding table generation unit 183 and included in the extracted corresponding record. Place attributes in that hierarchy.

  FIG. 16 is a flowchart illustrating an example of a data conversion process according to the second modification. The difference from the data conversion process shown in FIG. 14 is that step S31 to step S33 are added after step S22, and step S23A is changed. Since other processes are the same as those shown in FIG. 14, the description thereof will not be repeated here.

  When the index information is extracted from the reference data in step S22, one of the index names included in the index information is set as a processing target in the next step S31. Then, the attribute of the region starting from the position in the reference data specified by the position information associated with the index name to be processed is determined.

  In the next step S <b> 32, a correspondence record composed of a combination of the index name for processing and the determined attribute is added to the correspondence table stored in the RAM 112. If the correspondence table is not stored in the RAM 112, the correspondence table including one generated correspondence record is stored in the RAM 112. Further, when a corresponding record having the same index name is already stored, the corresponding record is not added to the corresponding table. Here, the same index name means that the fronts except the rear serial number match. This is because the corresponding record has a unique index name.

  Then, it is determined whether or not an unprocessed index name is included in the index information (step S33). An unprocessed index name excludes index names that have the same prefix. This is because the attributes are the same if the front of the index name matches. If an unprocessed index name is included in the index information, the index name is set as a processing target, and the process returns to step S31. If there is no unprocessed index name, the process proceeds to step S23A.

  In step S23A, a hierarchy in which the attribute name associated with the index name and the correspondence table generated in step S32 is classified based on the hierarchy and index name respectively included in the index information extracted from the reference data in step S22. Generate the target pattern to be defined.

  As described above, when the reference data is acquired, the MFP 3 in the second modification example extracts all index information included in the acquired reference data, and positions included in all the extracted index information. The attribute of the object contained in the reference data specified by the information is discriminated, and a correspondence table that associates the discriminated attribute with all the index names respectively contained in all the extracted index information is generated. Then, based on the hierarchies and index names respectively included in all the extracted index information, a target pattern that defines a hierarchy into which attributes associated with the index names and correspondence tables are classified is generated. Furthermore, an object having an attribute included in the generated target pattern is extracted from the image data, an index name associated with the attribute of the object by the correspondence table is given to the extracted object, and the attribute of the extracted object is The hierarchy classified by the generated target pattern is acquired. Therefore, since the correspondence table and the target pattern are generated when the reference data is acquired, it is not necessary to store the pattern table 191 and the correspondence table 193, and the rule for assigning the index can be determined.

  Further, when the storage destination of the image data is received, data already stored in the received storage destination is acquired as reference data. Therefore, a rule for assigning an index is determined by a simple operation for specifying the storage destination. be able to.

  In addition, when an operation input by the user is received, data specified by the received operation is acquired as reference data. Therefore, a rule for assigning an index can be determined by a simple operation for specifying reference data. .

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

<Appendix>
(1) It further comprises reading means for reading a document image and outputting image data,
The image data acquisition unit further includes a communication unit that acquires image data output by the reading unit and that communicates with an external device according to claim 1,
The image processing apparatus according to claim 1, wherein the image data acquisition unit acquires image data received from outside by the communication unit.

It is a figure showing the whole data conversion system outline in one of the embodiments of the invention. 2 is a block diagram illustrating an example of a hardware configuration of an MFP. FIG. 3 is a functional block diagram illustrating an example of a function of a CPU provided in the MFP together with information stored in an HDD. FIG. It is a figure which shows an example of a pattern table. It is a figure which shows an example of a correspondence table. It is a flowchart which shows an example of the flow of a data conversion process. FIG. 3 is a first diagram illustrating an example of a document image. It is a 1st figure which shows an example of index information. FIG. 6 is a second diagram illustrating an example of a document image. It is a 2nd figure which shows an example of index information. FIG. 10 is a functional block diagram showing an overview of functions of a CPU provided in an MFP according to a first modification, together with information stored in an HDD. It is a 1st figure which shows an example of an object pattern. It is a 2nd figure which shows an example of an object pattern. It is a flowchart which shows an example of the flow of the data conversion process in a 1st modification. FIG. 10 is a functional block diagram illustrating an overview of functions of a CPU provided in an MFP according to a second modification. It is a flowchart which shows an example of the flow of the data conversion process in a 2nd modification.

Explanation of symbols

  1 data conversion system, 1 pattern, 2 networks, 3 and 4 MFP, 10 ADF, 20 image reading unit, 30 image forming unit, 40 paper feeding unit, 50 facsimile unit, 101 main circuit, 111 CPU, 112 RAM, 113 EEPROM , 114 display unit, 115 operation unit, 116 HDD, 117 data communication control unit, 119A memory card, 151 operation reception unit, 153 image data acquisition unit, 155 pattern selection unit, 157 object extraction unit, 159 indexing unit, 161 index Information generation unit, 163 Data conversion unit, 165 Index information addition unit, 171 Reference data acquisition unit, 173 Index information extraction unit, 175, 175A Target pattern generation unit, 181 attribute determination unit, 183 correspondence table generation unit, 91 pattern table 193 corresponding table 300 server.

Claims (10)

Image data acquisition means for acquiring image data;
An object extraction means for extracting an object from the image data;
Indexing means for giving an index name pre-associated with the extracted object to the extracted object;
Generating index information including a hierarchy in which attributes of the extracted object are classified in advance in at least one hierarchy, a position in the image data of the extracted object, and the assigned index name Index information generating means for
An image processing apparatus comprising: index information adding means for adding the generated index information to the image data. Correspondence table storage means for storing a correspondence table including at least one correspondence record in which an index name and an attribute of an object are associated;
Pattern storage means for storing a plurality of types of patterns in which each attribute of at least one object is classified into one of at least one hierarchy;
Selecting means for selecting any one of the plurality of types of stored patterns as a target pattern; and
The object extraction means extracts an object having an attribute included in the selected target pattern from the image data,
The index assigning means assigns an index name associated with the attribute of the object and the correspondence table to the extracted object,
The image processing apparatus according to claim 1, wherein the index information generation unit acquires a hierarchy classified by the target pattern from which the attribute of the extracted object is selected. A storage location receiving means for receiving the storage location of the acquired image data;
The plurality of types of patterns are associated with one of a plurality of storage destinations,
The image processing apparatus according to claim 2, wherein the selection unit selects, as the target pattern, a pattern associated with the accepted storage destination among the plurality of types of patterns. An operation receiving means for receiving an operation input by the user;
The image processing apparatus according to claim 2, wherein the selection unit selects a pattern specified by an operation received by the operation reception unit from the plurality of types of patterns. Correspondence table storage means for storing a correspondence table including at least one correspondence record in which an index name and an attribute of an object are associated;
Reference data acquisition means for acquiring reference data;
Index information extracting means for extracting all index information included in the acquired reference data;
A target pattern generating means for generating a target pattern that defines a hierarchy in which attributes associated with the index name and the correspondence table are classified based on a hierarchy and an index name respectively included in all the extracted index information; Further comprising
The object extraction means extracts an attribute object included in the generated target pattern from the image data,
The index assigning means assigns an index name associated with the attribute of the object by the correspondence table to the extracted object,
The image processing apparatus according to claim 1, wherein the index information generation unit acquires a hierarchy in which the extracted attribute of the object is classified according to the generated target pattern. Reference data acquisition means for acquiring reference data;
Index information extracting means for extracting all index information included in the acquired reference data;
Attribute discrimination means for discriminating attributes of all objects specified by position information respectively included in all the extracted index information;
Correspondence table generating means for generating a correspondence table for associating the determined attributes with all index names respectively included in all the extracted index information;
A target pattern generating unit configured to generate a target pattern that defines a hierarchy in which attributes associated with the index name and the correspondence table are classified based on a hierarchy and an index name respectively included in all the extracted index information; Further comprising
The object extraction means extracts an object having an attribute included in the generated target pattern from the image data,
The index assigning means assigns an index name associated with the attribute of the object by the correspondence table to the extracted object,
The image processing apparatus according to claim 1, wherein the index information generation unit acquires a hierarchy in which the extracted attribute of the object is classified by the generated target pattern. A storage location receiving means for receiving the storage location of the acquired image data;
The image processing apparatus according to claim 5, wherein the reference data acquisition unit acquires data already stored in the accepted storage destination as the reference data. An operation receiving means for receiving an operation input by the user;
The image processing apparatus according to claim 5, wherein the reference data acquisition unit acquires data specified by the operation received by the operation reception unit as the reference data. Obtaining image data; and
Extracting an object from the image data;
Giving the extracted object an index name pre-associated with the attribute of the object;
Generating index information including a hierarchy in which attributes of the extracted object are classified in advance in at least one hierarchy, a position in the image data of the extracted object, and the assigned index name And steps to
Adding the generated index information to the image data. Obtaining image data; and
Extracting an object from the image data;
Giving the extracted object an index name pre-associated with the attribute of the object;
Generating index information including a hierarchy in which attributes of the extracted object are classified in advance in at least one hierarchy, a position in the image data of the extracted object, and the assigned index name And steps to
An image processing program for causing a computer to execute the step of adding the generated index information to the image data.

Images