JP4752758B2 - Image processing apparatus, image processing system, image processing program, and image processing method - Google Patents

Description

  The present invention relates to an improvement in an image processing apparatus, an image processing system, an image processing program, and an image processing method in which a job for processing image data is executed.

  2. Description of the Related Art In recent years, as an image processing apparatus that executes a job for processing image data, for example, a multi-function machine that integrates a scan function, a copy function, a print function, a FAX function, and the like is widely known. Such an image processing apparatus can execute a job such as reading of image data, print output, FAX transmission, and the like, and the risk of information leakage such as output of a copy-prohibited document is increased with the spread of the job. It is coming. For this reason, it is required that the image processing apparatus be provided with a function capable of tracking the output history when such information leakage occurs.

  For this purpose, the execution history of the job that processed the image data is stored and accumulated as log information so that it is possible to check who, when and where the information leaked document was output. An image processing apparatus has been proposed (see, for example, Patent Documents 1 and 2). The log information includes a method for storing and storing image information corresponding to the image itself (see, for example, Patent Document 1), and a method for extracting and storing text data included in an image (for example, see Patent Document 2). Proposed.

Japanese Patent Laid-Open No. 06-270477 (Example, FIG. 3) Japanese Patent Laying-Open No. 2005-1557569 (first embodiment, FIG. 4)

  The technical problem of the present invention is to generate log information with different storage capacities by determining the type of processed image data in a job that processes image data, and to reduce the overall storage capacity that is stored and accumulated as log information And providing an image processing apparatus, an image processing system, an image processing program, and an image processing method that enable tracking investigation.

That is, the invention according to claim 1 is an image processing apparatus having job execution means capable of executing image data image formation processing and a control device for controlling the job execution means, wherein the control apparatus is configured to execute the job execution. includes a log information generating means for generating an execution history information of a job executed by the means as log information, and log information storage means for storing accumulated the generated log information in the log information generating unit, wherein the log information generation means, and the image data type determining means for determining whether the original image data that is processed by the job execution means corresponds to the type determination condition of predefined image data, processed by the job execution means per to generate a stored image data to be stored in the original corresponding to the image data and a predetermined storage means is, determine the image data type discriminating means Based on the results, storage image which image data of the treated original is to reduce the data amount of image data for saving as compared with the case where it is determined that the applicable if it is determined not to correspond to the type determination condition a data generating means, either or both of the original image data that is processed by the job execution means underlying the generated storage image data and the image data for the saved was at the storage image data generating means Search information generating means for generating search information for searching for a corresponding job from one side, specific information generating means for generating specific information for specifying a job executed by the job execution means, and the storage image An image processing apparatus comprising association means for associating data, the search information, and the specific information with each other.

According to a second aspect of the present invention, in the image processing apparatus according to the first aspect, the type determination condition of the image data type determination unit is at least one of a character string, an image, and a form for image data. This is an image processing apparatus set under the conditions belonging to.
Invention is an image processing apparatus according to claim 1, wherein the search information generating means, type determination condition original image data that is processed by the job execution means in said image data type determining means according to claim 3 When it is determined that it does not correspond to this, the image processing apparatus generates search information with a smaller number of data than when it is determined that it corresponds.
According to a fourth aspect of the present invention, in the image processing apparatus according to the first aspect, further comprising an image reading unit that reads an original image, image data that is a search target read from the original by the image reading unit is further included. On the other hand, the image data type discriminating means discriminates the image data type discriminating condition, and the saving image data generating means and the search information generating means generate the saving image data and search information, By searching log information having the same search information as the search information from the log information stored and accumulated in the log information storage means based on the search information , it matches the image data for storage of the image data to be searched The image processing apparatus includes search processing means for specifying a job corresponding to log information including image data to be stored .

According to a fifth aspect of the present invention, there is provided an image processing apparatus having job execution means capable of executing image data image forming processing and a control device for controlling the job execution means, and connected to the image processing apparatus by communication means. An image processing system capable of storing and accumulating job execution history information processed by the image processing device as log information, wherein at least one of the image processing device and the server device. One of the log information generating means for generating, as log information, the execution history information of the job executed by the job executing means, and the log information storing means for storing and storing the log information generated by the log information generating means wherein the log information generating unit, the image data in which the original image data that is processed by the job execution means is predefined An image data type determining means for determining whether or not to correspond to the different evaluation criteria, the job execution means corresponding to the original image data processed by and predetermined storage image data to be stored in the storage means is Is generated based on the determination result of the image data type determination means, when it is determined that the processed original image data does not correspond to the type determination condition, as compared to the case where it is determined that it corresponds. A storage image data generation unit that reduces the data amount of the storage image data, a storage image data generated by the storage image data generation unit, and the job execution unit that is the basis of the storage image data and search information generating means for generating search information for searching both or corresponding job from either of the original image data that is processed, the job execution An image processing system comprising: specification information generation means for generating specification information for specifying a job executed by a stage; and association means for associating the storage image data, the search information, and the specification information with each other .

According to a sixth aspect of the present invention, in the image processing system according to the fifth aspect, the image processing apparatus includes an image reading unit that reads a document image. Further, at least one of the image processing apparatus and the server apparatus includes: For the image data to be retrieved read from the document by the image reading means , the image data type determining means determines the image data type determining condition, and the storage image data generating means and the search information generating The storage image data and the search information are generated by the means, and the log information having the same search information as the search information is searched from the log information stored and accumulated in the log information storage means based on the generated search information. it is, job corresponding to the log information including the storage image data that matches the stored image data of the image data to be retrieved An image processing system comprising a retrieval processing means for identifying.

According to a seventh aspect of the present invention, there is provided an image processing program capable of storing and accumulating execution history information of a job for processing image data as log information, job execution means capable of executing image data image formation processing, and job execution A computer in an image processing apparatus having a control device for controlling the means, or a computer connected to the image processing apparatus by communication means, and generating log information of job execution history information executed by the job execution means a log information generating means for, this log information generated by the log information generating unit to function and a log information storage means for storing accumulated the log information generating unit, the original of the Ru is processed by the job execution means an image data type determining means for determining whether the image data corresponds to the type determination condition of predefined image data, the job Per To generate a stored image data to be stored in corresponding to the original image data processed by the execution means and a predetermined storage means, based on the discrimination result of the image data type determining means is said processing When the original image data is determined not to satisfy the type determination condition, the storage image data generating means for reducing the data amount of the storage image data compared to the case where the original image data is determined to be applicable, and the storage Search for both or corresponding job from either of the original image data that is processed by the job execution means underlying the generated storage image data and the image data for the saved was by the image data generating means Search information generating means for generating search information for generating a specific information for generating specific information for specifying a job executed by the job executing means. Means, the storage image data, which is the retrieval information and the image processing program to function as an association means for associating the identification information with each other.

According to an eighth aspect of the present invention, there is provided an image processing method capable of storing and storing execution history information of a job for processing image data as log information, a job execution step for executing image formation processing of the image data, and a job execution step A log information generation step for generating the execution history information of the job processed in step 1 as log information, and a log information storage step for storing and accumulating the log information generated in the log information generation step. generating step, the image data type determining step of determining whether the original image data that is processed by the job execution step corresponds to the type determination condition of predefined image data, in said job execution step per to generate a stored image data to be stored in and a predetermined storage unit corresponding to the image data of the processed original, the Based on the determination result of the image data type determination step, when it is determined that the processed original image data does not correspond to the type determination condition, the data of the storage image data is compared with the case where it is determined that it corresponds a storage image data generating step to reduce the amount, the storage image data generating the original that will be processed by the job execution step image to be generated based on the stored image data and the image data for the stored at step A search information generation step for generating search information for searching for a corresponding job from both or either of the data , and specific information for generating specific information for specifying the job executed in the job execution step A generating step and an associating step associating the storage image data, the search information and the specific information with each other. The image processing method.

According to the first aspect of the present invention, it is possible to easily store and accumulate the execution history of a job whose image data has been processed, to appropriately prevent information leakage, and to leak information on a document. In addition to improving the convenience for the user, the amount of data to be saved can be varied according to the processed image data, and the log information capacity can be reduced. In addition, searchability for important image data is ensured.
According to the second aspect of the present invention, it is possible to perform more detailed classification for image data.
According to the third aspect of the invention, more accurate information is obtained as search information for searching for executed jobs, and a more accurate follow-up survey is possible.
According to the invention which concerns on Claim 4 , the search process at the time of tracking investigation can be performed with the said image processing apparatus .

According to the fifth aspect of the present invention, it is possible to construct an image processing system that uses the image processing apparatus and the server apparatus and that can obtain the same effect as the first aspect of the present invention.
According to the invention which concerns on Claim 6 , it becomes easy to perform the search process at the time of tracking investigation.
According to the invention concerning Claim 7 , the image processing program used for the image processing apparatus of the invention concerning Claim 1 is realizable .
According to the eighth aspect of the invention, the image processing method used in the image processing apparatus of the first aspect can be realized.

First, an outline of an embodiment model to which the present invention is applied will be described.
Outline of Embodiment Model FIG. 1 is a block diagram showing an outline of an image processing apparatus according to an embodiment model embodying the present invention.
In the figure, one of representative models of an image processing apparatus is an image processing apparatus having a job execution means 1 capable of executing image data image formation processing and a control device for controlling the job execution means 1. The control device includes a log information generation unit 2 that generates, as log information, execution history information of a job executed by the job execution unit 1, and a log that stores and accumulates the log information generated by the log information generation unit 2 and an information storage means 8, wherein the log information generation means 2 determines whether the original image data is Ru processed by the job execution means 1 corresponds to the type determination condition of predefined image data an image data type determining means 3, to generate a storage image data to be stored in and a predetermined storage unit corresponding to the image data of the processed original by said job execution means 1 If the original image data processed is determined not to satisfy the type determination condition based on the determination result of the image data type determination means 3, the storage data is stored as compared with the case where it is determined to be applicable. the storage image data generating means 4 for reducing the data amount of image data to said job execution means 1 made in the original storage image data and the image data for the stored generated by the storage image data generating means 4 Te and search information generating means 5 for generating search information for searching both or corresponding job from either of the original image data that will be processed, to identify the job executed by the job execution means 1 Specific information generating means 6 for generating the specific information, and association means 7 for associating the storage image data, the search information and the specific information with each other. It is.
Here, the job means a processing operation executed by the image processing apparatus, and the log means a history of information regarding the processing operation.

The job execution unit 1 of the model of the present embodiment may be provided with, for example, an image reading unit that reads an original image from an image processing apparatus, and processes data read from the original by the image reading unit as image data. Alternatively, the image data provided from outside the image processing apparatus may be processed.
The job execution means 1 is capable of at least image data image forming processing. Examples of jobs to be executed include image reading jobs, copy output jobs, print output jobs, FAX transmission jobs, and the like. Any device that has a function of image forming data and can handle image data in the image processing apparatus may be used.

  The job execution unit 1, the image data type determination unit 3, the storage image data generation unit 4, the search information generation unit 5, the specific information generation unit 6, the association unit 7 and the log information storage unit 8 are included in the same image processing apparatus. It may be provided, may be provided distributed among a plurality of image processing apparatuses, and may be provided redundantly on a plurality of image processing apparatuses. From the viewpoint of generating log information, log information generation means 2, that is, image data type determination means 3, storage image data generation means 4, search information generation means 5, specific information generation means 6 and association means 7 Are preferably provided together in one image processing apparatus.

  The search information generation means 5 may generate search information based on the storage image data generated by the storage image data generation means 4, or the storage image data and the source thereof. Search information may be generated from both of the image data. Further, the search information may be generated only from the original image data.

Hereinafter, the present invention will be described in more detail based on embodiments shown in the accompanying drawings.
Embodiment 1
FIG. 2 shows a schematic configuration of an image processing apparatus according to an embodiment to which the present invention is applied. The image processing apparatus 10 according to the present embodiment is a so-called multi-function machine provided with a scan function (image reading function), a copy function, a print function, and a FAX function.
In the figure, an image processing apparatus 10 has an image forming unit 11 for forming an image on a recording material at the center, and a plurality of recordings for supplying a recording material on which an image is formed by the image forming unit 11 below the image forming unit 11. A material supply member 12 (four 12a to 12d in this example) is provided, and an image reading unit 14 serving as an image reading unit for reading a document image is provided on the upper portion, and an image reading unit 14 is provided above the image reading unit 14. An automatic document feeder 15 for feeding a document to the image reading position on the platen glass is provided. A storage member between the image reading unit 14 and the image forming unit 11 is a storage member that discharges and stores the recording material on which the image is formed on the recording material supplied from the recording material supply member 12. 13 is formed. An operation unit 16 is provided in a part of the image reading unit 14 so that various processes can be manually operated. Note that reference numeral 20 in the figure is a control device that controls various processes in the image processing apparatus 10.

  As described above, the image processing apparatus 10 according to the present embodiment has an execution function for executing a job for any image data of an image reading job, a copy output job, a print output job, and a FAX transmission job. ing. The “image data” here is data for specifying an image processed by a job, and the data format and the like are not particularly limited.

Here, “log information” will be briefly described. The log information corresponds to information representing the contents of a job executed by the image processing apparatus 10, and information for specifying image data processed by the executed job, for searching for the corresponding job. It consists of search information and specific information for specifying the executed job.
Here, as the information for “specifying image data”, for example, processed image data itself may be used. In this case, the image data may be processed by the job itself, or may be data after undergoing a data amount reduction process such as data compression. Furthermore, instead of the image data itself, for example, information related to the storage location of the image data (location location name, file name, URL (Uniform Resource Locator) information, etc.) is used to “specify image data”. Also good.

Search information for “searching for a corresponding job” includes text information obtained by performing OCR (Optical Character Recognition) processing on image data, image feature amounts extracted from the image data, and the like. Furthermore, when code information for identifying the original image is embedded in the original image to be processed in the job by a barcode, a QR code (two-dimensional code), digital watermarking, or the like. The code information may be included in the log information, or the code information may be used as one piece of search information for “searching for a corresponding job”.
Specific information for “specifying an executed job” includes information about a job attribute such as a job requester (user) and a process execution date and time (hereinafter referred to as “job attribute information”). The job attribute information may be acquired by using a known method such as UI setting recognition or card authentication at the time of job execution.
Such log information is generated for each image processed by the executed job, that is, for each page of the image data (this can be generated for each job. Let's say every image. Then, as will be described later, the generated log information is used for a specific execution history tracking survey or the like.

<Control system>
Next, a control system that generates log information in the image processing apparatus 10 will be described.
FIG. 3 shows an outline of a functional block diagram of the image processing apparatus 10 according to the present embodiment. A control apparatus 20 that controls various processes in the image processing apparatus 10 and an input side of the control apparatus 20 are illustrated. The image reading unit 14 having a document scanning function (scanner function) provided and an image forming unit 11 provided on the output side are configured. In the present embodiment, the image data transmitted to the control device 20 includes a mode of data read by the image reading unit 14 and image data transmitted from an external device (not shown) (for example, the image processing device 10). There is a mode of external data when working as a printer function. Furthermore, in the present embodiment, various settings are performed from the operation unit 16 provided in the image reading unit 14.

The control device 20 is constituted by a computer system such as a CPU, a ROM, a RAM, various interfaces, and the like, and is operated by a predetermined program, and performs various image forming controls in the image processing device 10, In particular, the present embodiment has a function of controlling various processes for image data.
That is, a job execution unit 21 that processes image data, a log information generation unit 22 that generates, as log information, execution history information of a job executed by the job execution unit 21, and log information that stores and accumulates the generated log information The storage unit 28 is configured to include at least a search processing unit 29 that calculates a matching degree from log information stored and accumulated in the log information storage unit 28 based on a search source document and identifies a corresponding job. Then, the log information generation unit 22 includes an image data type determination unit 23 that determines whether the image data processed by the job execution unit 21 satisfies a predetermined image data type determination condition, and the image data type determination unit 23. A storage image data generation unit 24 that generates different storage image data from the image data processed by the job execution unit 21 based on the determination result of the data type determination unit 23, and the storage image data generation unit 24. A search information generation unit 25 for generating search information for searching for a corresponding job from the image data for storage generated in step S3 and the image data processed by the job execution unit 21 as a source, and a job execution unit 21 includes a specific information generating unit 26 that generates specific information for specifying the job executed in 21 and an associating unit 27 for associating these pieces of information. In the present embodiment, the configuration in which the log information generation unit 22, the log information storage unit 28, and the search processing unit 29 are provided in one image processing apparatus 10 is shown. However, the present invention is not limited to this, and the search processing unit 29 is provided. It is possible to prepare for other devices (for example, other image processing devices, server devices, etc.), and to perform a tracking survey from a specific search source document with other devices. In this case, it goes without saying that the data in the log information storage unit 28 is used.

The image data type discriminating unit 23 of the present embodiment discriminates whether or not the image data processed by the job executing unit 21 meets the predetermined image data type discriminating condition. For example, it has a function of discriminating whether or not the processed image data is a document in which it is difficult to leak information.
Here, as the type determination condition, for example, it is only necessary to set a condition for specifying a document in which information is leaked from the operation unit 16 or the like, and examples include the following. For example, you can set “confidential”, “address”, “phone number”, etc. in the text string, “company logo mark”, “company seal”, “shadow image of approval stamp”, etc. Furthermore, a “specific document form” or the like is set as the document form. As the type determination condition, any one of the above-described character string, image, and document form may be set, or any combination thereof, for example, having “company logo mark” as an image, It is also possible to set a document having “confidential” as a character string as a document in which information leakage is a problem.

Then, the image data type determination unit 23 determines whether or not the image data processed by the job execution unit 21 should not be leaked based on such a type determination condition. For example, if “confidential” is set in the character string as the type determination condition, “confidential” is included in the character string obtained by performing OCR processing or the like on the image data processed by the job execution unit 21. Whether or not is included. On the other hand, if the “company logo mark” as the image is set as the type determination condition, it may be determined by the image recognition method whether the image data includes the “company logo mark”. Furthermore, if a “specific document form” as a document form is set as a type determination condition, it may be determined by form recognition whether the image is a “specific document form” image. Needless to say, a known technique may be used for image recognition and form recognition.
In the present embodiment, the aspect in which the image processing apparatus 10 has a function for setting the type determination condition is shown. However, the present invention is not limited to this. For example, the function for setting the type determination condition is not the image processing apparatus 10, You may make it come from the other medium connected with a communication means.

Then, the storage image data generation unit 24 in the present embodiment generates different storage image data from the image data processed by the job execution unit 21 based on the determination result of the image data type determination unit 23. The image data type discriminating unit 23 generates different image data for storage depending on whether the image data type discriminating unit 23 determines that the type discriminating condition is met or not.
In the present embodiment, particularly from the viewpoint of reducing the data capacity of the storage image data, in the storage image data generation unit 24, the image data type determination unit 23 receives the image data processed by the job execution unit 21. When it is determined that the type determination condition is not met, the storage image data having a smaller data amount than that determined when the type determination condition is met is generated. Here, the method for reducing the data amount is not particularly limited, and the storage image may be a low resolution image or a high compression rate image, for example. For example, image data that is difficult to be leaked is set to a resolution of 600 dpi, and image data that is not so is generated to a resolution of 100 dpi, or image data that is not required to be leaked is compressed with low compression. Processing may be performed, and image data for storage may be generated by performing high-compression compression processing on image data that is not.

Further, the search information generation unit 25 searches for a corresponding job from the storage image data generated by the storage image data generation unit 24 and the image data processed by the job execution unit 21 that is the source thereof. The search information has a function of generating search information. In this example, the search information is an image feature amount calculated from the storage image data, and the image data that is the source of the storage image data, that is, a job This is text information obtained by OCR processing of the image data processed by the execution unit 21. Further, from the viewpoint of reducing the data capacity of the search information, the search information generation unit 25 determines that the image data processed by the job execution unit 21 does not meet the type determination condition by the image data type determination unit 23. In such a case, it is only necessary to generate search information with a smaller number of data than when it is determined to be applicable.
For example, in the case of image data where it is difficult to leak information, all of the image feature amount and text information obtained by OCR processing are used as search information, and image feature amount and OCR processing are obtained for other image data. A part of the text information (for example, only frequently used text information) is generated as search information.

Here, the “image feature amount” refers to a quantitative representation of the feature of the image, for example, a density distribution in the image, an abundance and distribution of edges, a histogram of each color value distribution, Some of the pixel distributions in the image are represented by run lengths, and these may be used in combination.
FIG. 4 shows an example of normalizing the image data size and the like and dividing the mesh (for example, 16 divisions in this example) as an example of the image feature amount, and calculating each feature amount in each divided mesh. In this case, for example, if the average density is used as the feature quantity in the mesh, a 16-dimensional density distribution feature quantity can be obtained as the image data. On the other hand, if the number of edge points is used as the feature quantity in the mesh, a 16-dimensional shade change feature quantity can be obtained.
The “image feature amount” is not limited to the above-described one, and other known techniques may be used.

Further, the specific information generation unit 26 in the present embodiment has a function of generating specific information for specifying a job executed by the job execution unit 21, that is, job attribute information. 16 and job attribute information such as processing date and time is generated.
Further, the associating unit 27 has a function of associating these pieces of information for each job and generating them as log information.
Furthermore, the log information storage unit 28 has a function of storing and accumulating log information generated by the association unit 27.

  The job execution unit 21, the log information generation unit 22, the log information storage unit 28, and the search processing unit 29 can be realized by executing a predetermined program in the control device 20 in the image processing apparatus 10. It is like that. At that time, prior to installation in the image processing apparatus 10, the program may be provided by being stored in a computer-readable storage medium, or provided via a wired or wireless communication medium. It may be a thing.

Next, an image processing method in the present embodiment will be described.
<Log information generation processing>
FIG. 5 is a flowchart showing a log information generation process according to this embodiment, and shows an operation flow when the image processing apparatus 10 performs a copy job, for example.
In the figure, when a copy job starts, first, image data obtained by scanning a document using an image reading unit 14 including an image reading sensor such as a CCD sensor of the image processing apparatus 10, and an image attached to the image reading unit 14. Job attribute information such as processing date and time or operator (user) is acquired by the specific information generation unit 26 of the log information generation unit 22 via the job execution unit 21 from an input from the operation unit 16 or a built-in timer, for example. (Step S001). When acquiring such image data and job attribute information in a print job, for example, a print unit (image data) from the client terminal is received by a communication unit (not shown) of the image processing apparatus 10. What is necessary is just to acquire image data and job attribute information. When performing a FAX transmission job, the image reading unit 14 may process a document image to acquire image data.
Furthermore, the acquisition of the operator information is not limited to the input from the operation unit 16, and for example, an information reader that reads an ID card for each person may be connected to the image processing apparatus 10 and acquired from this. That is, there is no problem if there is a mechanism capable of acquiring the operator information.

  Next, the image data type discriminating unit 23 of the log information generating unit 22 discriminates whether or not a predetermined type discriminating condition, for example, “shadow image of approval mark”, is included in the image data by an image recognition method. If it is determined that the image data is included, the image data corresponds to the document condition that is difficult to be leaked, and the document that is troublesome to be leaked is processed image data. If it is determined that there is no such document, it is determined that the image data is not image data that is difficult to be leaked (step S002).

When the image data type discriminating unit 23 discriminates that the type discriminating condition is satisfied, the saving image data generating unit 24 generates image data for storage that has been subjected to high resolution or low compression processing, and log information Information that can be stored in a storage device other than the storage unit 28 and that can specify the image data for storage (for example, the storage location and file name of the image data for storage) is generated and transferred to the association unit 27 (step S003). In this example, a method of storing the image data for storage in another storage device connected to the inside or outside of the image processing apparatus 10 other than the log information storage unit 28 has been described. The storage unit 28 may be used together.
In particular, in recent years, processing is performed by increasing the resolution of an image input unit (for example, equivalent to the image reading unit 14 in this example) and an image forming unit (for example, equivalent to the image forming unit 11 in this example) in an image processing apparatus. In many cases, the image data has a resolution of 600 dpi or more. If the image data is stored as it is, the storage capacity required for the storage becomes large and the capacity tends to be insufficient. For this reason, in the present embodiment, the high resolution processing in the storage image data generation unit 24 is performed, for example, by performing conversion processing to about 300 dpi lower than 600 dpi or low compression processing to reduce the storage capacity. Yes.

If it is determined in step S002 that the type determination condition is satisfied, the search information generation unit 25 calculates, for example, an image feature amount as shown in FIG. Information (for example, storage location and file name) that can specify the image feature amount is generated and transferred to the associating unit 27 (step S004). Note that the log information storage unit 28 may be used in combination with this storage device.
Further, the search information generation unit 25 performs OCR processing on the processed image data, extracts text information included in the image data, and transfers it to the association unit 27 (step S005).

  On the other hand, if it is determined in step S002 that the type determination condition is not met, that is, if it is determined that a document that is not in need of information leakage has been processed, the storage image data generation unit 24 performs processing. The image data that has been subjected to the low resolution or high compression processing is generated as the storage image data from the processed image data, and is stored in a storage device other than the log information storage unit 28 and information that can specify the storage image data (for example, storage location and File name etc.) is generated and transferred to the associating unit 27 (step S006). Note that the image data for storage may be stored in the log information storage unit 28 together.

  Further, in the search information generation unit 25, as in steps S 004 and S 005, information that calculates the image feature amount from the storage image data, saves it in a storage device other than the log information storage unit 28, and identifies this image feature amount (For example, storage location and file name) are generated and transferred to the associating unit 27 (step S007). Note that the log information storage unit 28 may be used in combination with this storage device. Further, the search information generation unit 25 performs OCR processing on the processed image data to extract text information included in the image data, and reduces the text information in order to reduce the capacity of the extracted text information. (Steps S008 and S009). In this reduction process, for example, the text information is reduced by performing a process such as limiting the appearance frequency to the top few.

  Then, the associating unit 27 associates these with each other from the above-described job attribute information, information that can specify the image data for storage, information that can specify the image feature amount, and text information search information, and generates one log information ( In step S010), the generated log information is stored and accumulated in the log information storage unit 28.

<Log information>
Here, a specific example of creating log information will be described.
FIG. 6A shows a case where the data capacity of the generated log information is reduced as in the present embodiment, and image data processed to date / time mm / mm / mm according to an instruction from the user AAAA. Log information (first log information) regarding a job related to the job, log information (second log information) regarding a job related to image data processed at the date and time nn / nn / nn according to an instruction from the user BBBB, The log information (third log information) about the job related to the image data processed on the date 11 / ll / ll according to the instruction is stored and accumulated.

Here, it is assumed that the job is executed by preliminarily defining whether the character string of the image data includes “confidential” as a type determination condition.
When the job execution unit 21 executes the first job (job by the user AAAA), the log information generation unit 22 performs OCR processing on the processed image data to acquire text information, and the character string “ It is determined whether or not “confidential” is included. When the image data of the first job includes the character string “confidential”, the image data type determination unit 23 determines that the first job is a job for an image that is in need of information leakage, and has a high resolution. Image data for storage is generated, and storage image data storage information “image 1” that can specify the storage destination of this data is created. Also, an image feature amount is calculated from the image data for storage, and “image feature amount 1” is created. Then, the “image feature amount 1” and the above-described text information “text 1,...” Are used as log information search data that is search information for searching for a job. One log information is generated in association.

  Next, when the job execution unit 21 executes the second job (job by the user BBBB), the image data processed in the same manner is subjected to OCR processing to acquire text information, and the character string “confidential” is included in the image data. Whether or not is included is determined. If the character string “confidential” is not included in the image data of this second job, it is determined that the second job is a job for an image that is not a problem if information is leaked, and is stored as image data for storage. Low-resolution image data is generated, and “image 2” in which this storage image data is specified is created. In addition, “image feature amount 2” that is an image feature amount calculated from the low-resolution storage image data and a part of text information of the text information obtained by the OCR processing, for example, the most frequent one word only. Used as log information search data as “text 2”.

Next, when the job execution unit 21 executes the third job (job by the user CCCC), the image data executed by the job execution unit 21 is subjected to OCR processing to acquire text information, and the character string “confidential”. Is included. If it is determined that the character string “confidential” is included in the image data of the third job, the third job is determined to be a job for an image that is in need of information leakage, and the image data for storage has high resolution. Image data is generated, and “image 3” in which the image data for storage is specified is created. In addition, “image feature amount 3” calculated from the image data for storage and all text information “text 3,...” Obtained by OCR processing are used as log information search data.
As a result, three pieces of log information as shown in FIG.

The image type in the figure indicates the determination result as to whether or not the image data type determination unit 23 satisfies the type determination condition defined in advance. The image data “1” corresponds to “ “0” means image data that does not correspond, but this is a simple description of the type and is not intended to be included in the log information. It can be included.
Further, although the example in which the storage image data storage information is used for the log information instead of the storage image data is shown, the storage image data itself may be included in the log information. Although “Image 1”, “Image 2”, and “Image 3” are shown, it is only necessary to be able to specify the storage destination of the image data for storage. It is not intended to limit. Further, for example, “Text 1,...” Means all text information, and “Text 2” means a part of the text information.

  The log information does not have to be the one shown in FIG. 6A, and may be in a format in which the discrimination result of the image data type discrimination unit 23 can be understood. For example, as shown in FIG. In addition, the image file name may be directly associated as the storage image data storage information. Here, a file name including high corresponds to the image type “1” in FIG. 6A, and a file name including low in the image type “0” in FIG. 6A. Correspond. Further, the name is not limited to a file name, and a stored folder (directory) name may be used.

  FIG. 6C shows log information described for comparison. Here, storage image data generated at the same resolution and log information at the same level regardless of the type of image data. Search data is used. Therefore, as the log information search data, the image feature amount of the image data and all text information obtained by, for example, OCR processing of the image data are used, so that such log information is stored and accumulated as it is. As a result, the amount of data to be stored and accumulated may become enormous.

  In the present embodiment, by using such log information, log information is generated every time image data processing is executed by the job execution unit 21, and the generated log information is, for example, shown in FIG. Even if the log information is generated and stored in the log information storage unit 28, the image data that is not the image data that is not required to be leaked is stored as the image data for saving and the data for searching the log information. By reducing the capacity, an increase in storage capacity for log information can be suppressed. Therefore, by generating such log information, the job execution history can be quickly investigated.

  In the present embodiment, a method of calculating the image feature amount from the storage image data when generating the log information is shown. However, the present invention is not limited to this. For example, the image feature amount is calculated from the original image data. There is no problem. Further, the image feature amount and the text information are shown as the log information search data. However, the present invention is not limited to this, and any one of them may be used as long as it can be classified.

<Search process>
Next, a search process performed by the search processing unit 29 of the image processing apparatus 10 when such log information is included as execution history information will be described.
It is assumed that the log information stored and accumulated in the log information storage unit 28 is used for tracking the execution history of the executed job. In other words, by using the log information, it is possible to check who has processed when and what is considered to be the same image data as the search target (document having leaked information, etc.).
Specifically, image feature amount calculation and OCR processing are performed on image data obtained by scanning an original document to be searched (such as an information leaked document) by the image reading unit 14 as in the case of log information generation. And the like, and the similarity between the image feature amount of the log information stored in the log information storage unit 28 and the image feature amount of the search target and the matching degree of the text information are used as criteria for the search target. It is determined whether there is the same image data as.

It is assumed that the log information stored and accumulated in the log information storage unit 28 is that whose image type is “1” is listed as shown in FIG. Information includes user AAAA, user DDDD, and user IEEE. Note that “image feature amount 1”, “image feature amount 1 ′”, and “image feature amount 1 ″” express that the feature amounts are similar.
In such log information, when the image feature amount obtained from the search target is “image feature amount 1”, the text information is “text 1,...”, And the image data is “image 1”, first, the image feature amount. Three pieces of log information (user AAAA, user DDDD, user EEEE) similar to the search target are selected from the amount. Next, one piece of log information (user AAAA) is selected from the text information. Further, the image data for storage and the image data to be searched are compared in detail, and if it is determined that they match, it is determined that the user AAAA has processed the target document at the date / time mm / mm / mm. become.

In the present embodiment, the method of generating log information is switched between image data of a document that is difficult to be leaked and image data that is not so, and the data capacity of the image data that is not so is stored small. Therefore, the search time for log information search data is shortened. On the other hand, since image data for storage is generated with high-resolution (or low-compression processing) images for image data that is difficult to be leaked, first of all, rough search at the time of retrieval based on image feature amounts and text information is performed. A search can be performed, and then a detailed search can be performed using the storage image data, so that the time until the detailed search can be shortened and a decrease in accuracy during the search can be suppressed. Further, the search system can be easily expanded.
For search information obtained from image data, for example, when a high-accuracy OCR processing technology or a high-accuracy image feature value calculation method is realized due to technological progress or the development of new technology. Needless to say, the search information may be updated by applying them.

Embodiment 2
FIG. 8 shows a schematic configuration of an image processing system according to an embodiment to which the present invention is applied. In the figure, the image processing system according to the present embodiment connects a plurality (three in this example) of image processing apparatuses 30 (30a to 30c), a server apparatus 40, and a PC (personal computer) 50. And a network line 60 as communication means.

  The image processing apparatus 30 in the present embodiment is configured in substantially the same manner as the image processing apparatus 10 in the first embodiment, but the image processing apparatus 30 in the present embodiment has at least a scan function, a copy function, and a print function. Any one or more functions are provided. For this reason, at least a job execution function for processing image data of any one of an image reading job, a copy output job, and a print output job is provided. In addition, the server device 40 provides a log information storage and accumulation service to each of the image processing devices 30 (30a to 30c). The PC 50 is connected to the image processing apparatus 30 and the server apparatus 40 via the network line 60 and exchanges various data. In this embodiment, in particular, the image data from the PC 50 is received from the PC 50. The data is transmitted to a predetermined image processing apparatus 30 so that a copy output or the like can be performed.

FIG. 9 is a functional block diagram of the image processing device 30 and the server device 40 in the present embodiment. The image processing device 30 is different from the image processing device 10 (see FIG. 2) in the first embodiment and is controlled. The apparatus 20 includes a job execution unit 21, a log information generation unit 22, and a search processing unit 29, and a log information storage unit 41 is provided on the server device 40 side. Therefore, the capacity of the log information storage unit 41 can be greatly increased. Further, in the present embodiment, storage image data is also stored in the server device 40.
Even in such a configuration, the same log information generation processing and search processing as in the first embodiment can be performed.

  In the present embodiment, the job execution unit 21, the log information generation unit 22, and the search processing unit 29 are provided in the image processing device 30, and the log information storage unit 41 is provided in the server device 40. Instead, the log information generation unit 22 and the log information storage unit 41 may be provided together in either the image processing device 30 or the server device 40, or may be provided separately from each other. . Furthermore, the image processing apparatus 30 side and the server apparatus 40 side may be provided redundantly. Furthermore, it is possible to provide a plurality of image processing apparatuses 30 (30a to 30c) in a distributed or overlapping manner.

Further, it is assumed that the log information generation unit 22, the log information storage unit 41, and the search processing unit 29 can be realized by the computer of the image processing device 30 or the server device 40 executing a predetermined program. At this time, such a predetermined program may be stored and provided in a computer-readable storage medium prior to installation in the image processing apparatus 30 or the server apparatus 40, or may be wired. Alternatively, it may be provided via a wireless communication medium or the like.
That is, the log information generation unit 22, the log information storage unit 41, and the search processing unit 29 can be realized by an image processing program that can be installed in the image processing device 30 or the server device 40. The program does not have to realize all of the above-described units. For example, a program that causes the server device 40 to function only as the log information storage unit 41 may be used.

  In the present embodiment, the search processing itself is performed by the image processing device 30. However, the search processing may be performed by another dedicated search processing device. For example, a scanner (not shown) may be connected to the PC 50 so that the function of the search processing unit 29 is performed by the PC 50. In this case, an image processing program for search processing may be installed in the PC 50. . Alternatively, the information stored and accumulated in the log information storage unit 41 in the present embodiment is supplied to the search-dedicated processing device disconnected from the network line 60 via the recording medium, and the search is performed here. There is no problem.

It is explanatory drawing which shows the outline | summary of embodiment model of the image processing apparatus to which this invention was applied. It is explanatory drawing which shows the image processing apparatus of Embodiment 1 to which this invention was applied. 2 is a functional block diagram of the image processing apparatus according to Embodiment 1. FIG. It is explanatory drawing which shows the example of calculation of an image feature-value. 3 is a log information generation flowchart according to the first embodiment. It is a schematic diagram regarding the log information of Embodiment 1, (a) is log information of Embodiment 1, (b) is log information as a modification, (c) is explanatory drawing which shows log information as a comparative example It is. It is a schematic diagram regarding similar log information. 6 is an explanatory diagram illustrating an image processing system according to Embodiment 2. FIG. 6 is a functional block diagram of an image processing system according to Embodiment 2. FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Job execution means, 2 ... Log information generation means, 3 ... Image data classification discrimination means, 4 ... Image data generation means for preservation, 5 ... Search information generation means, 6 ... Specific information generation means, 7 ... Association means, 8 ... Log information storage means

Claims (8)

An image processing apparatus having job execution means capable of executing image data image formation processing and a control device for controlling the job execution means,
The controller is
Log information generation means for generating, as log information, execution history information of a job executed by the job execution means;
Log information storage means for storing and accumulating log information generated by the log information generation means,
The log information generating means includes
An image data type discriminating means for discriminating whether the original image data that is processed by the job execution means corresponds to the type determination condition of predefined image data,
In generating image data for storage that corresponds to the original image data processed by the job execution unit and should be stored in a predetermined storage unit , based on the determination result of the image data type determination unit, A storage image data generating means for reducing the data amount of the storage image data when compared with a case where it is determined that the processed original image data does not correspond to the type determination condition ;
Both or corresponding job from either of the original image data that is processed by the storage image data storage image data generated by generating means and said job execution means to be the original image data for the store Search information generating means for generating search information for searching
Specific information generating means for generating specific information for specifying a job executed by the job executing means;
An image processing apparatus comprising: association means for associating the storage image data, the search information, and the specific information with each other. The image processing apparatus according to claim 1.
The image processing apparatus according to claim 1, wherein the type determination condition of the image data type determination unit is set in a condition belonging to at least one of a character string, an image, and a form for the image data. The image processing apparatus according to claim 1.
Said search information generating means, than if the original image data to which the Ru is processed by the job execution means when it is determined not to correspond to the type determination condition by the image data type determination means, it is determined that the corresponding An image processing apparatus that generates search information with a small number of data. The aspect of the image processing apparatus according to claim 1, comprising image reading means for reading a document image.
Further, the image data type determination unit determines image data type determination conditions for the image data to be retrieved read from the document by the image reading unit , and the storage image data generation unit and the storage unit Log information having the same search information as the search information from the log information stored and accumulated in the log information storage unit based on the generated search information by generating storage image data and search information in the search information generation unit An image processing apparatus comprising: search processing means for specifying a job corresponding to log information including storage image data matching the storage image data of the image data to be searched by searching . An image processing apparatus having job execution means capable of executing image data image forming processing and a control device for controlling the job execution means; and a server device connected to the image processing apparatus by communication means, An image processing system capable of storing and storing, as log information, job execution history information in which image data is processed by an image processing apparatus,
At least one of the image processing apparatus and the server apparatus is
A log information generation unit that generates, as log information, execution history information of a job executed by the job execution unit, and a log information storage unit that stores and accumulates log information generated by the log information generation unit,
The log information generating means includes
An image data type discriminating means for discriminating whether the original image data that is processed by the job execution means corresponds to the type determination condition of predefined image data,
In generating image data for storage that corresponds to the original image data processed by the job execution unit and should be stored in a predetermined storage unit , based on the determination result of the image data type determination unit, A storage image data generating means for reducing the data amount of the storage image data when compared with a case where it is determined that the processed original image data does not correspond to the type determination condition ;
Both or corresponding job from either of the original image data that is processed by the storage image data storage image data generated by generating means and said job execution means to be the original image data for the store Search information generating means for generating search information for searching
Specific information generating means for generating specific information for specifying a job executed by the job executing means;
An image processing system comprising: association means for associating the storage image data, the search information, and the specific information with each other. The aspect of the image processing system according to claim 5, wherein the image processing apparatus includes image reading means for reading a document image.
Furthermore, at least one of the image processing apparatus and the server apparatus sets the image data type determination condition by the image data type determination means for the image data to be retrieved read from the document by the image reading means. Log information that is stored and accumulated in the log information storage unit based on the generated search information by generating storage image data and search information in the storage image data generation unit and the search information generation unit The log information having the same search information as the search information is searched, and the job corresponding to the log information including the storage image data that matches the storage image data of the image data to be searched is specified. An image processing system comprising search processing means. An image processing program capable of storing and accumulating execution history information of a job for processing image data as log information,
A computer in an image processing apparatus having a job execution means capable of executing image data image forming processing and a control device for controlling the job execution means, or a computer connected to the image processing apparatus by communication means,
Log information generation means for generating, as log information, execution history information of a job executed by the job execution means;
Log information storage means for storing and accumulating log information generated by the log information generation means,
The log information generating means includes
An image data type discriminating means for discriminating whether the original image data that is processed by the job execution means corresponds to the type determination condition of predefined image data,
In generating image data for storage that corresponds to the original image data processed by the job execution unit and should be stored in a predetermined storage unit , based on the determination result of the image data type determination unit, A storage image data generating means for reducing the data amount of the storage image data when compared with a case where it is determined that the processed original image data does not correspond to the type determination condition ;
Both or corresponding job from either of the original image data that is processed by the storage image data storage image data generated by generating means and said job execution means to be the original image data for the store Search information generating means for generating search information for searching
Specific information generating means for generating specific information for specifying a job executed by the job executing means;
An image processing program that functions as an associating unit that associates the storage image data, the search information, and the specific information with each other. An image processing method capable of storing and storing execution history information of a job for processing image data as log information,
A job execution step for executing image data image formation processing;
A log information generation step for generating, as log information, execution history information of the job processed in the job execution step;
A log information storage step for storing and storing the log information generated in the log information generation step,
The log information generation step includes:
An image data type determining step of determining whether the original image data that is processed by the job execution step corresponds to the type determination condition of predefined image data,
In generating image data for storage that corresponds to the original image data processed in the job execution step and should be stored in a predetermined storage unit , based on the determination result of the image data type determination step, A storage image data generation step for reducing the data amount of the storage image data compared to the case where it is determined that the processed original image data does not correspond to the type determination condition ;
Both or corresponding job from either of the original image data that is processed by the job execution step underlying the generated storage image data and the image data for the saved was at the storage image data generating step A search information generation step for generating search information for searching
A specific information generation step for generating specific information for specifying the job executed in the job execution step;
An image processing method comprising: associating the storage image data, the search information, and the specific information with each other.

Images