JP2023063711A - Server, image processing device, information recording method, and information uploading method - Google Patents

Abstract

To solve the problem in which a mechanism for grasping and evaluating information, such as what kind of image and how much are to be subjected to image processing such as printing, is not enough.SOLUTION: A server capable of communicating with an image processing device includes: an acquisition unit that acquires information on a target image image-processed by the image processing device; a comparison unit that compares the information on the target image acquired by the acquisition unit with information on a stored image prestored in a storage medium and determines whether the target image matches or is similar to the stored image; and an information addition unit that records image processing information on the image processing in association with the stored image that matches or is similar to the target image according a result of the comparison.SELECTED DRAWING: Figure 2

Description

The present invention relates to a server, an image processing device, an information recording method, and an information uploading method.

Content is provided to users through the network. Such technology includes means for receiving and registering printable image data transmitted by a registrant, storage means for storing the registered image data, and storing in the storage means in response to a request from a user. and means for providing a user with image data that has been processed (see Patent Document 1).

JP-A-2002-230319

However, a mechanism for grasping and evaluating information such as what kind of image has been subjected to image processing such as printing and to what degree has been inadequate.

A server that can communicate with an image processing device includes an acquisition unit that acquires information on a target image that has been image-processed by the image processing device, and information on the target image acquired by the acquisition unit and stored in advance in a storage medium. a comparison unit that compares image information and determines whether or not the target image matches or resembles the stored image; and an information adding unit that records image processing information related to the image processing in association with each other.

An image processing device capable of communicating with a server includes an acquisition unit that acquires a target image, a processing unit that performs predetermined image processing on the target image acquired by the acquisition unit, and a processing unit that performs predetermined image processing on the target image acquired by the acquisition unit. In this case, the information of the target image is transmitted to the server, and the image processing related to the image processing is performed in association with the stored image stored in the server that matches or is similar to the target image. and a control unit for recording information.

An information recording method executed by a server capable of communicating with an image processing apparatus includes an acquisition step of acquiring information of a target image image-processed by the image processing device, and pre-storing the information of the target image acquired in the acquisition step. comparing information of a stored image stored in a medium to determine whether the target image matches or is similar to the stored image; or an information addition step of recording image processing information related to the image processing in association with the similar stored image.

An information uploading method executed by an image processing apparatus capable of communicating with a server includes an obtaining step of obtaining a target image, a processing step of performing predetermined image processing on the target image obtained in the obtaining step, and the processing step. When the image processing is successful, the information of the target image is transmitted to the server, and the server associates the stored image with the stored image that is stored in the server and matches or is similar to the target image. and a control step of recording image processing information related to the image processing.

FIG. 2 is a diagram simply showing a server and a plurality of image processing apparatuses; 4 is a flowchart showing an information recording method; FIG. 4 is a diagram showing an example of a coefficient table; A flow chart showing an information upload method. FIG. 5 is a flowchart showing an example of an information upload method different from that of FIG. 4; FIG. 4 is a flowchart showing an information recording method according to a first modified example; 9 is a flowchart showing an information recording method according to a second modified example; 9 is a flowchart showing an information recording method according to a third modified example;

Hereinafter, embodiments of the present invention will be described with reference to each drawing. Note that each drawing is merely an example for describing the present embodiment. Each figure is illustrative and may not be in exact proportions or shapes, may not match each other, or may be partially omitted.

1. A brief description of the device configuration:
FIG. 1 shows a server 10 and a plurality of image processing apparatuses 20, 20, 20, . . . according to this embodiment. A configuration including the server 10 and the image processing device 20 may be called a system 1 . The individual image processing devices 20 are, for example, printers, scanners, digital still cameras, and the like. The image processing apparatus 20 may be a multi-functional machine such as a printer and a scanner. In this embodiment, the image processing includes various processes related to images such as printing by a printer, copying by a multifunction machine, reading by a scanner, and imaging by a digital still camera. Printing by a printer is called printer printing, copying by a multifunction machine is called copy printing, reading by a scanner is called scanner reading, and imaging by a digital still camera is called camera imaging.

Each of the server 10 and the image processing device 20 is connectable to the network 30 and communicates via the network 30 . Network 30 includes the Internet and local area networks. The server 10 executes the "information recording method" according to this embodiment, and each of the image processing apparatuses 20 executes the "information uploading method" according to this embodiment.

The server 10 includes a control unit 11, a storage unit 13, a communication IF 14, and the like. IF is an abbreviation for interface. The control unit 11 includes one or a plurality of ICs having a CPU 11a as a processor, a ROM 11b, a RAM 11c, etc., other non-volatile memories, and the like. In the control unit 11, a processor, that is, a CPU 11a executes arithmetic processing according to a program 12 stored in a ROM 11b or other memory using a RAM 11c or the like as a work area.

By following the program 12, the control unit 11 realizes a plurality of functions such as an acquisition unit 12a, a comparison unit 12b, an information addition unit 12c, a processing instruction unit 12d, a success/failure determination unit 12e, and a notification unit 12f. These functions are only part of the functions that the program 12 causes the control unit 11 to implement. Also, some of these functions may be omitted. The processor is not limited to one CPU, and may be configured to perform processing by multiple CPUs or hardware circuits such as ASIC, or may be configured to perform processing in cooperation with CPUs and hardware circuits. good.

The storage unit 13 is, for example, a hard disk drive, a solid state drive, or other memory storage medium. A part of the memory of the control unit 11 may be understood as the storage unit 13 . Further, it may be understood that the storage unit 13 is included in the control unit 11 .
The communication IF 14 is a general term for one or a plurality of IFs for the server 10 to communicate with other devices via the network 30 in a wired or wireless manner in accordance with a predetermined communication protocol including known communication standards. .

In FIG. 1, one of the plurality of image processing apparatuses 20, 20, 20, . . . is identified by reference numeral 20a. Needless to say, each of the plurality of image processing apparatuses 20, 20, 20, . 1 shows the internal configuration of one image processing apparatus 20a as a representative of the plurality of image processing apparatuses 20, 20, 20, . . . . Each image processing device 20 may be interpreted in the same manner as the image processing device 20a.

The image processing device 20a has a control unit 21, a processing unit 23, a communication IF 24, an operation panel 25, and the like. The control unit 21 includes one or a plurality of ICs having a CPU 21a as a processor, a ROM 21b, a RAM 21c, etc., other non-volatile memories, and the like. In the control unit 21, a processor, that is, a CPU 21a executes arithmetic processing according to a program 22 stored in a ROM 21b or other memory using a RAM 21c or the like as a work area. By following the program 22, the control unit 21 realizes a plurality of functions such as an acquisition unit 22a and a confidentiality determination unit 22b. These functions are only part of the functions that the program 22 causes the control unit 21 to implement.

The processing unit 23 is a mechanism responsible for general functions of the image processing apparatus 20a, and differs depending on the specific product of the image processing apparatus 20a. For example, if the image processing device 20a is a printer, the processing unit 23 is a printing unit for printing an image on a medium such as paper using ink or toner. Also, if the image processing device 20a is a scanner, the processing unit 23 is a reading unit for optically reading a document to obtain image data, and includes a light source and an image sensor. Also, if the image processing device 20a is a digital still camera, the processing unit 23 is an imaging unit for capturing an image of a document and acquiring image data, and includes a lens and an image sensor.

The operation panel 25 includes a display section for displaying visual information and an operation receiving section for receiving user operations. The operation reception unit is implemented by, for example, physical buttons, a touch panel, a mouse, a keyboard, or the like. A touch panel is realized as one function of the display unit. Of course, the server 10 may also have a user interface equivalent to that of the operation reception unit 25 .
Some configurations of the server 10 are described as a first control unit 11, a first program 12, a first acquisition unit 12a, a first communication IF 14, etc., and some configurations of the image processing apparatus 20 are described as a second control unit 21, The second program 22, the second acquisition unit 22a, the second communication IF 24, etc. may be used to make it easier to distinguish between them.

2. Information recording method:
FIG. 2 shows a flow chart of an information recording method executed by the control unit 11 of the server 10 according to the program 12 .
In step S100, the acquisition unit 12a of the control unit 11 receives upload of information of the image-processed target image (hereinafter referred to as target image information) from the image processing device 20 via the communication IF 14, and acquires the target image information. A target image means an image to be subjected to image processing by the image processing apparatus 20 . Step S<b>100 corresponds to the “acquisition step” of acquiring target image information from the image processing apparatus 20 .

The timing of uploading the target image information is entrusted to each individual image processing apparatus 20 . Therefore, the flowchart of FIG. 2 is triggered by uploading target image information to the server 10 by any of the image processing apparatuses 20 .
Uploading of target image information to the server 10 by the image processing apparatus 20 will be described later with reference to FIG.

The breakdown of information included in the target image information includes, for example, target image data representing the target image itself, attribute information representing the attributes of the target image, and information on image processing of the target image by the image processing device 20 (hereinafter referred to as image processing). processing information). Attributes are, for example, documents, analysis data, photographic images, character images, and the like. The image processing information is, for example, the number of times of printing when the target image is printed by a printer, and the number of times of copy printing when the target image is copy-printed by a multifunction machine.

In step S110, the comparison unit 12b compares the target image information acquired by the acquisition unit 12a in step S100 with information of a stored image (hereinafter referred to as stored image information) stored in the storage unit 13 in advance. Determine if the image is the same as the stored image. "Identical" as used herein includes not only matching but also similarity exceeding a predetermined standard.

A stored image is an image that has been uploaded as a target image from the image processing apparatus 20 to the server 10 in the past and whose target image information has been registered in the storage unit 13 . That is, the target image information registered in the storage unit 13 is the stored image information. A stored image may be referred to as a registered image. The comparison unit 12b compares the target image information and the stored image information, and if it determines that the target image is the same as one of the stored images, proceeds from "Yes" in step S120 to step S140. On the other hand, if the comparison unit 12b compares the target image information and the stored image information and determines that the target image is not the same as any of the stored images, the process proceeds from "No" in step S120 to step S130. Such steps S110 and S120 correspond to the "comparison process".

A specific method for determining the identity between the target image and the stored image is not particularly limited. For example, the comparison unit 12b compares the target image with each of the stored images, and if there is a stored image whose similarity is higher than a predetermined standard by a so-called template matching method, it may be determined that the images are the same. In addition, the comparison unit 12b uses various techniques such as an SSDA (Sequential Similarity Detection Algorithm) method, a coarse/fine search method, an active search method, etc., to select stored images whose similarity to the target image is higher than a predetermined standard. A search can be performed and an identity determination made.

In step S130, the control unit 11 causes the storage unit 13 to store the target image information acquired in step S100. As a result, the target image information is registered in the storage unit 13 as new stored image information. After step S130, the process proceeds to step S140.

In step S140, the information addition unit 12c records the image processing information in association with the stored image determined to be the same as the target image according to the result of the comparison by the comparison unit 12b. Step S140 corresponds to the "information adding step".

If it is step S140 after passing "Yes" in step S120, the information addition unit 12c determines that the image processing information included in the target image information acquired in step S100 is the same as the target image in steps S110 and S120. added to the image processing information of the stored image. For easy understanding, image A is the target image in the target image information acquired in step S100, and image B is the stored image determined to be the same as image A. FIG. Assume that the current image processing information for image B stored in the storage unit 13 is as follows.
Printer printing = 10 times Copy printing = 8 times Scanner reading = 4 times Camera imaging = 2 times

That is, the image processing information of the image B indicates how much and what kind of image processing the image B has been subjected to by various image processing apparatuses 20 so far. The image processing information for image A, for example, printer printing=1 time, is added to the image processing information for image B as described above. As a result, the image processing information of image B is updated as follows.
Printer printing = 11 times Copy printing = 8 times Scanner reading = 4 times Camera imaging = 2 times

On the other hand, at step S140 after step S130, the information addition unit 12c uses the image processing information included in the target image information acquired at step S100 as image processing information for the stored image newly registered at step S130. Record. As can be seen from the description so far, according to step S130, the target image information acquired in step S100 is newly registered as the stored image information as it is. Therefore, recording of the image processing information to be executed in step S140 is substantially completed when step S130 is executed.

For easy understanding, let image C be the target image in the target image information acquired in step S100. Assume that "No" is determined for image C in step S120. In this case, if the image processing information of image C is, for example, scanner reading=1 time, as a result of steps S130 and S140, the image processing information of image C as a stored image is as follows.
Printer printing = 0 times Copy printing = 0 times Scanner reading = 1 time Camera imaging = 0 times

In step S150, the information addition unit 12c determines the evaluation value of the image from the image processing information recorded in association with the stored image in step S140. It may be understood that step S150 is also included in the "information adding step". It can be said that the more times an image has been subjected to image processing such as printing and reading, the more often it is used by users.

As an example, the information addition unit 12c determines the total number of times of each process such as printer printing, copy printing, scanner reading, and camera imaging indicated by the image processing information of the stored image as the evaluation value. In other words, when the evaluation value is E, the number of times of printer printing is e1, the number of copy printings is e2, the number of times of scanner reading is e3, and the number of times of camera imaging is e4, the information addition unit 12c uses the following formula (1): Determining the evaluation value of the stored image.
E=e1+e2+e3+e4 (1)

According to expression (1), the image processing information is substantially the evaluation value itself.
Alternatively, the information addition unit 12c may determine the evaluation value of the stored image according to the following equation (2) by weighted addition using predetermined coefficients w1, w2, w3, and w4. At least some of the coefficients w1, w2, w3, and w4 are set to values different from others.
E=e1×w1+e2×w2+e3×w3+e4×w4 (2)

For example, based on the idea that printing increases the value of an image more than reading or imaging, coefficients such as w1=w2=1.0 and w3=w4=0.5 can be used.
Further, the information addition unit 12c may employ different coefficients w1, w2, w3, and w4 depending on the attribute of the image, and determine the evaluation value of the stored image according to equation (2).

FIG. 3 shows an example of the coefficient table 40 pre-stored in the storage unit 13. As shown in FIG. The coefficient table 40 defines correspondence relationships between image attributes such as documents, analysis data, photographic images, and character images, and coefficients w1, w2, w3, and w4. As can be seen from the above description, the stored image information includes image attribute information. Therefore, the information addition unit 12c may read the coefficients w1, w2, w3, and w4 that match the attributes from the coefficient table 40 according to the attribute information of the stored image, and determine the evaluation value according to Equation (2).

The information addition unit 12c records the thus determined evaluation value of the stored image in association with the stored image, and finishes the flowchart of FIG. According to FIG. 2, each time target image information is uploaded from any of the image processing apparatuses 20 to the server 10, the server 10 updates the image processing information for the same stored image as the target image, Further update the evaluation value. That is, the server 10 can hold the latest image processing information and evaluation values for each of the stored images.

The number of times of image processing such as printer printing, copy printing, scanner reading, and camera imaging can be regarded as a kind of score. Therefore, in step S140, the process of recording the image processing information in association with the stored image can be said to be the point addition process. The process of determining the evaluation value in step S150 is also the process of adding points, and the points after such addition become the evaluation value of the image. Also, the number of times of image processing such as printer printing, copy printing, scanner reading, and camera imaging may be called the number of sheets.

3. Information upload method:
FIG. 4 shows a flow chart of an information upload method executed by the control unit 21 of the image processing apparatus 20 according to the program 22 . In FIG. 4, for the sake of convenience, the processes executed by the plurality of image processing apparatuses 20 are shown separately or collectively shown as one. Also, in the description of FIG. 4, each of the plurality of image processing apparatuses 20 may be referred to as a printer, a multifunction device, a scanner, a digital still camera, or the like.

For example, in the control unit 21 of the printer, the acquiring unit 22a acquires image data (step S200). The image data acquired in step S200 corresponds to one of the target images. The acquisition unit 22a can acquire image data from various memories such as a PC communicably connected to the printer, a smartphone, a USB memory, and an SD card. The control unit 21 of the printer transfers the image data acquired in step S200 to the processing unit 23 as a printing unit, and causes the printing unit to execute printing based on the image data (step S220).

The control unit 21 of the printer determines whether or not the printing in step S220 has succeeded (step S230). No” to step S240. The control unit 21 of the printer performs predetermined error handling processing in step S240, and executes step S220 again. Unsuccessful printing refers to various errors that can occur in the product, such as paper jams and running out of ink. The error handling process in step S240 is various processes for resolving an error that has occurred, and includes displaying on the operation panel 25 or issuing a voice notification requesting the user to take measures to resolve the error.

Also, the user sets a document on the reading section as one type of the processing section 23 of the MFP, and causes the reading section to scan (step S210). Since image data is generated as the reading result of the document in step S210, the acquisition unit 22a of the multifunction machine acquires this image data. A document before scanning and image data generated by scanning the document correspond to one of the target images. The reading unit may be understood as an acquisition unit that acquires the target image. The control unit 21 of the MFP transfers the image data acquired by the acquisition unit 22a through the scanning in step S210 to the printing unit as one type of the processing unit 23 of the MFP, and executes printing based on the image data (step S220). That is, copy printing of the document is executed. Steps S230 and S240 performed by the multifunction machine are the same as steps S230 and S240 performed by the printer, and thus description thereof is omitted.

Also, the user sets the document on the reading section as the processing section 23 of the scanner, and causes the reading section to scan (step S250). Since image data is generated as a reading result of the document in step S250, the acquisition unit 22a of the scanner acquires this image data. A document before scanning and image data generated by scanning the document correspond to one of the target images. The reading unit may be understood as an acquisition unit that acquires the target image.

However, the controller 21 of the scanner determines whether or not the scan in step S250 has succeeded (step S260). , the process proceeds to step S270. The control unit 21 of the scanner performs predetermined error handling processing in step S270, and executes step S250 again. An unsuccessful scan is various errors that can occur in the product, such as document jams and document skew. The error handling process in step S270 is various processes for resolving an error that has occurred, and includes displaying on the operation panel 25 and executing a notification requesting the user to take measures to resolve the error.

The flow in which a digital still camera, which is one of the image processing apparatuses 20, picks up an image of a document and acquires image data is substantially the same as steps S250, S260, and S270, and thus description thereof is omitted. Such steps S200, S210, and S250 correspond to "acquisition steps" in which the image processing apparatus 20 acquires the target image. Further, steps S220, S210, and S250 correspond to "processing steps" for performing predetermined image processing on the acquired target image.

The processing after step S300 occurs when any one of the image processing apparatuses 20 such as the printer, the multifunction device, the scanner, and the digital still camera executes the above-described processing. Therefore, the image processing device 20 and the control unit 21 referred to in the description of steps S300 to S360 and steps S352 and S354 refer to one image processing device 20 and its control unit 21 that have executed the above-described processes up to step S300. .

In step S<b>300 , control unit 21 of image processing device 20 starts communication with server 10 via communication IF 24 and network 30 . The control unit 21 attempts to establish communication with the server 10 by executing negotiations with the server 10 according to a predetermined communication protocol. In step S310, the control unit 21 determines whether or not the communication with the server 10 has succeeded. ” to step S320.

In step S320, the control unit 21 temporarily saves the image data as the target image in a predetermined memory, and retries step S300. In other words, the target image is held so as not to be discarded until it is determined "Yes" in step S310.

In step S330, the confidentiality determination unit 22b of the control unit 21 analyzes the image data as the target image and determines whether or not the target image contains confidential information. For example, the confidentiality determination unit 22b analyzes a character string or image included in the target image, and determines that confidential information is present when a specific word or stamp that suggests confidential information is included. Specific words are words such as "confidential" and "confidential", for example. Further, the confidentiality determination unit 22b can determine that confidential information is present even when identification information indicating that the target image is confidential information is attached to the target image. Alternatively, the confidentiality determination unit 22b may determine that there is confidential information when the attribute of the target image is a specific attribute, for example, when the attribute is analysis data.

In step S340, the control unit 21 branches the processing according to the determination result of step S330. That is, if it is determined that there is confidential information, the process proceeds from "Yes" in step S340 to step S350, and if it is determined that there is no confidential information, the process proceeds from "No" in step S340 to step S360.

In step S350, the control unit 21 reversibly encrypts the target image including confidential information in order to increase the security of the target image. There are various encryption methods that can be used, and for example, a common key cryptosystem or a public key cryptosystem can be used. The target image thus encrypted corresponds to information capable of restoring the original target image. The process proceeds to step S360 via step S350.

In step S<b>360 , the control unit 21 generates target image information and uploads the generated target image information to the server 10 . If it is step S360 through "No" in step S340, the control unit 21 performs image processing according to the image data as the target image, the attribute information of the target image, and the contents of steps S220 and S250 for the target image. To generate target image information including information and The image data as the target image to be included in the target image information may be a thumbnail or the like in which the data amount is reduced from that of the original target image. Also, the attributes of the target image may be determined according to instructions from the user or by analyzing the target image.

On the other hand, in step S360 after step S350, the control unit 21 generates the encrypted target image, attribute information of the target image, image processing information corresponding to the contents of steps S220 and S250 for the target image, Generate target image information including Note that the target image information may be encrypted collectively. The control unit 21 uploads the generated target image information to the server 10 together with an instruction to execute the information recording method (FIG. 2), and finishes the flowchart of FIG. As a result, the server 10 that has received the upload from the image processing device 20 executes the information recording method according to the instruction. Such step S360 transmits the target image information to the server 10, and causes the server 10 to record the image processing information in association with the stored image stored in the server 10 that matches or is similar to the target image. It corresponds to "control process".

In this embodiment, as an option other than step S350 when "Yes" is determined in step S340, step S352 may be executed as indicated by a two-dot chain line in FIG. may be executed. Which of steps S350, S352, and S354 should be executed from "Yes" in step S340 may be set in advance by an instruction from the user.

After proceeding from “Yes” in step S340 to step S352, the control unit 21 calculates a hash value based on the target image. A hash value can be calculated by converting image data as a target image using a predetermined hash function. The hash value will be the same value if the conversion source data is the same. As types of hash values, for example, a difference from the average luminance of an image is used as a luminance pattern, and an aHash value obtained from the luminance pattern and a pHash value obtained from low frequency components obtained by discrete cosine transform (DCT) of an image are used. Conceivable. A hash value obtained by another known algorithm may be adopted. The hash value is information generated based on the target image, and does not correspond to information that can restore the target image.

In step S360 after step S352, the control unit 21 includes the hash value generated based on the target image, the attribute information of the target image, and the image processing information about the target image. Generate target image information that does not include the target image. Then, this target image information is uploaded to the server 10 together with an instruction to execute the information recording method, and the flow chart of FIG. 4 ends. In step S360 after step S352, the target image and information that can restore the target image are not uploaded, so the confidentiality of the target image is more strongly protected.

After proceeding from "Yes" in step S340 to step S354, the control unit 21 notifies the user of the error, and ends the flow chart of FIG. In this case, since step S360 is not executed, the information recording method is not started on the server 10 side. The error notification in step S354 is a notification that the target image subjected to image processing contains confidential information, or that the target image contains confidential information and therefore will not be uploaded to the server 10, or the like. This error notification can also be executed by display on the operation panel 25 or by voice.

A supplementary description will be given of the processing on the server 10 side corresponding to steps S350 and S352.
When the server 10 acquires target image information including an encrypted target image from the image processing device 20, in step S110, after decrypting the encrypted target image, the server 10 compares it with the stored image to see if it is the same. You have to decide whether or not In this embodiment, it is only necessary for the control unit 11 to eventually decrypt the encrypted image on the server 10 side. do not. In certain stored image information in the storage unit 13, the stored image may also be encrypted, so the control unit 11 also decrypts the stored image as necessary.

When the server 10 acquires the target image information including the hash value of the target image from the image processing apparatus 20, in step S110, the hash value of the stored image is calculated, and the hash value of the target image and the hash value of the stored image are combined. are compared to determine their identity. That is, when the compared hash values match or the degree of similarity is higher than a predetermined level, it is determined that the target image and the stored image are the same. It is assumed that the image processing device 20 and the server 10 use the same algorithm for hash value calculation. Since certain stored image information in the storage unit 13 may include the hash value of the stored image, the control unit 11 may calculate the hash value for the stored image that requires calculation of the hash value.

FIG. 5 shows an information upload method executed by the control unit 21 of the image processing apparatus 20, showing an example different from FIG. 4 in a flowchart. As for FIG. 5, only differences from FIG. 4 will be described. According to FIG. 5, the control unit 21 proceeds to step S350 from the determination of "No" in step S340 and then executes step S360. to execute step S360. That is, according to FIG. 5, when the target image includes confidential information, the control unit 21 includes, as target image information, information generated based on the target image and does not include information that can restore the target image. Send the information to the server 10 . On the other hand, if the target image does not contain confidential information, information including information that can restore the target image is transmitted to the server 10 as target image information.

4. summary:
As described above, according to the present embodiment, the server 10 that can communicate with the image processing device 20 includes the acquisition unit 12a that acquires information (target image information) of a target image image-processed by the image processing device 20, and the acquisition unit 12a. a comparison unit 12b for comparing the information of the target image acquired by with the information of the stored image (stored image information) previously stored in the storage medium, and determining whether the target image matches or resembles the stored image; and an information addition unit 12c for recording image processing information related to the image processing in association with a stored image having a matching or similar target image according to the result of the comparison.

According to the above configuration, the server 10 can record and manage image processing information for each image. Therefore, it is possible to grasp and evaluate information such as which image has been subjected to image processing such as printing and to what degree.

Further, according to the present embodiment, the information addition unit 12c records the image processing information according to the content of the image processing executed by the image processing device 20. FIG.
According to the above configuration, the image processing information corresponding to the content of the image processing executed by the image processing apparatus 20, such as the number of times of printing and the number of times of reading, can be recorded in association with the stored image.

Further, according to this embodiment, the recording of the image processing information may be the addition of points.
According to the above configuration, it is possible to grasp and evaluate the usage status and value of each image by points.

The effects produced by this embodiment will be further described.
As described above, the server 10 has image processing information representing the value of the image such as the score and evaluation value for each image. (SNS) and by increasing exposure on video sites, etc., it is possible to excavate printing demand.
Also, by selling information on images with relatively high value to companies, advertising companies, etc., it is possible to increase the profits of users who own the images.
Furthermore, it is possible to set the charge for using the image according to the relative value of the image, and to optimize the profitability of services such as sales of contents for printing. Furthermore, it is possible to set an appropriate charge according to the value of an image containing a copyrighted work such as a character with a relatively high value.

However, the image processing information in the present embodiment is not limited to the number of times of processing such as printing, reading, and copying as described above, or the evaluation value or score based on the number of times.
Image processing information includes, for example, the date and time of execution of image processing, location, color/monochrome settings, resolution settings, double-sided/single-sided printing settings, double-sided/single-sided reading settings, number of processed sheets, error information, user information, etc. It may contain various information and histories related to image processing. Then, the server 10 may record the image processing information for each image according to the upload from each image processing device 20 . This record may be recorded in the stored image information or the header of the image file as the stored image, or may be recorded in a file provided in association with one or more stored images. Also, multiple stored images are treated as one group, and when an image within the group is subjected to image processing, the image processing information is recorded in association with the group in a format in which it is not possible to know which image within the group has undergone image processing. good too.

Further, according to this embodiment, the target image information may include information that can restore the target image.
According to the above configuration, the security of the target image is enhanced in the process of passing the target image information from the image processing device 20 to the server 10, and the server 10 can restore the target image.

Further, according to this embodiment, the target image information may include information generated based on the target image and may not include information that can restore the target image.
According to the above configuration, it is possible to eliminate the possibility that the target image is leaked in the process of passing the target image information from the image processing device 20 to the server 10, and the server 10 substantially compares the target image with the stored image. make it possible. The information generated based on the target image is, for example, a hash value, but is not limited to this.

Further, according to the present embodiment, the image processing apparatus 20 that can communicate with the server 10 includes an acquisition unit that acquires a target image, a processing unit 23 that performs predetermined image processing on the target image acquired by the acquisition unit, When the image processing by the processing unit 23 is successful, the information of the target image (target image information) is transmitted to the server 10, and the stored image stored in the server 10 that matches or is similar to the target image is sent to the server 10. and a control unit 22 for recording image processing information related to the image processing in association with the image.
According to the above configuration, the image processing apparatus 20 can upload the target image information to the server 10 and cause the server 10 to execute the processing according to the present embodiment when the image processing by the processing unit 23 is successful.

Further, according to the present embodiment, the control unit 22 of the image processing apparatus 20 analyzes the target image image-processed by the processing unit 23 to determine whether or not confidential information is included. is sent to the server 10 as target image information including information generated based on the target image and not including information that can restore the target image, and if the target image does not include confidential information , information including information capable of restoring the target image may be transmitted to the server 10 as the target image information.
According to the above configuration, when the target image contains confidential information, the image processing apparatus 20 eliminates the possibility of the target image being leaked during the process of passing the target image information to the server 10, and the server 10 substantially Allows comparison of target images with stored images. Furthermore, even if the target image does not contain confidential information, the server 10 can restore the target image while increasing the security of the target image in the process of passing the target image information to the server 10 .

In addition to the categories of the server 10, the image processing device 20, and the system 1, the present embodiment discloses inventions in various categories such as methods executed by each device and programs for causing a processor to execute the methods.
For example, an information recording method executed by the server 10 capable of communicating with the image processing device 20 includes an acquisition step of acquiring information of a target image image-processed by the image processing device 20, and information of the target image acquired in the acquisition step. comparing information of a stored image stored in advance in a storage medium to determine whether or not the target image matches or resembles the stored image; and an information addition step of recording image processing information related to the image processing in association with a similar stored image.

Further, the information upload method executed by the image processing apparatus 20 capable of communicating with the server 10 includes an acquisition step of acquiring a target image, a processing step of performing predetermined image processing on the target image acquired in the acquisition step, and a processing When the image processing by the process is successful, the information of the target image is transmitted to the server 10, and the server 10 stores the image in correspondence with the stored image that matches or is similar to the target image. and a control step for recording image processing information relating to the processing.

5. Variant:
Some modifications included in this embodiment will be described. As for the modified example, differences from the embodiments described so far will be mainly described. Moreover, a combination of a plurality of modifications is naturally included in the present embodiment.

First variant:
FIG. 6 is a flow chart showing the information recording method according to the first modification executed by the server 10. As shown in FIG. Regarding FIG. 6, differences from FIG. 2 will be described. Steps S100 and S110 are as already explained. In step S122, the comparison unit 12b selects one or more candidates of stored images that match or are similar to the target image (hereinafter referred to as candidate stored images), which are estimated by the comparison in step S110, to the image processing device that is the transmission source of the target image. 20 via the communication IF 14 . In other words, the comparison unit 12b sets stored images that can be determined to have a similarity to the target image higher than a predetermined criterion as candidate stored images, and sends them to the image processing device 20. FIG.

Although not shown in FIG. 6, if a stored image that can be determined to be the same as the target image is not stored in the storage unit 13, the process proceeds to step S130 as described with reference to FIG. Although not shown in FIG. 6, even in the first modified example, it is not prohibited to proceed to step S140 from the determination of "Yes" in step S120 as described in FIG. For example, in the first modified example, if there are a plurality of stored images that can be determined to have a similarity to the target image higher than a predetermined standard, these can be used as candidate stored images and step S122 can be executed.

The control unit 21 of the image processing device 20 that has received the candidate stored images selects at least one candidate stored image that is the same as the target image that it has transmitted to the server 10 from among the received candidate stored images. First identification information that identifies the candidate stored image is generated. That is, in the first modification, the image processing device 20 is caused to finally identify the stored image that is the same as the target image. Control unit 21 then transmits the first specific information to server 10 via communication IF 24 .

As shown in FIG. 6, in step S124, the information addition unit 12c receives the first specific information from the image processing device 20. As shown in FIG. In step S140, the information adding unit 12c that has received the first specific information in step S124 records the image processing information in association with the stored image specified by the first specific information among the stored images in the storage unit 13. . Step S150 has already been described.
If there is no candidate stored image that is the same as the target image among the received candidate stored images, the control unit 21 of the image processing device 20 notifies the server 10 to that effect. In that case, although not shown in FIG. 6, the server 10 may proceed to step S130 as described in FIG.

As described above, according to the first modification, the comparison unit 12b transmits one or more candidates of stored images that match or are similar to the target image estimated by the comparison to the image processing device 20, and the information addition unit 12c receives first identification information identifying at least one of the candidates from the image processing device 20, and records image processing information in association with the stored image identified by the first identification information. According to such a configuration, the server 10 causes the image processing device 20, which originally has the target image, to specify a stored image identical to the target image, and records the image processing information according to the specified result. Therefore, the processing load on the server 10 can be suppressed. Further, even if the image processing device 20 transmits to the server 10 information that cannot specify the same stored image as the target image, the image processing device 20 can specify the same stored image as the target image. In this way, when an image containing confidential information is image-processed by the image processing device 20, the image will not be stored in the server 10, so the confidential information will not be transferred to the server 10 because there is no identical image. When an image that does not leak and does not contain confidential information is image-processed by the image processing device 20, the same image is identified by the server 10. FIG. In other words, this modification is an example of achieving both protection of confidential information and recording of image processing information.

Second variant:
FIG. 7 is a flow chart showing the information recording method according to the second modification executed by the server 10. As shown in FIG. The second modified example is a process that can be performed separately from the embodiments and other modified examples described so far.
In step S400, the processing instruction unit 12d of the control unit 11 transmits the stored image stored in the storage unit 13 and an image processing instruction to perform image processing on the stored image via the communication IF 14. Send to processing device 20 . The method of selecting the stored image to be transmitted to the image processing device 20 and the method of selecting the image processing device 20 to which the stored image is to be transmitted do not matter here. Of course, the user may select the stored image and the image processing device 20 .

In the second modification, it can be said that the image processing device 20 acquires an image to be processed from the server 10 . The image processing device 20 that has received the stored image and the image processing instruction from the server 10 executes image processing on this stored image. For example, the control unit 21 of the image processing device 20 causes the processing unit 23 as a printing unit to execute printing based on the stored image. Then, the control unit 21 transmits a success/failure notification indicating whether or not the image processing based on the stored image has succeeded to the server 10 via the communication IF 24 . At this time, if the image processing based on the stored image is successful, the control unit 21 transmits to the server 10 image processing information corresponding to the contents of the image processing based on the stored image together with a success/fail notification indicating the success.

As shown in FIG. 7, in step S410, the success/failure determination unit 12e receives the success/failure notification from the image processing device 20, and in step S420, according to the success/failure notification, the image processing of the stored image by the image processing device 20 is performed. judge. If the success/failure notification indicates success, the process proceeds from "Yes" in step S420 to step S430. On the other hand, if the success/failure notification indicates unsuccessful, the flow chart of FIG. 7 ends from "No" in step S420.

In step S430, the information addition unit 12c records the image processing information in association with the stored image transmitted to the image processing apparatus 20 in step S400. In other words, a determination of "Yes" in step S420 means that image processing information related to image processing based on a stored image has been obtained from the image processing apparatus 20 together with a success/failure notification. It is recorded in association with the stored image transmitted to the image processing device 20 . After step S430, step S440 is executed, and the flowchart is finished. For steps S430 and S440, refer to the description of steps S140 and S150 as appropriate.

As described above, according to the second modification, the server 10 transmits a stored image to the image processing device 20 and instructs the image processing device 20 to perform image processing on the transmitted stored image; A success/failure determination unit 12 e that determines success or failure of the image processing of the stored image transmitted to the processing device 20 according to a notification from the image processing device 20 is further provided. When the success/failure determining unit 12e determines that the image processing by the image processing device 20 has succeeded, the information adding unit 12c records the image processing information in association with the stored image transmitted to the image processing device 20. do.
According to such a configuration, the server 10 transmits a stored image held by itself to the image processing device 20 to execute image processing such as printing, and acquires a success/failure notification from the image processing device 20 . Therefore, there is no need to upload the target image from the image processing device 20 to the server 10, and it is not necessary for the server 10 to perform identity determination between the target image and the stored image as described above.

Third modification:
FIG. 8 is a flow chart showing the information recording method according to the third modification executed by the server 10 . Regarding FIG. 8, differences from FIG. 2 will be described. FIG. 8 differs from FIG. 2 in that step S102 is followed by determination in step S100. In step S102, the control unit 11 determines whether or not the target image information acquired in step S100 includes second identification information for identifying a stored image.

The second identification information is identification information for uniquely identifying an image, and is assigned to at least a portion of target images in the system 1 according to a predetermined rule, for example. Therefore, when uploading the target image information to the server 10, the image processing apparatus 20 can upload the target image information including the second identification information of the target image, for example, according to an instruction from the user or automatically. When target image information of a certain target image is uploaded from the image processing apparatus 20 for the first time, this target image is newly registered in the storage unit 13 and becomes a stored image. Therefore, when certain target image information is uploaded, if the target image information includes the second specification information, the stored image in the storage unit 13 can be uniquely specified by the second specification information.

In step S102, if the target image information acquired in step S100 includes the second specific information, the control unit 11 determines "Yes" and proceeds to step S140. On the other hand, if the target image information acquired in step S100 does not include the second specific information, the process advances to step S110 from the determination of "No" in step S102. Step S110 and subsequent steps are as already described.

In step S140 after "Yes" in step S102, the information adding unit 12c selects a stored image from among the stored images in the storage unit 13 by using the second specific information included in the target image information acquired in step S100. The information is uniquely specified, and the image processing information is recorded in association with the specified stored image. In step S140 after "Yes" in step S102, it is possible that the stored image cannot be specified by the second specifying information included in the target image information acquired in step S100. Just do it. Of course, the determination in step S102 can also be performed between steps S100 and S110 in FIG.

Thus, according to the third modification, when the information of the target image acquired by the acquiring unit 12a includes the second specifying information specifying the stored image, the information adding unit 12c adds the second specifying information and recording the image processing information in association with the stored image specified by the acquisition unit 12a, if the information of the target image acquired by the acquisition unit 12a does not include the second specification information, according to the result of the comparison by the comparison unit 12b Then, the image processing information is recorded in association with the stored image that matches or resembles the target image. According to such a configuration, the frequency with which the server 10 executes identity determination between the target image and the stored image can be reduced, and the processing load on the server 10 can be reduced.

Fourth variant:
The server 10 may further include a notification unit 12f that notifies the owner of the stored image of the image processing information. The owner of a stored image is, for example, the individual or corporation that owns the copyright of that image. In the storage unit 13, it is assumed that the correspondence relationship with the owner is defined in advance for each stored image. Therefore, the notification unit 12f notifies the owner of the stored image of the image processing information recorded in association with the stored image at the timing of step S140 or step S150 or the timing of step S430 or step S440, for example. do. The notification method by the notification unit 12f is not particularly limited, such as sending an e-mail or posting to an SNS. The image processing information to be notified may, of course, be the evaluation value or score described above. According to the fourth modified example, the owner of the image can grasp how much the image, which is his/her property, is used for printing and the like in the world.

Reference Signs List 1 system, 10 server, 11 control unit, 12 program, 12a acquisition unit, 12b comparison unit, 12c information addition unit, 12d processing instruction unit, 12e success/failure determination unit, 12f notification unit, 13 storage unit 14 communication IF 20, 20a image processing device 21 control unit 22 program 22a acquisition unit 22b confidentiality determination unit 23 processing unit 24 communication IF 25 Operation panel 30 Network 40 Coefficient table

Claims (14)

A server communicable with an image processing device,
an acquisition unit that acquires information of a target image that has undergone image processing by the image processing device;
a comparison unit that compares information of the target image acquired by the acquisition unit with information of a stored image that is stored in advance in a storage medium, and determines whether the target image matches or is similar to the stored image; ,
and an information adding unit that records image processing information related to the image processing in association with the stored image that matches or resembles the target image according to the result of the comparison. 2. The server according to claim 1, wherein said information addition unit records said image processing information according to the content of image processing executed by said image processing apparatus. 3. The server according to claim 2, wherein said recording of image processing information is addition of points. 4. The server according to any one of claims 1 to 3, wherein the information of the target image includes information capable of restoring the target image. 4. The method according to any one of claims 1 to 3, wherein the information of the target image includes information generated based on the target image, and does not include information capable of restoring the target image. server. 6. The server of claim 5, wherein the information generated based on the target image is a hash value. The comparison unit transmits to the image processing device one or more candidates of the stored image that match or are similar to the target image estimated by the comparison,
The information addition unit receives first specification information specifying at least one of the candidates from the image processing device, and performs the image processing in association with the stored image specified by the first specification information. 7. The server according to any one of claims 1 to 6, wherein information is recorded. a processing instruction unit that transmits the stored image to the image processing device and instructs the image processing device to execute image processing of the transmitted stored image;
a success/failure determination unit that determines success or failure of image processing of the stored image transmitted to the image processing device according to a notification from the image processing device;
The information addition unit records the image processing information in association with the stored image transmitted to the image processing device when the success/failure determination unit determines that the image processing by the image processing device has succeeded. The server according to any one of claims 1 to 7, characterized by: The information addition unit
When the information of the target image acquired by the acquiring unit includes second specifying information specifying the stored image, the image processing is performed in association with the stored image specified by the second specifying information. record information and
When the information of the target image acquired by the acquisition unit does not include the second specific information, the target image corresponds to the stored image that matches or is similar according to the result of the comparison by the comparison unit. 9. The server according to any one of claims 1 to 8, wherein the image processing information is recorded with an attachment. 10. The server according to any one of claims 1 to 9, further comprising a notification unit for notifying an owner of said stored image of said image processing information. An image processing device capable of communicating with a server,
an acquisition unit that acquires a target image;
a processing unit that performs predetermined image processing on the target image acquired by the acquisition unit;
When the image processing by the processing unit is successful, the information of the target image is transmitted to the server, and the stored image that is stored in the server and that matches or is similar to the target image is transmitted to the server. and a control unit that records image processing information related to the image processing in association with the image processing apparatus. The control unit analyzes the target image image-processed by the processing unit to determine whether confidential information is included,
if the target image includes confidential information, transmitting to the server information that includes information generated based on the target image and does not include information that can restore the target image, as information of the target image;
12. The image processing according to claim 11, wherein, when the target image does not include confidential information, information including information capable of restoring the target image is transmitted to the server as information of the target image. Device. An information recording method executed by a server communicable with an image processing device,
an acquisition step of acquiring information of a target image image-processed by the image processing device;
A comparison step of comparing information of the target image acquired in the acquisition step with information of a stored image stored in advance in a storage medium to determine whether the target image matches or resembles the stored image. and,
and an information adding step of recording image processing information related to the image processing in association with the stored image with which the target image matches or is similar according to the result of the comparison. An information upload method executed by an image processing device capable of communicating with a server,
an acquisition step of acquiring a target image;
a processing step of performing predetermined image processing on the target image obtained in the obtaining step;
When the image processing by the processing step is successful, the information of the target image is transmitted to the server, and the stored image that is stored in the server and that matches or is similar to the target image is transmitted to the server. and a control step of recording image processing information related to the image processing in association with the information upload method.

Images