JP3302038B2 - Image processing apparatus and control method thereof - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and a control method therefor, for example, to a function for preventing unauthorized copying.

[0002]

2. Description of the Related Art In recent years, with the improvement of performance of color copying machines and color printers, crimes of illegally copying originals for which copying is prohibited (hereinafter referred to as "specific originals") have been increased by using the same. ing.

[0005] On the other hand, measures to prevent unauthorized copying have been attempted by registering the image pattern of a specific document in a color copying machine, a color printer, or the like, and identifying the specific document by image recognition.

[0004]

However, the above technique has the following problems. (1) The image patterns that can be registered are limited, and it is practically impossible to register the image patterns of all specific manuscripts in Japan and overseas. (2) When the design of a specific manuscript is changed, it is necessary to update the storage means for registering the image pattern each time. (3) It is impossible to pre-register an image pattern such as a document protected by copyright or a confidential document. (4) Since the image recognition requires processing time, the throughput of the printing process is reduced. (5) When a specific document is placed obliquely on a document reading device such as a scanner, it may be difficult or impossible to determine whether the specific document is a specific document. (6) There is no device or system that monitors for improper operation of the image input / output device together with the input image.

An object of the present invention is to solve the above-mentioned problems, and to easily change or add a specific image, flexibly cope with various specific image determinations, and determine the specific image. It is another object of the present invention to control an image output in accordance with an operation of an image input / output device.

[0006]

The present invention has the following arrangement as one means for achieving the above object.

A control method according to the present invention provides an image input / output device and a communication unit for communicating with an external device having a function of determining coincidence with an arbitrary specific image or a function of determining operation information of the image input / output device. A method of controlling an image processing device comprising: notifying the external device of execution of a monitoring process in which the external device determines whether an image processed by the image input / output device matches a specific image. Stopping the operation of the image input / output device when there is no response from the external device to the notification, and receiving the response from the image input / output device when there is a response from the external device to the notification. The operation information and the image information of the image input / output device are stored in a memory, the operation information and the image information stored in the memory are transmitted to the external device, and the transmitted image information and the specific image are transmitted. And a determination result based on a comparison result between the transmitted operation information and the specific prohibited operation information is received from the external device, and the received determination information and the specific image are received. Based on a preset treatment method for the determination information indicating, based on the operation of the image input / output device, or, for the image input / output device, controlling the output of the image information stored in the memory, I do.

An image processing apparatus according to the present invention includes an image input / output device and an external device having a function of determining coincidence with an arbitrary specific image or a function of determining operation information of the image input / output device. Communication means, and an image processing apparatus having control means for controlling the image input / output device, wherein the control means determines whether an image processed by the image input / output device matches a specific image. Notifying the external device of the execution of the monitoring process of performing the determination in the external device, if there is no response from the external device to the notification, stop the operation of the image input and output device, the response to the notification When a response is received from an external device, the operation information and the image information of the image input / output device received from the image input / output device are stored in a memory, and the operation information and the image information stored in the memory are stored. Transmits image data to the external device,
A determination result of a match between the transmitted image information and the specific image,
And receiving, from the external device, determination information based on a determination result of the comparison between the transmitted operation information and the specific prohibited operation information, and receiving the determination information and the determination information indicating that the image is the specific image. The operation of the image input / output device or the output of image information stored in the memory to the image input / output device is controlled based on a preset treatment method.

[0009]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment according to the present invention will be described below in detail with reference to the drawings.

FIG. 1 is a block diagram showing a configuration example of a monitoring unit according to the embodiment.

In FIG. 1, reference numeral 100 denotes a CPU, which controls a monitoring unit and comprises a known microprocessor. Reference numeral 101 denotes a ROM for storing a program executed by the CPU 100. Reference numeral 102 denotes a RAM, which is used as a work area of the CPU 100. Reference numeral 103 denotes a backup RAM, which retains the stored contents even when the power supply of the monitoring unit is turned off.

Reference numeral 104 denotes a SCSI controller, 105 denotes a GPIB controller, 106 denotes a DMA controller, and 108 denotes a frame memory. The SCSI controller 104 and the GPIB controller 105 transmit and receive data to and from an external device (not shown),
Data is transferred to and from the frame memory 108 via the A controller 106. It should be noted that which of the GPIB / SCSI interface is used is determined by the CPU 100 detecting the state of a hardware switch (not shown).

Reference numeral 107 denotes a video I / F, and image data from the image input device is stored in the frame memory 108 via the video I / F 107. Further, the image data stored in the frame memory 108 can be sent to the image output device via the video I / F 107. Note that the memory capacity of the frame memory 108 is 32 MB each for RGB and 96 MB in total.

A binarizing circuit 109 converts the RGB multi-valued image data stored in the frame memory 108 into binary bit map image data.

Reference numeral 110 denotes a compression circuit for compressing the RGB multi-valued image data stored in the frame memory 108. In addition,
The compression ratio is fixed.

Reference numeral 111 denotes a coding circuit, and a frame memory 108
From the RGB multi-valued image data stored in the storage unit, and converts them into code data unique to the system.

FIG. 2 is a diagram showing an example of connection between the monitoring unit and an external device.

In FIG. 2, reference numeral 201 denotes a monitoring unit of the present embodiment. An image input / output device 202 includes an image input device 202a and an image output device 202b. 204 is an external device, and 205 is a communication line. Monitoring unit 2
01 is incorporated in the housing of the image input / output device 202, and when the monitoring unit 201 is removed, the image input / output device 202 does not operate.

The monitoring unit 201 includes a communication line 205
The operation of the image input / output device 202 is notified to the external device 204 via the communication line 205 while the operating of the image input / output device 202 is monitored in accordance with the instruction from the external device 204, and the operation of the image input / output device 202 is notified. Control.

Hereinafter, the operation of the monitoring unit 201 will be described in detail. FIG. 3 and FIG. 4 are flowcharts showing an example of the operation of the monitoring unit 201.

First, the initial setting of the monitoring unit 201 is performed. Specifically, the monitoring unit 201
When the mode designation command is received from the external device 204 in step S31, the mode data transmitted from the external device 204 in the format shown in Table 1 is received in step S32, and the received mode data is normal in step S33. If so, the process proceeds to step S35. If there is an abnormality in the received mode data, the process proceeds to step S34, notifies the external device 204 of the fraud information NAK, and then returns to step S32. In addition, NA
The external device 204 that has received K transmits the mode data again.

[Table 1]

If the received mode data is normal, the monitoring unit 201 confirms the ACK information in step S35.
Is notified to the external device 204, in step S36, initialization is performed based on the received mode data. The set contents are held in the backup RAM 103, and the set contents are not changed until they are initialized again by the external device 204.

The initial setting can be performed only from the external device 204 via the communication line 205, and cannot be performed by the image input / output device 202 or the monitoring unit 201 alone. Furthermore, after the initial setting is performed once, the external device 20
When 4 becomes unresponsive, the image input / output device 202 enters the operation prohibited state.

The mode data shown in Table 1 is composed of fields whose examples will be described below.

(1) Monitoring ON / OFF field: When this field is set to “1”, the monitoring unit 2
01 executes monitoring of the image input / output device 202 and notifies the external device 204 of the result based on the contents specified in the second and subsequent fields. When this field is set to '0', the monitoring unit 201 does not execute monitoring, and the settings in the second and subsequent fields become invalid.

(2) Information designation field: When this field is set to “0”, the monitoring unit 201 notifies the external device 204 of the setting information of the image input / output device 202 and the image data read by the image input device 202a. I do. If this field is set to '1', monitoring unit 2
01 notifies the external device 204 of the setting information of the image input / output device 202. When this field is set to “2”, the monitoring unit 201 notifies the external device 204 of the image data read by the image input device 202a.

(3) Area determination designation field: When this field is set to “1”, the monitoring unit 201
The image input device 202a reads the image data stored in the frame memory 108 and executes an image area determination process described later. When this field is set to “0”, the monitoring unit 201 does not execute the image area determination processing.

(4) Image conversion type designation field: The monitoring unit 201 converts the RGB multi-valued image data read by the image input device 202a and stored in the frame memory 108 into the following data according to the designated value of this field. I do. When '5' is specified, image data processing by software is executed. When '1' is specified, data conversion is not performed. When '2' is specified: Binary bitmap image data When '3' is specified: Compressed image data When '4' is specified: Coded data

(5) Print operation prohibition designation field:
If this field is “1”, the external device 204 determines that the copy is illegal, and the monitoring unit 201 forcibly prohibits the output operation of the image output device 202b. When this field is “0”, the monitoring unit 201 follows the setting of the next output operation designation field.

(6) Output operation designation field: External device 2
If it is determined that 04 is an illegal copy and the image output is not forcibly prohibited, the monitoring unit 201 performs the following operation by setting this field. When '0' is set: The image data read by the image input device 202a is output to the image output device 202b through. When '1' is set: For example, a pattern registered in the ROM 101 in advance is added to the image data read by the image input device 202a and stored in the frame memory 108 and output to the image output device 202b. When '2' is set: The image output mode is forcibly switched from full color output to black and white output.

When the initial setting is completed in step S36, the monitoring unit 201 waits for the operation of the image input / output device 202 in step S37. Then, after the operator sets the number of copies and the enlargement / reduction ratio via the operation unit of the image input / output device 202, the start key is used to instruct the start of copying, and a start request is sent from the image input / output device 202. If so, the process proceeds to step S38.

The monitoring unit 201 proceeds to step S38
In step S39, if the received operating information is normal, the process proceeds to step S41, where the confirmation information ACK is input to the image. Output device
Notify 202. If there is an abnormality in the received operating information, the process proceeds to step S40, notifies the image input / output device 202 of the illegal information NAK, and then returns to step S38. The image input / output device 202 that has received the NAK transmits the operating information again. The monitoring unit 20
1 stores the received operating information in, for example, the RAM 102 or the like.

[Table 2]

The operating information shown in Table 2 is composed of fields whose examples are described below. (1) Data length: Indicates the total data size of the operating information. (2) Model code: represents the model of the image input / output device 202. (3) Serial number: specifies the image input / output device 202,
For example, a device unique number of two unit length. (4) Command code and parameters: Image input / output device 20
A command code indicating the operator's operation for 2 and the parameters associated with the command.

When the monitoring unit 201 notifies the image input / output device 202 of an ACK, the image input device 202a reads an image. The monitoring unit 201 determines in step S42 that
The read image data is stored in the frame memory 108 via the video I / F 107, and in step S43, the image input device 202a
Step S42 is repeated until a read completion notification is received from. Note that the image input device 202a scans the entire area of the document table of the image input device 202a regardless of the mode specified by the operator.

Next, the processing of the monitoring unit 201 is branched in step S44 according to the initially set mode.

The monitoring ON / OFF field is '0',
That is, if the mode is set not to perform monitoring, the process proceeds to step S49, after transferring the image data stored in the frame memory 108 to the image output device 202b, the process proceeds to step S45, and output permission is transmitted to the image output device 202b. After the transmission, the process returns to step S31. Therefore, monitoring ON / OFF
When the field is “0”, the image output device 202b outputs the image data read by the image input device 202a and stored in the frame memory 108 as it is.

Next, when the monitoring ON / OFF field is "1", that is, when the monitoring mode is set, the monitoring unit 201 executes the monitoring processing in step S46.

FIG. 5 is a flowchart showing an example of the monitoring process executed by the monitoring unit 201.

First, the monitoring unit 201 sends a monitoring notification to the external device 204 in step S61. Subsequently, upon receiving the ACK from the external device 204 in step S62, the monitoring unit 201 proceeds to step S64. Also,
If a signal other than ACK is received from the external device 204, or if nothing can be received for a predetermined time, the process proceeds to step S63, where the image input / output device 202 is stopped in step S63 and the process ends.

Upon receiving the ACK from the external device 204, the processing of the monitoring unit 201 branches in step S64 according to the information designation field. In step S64,
If the information designation field is '0', the operating information stored in the RAM 102, for example, is stored in the external device 20 in step S66.
After sending to 4, the process proceeds to step S67. In the case of '1', the process proceeds to step S67, and in the case of '2', the operating information stored in the RAM
After the transmission to (4), the monitoring process ends, and the process proceeds to step S47 shown in FIGS.

The monitoring unit 201 determines in step S67
If the area determination specification field is '1', step S68
After executing the region determination processing of (1), the process proceeds to step S69. If not “1”, the process proceeds to step S69. Note that the area determination processing in step S68 scans the frame memory 108 that stores the image data read by the image input device 202a to detect, for example, a rectangular area 801 as shown in FIG. Direction size W, H (unit: pixel),
The inclination θ of the platen with respect to the X direction is detected.

Subsequently, if the image conversion type designation field is "1" in step S69, the flow advances to step S71. If the value is not '1', the process proceeds to step S70. After performing image processing in step S70, the process proceeds to step S71.

The image processing in step S70 is performed by converting the image data stored in the frame memory 108 included in the rectangular area detected in step S68 into a binary form by the binarization circuit 109 when the image conversion type designation field is "2". In the case of '3', the data is compressed by the compression circuit 110, and in the case of '4', the coding circuit 11
It is coded by 1, and in the case of '5', it is processed by the image processing software of the specified address. Note that the image processing software in the case where the image conversion type designation field is “5” can be downloaded from the external device 204 to the RAM 102, for example.

In step S71, the monitoring unit 201
After transferring the image data with the header of the format shown in Table 3 to the external device 204, the monitoring process ends, and the process proceeds to step S47 shown in FIGS. The “data length” shown in Table 3 represents the total data size of the header and the image data. The “model code” and “serial number” shown in Table 3 are the same as the data of the same name shown in Table 2, and the “information specification” and “area determination specification” shown in Table 3 are the same as the data of the same name shown in Table 1. Therefore, detailed description is omitted.

[Table 3]

As described above, when the area determination designation field is "1", the monitoring unit 201 converts only the image data stored in the frame memory 108 included in the rectangular area detected in step S68 into the image conversion. Based on the type designation field, the image is processed in step S70 and then transferred to the external device 204. Therefore, the amount of image data transferred in step S71 can greatly reduce the transfer time as compared with transferring all image data stored in the frame memory 108 to the external device 204 as it is.

When the monitoring unit 201 completes the monitoring processing shown in FIG. 5, the monitoring unit 201 subsequently waits for a determination notification from the external device 204 in step S47 shown in FIGS. Execute the process.

FIG. 6 is a flowchart showing an example of the post-judgment processing.

The external device 204 includes a monitoring unit 201
The monitoring unit 201 compares the monitoring information notified from the MFP with the pre-registered image pattern of the specific document and the contents of the prohibited operation, determines whether to prohibit or permit the image output, and notifies the monitoring unit 201 of the determination result.

In step S91, if the notification from the external device 204 indicates that output is prohibited, the process proceeds to step S92. If the output is permitted, the process proceeds to step S98, in which the image data stored in the frame memory 108 is sent to the image output device 202b. Then, the post-determination process ends, and the process proceeds to step S45 shown in FIGS.
That is, when the notification from the external device 204 indicates that output is permitted,
The image output device 202b outputs the image data read by the image input device 202a and stored in the frame memory 108 as it is.

If the print operation prohibition designation field is "0" in step S92, the flow advances to step S94. Also '1'
In the case of, the image input / output device 202 is stopped in step S93, and the process ends.

The print operation prohibition designation field is '0'
In the case of, the monitoring unit 201 performs steps S94 and S9
If the output operation specification field is '0' in step 5,
Proceeding to S98, the image data stored in the frame memory 108 is transferred to the image output device 202b through. If the value is '1', the process proceeds to step S97, in which, for example, a pattern registered in advance in the ROM 101 is added to the image data stored in the frame memory 108, and the image data obtained by adding the pattern in step S98 is output as an image. Transfer to the device 202b. In the case of '2', the process proceeds to step S96, in which the image output mode of the image output device 202b is forcibly changed from the full color mode to the black and white mode, and the image data stored in the frame memory 108 in step S98 is converted to an image. Output device 2
Transfer to 02b.

The add-on of the pattern performed in step S97 is, for example, "INVALID" (invalid) on the entire surface of the image output 1902 when copying the specific original 1901 shown in FIG.
And add-on characters.

When the image data transfer in step S98 is completed, the monitoring unit 201 ends the post-determination processing, and proceeds to step S45 shown in FIGS. Therefore, the image output device 202b sets the monitoring unit 201 to step S98.
To output the transferred image data.

While the image input / output device 202 is ON, the series of processes shown in FIGS. 3 to 6 is repeatedly executed unless the process of step S63 shown in FIG. 5 or step S93 shown in FIG. 6 is executed. .

In the above description and FIG. 2, the embodiment in which the monitoring unit 201 of this embodiment is built in the housing of the image input / output device 202 has been described. However, this embodiment is not limited to this. For example, a form external to the image input / output device 202 may be used. However, in the case of an external connection, the image input / output device 202 is also provided with a storage unit for the monitoring mode, and provided with a control unit that does not operate when the monitoring unit 201 is disconnected during monitoring.

In the above description and FIG. 7, an example in which a character string pattern recognizable by the operator is added on has been described. However, the present embodiment is not limited to this.
The pattern to be added on is, for example,
ID code, information such as a serial number or a time stamp, or an operator-specific identification code may be symbolized and added as an unrecognizable pattern to the operator,

In the above description and figures, the ROM 1
The example in which the fixed pattern registered in 01 is added on has been described, but the present embodiment is not limited to this.For example, by setting the add-on pattern in the backup RAM 103, for example, the add-on pattern can be May be downloaded. Further, a plurality of add-on patterns can be stored and can be arbitrarily selected from the external device 204, for example.

In the above description and drawings, the example in which the image output mode of the image output device 202 is forcibly changed to the black and white mode has been described. However, the present embodiment is not limited to this. Based on the operation information of
For example, the mode can be changed to an arbitrary mode according to an instruction from the external device 204.

In the above description and FIG. 1, the example in which the SCSI / GPIB interface is used as the communication means with the external device 204 has been described. However, the present embodiment is not limited to this. Any interface having a two-way communication function capable of exchanging information between the unit 201 and the external device 204 may be used.

As described above, according to the present embodiment,
The operation contents and operation procedure of the image input / output device 202 and the read image are monitored, and the information is processed and notified to the external device 204 according to the instruction of the external device 204, and the determination result of the external device 204 based on the notified information is processed. Accordingly, it is possible to prohibit the operation of the image input / output device 202, add on the pattern to the output image of the image output device 202b, or forcibly set the image output mode of the image output device 202b to the monochrome mode. Therefore, it is possible to prevent unauthorized copying and the like, and to improve the accuracy of determination of unauthorized copying and shorten the determination time. Further, even when a specific document or the like is placed obliquely on the document reading table of the image input device 202a, it is possible to determine whether the document is a specific document or the like.

Further, according to this embodiment, copying can be prohibited not only for a specific document such as a bill or securities but also for any document, and the copying operation is monitored for any operation. be able to.

Further, since the image pattern is registered in the external device 204 and the specific document or the like can be determined by the external device 204, the image pattern of the specific document or the like is registered in the storage unit of the monitoring unit 201 or the image input / output device 202. You don't have to. Therefore, there are the following advantages. (1) By providing the external device 204 with storage means having a sufficient memory capacity, it is also possible to register the image patterns of all the specific documents in Japan and overseas. (2) When the design of the specific document is changed, it is not necessary to update the storage unit of the monitoring unit 201 or the image input / output device 202. (3) Image patterns such as documents protected by copyright and confidential documents can be registered in advance. (4) By using a high-speed device as the external device 204, the processing time required for image recognition can be reduced,
It is possible to prevent a decrease in the throughput of the printing process.

The present invention may be applied to a system constituted by a plurality of devices or to an apparatus constituted by a single device. Further, it goes without saying that the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or an apparatus.

[0064]

As described above, according to the present invention,
It is possible to easily change or add a specific image, flexibly respond to various specific image determinations, and control image output according to the specific image determination result and the operation of the image input / output device. .

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration example of a monitoring unit according to an embodiment of the present invention;

FIG. 2 is a diagram showing a connection example between a monitoring unit and an external device,

FIG. 3 is a flowchart showing an example of the operation of the monitoring unit;

FIG. 4 is a flowchart showing an example of the operation of the monitoring unit;

FIG. 5 is a flowchart illustrating an example of a monitoring process;

FIG. 6 is a flowchart illustrating an example of post-determination processing;

FIG. 7 illustrates an example of area determination.

FIG. 8 is a diagram illustrating an example of a pattern add-on.

──────────────────────────────────────────────────続 き Continued on the front page (58) Field surveyed (Int.Cl. ⁷ , DB name) H04N 1/00 H04N 1/40-1/409 H04N 1/46-1/64

Claims (5)

(57) [Claims] 1. An image input / output device and a function of determining coincidence with an arbitrary specific image or a function of the image input / output device
A method of controlling an image processing apparatus including a communication unit with an external device having a function of determining operation information , wherein an image processed by the image input / output device matches a specific image.
A monitoring process for determining whether or not to perform
Notify the external device of the execution of the processing, if there is no response from the external device to the notification, stop the operation of the image input and output device, if there is a response from the external device to the notification, Of the image input / output device received from the image input / output device
Operation information and the image information stored in the memory, the operation information and the image information stored in the memory and transmitted to the external device, the determination result of the match between the specific image and the transmitted image information,
And the ratio of transmitted operation information to specific prohibited operation information
Receiving the determination information based on the comparison determination result from the external device, and determining that the received determination information is the specific image.
Based on a preset treatment methods against decision information indicating the operation of the image output device, or, with respect to the image input and output apparatus, and controls the output of the image information stored in the memory Control method. 2. The method according to claim 1, wherein the control is one of permitting or prohibiting output of the image information, adding and outputting a predetermined pattern to the image information, and setting the image output to black and white. A control method according to item 1. 3. The control method according to claim 1, further comprising setting in advance whether or not to execute the monitoring process based on setting information received from the external device. 4. The method according to claim 1, further comprising: setting in advance the treatment method for image information determined to match the specific image based on setting information received from the external device. Control method. 5. An image input / output device and a function of determining coincidence with an arbitrary specific image or a function of the image input / output device
Means for communicating with an external device having the function of determining the operation information, and an image processing apparatus for <br/> have a control means for controlling said image input apparatus, the control means, the image input and output The image processed by the device matches the specific image
A monitoring process for determining whether or not to perform
Notify the external device of the execution of the processing, if there is no response from the external device to the notification, stop the operation of the image input and output device, if there is a response from the external device to the notification, Of the image input / output device received from the image input / output device
Operation information and the image information stored in the memory, the operation information and the image information stored in the memory and transmitted to the external device, the determination result of the match between the specific image and the transmitted image information,
And the ratio of transmitted operation information to specific prohibited operation information
Receiving the determination information based on the comparison determination result from the external device, and determining that the received determination information is the specific image.
Based on a preset treatment methods against decision information indicating the operation of the image output device, or, with respect to the image input and output apparatus, and controls the output of the image information stored in the memory Image processing device.