JP2010219785A - Image processing system, image processor, and terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing system which can simply obtain image data to be composited from an external terminal without being followed by operations such as loading and unloading, etc., and can composite it to a designated position on an original image. <P>SOLUTION: The image data to be composited and fingerprint data to be verified have in advance been stored in a terminal device 30. A complex machine 10 includes a display part equipped with a touch panel, and displays the original image on the display part, and when a user depresses a position where the user desires to composite on an original screen by the user's finger, the depression position is recognized and the finger's fingerprint is read. The user's finger and body become a communication path during depression, the complex machine 10 is communicably connected to the terminal device 30, and the fingerprint data is given and received to carry out a fingerprint verification. When succeeding in the verification, the complex machine 10 obtains the image data from the terminal device 30, and composites this image data to the designated compositing position on the original image. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing system that synthesizes another image data at a specified position in image data.

  2. Description of the Related Art In recent years, there are multifunction devices capable of synthesizing a small image such as a stamp with an image displayed on a display unit and transmitting the synthesized image by facsimile or printing it out.

  For example, there is a type in which seal data (a seal image) is registered in advance in a multifunction peripheral and the seal data is synthesized at a specified position in the image data. Specifically, as advance preparation, the fingerprint information of each user and the seal data of the user are registered in the multi-function peripheral. In the actual pasting operation, the entire image data to be pasted with the seal data is displayed on a display unit having a touch panel function. When the touch panel senses that the user's finger has touched the display area of the image data, the position of the finger is recognized from the contact information to determine the position where the seal data is pasted, and the touch information is acquired from the contact information. Seal data associated with fingerprint information is selected from registered seal data, and the seal data is pasted on image data (see Patent Document 1).

JP 2008-92490 A

  Although it is convenient to synthesize the seal image of the touched user at the touched position by simply touching the display unit with a finger, the user's fingerprint information and seal data are preliminarily stored in a multi-function printer. It is not preferable in terms of security to register.

  In addition, the above functions cannot be used unless fingerprint information and seal data are registered in advance in the multifunction device, which is inconvenient. Also, there was no way to leave the composite image even if it was necessary to keep it.

  Instead of registering fingerprint information and seal data inside the multifunction device, fingerprint information and seal data are stored in advance in a removable storage medium such as a USB (Universal Serial Bus) memory, and then inserted into the multifunction device. Although a method is also assumed, it is complicated to attach and detach the USB memory and the like, and there is a concern about information leakage due to forgetting to remove it.

  The present invention is intended to solve the above-described problem, and is an image processing system capable of easily obtaining data to be synthesized from an external terminal and performing image synthesis at a specified position without any work such as attachment / detachment. Another object of the present invention is to provide an image processing device and a terminal device included in the device.

  The gist of the present invention for achieving the object lies in the inventions of the following items.

[1] a display unit for displaying an image based on image data;
A detection unit for detecting a pressed position on the screen of the display unit;
A communication unit that communicates with a terminal device connected using the human body pressing the screen of the display unit as a communication path;
While the screen of the display unit is being pressed, the communication unit acquires predetermined data from the terminal device, and the image data of the image displayed on the display unit is based on the acquired data A control unit that synthesizes image data into a synthesis position corresponding to the position of the press detected by the detection unit;
An image processing apparatus comprising:
A storage unit for storing the data;
A communication unit that transmits the data stored in the storage unit to the image processing apparatus using a human body pressing the screen of the display unit as a communication path;
An image processing apparatus system comprising: a terminal device comprising:

  In the above invention, when the screen of the display unit of the image processing apparatus is pressed, the image processing apparatus detects the pressed position, and combines from the terminal device connected using the pressed user's finger and body as a communication path. The data related to the image is acquired, and the image to be synthesized is synthesized at the pressed position in the image displayed on the display unit. As a result, the user simply presses the screen of the display unit on which the original image is displayed with his / her finger, and the image to be synthesized based on the data stored in advance in the terminal device carried by the user is stored in the original image. Can be synthesized at the pressed position, providing extremely high convenience. Further, since data related to the image to be combined is stored in the personal terminal device and not stored in the shared image processing device, security can be ensured.

[2] The image processing apparatus further includes a fingerprint detection unit that acquires fingerprint information of a finger pressing the screen of the display unit, and the control unit is connected to the terminal device connected through the communication path. Send the fingerprint information acquired by the fingerprint detector,
The terminal device further stores fingerprint information for collation in the storage unit, and collates the fingerprint information received from the image processing device with the fingerprint information for collation stored in the storage unit. , Sending the collation result to the image processing apparatus through the communication path,
[1] The image processing apparatus performs the combination when the collation result of the collation success is received from the terminal apparatus, and does not perform the combination when the collation result of the collation success is not received. Image processing system.

  In the above invention, the image processing apparatus reads the fingerprint information when the display unit is pressed with a finger and transmits the fingerprint information to the terminal apparatus through the human body, and the terminal apparatus stores the matching information stored in advance in the own apparatus. The fingerprint information and the fingerprint information received from the image processing apparatus are collated, and the collation result is returned to the image processing apparatus. Only when the image processing apparatus is successfully verified, the image obtained from the terminal apparatus is synthesized. Since fingerprint verification is performed by the terminal device that stores the fingerprint information for verification, leakage of the fingerprint information for verification is prevented.

[3] The image processing apparatus further includes a fingerprint detection unit that acquires fingerprint information of a finger pressing the screen of the display unit, and the control unit is connected to the terminal device connected via the communication path. Send a request to send fingerprint information for verification,
The terminal device further stores fingerprint information for verification in the storage unit, and transmits the fingerprint information for verification to the image processing device through the communication path in response to the transmission request.
The image processing device collates the fingerprint information for collation received from the terminal device with the fingerprint information acquired by the fingerprint detection unit, and performs the composition if the collation result is a collation success, and the collation is not successful. In the case, the image processing system according to [1], wherein the synthesis is not performed.

  In the above invention, the image processing apparatus reads the fingerprint information when the display unit is pressed with a finger, receives the fingerprint information for collation stored in advance by the terminal device from the terminal device, and the fingerprint information for collation And fingerprint comparison with the read fingerprint information. Only when the collation is successful, the image obtained from the terminal device is synthesized. Since fingerprint collation is performed on the image processing device side, the processing burden on the terminal device is reduced.

[4] The image processing device transmits the combined image data to the terminal device through the communication path,
The image processing system according to any one of [1] to [3], wherein the terminal device that has received the image data stores the image data in the storage unit.

  In the above invention, the combined image data is stored in the terminal device as a record.

[5] The image processing system according to any one of [1] to [4], wherein the image processing apparatus further includes a fine adjustment setting unit that receives an operation of finely adjusting the composite position.

  In the above invention, the combined position can be determined by finely adjusting the position pressed by the finger.

[6] The image processing apparatus further includes a synthesis target selection unit that receives a selection operation of data to be synthesized from among a plurality of data received from the terminal device. 5]. The image processing system according to any one of [5].

  In the said invention, the image of a synthetic | combination object can be selected from the some data memorize | stored in the terminal device.

[7] The data to be synthesized that the image processing device acquires from the terminal device is text data,
The image processing system according to any one of [1] to [6], wherein the control unit combines image data obtained by converting the text data into a two-dimensional barcode.

  In the above invention, the text data stored in the terminal device is converted into a two-dimensional bar code and synthesized with the original image.

[8] An image processing apparatus included in the image processing system according to any one of [1] to [7].

[9] A terminal device included in the image processing system according to any one of [1] to [7].

  According to the image processing system, the image forming apparatus, and the terminal device according to the present invention, it is possible to easily obtain the data to be combined from an external terminal and synthesize the image at a specified position without any work such as attachment / detachment.

It is explanatory drawing which shows the system configuration example of the image processing system which concerns on embodiment of this invention. 1 is a block diagram illustrating a schematic configuration of a multifunction machine as an image processing apparatus. It is a block diagram which shows schematic structure of a terminal device. It is explanatory drawing which shows the sequence of an image synthesis in the case of non-authentication mode and only one data registered in the terminal device. 5 is a flowchart showing the operation of the multifunction machine in the sequence of FIG. It is a flowchart which shows operation | movement of the terminal device in the sequence of FIG. It is explanatory drawing which shows the sequence of an image synthesis | combination in a non-authentication mode and when several data are registered into the terminal device. It is a flowchart which shows operation | movement of the multifunctional device in the sequence of FIG. It is a flowchart which shows operation | movement of the terminal device in the sequence of FIG. It is explanatory drawing which shows the sequence of an image synthesis | combination in the case where only one data is registered into a non-authentication mode and a terminal device is subjected to fine adjustment of the composition position. 11 is a flowchart showing the operation of the multifunction machine in the sequence of FIG. It is a front view which shows an example of the operation panel on which the screen which receives designation | designated of a synthetic | combination position was displayed. It is explanatory drawing which shows the sequence of an image composition in the case of performing fingerprint collation with a terminal device. 14 is a flowchart illustrating the operation of the multifunction peripheral in the sequence of FIG. It is a flowchart which shows operation | movement of the terminal device in the sequence of FIG. FIG. 11 is an explanatory diagram illustrating an image composition sequence when fingerprint matching is performed by a multifunction peripheral. FIG. 17 is a flowchart showing the operation of the multifunction machine in the sequence of FIG. 16. It is a flowchart which shows operation | movement of the terminal device in the sequence of FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows a system configuration example of an image processing system 5 according to an embodiment of the present invention. The image processing system 5 includes a multifunction device 10 as an image processing device, and a terminal device 30 that is carried by a user operating the multifunction device 10 in a pocket or wearing it.

  The multi-function device 10 has a copy function for optically reading a document image and printing the duplicate image on a recording paper, a scan function for saving the image data of the read document as a file, and transmitting it to an external terminal, a personal computer This is an apparatus called a multi-function machine having a PC print function for forming and outputting an image related to a print job received from an external terminal on a recording sheet, a facsimile function for transmitting and receiving image data, and the like.

  Furthermore, the multifunction machine 10 has a function of inserting and synthesizing an image to be synthesized such as a stamp or seal imprint on an original image such as a displayed document and transmitting or printing it out. Data relating to the compositing target image is stored in the terminal device 30 in advance. When a user wearing this terminal device 30 touches a desired composite position on the display screen of the multifunction device 10 on which the original image is displayed with the finger, the user's human body becomes a communication path and the multifunction device 10 The terminal device 30 is connected. The multifunction machine 10 acquires data from the terminal device 30 through the human body communication path. The multifunction machine 10 includes a touch panel as a detection unit that detects a position pressed by the user with a finger on the display unit screen, determines a composite position of the image from the detected pressed position, and is displayed on the display unit. A function for synthesizing an image based on data acquired from the terminal device 30 is provided at the synthesis position on the original image.

  Further, when compositing an image that requires security, such as seal imprint data, personal authentication is performed by fingerprint verification. In the image processing system 5, fingerprint data for collation is stored in advance in the terminal device 30, and the multifunction device 10 has a function of reading the fingerprint of the finger when the user presses the display unit with the finger. Then, only when the MFP 10 or the terminal device 30 collates the fingerprint data of the fingerprint read by the MFP 10 with the fingerprint data for collation stored in the terminal device 30 and succeeds in the personal authentication. An image is combined with an image.

  Communication methods using a human body as a communication path (also referred to as human body communication) include a current method and an electric field method. Human body communication is a technology that performs short-distance data communication using the human body as a communication path, and the current method is a method of communicating by passing a weak current (alternating current) through the human body and putting data (information) on the current. It is. Data communication is possible simply by touching the electrode of the information terminal with a hand equipped with a communication device such as a wristwatch. In the electric field system, by generating an electric field in the vicinity of the human body, the human body, which is a dielectric, is dielectrically polarized, and the entire human body becomes a communication path that encloses the electric field. In the electric field method, since the fluctuation of the electric field is detected as a signal, the transceiver and the human body do not need to be in direct contact with each other, and communication can be established even if there is an insulator between the signal paths. The terminal device 30 has a human body communication function, and can be in the form of a card type (for example, embedded in an employee card), a wristwatch type, a key type, or the like.

  FIG. 2 is a block diagram illustrating a schematic configuration of the multifunction machine 10. The multifunction device 10 includes a reading unit 13, a recording unit 14, a ROM (Read Only Memory) 15, and a RAM (Random) via a bus 12 to a CPU (Central Processing Unit) 11 that controls the operation of the multifunction device 10. Access Memory) 16, display unit 17, operation unit 18, image processing unit 21, external terminal communication unit 22, network communication unit 23, communication control unit 24, power supply control unit 25, and hard disk device 26. And a modem 27 and the like are connected. An NCU (Network Control Unit) 28 is connected under the modem 27.

  The reading unit 13 optically reads a document image and acquires image data. For example, the reading unit 13 forms a light source that irradiates light on a document, a line image sensor that receives the reflected light for one line in the width direction, and guides reflected light from the document to the line image sensor. In addition to an optical system including a lens and a mirror to be moved, a moving mechanism that sequentially moves the reading position in units of lines in the length direction of the document by moving the mirror and the light source is provided.

  The recording unit 14 forms and outputs an image based on the image data on a recording sheet by an electrophotographic process. The recording unit 14 includes, for example, a recording paper conveyance device, a photosensitive drum, a charging device, an LD (Laser Diode) that is controlled to be turned on according to input image data, and laser light emitted from the LD. It is configured as a so-called laser printer having a scanning unit that scans on a photosensitive drum, a developing device, a transfer separating device, a cleaning device, and a fixing device. Instead of an LED printer that irradiates a photosensitive drum with an LED (Light Emitting Diode) instead of a laser beam, other types of printers may be used.

  Various programs and fixed data are stored in the ROM 15, and the CPU 11 executes various processes according to these programs. The RAM 16 is used as a work memory for temporarily storing various data when the CPU 11 executes a program and an image memory for temporarily storing image data. The hard disk device 26 is used for storing image data of a document read by the reading unit 13, print data received from an external PC (personal computer), image data received by facsimile, and the like.

  The display unit 17 is configured by a liquid crystal display or the like, and displays various screens such as an operation screen, a setting screen, a guidance screen, and a communication history screen. The operation unit 18 includes various buttons such as a mode selection button, a start button, a stop button, and a numeric keypad, and a pressed position detection unit that is provided on the surface of the liquid crystal display and detects a pressed coordinate position. 19 and a fingerprint detection unit 20 that reads a fingerprint of a finger pressed on the screen of the display unit 17. The fingerprint detection unit 20 is configured to read a fingerprint using information detected by the touch panel (pressed position detection unit 19), for example. Other methods may be used for reading the fingerprint.

  The image processing unit 21 performs various kinds of image processing such as image correction, rotation, enlargement / reduction, compression / expansion on the image data. Also, an image composition process for synthesizing another image data with the image data is performed. The image processing unit 21 or the CPU 11 performs the process of combining the synthesis target image obtained from the terminal device 30 with the original image.

  The external terminal communication unit 22 performs a function of transmitting / receiving various data to / from the terminal device 30 using the human body as a communication path. An electrode (antenna) serving as a connection point with the human body is provided on the surface of the display unit 17 in the current method, and is provided, for example, on the surface of the display unit 17 or around the screen of the display unit 17 in the electric field method.

  The network communication unit 23 performs a function of transmitting / receiving various data to / from an external PC through a network such as a LAN (Local Area Network). The communication control unit 24 performs protocol control related to facsimile communication. The modem 27 modulates and demodulates the digital signal so that it can be transmitted as an analog signal, and the NCU 28 is connected to a public telephone line and performs control and detection regarding outgoing and incoming calls.

  The power supply control unit 25 controls the power supply to each part of the multi-function device 10 and supplies the power to all parts other than the normal mode for supplying power to all parts of the multi-function device 10 and the part that detects the start of user operation or an incoming call. Switching control with the stopped power saving mode is performed.

  In addition, the multi-function device 10 includes a sound generation unit for generating a “beep” sound or making a sound announcement.

  FIG. 3 is a block diagram illustrating a schematic configuration of the terminal device 30. The terminal device 30 includes a ROM 31, a RAM 34, a storage unit 35, a data input unit 36, a display unit 37, an operation unit 38, and a main body communication unit through a bus 32 to a CPU 31 that performs overall control of the operation of the terminal device 30. 39 etc. are connected.

  The ROM 33 stores various programs executed by the CPU 31 and various fixed data. The RAM 34 is used as a work memory that temporarily stores various data when the CPU 31 executes a program, a communication buffer that temporarily stores data related to transmission and reception, and the like.

  The storage unit 35 is a nonvolatile memory, and stores data used for synthesis and fingerprint data for verification. The data for combining stores image data of an arbitrary stamp, image data used as a watermark, image data such as seal data (image data of seal stamp), or text data that is the basis of the image to be combined. The The text data is, for example, converted into a two-dimensional barcode in the multifunction machine 10 and the image is used as an image to be synthesized.

  The data input unit 36 is an interface unit that inputs data stored in the storage unit 35 from the outside. The display unit 37 is configured with a liquid crystal display or the like, and displays an operation screen, a setting screen, and the like. The operation unit 38 includes a touch panel on the liquid crystal display, operation switches, and the like. The main body communication unit 39 has a function of transmitting / receiving various data to / from the multifunction machine 10 using the human body as a communication path.

  Next, an operation when the image processing system 5 pastes and composites a stamp, a seal, and the like on the original image will be described. Hereinafter, it is assumed that the terminal device 30 stores image data as data to be combined in the storage unit 35.

  The original image to be combined with an image such as a stamp or seal image includes an image obtained by reading by the reading unit 13, an image received from an external PC, an image obtained by rasterizing print data received from an external PC, and the hard disk device 26. Images stored in are used. The multifunction machine 10 receives the original image from the user or performs a designation operation, and displays the designated original image (an image corresponding to the designated image data) on the display unit 17.

  The operation of combining the image to be combined with the original image displayed on the display unit 17 includes a non-authentication mode that does not perform personal authentication and an authentication mode that performs personal authentication using fingerprints. The non-authentication mode is suitable for use when an image that does not require security management is to be combined. The authentication mode is suitable for use when an image requiring security management is to be synthesized. For example, it is suitable when the compositing target image is an imprint.

  Furthermore, in each of the non-authentication mode and the authentication mode, there are operations such as when only one image data is registered as a compositing target in the terminal device 30, when a plurality of registrations are registered, and when a composite position is finely adjusted, Each case will be described below.

  First, a case where only one data (image data to be combined) is registered in the terminal device 30 in the non-authentication mode will be described.

  4 shows an image composition sequence when only one data is registered in the terminal device 30 in the non-authentication mode, FIG. 5 shows an operation flow of the MFP 10 in that case, and FIG. 6 shows a terminal in that case. The flow of operation of the device 30 is shown respectively.

  The multifunction machine 10 displays the original image on the display unit 17 (FIG. 5: Step S101). In this state, the multifunction machine 10 waits for the user wearing the terminal device 30 to touch the original image displayed on the display unit 17 (FIG. 5: Step S102; No). The user presses (touches) a position where the stamp is desired to be combined on the original image displayed on the display unit 17.

  When the pressed position detection unit 19 detects the pressing of the screen of the display unit 17 by the user (FIG. 5: Step S102; Yes, FIG. 4: P1), the multifunction machine 10 recognizes the pressed position information indicating the pressed position. (FIG. 5: Step S103). The pressed position information is represented, for example, by coordinate information with the lower left on the screen of the display unit 17 as the origin.

  Subsequently, the multifunction device 10 transmits an image data transmission request for requesting transmission of image data to be combined to the terminal device 30 (FIG. 5: step S104, FIG. 4: P2), and returns a reply from the terminal device 30. Wait (FIG. 5: Step S105; No).

  Receiving the image data transmission request (FIG. 6: Step S201; Yes, S202; Yes), the terminal device 30 transmits the image data of the compositing target image stored in the storage unit 35 to the multifunction device 10 (FIG. 6, FIG. 6). Step S203, FIG. 4: P3).

  When receiving the image data of the compositing target image from the terminal device 30 (FIG. 5: Step S105; Yes), the multifunction machine 10 recognizes the received image data at the composite position corresponding to the pressed position information recognized and stored in Step S103. The image is synthesized (FIG. 5: Step S106, FIG. 4: P4). Further, the multifunction machine 10 transmits the image data of the synthesized image generated by the synthesis together with the storage request for the synthesized image to the terminal device 30 (FIG. 5: Step S107, FIG. 4: P5), and stores from the terminal device 30. It waits for a reply to the completion notification (FIG. 5: Step S108; No).

  The terminal device 30 that has received the composite image image data and the composite image storage request (FIG. 6: Step S201; Yes, S202; No, S204; Yes) stores the received composite image image data in the storage unit 35. After that (FIG. 4: P6), a storage completion notification is transmitted to the multifunction machine 10 (FIG. 6: step S205, FIG. 4: P7).

  Upon receiving the storage completion notification from the terminal device 30 (FIG. 5: Step S108; Yes), the multifunction device 10 may release the pressed finger from the user, for example, by sounding a “beep” sound. A notification that the status has been reached (FIG. 5: step S109) and a message indicating that the storage of the copy (composite image) has been completed is displayed on the display unit 17 (FIG. 5: step S110, FIG. 4: P8). End processing (END). It is desirable that the message is displayed at a position avoiding the portion where the synthesis target image is synthesized or displayed in a dedicated message area.

  In the multi-function device 10, an operation according to a user instruction, for example, facsimile transmission or printout is performed on the combined image after combining.

  As described above, the user wearing the terminal device 30 simply presses the desired combining position on the original image displayed on the display unit 17 with a finger, and the image to be combined stored in the terminal device 30 is stored. Since the data is automatically synthesized at the pressed position, a synthesis target image such as a stamp can be synthesized at a designated position in the original image with a simple operation. Further, since the combined image is automatically stored in the terminal device 30 as a copy, the copy can be taken without taking time and effort.

  Further, since the image data of the compositing target image is acquired from the terminal device 30, it is not necessary to register the image data in the multifunction device 10 in advance, and the work related to registration is reduced. In particular, a plurality of multifunction devices 10 are used. It is effective in the case.

  Further, since the timing of releasing the finger is notified, it is possible to prevent an error that the user releases the finger during communication. In addition, the user can release his / her finger in peace by receiving the notification.

  Next, a case where a plurality of data (image data to be combined) is registered in the terminal device 30 in the non-authentication mode will be described.

  7 shows a sequence of image composition when a plurality of data is registered in the terminal device 30 in the non-authentication mode, FIG. 8 shows a flow of operation of the multifunction machine 10 in that case, and FIG. 9 shows a terminal device in that case. The flow of 30 operations is shown respectively.

  The multifunction machine 10 displays the original image on the display unit 17 (FIG. 8: Step S301). In this state, the multifunction machine 10 waits for the user wearing the terminal device 30 to touch the original image displayed on the display unit 17 (FIG. 8: Step S302; No). The user presses (touches) a position where the stamp is desired to be combined on the original image displayed on the display unit 17.

  When the pressed position detection unit 19 detects that the user presses the display unit 17 screen (FIG. 8: Step S302; Yes, FIG. 7: P1), the multifunction machine 10 recognizes the pressed position information indicating the pressed position. Store (FIG. 8: Step S303).

  Subsequently, the multifunction device 10 transmits an image data transmission request for requesting transmission of image data to be combined to the terminal device 30 (FIG. 8: step S304, FIG. 7: P2), and returns a reply from the terminal device 30. Wait (FIG. 8: Step S305; No).

  The terminal device 30 that has received the image data transmission request (FIG. 9: Step S401; Yes, S402; Yes) transmits all the image data of the plurality of compositing target images stored in the storage unit 35 to the multifunction device 10 ( FIG. 9, step S403, FIG. 7: P3).

  Upon receiving the image data of the compositing target image from the terminal device 30 (FIG. 8: Step S305; Yes), the multifunction machine 10 releases the pressed finger to the user by, for example, sounding a “beep” sound. Is in a good state (FIG. 8: step S306). Further, all the received compositing target images are displayed on the pop-up screen (FIG. 8: Step S307, FIG. 7: P4), and an operation for selecting an image to be composited from them is received from the user (FIG. 8: Step S308). ).

  When an image is selected from a plurality of synthesis target images displayed in a pop-up (step S308; Yes, FIG. 7: P5), the image data of the selected image is recognized and stored in step S303 and corresponds to the pressed position information. The original image is synthesized at the synthesis position (FIG. 8: Step S309, FIG. 7: P6). Further, the multifunction machine 10 transmits the image data of the synthesized image generated by the synthesis together with the request for storing the synthesized image to the terminal device 30 (FIG. 8: step S310, FIG. 7: P7), and the storage from the terminal device 30. It waits for a reply to the completion notification (step S311; No).

  The terminal device 30 that has received the composite image image data and the composite image storage request (FIG. 9: Step S401; Yes, S402; No, S404; Yes) stores the received composite image image data in the storage unit 35. After that (FIG. 7: P8), a storage completion notification is transmitted to the multifunction machine 10 (FIG. 9: Step S405, FIG. 7: P9).

  When the multifunction device 10 receives the storage completion notification from the terminal device 30 (FIG. 8: Step S311; Yes), the multifunction device 10 notifies the user of the timing of releasing the pressed finger by, for example, sounding a “beep” sound. (FIG. 8: Step S312), and a message to the effect that storage of the copy (composite image) has been completed is displayed on the display unit 17 (FIG. 8: Step S313, FIG. 7: P10), and the process ends (END). .

  In the multi-function device 10, an operation according to a user instruction, for example, facsimile transmission or printout is performed on the combined image after combining.

  As described above, even when a plurality of compositing target images are stored in the terminal device 30, they are taken into the multi-function device 10 using the human body as a communication path and displayed on the display unit 17. Since the user can select a desired image as a composition target, convenience is improved. Further, since the timing of releasing the finger is notified, it is possible to prevent an error that the user releases the finger during communication. In addition, the user can release his / her finger in peace by receiving the notification.

  Next, a case where the non-authentication mode and the composite position are finely adjusted will be described.

  FIG. 10 shows an image composition sequence when only one piece of data (image data to be synthesized) is registered in the terminal apparatus 30 and the composition position is finely adjusted, and FIG. 11 shows a multifunction machine in that case. 10 shows a flow of operations. The operation of the terminal device 30 is the same as that in FIG.

  The multifunction machine 10 displays the original image on the display unit 17 (FIG. 11: Step S501). In this state, the multifunction machine 10 waits for the user wearing the terminal device 30 to touch the original image displayed on the display unit 17 (FIG. 11: Step S502; No). The user presses (touches) a position where the stamp is desired to be combined on the original image displayed on the display unit 17.

  When the pressed position detection unit 19 detects that the user presses the display unit 17 screen (FIG. 11: Step S502; Yes, FIG. 10: P1), the multifunction machine 10 recognizes the pressed position information indicating the pressed position. Store (FIG. 11: Step S503).

  Subsequently, the multifunction device 10 transmits an image data transmission request for requesting transmission of image data to be combined to the terminal device 30 (FIG. 11: step S504, FIG. 10: P2), and returns a reply from the terminal device 30. Wait (FIG. 11: Step S505; No).

  Receiving the image data transmission request (FIG. 6: Step S201; Yes, S202; Yes), the terminal device 30 transmits the image data of the compositing target image stored in the storage unit 35 to the multifunction device 10 (FIG. 6, FIG. 6). Step S203, FIG. 10: P3).

  When the multifunction device 10 receives the image data of the compositing target image from the terminal device 30 (FIG. 11: Step S505; Yes), the user presses the pressed finger away by, for example, sounding a “beep” sound. Is in a good state (FIG. 11: step S506). Then, the synthesis position (coordinate information) indicated by the pressed position information stored in step S503 is set as a temporary synthesis position, and the synthesis target image is temporarily synthesized (only synthesized on the display) at the position indicated by the temporary synthesis position with respect to the original image. Thus, the actually synthesized image is displayed on the display unit 17 (FIG. 11: Step S507, FIG. 10: P4).

  As illustrated in FIG. 12, the operation unit 18 is provided with a fine adjustment button 51 for finely adjusting the composite position and a position confirmation button 52 for confirming the composite position. In the example of FIG. 12, a fine adjustment button 51 and a position confirmation button 52 are arranged in an area that does not overlap with the original image on the screen of the display unit 17. The fine adjustment button 51 is a cross key that can individually indicate the moving direction up, down, left, and right.

  When an instruction to move the composite position is received from the user by operating the fine adjustment button 51 (FIG. 11: Step S508; Yes), the temporary composite position (coordinates) is changed in accordance with the movement instruction, and the changed temporary composite position is set. The display position of the compositing target image is moved to the corresponding position (FIG. 11: step S509, FIG. 10: P5).

  When the operation of the position confirmation button 52 is received (FIG. 11: Step S510; Yes, FIG. 10: P6), the temporary composition position at that time is set as the confirmed composition position, and the composition target is set to the confirmed composition position on the original image. A composite image is generated by combining the images (FIG. 11: Step S511, FIG. 10: P7).

  The multi-function device 10 transmits the image data of the synthesized image generated by the synthesis to the terminal device 30 together with the storage request for the synthesized image (FIG. 11: Step S512, FIG. 10: P8), and the storage from the terminal device 30 is completed. It waits for a reply of notification (step S513; No).

  The terminal device 30 that has received the composite image image data and the composite image storage request (FIG. 6: Step S201; Yes, S202; No, S204; Yes) stores the received composite image image data in the storage unit 35. (FIG. 10: P9) After that, a storage completion notification is transmitted to the multifunction device 10 (FIG. 6: step S205, FIG. 10: P10).

  When the multifunction device 10 receives the storage completion notification from the terminal device 30 (FIG. 11: Step S513; Yes), the multifunction device 10 notifies the user of the timing of releasing the pressed finger by, for example, sounding a “beep” sound. (FIG. 11: Step S514), and a message to the effect that storage of the copy (composite image) has been completed is displayed on the display unit 17 (FIG. 11: Step S515, FIG. 10: P11), and the process ends (END). .

  In this way, since the composite position can be finely adjusted, it is possible to synthesize an image such as a stamp by adjusting the composite position to an appropriate position even if the position pressed first with a finger deviates from the desired composite position. it can.

  Next, the operation in the authentication mode will be described. The authentication mode is suitable for use in the case where an image requiring security management is a synthesis target. Here, a case where the synthesis target image is a seal image will be described as an example. In the authentication mode, there are a case where fingerprint verification is performed by the multifunction device 10 and a case where the terminal device 30 performs. First, a case where fingerprint verification is performed by the terminal device 30 will be described.

  13 shows an image composition sequence when fingerprint matching is performed by the terminal device 30, FIG. 14 shows an operation flow of the multifunction device 10 in that case, and FIG. 15 shows an operation flow of the terminal device 30 in that case. ing.

  The multi-function device 10 displays the original image on the display unit 17 (FIG. 14: step S601). In this state, the multifunction machine 10 waits for the user wearing the terminal device 30 to touch the original image displayed on the display unit 17 (FIG. 14: Step S602; No). The user presses (touches) a position on the original image displayed on the display unit 17 where a seal is desired to be combined.

  When the pressed position detection unit 19 detects a pressing operation by the user (FIG. 14: Step S602; Yes, FIG. 13: P1), the multifunction machine 10 recognizes and stores the pressed position information indicating the pressed position (see FIG. 14). FIG. 14: Step S603). At this time, the fingerprint detection unit 20 reads the fingerprint of the user. The fingerprint data obtained by the reading is stored in the RAM 16 (FIG. 14: step S604, FIG. 13: P1).

  Subsequently, the multi-function device 10 transmits the imprint data transmission request for requesting the transmission of the imprint data that is the image data to be combined to the terminal device 30 (FIG. 14: Step S605, FIG. 13: P2) waits for a reply from the terminal device 30 (FIG. 14: Step S606; No).

  The terminal device 30 that has received the imprint data transmission request with the fingerprint data added (FIG. 15: Step S701; Yes, S702; No, S704; Yes), the received fingerprint data and the collation stored in the storage unit 35 in advance. The fingerprint data is collated (FIG. 15: Step S705, FIG. 13: P3). Here, one or a plurality of sets of a pair of fingerprint data for collation and imprint data to be transmitted to the multifunction device 10 when collation is successful with the fingerprint data are registered in the storage unit 35. It is possible. The terminal device 30 collates the received fingerprint data with each registered fingerprint data for matching, and searches for matching data.

  If there is a match as a result of the collation (FIG. 15: Step S706; Yes), the imprint data corresponding to the matched fingerprint is transmitted to the multifunction device 10 (FIG. 15: Step S707, FIG. 13: P4). If there is no match (FIG. 15: Step S706; No), a response indicating unsuccessful verification (error) is transmitted to the multifunction machine 10 (FIG. 15: Step S708).

  When receiving the response from the terminal device 30 (FIG. 14: step S606; Yes), if the received content is seal impression data (step S607; Yes), the received seal stamp data is recognized and stored in step S603. The original image is synthesized at the synthesis position corresponding to the pressed position information (FIG. 14: step S611, FIG. 13: P5). Further, the multifunction machine 10 transmits the image data of the synthesized image generated by the synthesis to the terminal device 30 together with the storage request for the synthesized image (FIG. 14: step S612, FIG. 13: P6), and stores from the terminal device 30. It waits for a reply to the completion notification (FIG. 14: Step S613; No).

  The terminal device 30 that has received the composite image image data and the composite image storage request (FIG. 15: Step S701; Yes, S702; Yes) stores the received composite image image data in the storage unit 35 (FIG. 13: FIG. 13). After that, a storage completion notification is transmitted to the multifunction device 10 (FIG. 15: Step S703, FIG. 13: P8).

  When the multifunction device 10 receives the storage completion notification from the terminal device 30 (FIG. 14: Step S613; Yes), the multifunction device 10 may release the pressed finger from the user, for example, by sounding a “beep” sound. A message indicating that the status has been reached (FIG. 14: step S614) is displayed on the display unit 17 (FIG. 14: step S615, FIG. 13: P9). End processing (END).

  On the other hand, when the response received from the terminal device 30 is an error (FIG. 14: Step S608; Yes), the user may release the pressed finger by, for example, sounding a “beep” sound. (FIG. 14: Step S609), and an error message indicating that the seal imprint could not be stamped is displayed on the display unit 17 (FIG. 14: Step S610), and the process is terminated (END).

  Next, a case where fingerprint verification is performed by the multifunction machine 10 will be described.

  16 shows an image composition sequence when fingerprint matching is performed by the multifunction device 10, FIG. 17 shows an operation flow of the multifunction device 10 in that case, and FIG. 18 shows an operation flow of the terminal device 30 in that case. ing.

  The multifunction device 10 displays the original image on the display unit 17 (FIG. 17: step S801). In this state, the multifunction machine 10 waits for the user wearing the terminal device 30 to touch the original image displayed on the display unit 17 (FIG. 17: Step S802; No). The user presses (touches) a position on the original image displayed on the display unit 17 where a seal is desired to be combined.

  When the pressed position detection unit 19 detects a pressing operation by the user (FIG. 17: Step S802; Yes, FIG. 16: P1), the multifunction machine 10 recognizes and stores the pressed position information indicating the pressed position ( FIG. 17: Step S803). At this time, the fingerprint detection unit 20 reads the fingerprint of the user and stores the fingerprint data obtained by the reading (FIG. 17: step S804, FIG. 16: P1).

  Subsequently, the multifunction device 10 transmits a request for transmitting fingerprint data for verification, which is personal authentication information, to the terminal device 30 (FIG. 17: step S805, FIG. 16: P2), and waits for a response to the request. (FIG. 17: Step S806; No).

  Upon receiving the request for transmitting the personal authentication information (FIG. 18: Step S901; Yes, S902; Yes), the terminal device 30 transmits the fingerprint data for verification stored in advance in the storage unit 35 to the multifunction device 10. (FIG. 18: Step S903, FIG. 16: P3). Here, the fingerprint data for collation, the identification number thereof, and the imprint data to be transmitted to the multi-function device 10 when collation is successful with the fingerprint data are associated with one set in the storage unit 35. Multiple sets can be registered. If only one piece of collation fingerprint data is stored in the storage unit 35, the terminal device 30 transmits it. When a plurality of collation fingerprint data are stored, the collation fingerprint data and its identification number are associated with each other and transmitted to the multifunction device 10.

  When the MFP 10 receives the fingerprint data for collation from the terminal device 30 (FIG. 17: Step S806; Yes), the MFP 10 collates the received fingerprint data for collation with the fingerprint data read in Step S804, and matches them. What is to be searched is searched (FIG. 17: Step S807, FIG. 16: P4). If there is a match (FIG. 17: Step S808; Yes), the terminal device 30 is requested to transmit imprint data corresponding to the matched fingerprint data for matching (FIG. 17: Step S811, FIG. 16: P5), that is, the identification number corresponding to the matching fingerprint data for matching is added to the stamp data transmission request and transmitted. Then, it waits for a response to the request (FIG. 17: Step S812; No).

  The terminal device 30 that has received the imprint data transmission request (FIG. 18: Step S901; Yes, S902; No, S904; Yes) transmits the imprint data corresponding to the identification number added to the request to the MFP 10. (FIG. 18: Step S905, FIG. 16: P6). If only one collation fingerprint data is registered in the terminal device 30, the imprint data can be specified without an identification number, so that the identification number need not be exchanged.

  When the MFP 10 receives the imprint data from the terminal device 30 (FIG. 17: Step S812; Yes), the MFP 10 combines the received imprint data with the original image at the combination position corresponding to the pressed position information recognized and stored in Step S803. (FIG. 17: Step S813, FIG. 16: P7). Further, the multifunction machine 10 transmits the image data of the synthesized image generated by the synthesis together with the request for storing the synthesized image to the terminal device 30 (FIG. 17: Step S814, FIG. 16: P8), and stores from the terminal device 30. It waits for a reply of the completion notification (FIG. 17: Step S815; No).

  The terminal device 30 that has received the composite image image data and the composite image storage request (FIG. 18: Step S901; Yes, S902; No, S904; No, S906; Yes) stores the received composite image image data in the storage unit. After storing in 35 (FIG. 16: P9), a storage completion notification is transmitted to the multifunction device 10 (FIG. 18: Step S907, FIG. 16: P10).

  Upon receipt of the storage completion notification from the terminal device 30 (FIG. 17: Step S815; Yes), the multi-function device 10 may release the pressed finger from the user by sounding a “beep” sound or the like. The status is notified (FIG. 17: Step S816), and a message indicating that the storage of the copy (composite image) is completed is displayed on the display unit 17 (FIG. 17: Step S817, FIG. 16: P11). End processing (END).

  On the other hand, if there is no match in fingerprint collation (FIG. 17: Step S808; No), the user can release the pressed finger by sounding a “pi” sound or the like. (FIG. 17: step S809), and an error message indicating that the seal imprinting could not be performed is displayed on the display unit 17 (FIG. 17: step S810), and the process is terminated (END).

  In this way, by one operation of pressing a desired composite position with a finger, designation of the composite position and reading of a fingerprint, and further, human body communication of fingerprint data and imprint data between the terminal device 30 and the multifunction device 10 Therefore, it is possible to synthesize an imprint image at a designated position with a simple operation while ensuring security by fingerprint authentication.

  In addition, since communication between the terminal device 30 and the multifunction device 10 is performed by human body communication, there is no information leakage due to forgetting that can occur when a removable storage medium such as a USB memory is used. In addition, convenience is improved without the need for attachment / detachment.

  Fingerprint data and seal stamp data are stored in the terminal device 30 owned by the user and are not registered in the multi-function device 10 shared by many people, so that high security can be ensured. In addition, since communication is performed only from the person who touched (the terminal device 30 possessed) at the time of touching, high security is ensured.

  Even in the authentication mode, fine adjustment of the composite position is possible.

  FIG. 12 is a diagram showing the diagnosis result confirmation sheet displayed on the display unit 17 when the diagnosis result confirmation sheet is sent by facsimile to the patient who visited the other day in the multifunction machine 10 installed in the hospital. The example of a screen in the case of receiving the stamping operation of the hospital director is shown.

  If the doctor in charge and the hospital director press the location of the “mark” mark in the diagnosis result confirmation document with their fingers, the multifunction device 10 and each of the multifunction devices 10 and the human body are connected to each other at the time of pressing (at the same time as reading the fingerprint). Communication is performed with the terminal device 30 (for example, in a pocket). By this communication, fingerprint data and the like are transmitted / received, and either the multi-function device 10 or the terminal device 30 performs personal authentication by fingerprint verification. When the collation is successful, the seal data is transmitted / received by human body communication. The seal of the doctor in charge is the position pressed by the doctor in charge (X, Y1), and the seal of the hospital director is the position pressed by the hospital director (X, Y2). Each image is synthesized and an electronic seal is stamped.

  Note that whether the pressed position is a combined position or whether the fine position adjustment is permitted with the pressed position as a temporary position can be switched by a separate setting. When the mode for permitting fine adjustment is set, as shown in FIG. 12, a fine adjustment button 51 and a position confirmation button 52 are displayed in an area avoiding the document display area 53. When the fine adjustment button 51 and the position confirmation button 52 are operated, the fingerprint is not read.

  The embodiment of the present invention has been described with reference to the drawings. However, the specific configuration is not limited to that shown in the embodiment, and there are changes and additions within the scope of the present invention. Are also included in the present invention.

  For example, in the embodiment, the image data stored in the storage unit 35 of the terminal device 30 is combined with the original image, but the data stored in the storage unit 35 may be text data. In this case, the CPU 11 of the multifunction machine 10 synthesizes image data obtained by rasterizing text data. Alternatively, the content indicated by the text data may be converted into a two-dimensional barcode, and the two-dimensional barcode image may be synthesized with the original image. In addition, date and time information of image composition may be included in the two-dimensional barcode. Further, even when image data is received as a compositing target image from the terminal device 30, the date and time information may be further composed.

  In the embodiment, the synthesized image is transmitted to the terminal device 30 and stored as a copy. However, whether or not to store the copy is preferably configured to be changeable on the multifunction device 10 side. . That is, only when the setting for storing a copy is made, the composite image and its storage request are transmitted from the multifunction device 10 to the terminal device 30, and if there is a storage request from the multifunction device 10, the copy is stored. If the mechanism for storing is used, it is possible to switch whether or not to store a copy only by the setting on the multifunction machine 10 side.

  Conversely, the switching may be performed on the terminal device 30 side. For example, if the terminal device 30 requests the multifunction device 10 to send a copy, it is possible to switch between leaving / not leaving a copy for each terminal device 30, that is, for each individual.

  The notification of the timing of releasing the finger is not limited to the sound of a “beep” sound, and may be performed on a display. Further, the terminal device 30 may be provided with a voice generation unit so as to notify the success or failure of communication through the human body by voice.

  The communication between the multifunction device 10 and the terminal device 30 is such that the terminal device 30 can respond to requests from the multifunction device 10 at any time, and the multifunction device 10 allows the external terminal communication unit 22 to be used only during a period required for communication. It may be configured to operate. For example, after the function related to image composition is selected, after the announcement “Please imprint” or when the subsequent screen press is detected, the external terminal communication unit 22 is operated to The communication may be configured to start. The terminal device 30 may be configured to operate by receiving power supply through communication with the multifunction machine 10.

  In the other embodiments, the multifunction peripheral 10 has been described as an example. However, any other type of image processing apparatus having functions such as a display unit for displaying an original image, a pressed position detection unit, and a fingerprint detection unit may be used. It does not matter even if it is a device. For example, a facsimile machine or a copying machine may be used, or a dedicated device for electronic stamps may be used.

  Note that data (image data and seal data) relating to the synthesis target image transmitted from the terminal device 30 to the MFP 10 and fingerprint data for collation are used after use (for example, after collation or after completion of image synthesis). Are erased from the multifunction machine 10.

5 ... Image processing system 10 ... Multifunction machine 11 ... CPU
12 ... Bus 13 ... Reading unit 14 ... Recording unit 15 ... ROM
16 ... RAM
DESCRIPTION OF SYMBOLS 17 ... Display part 18 ... Operation part 19 ... Pressed position detection part 20 ... Fingerprint detection part 21 ... Image processing part 22 ... External terminal communication part 23 ... Network communication part 24 ... Communication control part 25 ... Power supply control part 26 ... Hard disk device 27 ... modem 28 ... NCU
30 ... Terminal device 31 ... CPU
32 ... Bus 33 ... ROM
34 ... RAM
35 ... Storage unit 36 ... Data input unit 37 ... Display unit 38 ... Operation unit 39 ... Main unit communication unit 51 ... Fine adjustment button 52 ... Position confirmation button 53 ... Document display area

Claims (9)

A display unit for displaying an image based on the image data;
A detection unit for detecting a pressed position on the screen of the display unit;
A communication unit that communicates with a terminal device connected using the human body pressing the screen of the display unit as a communication path;
While the screen of the display unit is being pressed, the communication unit acquires predetermined data from the terminal device, and the image data of the image displayed on the display unit is based on the acquired data A control unit that synthesizes image data into a synthesis position corresponding to the position of the press detected by the detection unit;
An image processing apparatus comprising:
A storage unit for storing the data;
A communication unit that transmits the data stored in the storage unit to the image processing apparatus using a human body pressing the screen of the display unit as a communication path;
An image processing apparatus system comprising: a terminal device comprising: The image processing apparatus further includes a fingerprint detection unit that acquires fingerprint information of a finger pressing the screen of the display unit, and the control unit is connected to the terminal device connected through the communication path. Sends the fingerprint information obtained by
The terminal device further stores fingerprint information for collation in the storage unit, and collates the fingerprint information received from the image processing device with the fingerprint information for collation stored in the storage unit. , Sending the collation result to the image processing apparatus through the communication path,
2. The image processing apparatus according to claim 1, wherein the image processing apparatus performs the combination when a collation result indicating successful collation is received from the terminal apparatus, and does not perform the combination when a collation result indicating successful collation is not received. Image processing system. The image processing apparatus further includes a fingerprint detection unit that acquires fingerprint information of a finger pressing the screen of the display unit, and the control unit is used for verification with respect to the terminal device connected through the communication path. Send a request to send fingerprint information for
The terminal device further stores fingerprint information for verification in the storage unit, and transmits the fingerprint information for verification to the image processing device through the communication path in response to the transmission request.
The image processing device collates the fingerprint information for collation received from the terminal device with the fingerprint information acquired by the fingerprint detection unit, and performs the composition if the collation result is a collation success, and the collation is not successful. The image processing system according to claim 1, wherein in the case, the synthesis is not performed. The image processing device transmits the combined image data to the terminal device through the communication path,
The image processing system according to any one of claims 1 to 3, wherein the terminal device that has received the image data stores the image data in the storage unit. The image processing system according to claim 1, wherein the image processing apparatus further includes a fine adjustment setting unit that receives an operation of finely adjusting the synthesis position. The said image processing apparatus further has a synthetic | combination target selection part which receives selection operation | movement of the data made into the said synthetic | combination object from the some data received from the said terminal device. The image processing system according to one item. The data to be combined that the image processing device acquires from the terminal device is text data,
The image processing system according to claim 1, wherein the control unit synthesizes image data obtained by converting the text data into a two-dimensional barcode.   An image processing apparatus included in the image processing system according to claim 1.   The terminal device contained in the image processing system as described in any one of Claims 1 thru | or 7.

Images