JP2006195923A - Image information processing system and image information processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a simple and effective information processing system flexible to requirement of a user, even in a small-size portable information device having a limited information processing function. <P>SOLUTION: This image information processing system has: a portable information terminal having a communication means, a photographing means, and a conversion means for converting image information into an electronic file in a prescribed format; and a means for storing the image information, set on a network 200 connectable by the communication means. The portable information terminal 500a has: a means for describing prescribed processing information in a prescribed meta information description portion of the image information; and holding/exhibition means for monitoring a means connectable via the network 200 by the portable information terminal 500a, performing prescribed processing to the image information on the basis of the meta information when an image file storing the meta information is transmitted to the means, and holding or exhibiting information in a form allowing a prescribed target person to confirm information about at least one of a processing result and a processing process. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image information processing system and an image information processing method for processing image information via a network using a portable information terminal.

  As a conventional technique, for example, there is a method disclosed in Patent Document 1. This system configuration is shown in FIG. Here, the information providing server 7 receives a file composed of detailed information from the terminal device 4 of the information provider via the wireless base station 5 and the network 6. Further, a storage address is generated by the information providing server 7 in which the user stores correspondence information in advance, and a barcode encoded with this address is inserted into a paper document such as a poster, printed, and distributed. The user takes a barcode (digital mark) attached to the information, attaches it to a mail as image data, and sends it to the information providing server 7. The server 7 analyzes the barcode information from the image data and stores the information. An address is generated and the corresponding storage information is read from the database 9 and transmitted to the user's mobile phones 9a to 9d by mail, and the user accesses the desired information by displaying the received file.

  As a remote operation system using e-mail, for example, Patent Document 2 is disclosed. This system configuration is shown in FIG. In this method, an e-mail including a command is transmitted to the e-mail, analyzed by a mail server, content data is processed based on the analysis result, and a reply process is performed to the user terminal.

Japanese Patent Publication No. 2003-91487 JP 2003-67311 A

  However, the conventional method as shown in FIG. 19 is intended to finally display information on the user's mobile terminal side, so an information source suitable for each information terminal to be used is prepared in advance. In addition, it is necessary to insert multiple digital marks into the document for each source in order to access each information, so there may be multiple digital marks on the printed document. There is a problem that it becomes difficult to see the document information. Moreover, since it is specialized in a system for presenting detailed information to itself, only a single operation can be performed on single image information. It is also possible to execute a command message by describing a processing command in a mail as shown in FIG. 20, but all parameters such as the processing order and the correspondence between the attached image data and the processing are included in the mail. In particular, the operation becomes complicated in a portable information terminal having a poor input environment.

  Further, in the conventional method as shown in FIG. 19, when a digital mark such as a paper surface is photographed, depending on the lighting condition, a blur of the digital mark due to a camera shake due to a decrease in shutter speed or a focus error due to a low illuminance occurs. Therefore, there is a problem that it becomes impossible to decode the digital mark. Also, it is possible to execute a command message by describing a processing command in an email as shown in FIG. 20, but in the case of a decoding error due to the above-mentioned camera shake or focus error, the digital mark is repeated many times. It takes time and effort to resend the email.

  The present invention has been made in view of the above, and provides a simple, effective, and flexible information processing system for a user's request even in a small portable information device with limited information processing functions. Objective.

  In order to solve the above-described problems and achieve the object, the invention according to claim 1 includes at least communication means, photographing means, and conversion means for converting image information into an electronic file in a predetermined format. An information processing system comprising: a portable information terminal; and an image information storage means for storing the image information installed on a network connectable by the communication means, wherein the portable information terminal includes the image information A processing information description unit that describes predetermined processing information in a predetermined meta information description part, and monitors the image information storage unit connectable via a network by the portable information terminal; When an image file storing the meta information is transmitted, the image information is subjected to a predetermined process based on the meta information, and a processing result or a process step Characterized by comprising a holding / presenting means for holding or presenting the information in one of the information a given subject is identifiable form even without.

  According to the present invention, the image information storage means connectable via the network by the portable information terminal is monitored, and when the image file storing the meta information is transmitted to the image information storage means, the meta information is restored. A holding / presentation means for performing predetermined processing on the image information and holding or presenting the information in a form in which a predetermined target person can confirm at least one of the processing result and the processing process, In a small-sized portable information terminal with limited information processing, it is possible to provide information that is simple and flexible in response to a user request.

  The invention according to claim 2 is characterized in that the portable information terminal includes text information description means for describing the image processing information as text information in a tag information area of an image format which is a meta information area.

  According to the present invention, the portable information terminal is provided with the text information description means for describing the image processing information as text information in the tag information area of the image format which is the meta information area. However, it is possible to provide information that is simple and flexible in response to a user's request in a portable information terminal with limited access.

  The invention according to claim 3 further comprises storage means for storing the processing item list of the meta information in the portable information terminal in advance, and the meta information from the selection information of the processing item in the list by the operator. Processing information description means for describing predetermined processing information in the area is provided.

  According to the present invention, the processing information description means for describing predetermined processing information in the meta information area based on the selection information of the processing item in the list by the operator is provided in the first aspect. An efficient input is also possible in a portable information terminal.

  According to a fourth aspect of the present invention, there is provided a detecting means for detecting that the image information is transmitted via the network and stored in the image information storage means, and the image file information is completely stored in the image information storage means. And processing means for performing processing based on the meta information at the stage of being performed.

  According to the present invention, in claim 1, the detecting means for detecting that the image information is transmitted via the network and stored in the image information storing means, and the image file information is completely stored in the image information storing means. By including processing means for performing processing based on the meta information at a stage, it becomes possible to reduce processing errors due to delay due to the network environment to be used.

  According to a fifth aspect of the present invention, there is provided storage means for storing a result processed based on the meta information as a file in a predetermined storage area, and attribute information of the generated file is stored in the predetermined meta of the image information. Attribute information storing means for storing in the information area.

  According to the present invention, in claim 1, the storage means for storing the result processed based on the meta information as a file in a predetermined storage area, and the attribute information of the generated file in the predetermined meta information area of the image information And attribute information storage means for storing information in the image file, it is possible to improve information handling such as improved searchability by providing the image file itself with link information from the image file to the processing result. .

  Further, the invention according to claim 6 comprises storage means for storing the processing result as a file in a predetermined format, and sending means for sending the content of the result to a predetermined user via a network. It is characterized by.

  According to the present invention, in claim 1, the storage unit stores the processing result as a file in a predetermined format, and the transmission unit transmits the result contents to the predetermined user via the network. In addition, it is possible to confirm the upload result of the image information on the spot and to effectively use the processing result.

  According to a seventh aspect of the present invention, there is provided a portable information terminal having at least communication means, photographing means, and conversion means for converting image information into an electronic file in a predetermined format, connected by the communication means. An image information processing method in an information processing system having an image information storage means for storing the image information installed on a network capable of describing predetermined processing information in a predetermined meta information description portion of the image information An image in which the meta information is stored in the image information storage means, the first step in the portable information terminal having the step of performing the monitoring, and the image information storage means connectable via the network by the portable information terminal A second step of performing predetermined processing on the image information based on the meta information when the file is transmitted, and a processing result or processing step Characterized in that it comprises a third step at least one of the information given subject holds or presents information in a verifiable form, a.

  According to the present invention, when the portable information terminal monitors the image information storage means connectable via the network, the meta information is stored when the image file storing the meta information is transmitted to the image information storage means. Information processing is limited in size by performing predetermined processing on image information and holding or presenting information in a form that allows a predetermined target person to confirm at least one of the processing results or the processing process. In a portable information terminal, it is possible to provide information that is simple and flexible in response to a user request.

  The invention according to claim 8 includes a text information description step in which the portable information terminal describes the processing information as text information in a tag information area of an image format which is a meta information area.

  According to this invention, the portable information terminal includes a text information description step in which the portable information terminal describes the processing information as text information in the tag information area of the image format which is a meta information area, so that information processing can be performed in a small size. It is possible to provide information that is simple and flexible in response to a user's request in a limited portable information terminal.

  According to a ninth aspect of the present invention, there is provided a processing item list storing step of storing the processing item list of the meta information in the portable information terminal in advance, and a meta information area based on selection information of the processing items in the list by an operator. Includes a process information description step describing predetermined process information.

  According to the present invention, the meta information area according to claim 7, wherein a meta data area is stored by a process item list storing step of storing a meta information process item list in the portable information terminal in advance and selection information of the process items in the list by an operator. By including a processing information description step for describing predetermined processing information, efficient input is possible even in a small portable information terminal with a poor user interface.

  According to a tenth aspect of the present invention, there is provided a detection step of detecting that the image information is transmitted and stored in the image information storage means via a network, and the image file information is completely received by the storage device. And a processing step of performing processing based on the meta information in a stage.

  According to the present invention, in claim 7, a detection step of detecting that the image information is transmitted via the network and stored in the image information storage means, and the image file information is completely received by the storage device By including a processing step for performing processing based on meta information at a stage, it becomes possible to reduce processing errors due to delay due to the network environment to be used.

  According to an eleventh aspect of the present invention, there is provided a storing step of storing a result processed based on the meta information as a file in a predetermined storage area; and attribute information of the generated file is stored in a predetermined meta of the image information. A storage step of storing in the information area.

  According to the present invention, in claim 7, the storing step of storing the result processed based on the meta information as a file in a predetermined storage area, and the attribute information of the generated file as the predetermined meta information of the image information Including the storing step of storing in the area, it becomes possible to improve the handling of information such as an improvement in searchability by providing the image file itself with link information from the image file to the processing result.

  The invention according to claim 12 includes a storing step for storing the processing result in a file in a predetermined format, and a sending step for sending the contents of the processing result to a predetermined user via a network. It is characterized by that.

  According to the present invention, in claim 7, the method includes a storing step for storing the processing result in a file in a predetermined format, and a sending step for sending the contents of the processing result to a predetermined user via the network. As a result, it is possible to confirm the upload result of the image information on the spot and to effectively use the processing result.

  According to a thirteenth aspect of the present invention, there is provided a portable information terminal having a photographing unit capable of acquiring image information as digital information, and an electronic mail transmitting unit capable of transmitting at least the image information as attached information, and the portable information terminal An image information processing system comprising: an information processing apparatus that receives a mail with attached image information transmitted from the portable information terminal, wherein the portable information terminal stores predetermined processing information in a desired area of the meta information area of the image information. Processing information insertion means for inserting, and instruction data description means for describing predetermined processing instruction data information in a desired area of the outgoing mail data, wherein the information processing apparatus inserts the image information into the meta information Image information processing means for performing image processing corresponding to the processed processing information and obtaining a desired processing result, and at least the subject of the mail, the body text, or the image information A desired information operation based on an analysis means for analyzing any one of the operation procedure processing information described in the meta information area, a processing result by the image information processing means, and a processing procedure obtained by the operation processing procedure analysis And a presenting means for presenting at least one of the processing result and the processing process by e-mail in a form that can be confirmed by a predetermined target person.

  According to the present invention, each configuration described in claim 13 makes it possible to provide information that is simple and flexible in response to a user's request in a small portable information terminal with limited information processing.

  According to a fourteenth aspect of the present invention, there is provided additional information reference means for referring to additional information stored in a predetermined database according to the processing result of the image information and corresponding to the processing result, and the data referred to in the processing procedure. And a process control means for adding a desired process according to the process.

  According to the present invention, in claim 13, there is provided additional information reference means for referring to additional information stored in a predetermined database according to the processing result of the image information and corresponding to the processing result, and the data referred to in the processing procedure By providing a process control means for adding a desired process according to the above, it becomes possible to provide information that is simple and flexible in response to a user's request in a small portable information terminal with limited information processing.

  The invention according to claim 15 shows list information storage means for storing list information of processing services implemented, and the information processing contents that can be executed for a predetermined information processing device in the portable information terminal. Requesting means for requesting a processing service list; storage means for storing the service list information from the information processing apparatus; operating means for setting processing information to meta information of the image information by a selection operation from the service list; , Provided.

  According to the present invention, in claim 13, the list information storing means for storing the list information of the processing service implemented, and the processing indicating the information processing contents that can be executed for a predetermined information processing apparatus in the portable information terminal Request means for requesting a service list, storage means for storing the service list information from the information processing apparatus, and operation means for setting processing information to meta information of image information by a selection operation from the service list. This makes it possible to provide an environment in which a user can freely and easily use a service provided for each location or LAN.

  According to a sixteenth aspect of the present invention, the image information includes a plurality of pieces of image information, and the image information processing means includes image processing means for generating image data for predetermined processing from the plurality of image information. It is characterized by.

  According to the present invention, in claim 13, the image information includes a plurality of pieces of image information, and the image information processing means includes image processing means for generating image data for predetermined processing from the plurality of image information. It becomes possible to provide highly reliable information from a plurality of pieces of image information, and security measures such as impersonation become possible.

  According to a seventeenth aspect of the present invention, there is provided a portable information terminal having a photographing unit capable of acquiring image information as digital information, an e-mail transmission unit capable of transmitting at least the image information as attached information, and transmitted from the terminal. An image information processing method for receiving an attached mail with attached information, comprising: an information insertion step of inserting predetermined information into a desired area of the meta information area of the image information; An instruction data insertion step of inserting processing instruction data information, an image information processing step of performing image processing on the image information corresponding to the information inserted in the meta information to obtain a desired processing result, and at least a mail An analysis step for analyzing any operation procedure processing information described in a subject, body text, or meta information area in image information; and A predetermined target person can confirm information on at least one of a processing step and a processing step for controlling and executing a desired information operation based on the processing result obtained and the processing procedure obtained by the operation processing procedure analysis. And a presentation step of presenting in a form by e-mail.

  According to the present invention, the steps described in claim 17 make it possible to provide information that is simple and flexible in response to a user's request in a small portable information terminal with limited information processing.

  According to an eighteenth aspect of the present invention, there is provided an additional information reference step for referring to additional information stored in a predetermined database according to the processing result of the image information and referring to the processing result, and data referred to in the processing procedure. And a process control step of adding a desired process in the process procedure.

  According to the present invention, in the seventeenth aspect, according to the additional information reference step of referring to the additional information stored in a predetermined database and corresponding to the processing result according to the processing result of the image information, and the data referred to in the processing procedure By including a process control step of adding a desired process in the process procedure, it is possible to provide information that is simple and flexible in response to a user's request in a small portable information terminal with limited information processing .

  According to a nineteenth aspect of the present invention, there is provided a list information storing step for storing list information of processing services implemented, and the information processing contents that can be executed for a predetermined information processing device in the portable information terminal. A requesting process for requesting a processing service list, a service list information storing process for storing the service list information from the information processing apparatus, and setting processing information in the meta information of the image information by a selection operation from the service list And an operation step.

  According to the present invention, in claim 17, a list information storing step for storing list information of processing services implemented, and a process indicating information processing contents that can be executed on a predetermined information processing apparatus in a portable information terminal A requesting step for requesting a service list, a service list information storing step for storing service list information from the information processing device, an operation step for setting processing information in meta information of image information by a selection operation from the service list, It is possible to provide an environment in which a user can freely and easily use a service provided for each location or LAN.

  The invention according to claim 20 is characterized in that the image information includes a plurality of pieces of image information, and includes an image processing step of generating image data for predetermined processing from the plurality of pieces of image information.

  According to this invention, in claim 17, the image information includes a plurality of image information, and includes an image processing step of generating image data for predetermined processing from the plurality of image information. Therefore, it is possible to provide highly reliable information, and security measures such as spoofing can be provided.

  Further, the invention according to claim 21 is connectable with a portable information terminal having at least communication means, photographing means, and conversion means for converting image information into an electronic file in a predetermined format, by the communication means. An image information acquisition unit configured to acquire the image information installed on a network, and the portable information terminal transmits the image information to the image information acquisition unit via the network. An image file having description means for describing predetermined processing information in an image file or transmission information, monitoring the image information acquisition means, and having attached the attached information including the processing information to the image information acquisition means has been transmitted An image information processing system for performing predetermined processing on the image information based on the attached information, wherein the processing target images are at least the same or The continuous image information is obtained by photographing the same object by changing one or more photographing conditions, and the processing based on the processing information included in the attached information is executed based on the image processing result of at least two of the image information. A processing execution means is provided.

  According to the present invention, the processing target image is continuous image information in which the same target is photographed by changing at least the same or one or more photographing conditions, and the attached information is based on the image processing result of at least two or more of the image information. By providing processing execution means for executing processing based on the processing information included in the mobile information terminal, which is small and has limited information processing, it is possible to provide information that is simple and flexible in response to user requests. .

  According to a twenty-second aspect of the present invention, there is provided file attribute adding means for adding information indicating that the continuous image information is image information obtained by photographing the same object to a file attribute such as a file name or meta information of each image information. It is provided.

  According to the present invention, in claim 21, file attribute adding means for adding information indicating that the continuous image information is image information obtained by photographing the same object to a file attribute such as a file name or meta information of each image information. By providing it, it is possible to reliably process as a continuous shot image, and it is possible to provide a reliable system in response to a user request.

  The invention according to claim 23 employs a recognition means for recognizing that at least two of the image processing results in the continuous image information are matched, and the matching result as an image processing result. And continuation means for continuing the process added to the image information.

  According to the present invention, in claim 21, the recognition means for recognizing that at least two matching results among the image processing results in the continuous image information are obtained, and the matching results are employed as the image processing results. By providing the continuation means for continuing the processing added to the image information, it is possible to execute effective image processing and to provide a reliable system in response to a user request. .

  According to a twenty-fourth aspect of the present invention, there is provided a comparison / synthesis unit for comparing and synthesizing each image processing result of the continuous image information, and a process added to the image information using the comparison / synthesis process result from the comparison / synthesis unit. And a process continuation means for continuing.

  According to the present invention, in claim 21, the comparison / synthesis means for comparing and synthesizing each image processing result of the continuous image information, and the processing added to the image information using the comparison / synthesis processing result from the comparison / synthesis means are continued. By providing the processing continuation means, it is possible to execute effective image processing and to provide a reliable system in response to a user request.

  Further, the invention according to claim 25 is connectable with a portable information terminal having at least communication means, photographing means, and conversion means for converting image information into an electronic file in a predetermined format by the communication means. An image information acquisition unit configured to acquire the image information installed on a network, and the portable information terminal transmits the image information to the acquisition unit via the network. When an image file having information description means for describing predetermined processing information in a file or transmission information, monitoring the image acquisition means, and attached information including the processing information is transmitted to the image information acquisition means An image information processing method for performing predetermined processing on the image information based on the attached information, wherein the processing target images are at least the same or one An imaging process for imaging the same object by changing the above imaging conditions, a transmission process for transmitting the image information group, and a process included in the attached information based on image processing results of at least two or more of the image information And a processing step for executing processing based on information.

  According to the present invention, the steps described in claim 25 make it possible to provide information that is simple and flexible in response to a user's request in a small portable information terminal with limited information processing.

  The invention according to claim 26 includes an attribute adding step of adding information indicating that the continuous image information is image information obtained by photographing the same object to a file attribute such as a file name or meta information of each image information. It is characterized by that.

  According to this invention, in claim 25, an attribute addition step of adding information indicating that the continuous image information is image information obtained by photographing the same object to a file attribute such as a file name or meta information of each image information is included. As a result, it is possible to reliably process as a continuously shot image and to provide a reliable image information processing method in response to a user request.

  The invention according to claim 27 employs a recognition step for recognizing that at least two or more of the image processing results in the continuous image information are obtained, and the matching result as the image processing result. And a continuation step of continuing the process added to the image information.

  According to the present invention, in claim 25, the recognition step for recognizing that at least two of the image processing results in the continuous image information are matched, and the matching result is adopted as the image processing result. In addition, it is possible to execute effective image processing and to provide a reliable image information processing method in response to a user request. Is possible.

  According to a twenty-eighth aspect of the present invention, a comparison and synthesis step for comparing and synthesizing each image processing result of the continuous image information, and a process added to the image information using the comparison and synthesis processing result from the comparison and synthesis step. And a continuation process to be continued.

  According to the present invention, in claim 25, the comparison and synthesis step for comparing and synthesizing each image processing result of the continuous image information, and the processing added to the image information using the comparison and synthesis processing result from the comparison and synthesis step are continued. By including the continuation step, it is possible to execute effective image processing and to provide a reliable image information processing method in response to a user request.

  An image information processing system according to the present invention (Claim 1) monitors image information storage means connectable via a network by a portable information terminal, and an image file storing meta information is transmitted to the image information storage means. When this is done, the image information is processed based on the meta information, and the information is stored or presented in a form that allows a predetermined target person to confirm at least one of the processing result and the processing process. / Since the presenting means is provided, it is possible to provide information that is simple and flexible in response to the user's request in a small portable information terminal with limited information processing.

  The image information processing system according to the present invention (Claim 2) is the text information description according to Claim 1, in which the portable information terminal describes the image processing information as text information in a tag information area of an image format which is a meta information area. Since the device is provided, it is possible to provide information that is simple and flexible in response to a user request in a small portable information terminal with limited information processing.

  The image information processing system according to the present invention (Claim 3) is the image information processing system according to Claim 1, further comprising processing information description means for describing predetermined processing information in a meta information area based on selection information of processing items in a list by an operator. Since it is provided, it is possible to perform an efficient input even in a small portable information terminal having a poor user interface.

  According to a fourth aspect of the present invention, there is provided an image information processing system according to the first aspect, wherein the detection means for detecting that the image information is transmitted via the network and stored in the image information storage means, and the image file information And processing means for performing processing based on the meta-information when it is completely stored in the image information storage means, so that it is possible to reduce processing errors caused by delay due to the network environment to be used Play.

  The image information processing system according to the present invention (Claim 5) is characterized in that, in Claim 1, the storage means for storing the result processed based on the meta information as a file in a predetermined storage area, and the generated file Attribute information storage means for storing the attribute information in a predetermined meta information area of the image information, so that the image file itself has link information from the image file to the processing result to improve the searchability. There exists an effect that handling property can be improved.

  According to a sixth aspect of the present invention, there is provided an image information processing system according to the first aspect of the present invention, wherein the storage means for storing the processing result as a file in a predetermined format and the contents of the result are transmitted to a predetermined user via a network. And a sending means for sending, so that the upload result of the image information can be confirmed on the spot and the processing result can be effectively used.

  An image information processing method according to the present invention (Claim 7) monitors an image information storage means connectable via a network by a portable information terminal, and the image file in which the meta information is stored in the image information storage means Is transmitted to the image information based on the meta information, and the information is held or presented in a form that allows a predetermined target person to confirm at least one of the processing result and the processing process. Therefore, there is an effect that it is possible to provide information that is simple and flexible in response to a user's request in a small portable information terminal with limited information processing.

  The image information processing method according to the present invention (Claim 8) is the text information description according to Claim 7, in which the portable information terminal describes the processing information as text information in a tag information area of an image format which is a meta information area. Since the process is included, it is possible to provide information that is simple and flexible in response to a user request in a small portable information terminal with limited information processing.

  The image information processing method according to the present invention (Claim 9) is the processing information list storage step for storing the processing item list of meta information in the portable information terminal in advance in Claim 7, and the list by the operator Processing information description step for describing predetermined processing information in the meta information area by the selection information of the processing items in the processing information, so that it is possible to perform an efficient input even in a small portable information terminal with a poor user interface Play.

  According to a tenth aspect of the present invention, there is provided an image information processing method according to the seventh aspect, wherein a detection step of detecting that the image information is transmitted and stored in the image information storage means via a network; Including a processing step of performing processing based on meta information when the file information is completely received by the storage device, and thus it is possible to reduce processing errors caused by delays due to the network environment to be used. .

  The image information processing method according to the present invention (invention 11) is characterized in that, in claim 7, a storage step of storing a result processed based on meta information as a file in a predetermined storage area, and the generated file A storage step for storing the attribute information of the image file in a predetermined meta information area of the image information, so that the image file itself has link information from the image file to the processing result, thereby improving the searchability of the information. The effect that can be improved.

  The image information processing method according to the present invention (Claim 12) is characterized in that, in Claim 7, a storing step of storing the processing result in a file in a predetermined format and storing the content of the processing result through the network. Including a sending step for sending to the user, it is possible to confirm the upload result of the image information on the spot and to effectively use the processing result.

  In addition, the image information processing system according to the present invention (claim 13) is simple and flexible with respect to a user's request in a small-sized portable information terminal with limited information processing. There is an effect that information can be provided.

  Further, the image information processing system according to the present invention (Claim 14) has the additional information reference means according to Claim 13, which is stored in a predetermined database according to the processing result of the image information and refers to the additional information corresponding to the processing result. In addition, since it has processing control means for adding desired processing according to the data referred to in the processing procedure, it is simple in a portable information terminal that is small in size and limited in information processing, and is flexible with respect to user requests. There is an effect that information can be provided.

  An image information processing system according to the present invention (Claim 15) is characterized in that, in Claim 13, list information storage means for storing list information of processing services implemented, and a predetermined information processing apparatus in a portable information terminal. A requesting means for requesting a processing service list indicating the information processing contents executable on the storage means; a storing means for storing the service list information from the information processing apparatus; and a selection operation from the service list for meta information of image information. The operation means for setting the processing information is provided, so that it is possible to provide an environment in which the user can freely and easily use the service provided for each location or LAN.

  An image information processing system according to the present invention (claim 16) is the image information processing system according to claim 13, wherein the image information includes a plurality of pieces of image information, and the image information processing means obtains image data for predetermined processing from the plurality of pieces of image information. Since the image processing means to generate is provided, it is possible to provide highly reliable information from a plurality of image information, and there is an effect that security measures such as impersonation can be realized.

  The image information processing method according to the present invention (Claim 17) is simple and flexible in response to the user's request in a small portable information terminal with limited information processing by each process according to Claim 17. There is an effect that information can be provided.

  An image information processing method according to the present invention (claim 18) is the image information processing method according to claim 17, wherein the additional information reference step refers to the additional information stored in a predetermined database and corresponding to the processing result according to the processing result of the image information. And a process control step of adding a desired process in the process procedure according to the data referred to in the process procedure. And flexible information can be provided.

  According to a nineteenth aspect of the present invention, there is provided an image information processing method according to the seventeenth aspect, wherein a list information storing step of storing list information of processing services implemented and a predetermined information processing device in a portable information terminal are provided. A requesting process for requesting a processing service list indicating information processing contents that can be executed, a service list information storing process for storing service list information from the information processing apparatus, and selection from the service list as meta information of image information And an operation step of setting processing information by an operation, so that it is possible to provide an environment in which a user can freely and easily use a service provided for each location or LAN.

  An image information processing method according to the present invention (claim 20) is the image processing method according to claim 17, wherein the image information includes a plurality of pieces of image information, and image data for predetermined processing is generated from the plurality of pieces of image information. Since the process is included, it is possible to provide highly reliable information from a plurality of pieces of image information, and there is an effect that security measures such as impersonation become possible.

  In the image information processing system according to the present invention (claim 21), the processing target image is continuous image information obtained by capturing the same object by changing at least the same or one or more shooting conditions, and at least two or more of the images Since the processing execution means for executing the processing based on the processing information included in the attached information based on the image processing result of the image information is provided, it is simple and small in response to the user's request in the portable information terminal with limited information processing And flexible information can be provided.

  The image information processing system according to the present invention (Claim 22) is the information processing system according to Claim 21, in which information indicating that the continuous image information is image information obtained by photographing the same object, the file name of each image information, meta information, etc. Since the file attribute adding means for adding to the file attribute is provided, it is possible to reliably process the continuous shot image and to provide a reliable system in response to the user's request.

  Further, the image information processing system according to the present invention (Claim 23) is the recognition means according to Claim 21 for recognizing that at least two of the image processing results in the continuous image information are matched. And a continuation means that continues the processing added to the image information by adopting the coincidence result as the image processing result, so that effective image processing can be executed and the user's request is surely met. The effect that it can provide a simple system is produced.

  According to a twenty-fourth aspect of the present invention (claim 24), the image information processing system according to the twenty-first aspect uses the comparison / synthesis means for comparing and synthesizing each image processing result of the continuous image information and the comparison / synthesis processing result from the comparison / synthesis means. And a process continuation means for continuing the process added to the image information, so that effective image processing can be executed and a reliable system can be provided in response to a user request. There is an effect.

  In addition, the image information processing method according to the present invention (claim 25) is simple and flexible in response to a user's request in a small portable information terminal with limited information processing by each step of claim 25. There is an effect that information can be provided.

  The image information processing method according to the present invention (claim 26) is the image information processing method according to claim 25, wherein information indicating that the continuous image information is image information obtained by photographing the same object is represented by a file name, meta information, etc. of each image information. This includes the attribute adding step for adding to the file attribute, so that it is possible to reliably process the continuous shot image and to provide a reliable image information processing method in response to the user's request.

  An image information processing method according to the present invention (Claim 27) is the recognition process according to Claim 25, wherein the recognition process recognizes that at least two of the image processing results in the continuous image information are matched. And the continuation step of continuing the processing added to the image information by adopting the matching result as the image processing result, and effective image processing can be executed and in response to a user request There is an effect that a reliable image information processing method can be provided.

  According to a twenty-eighth aspect of the present invention (claim 28), the image information processing method according to the twenty-fifth aspect uses a comparison and synthesis step of comparing and synthesizing each image processing result of continuous image information, and a comparison and synthesis process result from the comparison and synthesis step. In addition, it is possible to execute effective image processing and provide a reliable image information processing method in response to a user request. There is an effect.

  Exemplary embodiments of an image information processing system and an image information processing method according to the present invention are explained in detail below with reference to the accompanying drawings.

  The present invention uses a standard image (still image, moving image) format, and meta information (structured file) that can be described uniquely by a user or manufacturer (providing a portable information terminal that generates image data) within the format. A processing flow is described in (tag information), a server that uploads the image data via the network performs data processing according to the processing flow, and provides a system that effectively uses the result. Furthermore, by exchanging messages on a mail system basis and further describing the entire processing flow in the mail, it becomes possible to perform more complicated information operations using a plurality of images. Hereinafter, the first embodiment to the second embodiment will be described in detail.

(First embodiment)
A system configuration according to the present invention is shown in FIG. In this system, as a small portable information input terminal device having a communication function and an image information input function, for example, there is an information terminal device 100 such as a digital camera (with a communication function) or a mobile phone with a digital camera, and wireless communication or the like. The connectable network 200 has a client-server type system configuration such as an information device 300a as a storage means supporting a communication protocol having a file transfer function, for example, a PC server. Further, the information device 300a is provided with a means (PC 400) for holding the processing result as a file in a predetermined storage area and browsing at a later date. If the user wants to use the processing result immediately, the portable information terminal 500a on hand for viewing the processing result or processing log information transmitted via the communication function of the information terminal device 100 (integrated with the portable device). (It does not matter).

  In this system, as shown in FIG. 2, a predetermined image is captured by the image capturing unit 10 of the information terminal and an image file is created in a predetermined format (executed by the CPU 11 and the storage unit 12 and a program for controlling the same). The user performs an operation for describing a processing process from the menu screen of the information terminal device 100 in order to describe desired processing information for the target image file. As a target process, the information terminal device 100 is a file in which a list corresponding to the processing unit 16 serviced on the information device 300a side is described in a text format (for example, XML (extensible Markup Language) format). Is previously created in the storage unit 12.

  Next, the menu operation will be described with reference to the flowchart of FIG. First, the main menu is displayed (step S11), and it is determined whether or not the comment input mode is selected (step S12). When the comment input mode is selected here, the comment data file is read (step S13). After reading this list information, it is displayed to prompt the user to make a selection. Determine whether a list has been selected. (Step S14). Here, the user selects each item. If the list is selected here, the selected items are temporarily stored in the storage means sequentially (step S15). Subsequently, it is determined whether there is an additional list (step S16). When it is determined that there is no corresponding next item, the selection items up to that point are presented to the user (step S17), and after confirmation (step S18), a concatenated character string in the selection order of selection item characters is written in a predetermined meta information area (step S19).

  For example, when a digital camera is used as an information terminal, image information is held in an image format format conforming to the Exif (Exchange Image File format) standard shown in FIG. 4, which is a commonly used format format, and the user can freely The text data as the processing information is stored in the data area of the UserComment tag 20 (tag No. 37510) that is permitted to be written.

  As an example of a specific operation method, as shown in FIG. 5, after capturing and storing a target image, predetermined image data is selected and displayed in the playback mode, and a tab-type menu screen 53 is activated (actually After the menu is activated by pressing the menu activation button 50, the menu items are selected in the order according to the processing procedure by moving the menu items with the cross key 52 and the decision key 51). For example, when it is desired to perform OCR (optical character recognition) processing on an image obtained by capturing an image including character information such as a document and acquire information such as a document title and a document creator as text information by e-mail. First, the OCR processing item is selected from the first processing item menu 54 (see reference numeral 54a), the mail notification item 55a of the second processing item 55 is selected as a method for receiving the processing result, and then the address item 56 is displayed as a related item. The mail destination address as the output destination is selected (see reference numeral 56a). Finally, after displaying and confirming the selection results so far (see reference numeral 57) (see reference numeral 57a), the meta information is partitioned by an identification symbol (here, “>>”) indicating an item delimiter. Concatenated as character string information and written as text data 58 in the data area of the UserComment tag (tag No. 37510).

  The process is started by transmitting an image file to a predetermined area of the storage unit 14 on the server (information device 300a) shown in FIG. 2 via the communication unit and confirming that the image file is newly received by the monitoring unit 15 It starts when it is detected.

  FIG. 6 shows a flowchart of the process. The server (information device 300a) constantly monitors the storage unit (folder) 14 to determine whether or not the image file has been newly generated (step S21). The meta information of the file is acquired (step S22). Subsequently, the presence / absence of meta information in which the processing item is described as text information is confirmed from the obtained meta information (step S23), and after confirmation, the content of the meta information is obtained (step S24). Further, processing list information according to the processing procedure is created from the processing items delimited by the identifier (step S25). After the creation of the list, the items described in the list information are determined (steps S26 and S27), and predetermined processing is sequentially executed (steps S28 to S32). The system confirms that all processing in the list has been performed, that is, if an error has occurred in the processing stage (step S31), and then the processing result (if there is an intermediate error, processing result up to that point) Alternatively, the error content) is filed in a predetermined format and stored as log information in a predetermined folder (step S33).

  More specifically, in the example of the digital camera shown in FIG. 1 and FIG. 2, a PC (information device 300a, a Windows system as an OS, Windows is a registered trademark of Microsoft Corporation) in a folder ( An application (monitoring unit 15) that implements the monitoring function of the storage unit 14) is activated. The user of the digital camera uses an FTP or other file transfer function to transfer an image file to a predetermined folder (storage unit 14) through an FTP (File Transfer Protocol) server running on the PC server (information device 300a). . When the FTP server receives the file, the OS (operation system) generates predetermined event information when a new file is created. The application (monitoring unit 15) monitors events related to files. When an event is detected here, the file content is read into the memory and processed by a processing application (which may be installed in the monitoring application) which is the processing unit 16.

  At this time, depending on the communication environment or event type, an event is detected before the image file is written to the folder (storage unit 14), so appropriate event processing is performed or it is confirmed that all the files have been written. After that, it is necessary to control the read timing so that the file is read (for example, a processing delay of a predetermined time is provided or a process for checking the file size is performed).

  After reading the file, tag information is read in accordance with the Exif file format, text information is extracted from the tag data area (see reference numeral 20 in FIG. 4) of UserComment (tag No. 3750), and an identifier (here, “ >> "), the item character string is cut out and individually stored as, for example, array information. In the above OCR example (example of processing data 58 in FIG. 5), “OCR”, “email notification”, and “XX@xx.jp” are stored in the character string array in order, and first the “OCR” character An OCR (= Optical Character Recognition) module (for example, a program installed in the processing unit 16 in the DLL (Dynamic Link Library) format) is activated from the column to deliver image data and perform character information conversion processing.

  The OCR result is saved as a file in a predetermined folder (storage unit 14). Next, an e-mail transmission module (for example, a program installed in the processing unit 16 in the DLL format) is called from the “mail notification” character string, and the file content of the OCR result is copied to the mail body data. "@ Xx.jp" character string is acquired, copied to destination data, and sent to an SMTP (Simple Mail Transfer Protocol) server (existing in the network, not shown). At this time, other Exif information (for example, shooting date and time, position information by GPS (Global Positioning System), etc.) may be additionally copied and sent in the mail text or title. With this system, for example, character information written by photographing a document is received as text information in the form of an e-mail in the portable information terminal 500a at hand, and is acquired by the display unit 18, and is used as search data on the network. In the case of business card photography, when taking a close-up shot of a business card, a photo of the face of the person on the business card is taken, and the photo data is linked to the OCR result of the business card image data and registered in the desired database automatically. It becomes possible to do.

  Furthermore, the file name of the processing result and the processing log file name (which may include the route information of the storage destination) are additionally described in the UserComment tag of the image data and used as search information together with the image information as link information. Is possible. As a result, even if the processing result is saved in a separate file according to the present invention, it becomes possible to confirm processing information from an image file alone, and the processing result file or the link data can be traced to easily process the processing result file. It is possible to obtain.

  This embodiment shows a case where image data is transmitted by FTP and processing results are exchanged by e-mail with respect to the following embodiments, and all processing procedures are included in the meta information of the image information. This is an example of writing.

(Second Embodiment)
In the following embodiments, message exchange and image data transmission are performed in the body of an email and attached file, and the processing procedure is described separately in the text description portion of the email and the meta information of the image data. An example is shown.

  7 and 8 show schematic configurations of the image processing information system according to the present invention, and FIGS. 9, 10, 11, 12-1, and 12-2 show operation examples and components.

  In the system according to the present invention, as shown in FIG. 7, a portable information terminal 500b having a camera mechanism capable of digital photography and a mail function capable of sending an e-mail with the image data attached via a network, and a network 200 And a mail server that can be connected to the information terminal (the information device 300b has a built-in mail processing server. Even if a separate processing server is physically provided, it may be connected by communication means). As shown in FIG. 8, the portable information terminal 500 b includes an e-mail transmission / reception unit 114 including an image data editing unit 110 and a communication unit 113 that can edit meta information on a captured image.

  If the image information photographed by the photographing unit 111 is stored in, for example, an Exif format, a UserComment tag 131 that allows the user to freely describe text information in the header portion 130 in the case of the Exif format as shown in FIG. Are prepared, and each user can write text information in this tag area. In the portable information terminal 500b used in the present system, an editing unit 110 (application) that edits Exif tag information is installed, and image processing items for a captured image are described in the tag 131 as text information. Alternatively, a keyword list corresponding to image processing that can be used in advance is stored in the storage unit 112 of the portable information terminal 500b, and the description is made by selecting the list item 121a in the editing unit 110 as shown in FIG. 9 (121b). You may make it do.

  For example, when a document 104 including a barcode symbol is photographed, when “barcode processing” for instructing decoding processing is selected, and a face image 105 for performing authentication is photographed to perform authentication processing. By describing “face recognition”, it is also possible to receive the presence / absence of authentication and user information in the processing result.

  In the system of the present invention, the information device 300b (including the mail server 115 and the mail analysis server 116) that performs mail processing designates a specific address 142 for mail analysis processing as shown in FIG. Image information 144 in which predetermined image processing keywords are described in meta information is attached, processing flow information (excluding processing information of attached image information) and parameters (necessary information source, etc.) are attached to the body of the mail (possible with subject) Is described by a certain rule based on an instruction, for example, a mail address or a part of contents extracted after image processing = file storage destination address) (reference numeral 143), the mail analysis server 116 performs this processing flow (reference numeral 143). Are analyzed and the corresponding processing is executed sequentially.

  12-1 and 12-2 show flowcharts of mail processing. First, the mail analysis server 116 periodically checks the mail received by the mail server 115 to check whether the destination is the predetermined mail address (step S41). Here, when the corresponding address is detected, the mail is received, the mail text content is extracted (step S42), and the description format and contents are checked (step S43). Next, a list of processing keywords is generated for processing (step S44), and processing corresponding to the keywords is sequentially executed (steps S45 to S51). At this time, the attached file is cut out in parallel, and image processing is executed for each attached image file. In each image processing, a keyword is extracted from the meta information (step S53), the corresponding image processing is executed (step S54), and the processing result is stored in a predetermined storage unit 118 (such as a memory). (Steps S55 and S56). At this time, various information corresponding to the processing result may be acquired by referring to a necessary database according to the processing result. For example, when the person identification is successful as a result of the face authentication process, various information (name, email address, affiliation, post information, etc.) for the person is acquired from the personnel management database. At the time of the sequential processing corresponding to the processing keyword from the mail body, various information corresponding to the keyword described by the parameter is stored at a predetermined timing from the storage unit 118 storing the image processing result and the extracted additional information. And batch processing is performed by sequentially executing the processing using the contents. Then, the user can grasp the processing state by returning the mail describing the processing result in the text to the user (step S52).

  In the portable information terminal 500b, when the mail processing unit 119 installed in the mail analysis server 116 differs depending on the location, a keyword list corresponding to the image processing service installed in the storage unit 118 of the mail analysis server 116 is created. If the user enters the service range (the range in which the mail service can be detected from the Internet) with the portable information terminal 500b, a mail for inquiring about the service list is sent to the predetermined mail address and a reply mail is sent The service list is acquired as a body text or an attached file, stored in a predetermined storage unit 112 in the band information terminal 500b, and when performing the image processing service, a predetermined item is selected from the list and each meta data is selected. If you set information, you can have multiple services at the right place It is possible to receive.

  Next, a specific example will be described using an example of document distribution. In FIG. 7, the tag information editing function is used to capture the paper document 104 that includes the barcode and encodes the link information (file path, etc.) to the electronic entity of the target paper document and writes the barcode as a barcode at a predetermined position. Use “” to describe “decode processing” in the tag. Further, since it is a meeting place or the like, when it is desired to send the file information to the other party who is present, the person's face 105 is further photographed and the tag information editing function is used to describe “face authentication” in the tag. When mail is delivered on a portable information terminal, the processing procedure is described in the body text, for example, the processing content and processing parameters are specified according to the predetermined description rule of “keyword; parameter;” with “;” as a delimiter Then, the image data (see reference numeral 144 and FIG. 11) is attached. At this time, the image data is attached and transmitted to a predetermined address 142 for processing (see FIG. 11). The mail server on the server side of this system performs reception processing like other mails. At this time, in this system, when the mail processing server (the specific mail address is assigned) periodically checks the received mail and detects the mail sent to itself, the mail body is acquired. Check the contents and determine whether there is any text written according to the above description rules. When the above description is detected, a processing list is created and each attached image data is extracted and transmitted to the processing module. The processing module first refers to the tag information, analyzes the processing items described therein, and performs image processing analysis corresponding to the processing items. In the above example, the barcode image data is subjected to decoding processing, and the face photograph is subjected to face recognition processing. When each processing is successful, a predetermined processing result is output. For example, the decoding result is output in the decoding process, and the personal information (name, affiliation, mail address, etc.) recognized in the face recognition is output and set in the predetermined storage unit 118. Further, after the processing list is created, the processing items are executed in the order of the list, and the processing is sequentially performed by referring to the output result of the image processing module as necessary and setting the parameters.

If this operation is described in the above example, the processing contents of “mailperson;” and “fileto; _decode;” in the mail body 143 are extracted, and the following processing list is created.
Order Process item Parameter 1 mailperson
2 fileto _decode
For the mailperson keyword, the mail address information is received from the person information indicated by the parameter (refer to the face authentication result in this case), and is set at the mail destination. For the fileto keyword, the file path information is referenced from the decoding result indicated by the parameter, a copy of the document data of the corresponding electronic entity is acquired and set in the mail attachment, and the mail is transmitted.

  Further, in the present invention, it is possible to provide more advanced image information by attaching a plurality of pieces of image information and combining them with the mail processing server. For example, when the user authentication using the face authentication is considered, it is possible with this system that another person can easily become an individual by using a separately acquired face photograph. Therefore, in the present invention, a plurality of pieces of image information obtained by photographing a face photograph at a predetermined different angle are used, and “=” is used as a delimiter in the meta information, for example, as in the above description example, “face synthesis; 1; face authentication; "(Processing; described by a combination of parameters, meaning in this example is" execution instruction for compositing face image; first image; performing face authentication; composing two images in total ") It is possible to prevent impersonation using the above-mentioned photograph or the like by combining two face photographs as a stereoscopic image and performing authentication processing as three-dimensional face information.

  In this way, the user can customize the information processing flow in a form suitable for the processing provided by using the system according to the present invention, and it is possible to provide a remote information service based on flexible mail, It is possible to provide an easy-to-understand information operating environment that does not require complicated processing description.

  The present invention is not limited to the above example and can be modified in various ways. For example, in the case of JPEG (Joint Photographic Experts Group) file format, unique meta information can be set as an application marker segment. Can be described in a unique format, and more complicated processing items can be described. Various processing services are also conceivable. For example, when the barcode information is in the image, the processing flow information is encoded into the barcode information, and the code information in the barcode is followed. It is also possible to perform processing.

(Third embodiment)
The present invention compares the image processing results of continuous shot images using continuous shot images with different shooting conditions in a system that performs data processing according to the processing flow on a server that has uploaded the image data via a network. Thus, a system for acquiring the image processing result more reliably is provided. Hereinafter, this third embodiment will be described in detail.

  FIG. 13 shows the system configuration of the third embodiment according to the present invention. In this system, a small portable information terminal 500c having a communication function and an image information input function, for example, an information terminal device such as a mobile phone with a digital camera function (in addition, a digital camera with a communication function is also possible, On the network 200, which has a bidirectional communication function and a small display in view of browsing on-site browsing and processing log information) and can be connected by wireless communication or the like Includes an information device 300c as a server having a storage unit that supports a communication unit (for example, an e-mail server function or a file exchange server such as FTP) in which a file acquisition function is implemented, for example, a client server type system configuration such as a PC server Have Further, the information device 300c may be provided with a means for holding the processing result as a file in a predetermined storage area and browsing it at a later date.

  In the present system (in this embodiment, an example of an e-mail-based system is shown), as shown in FIG. 14, the continuous shooting section 155 of the portable information terminal 500c has a plurality of shooting conditions (which may be the same, but the present invention In order to make the image effective, a predetermined series of images in which the exposure and shutter speed are changed by a predetermined amount before and after the optimum value determined by the machine are photographed to obtain a predetermined format (for example, Exif). Format each image file group. At this time, in order to indicate that the images are sequential shot images, for example, as shown in FIG. 15, by setting a file name 170c such as the same image file name + sequential number, a file excluding the serial number portion on the server side. If the name parts match, image processing is performed as a continuous shot image. The user attaches the file name 170c to the target image file group using the e-mail client 171 and also supplies desired processing information using the image processing result with the text 173 (subject name can be used) according to a predetermined description rule. The subject is subject to the number of characters, etc.) and the scheduled remote service is executed.

  In this system, for example, the mobile information terminal 500c side sends a mail to a predetermined address destination 172 to use the service, and the server (information device 300c) side monitors the mail to the specific address by the mail transmission / reception unit 162. When received, the mail is downloaded from the mail server 160 and predetermined processing is performed by the mail processing means 164. For example, according to a predetermined description rule of “keyword; parameter;” using “;” as a delimiter, the processing content and processing parameters are specified and described in the text, and the continuous shot image data is attached. Send to. When the image processing result is used as a parameter, if the target image is clearly indicated by a symbol “<” “>” such as “<target image file name>” after the parameter, as shown in FIG. A complex processing service for a plurality of types of images 151 and 152 (here, face recognition processing and bar code processing are shown) (for example, acquisition of a destination mail address using a face recognition image 151 as shown in FIG. 13) It is possible to realize a mail attachment delivery service for a target document by document attachment barcode processing (see reference numeral 152).

  The processing in the server is shown in the flowcharts of FIGS. 18-1 and 18-2. First, the address is checked (step S61). Here, the information device 300c (assigned the specific mail address) of this system periodically checks the received mail, and when the mail sent to itself is detected, the mail text is acquired. The contents and the attached file are checked (steps S62 and S63), and the presence / absence of the text written in the description rule is determined. When the above description is detected, a processing list is created (step S64), and each attached image data group is extracted and transmitted to the processing modules (steps S71 to S78). In this processing module, an image processing list is referred to from the processing list (see only the processing list of the image processing keyword item), the processing items described therein are analyzed, and image processing corresponding to the processing items is performed. Analyze.

  In the example shown in FIG. 15, image data of a two-dimensional barcode (for example, QR code) is subjected to decoding processing (keyword is “QRdecode”), and a face photograph is subjected to face recognition processing (keyword is “FaceReaction”). If the processing is successful, a predetermined processing result is output, for example, the decoding result is output in the decoding processing, and the personal information (name, affiliation, mail address, etc.) recognized in the face recognition is output to the predetermined storage unit 164. In the image processing routine (steps S74 to S78), it is determined whether or not the same file name (excluding the serial number portion) is determined (step 71), and the file name indicated by the parameter for the image processing indicated by the keyword is set. This is performed on a series of continuous shot image data possessed (steps S72 and S73), and the results are compared and examined. In this example, face recognition processing is performed on the image file having the file name “AAAAAA” (excluding the serial number) indicated by the parameter for the FaceReaction keyword. Decoding processing is performed on the image file having the file name “BBBBBBB” (excluding the serial number portion) indicated by the parameter, for example, by comparing the processing results for each image processing. There is a method such as adopting a match, etc. In addition, when image processing results such as OCR processing vary, text data obtained by extracting only the text portion common to the processing results (or the common portion and Concatenated text data with different parts may be used as processing results.

  Also, after creating the processing list in step S64, the batch processing list item is created (included in step S64) by referring to the keyword items related to batch processing, and the output result of the image processing module is executed as necessary. Referring to, sequential processing is performed by setting parameters (steps S65 to S69).

In the above example, extract the processing list of “mailto; _person <AAAAAA>;” and “fileto; _decode <BBBBBB>;” from the batch processing keyword items in the body of the email, and create the following processing list .
Order Process item Parameter Reference image processing 1 mailto _person AAAAAA
2 fileto _decode BBBBBB
For the maltio keyword, e-mail address information is received from the personal information indicated by the parameter (refer to the face authentication result in this case) from the image processing result of the continuous image data group indicated by “AAAAAAA + sequential number”, and set to the destination To do. For the fileto keyword, the file path information is obtained from the decoding result indicated by the parameter from the image processing result of the continuous image data group indicated by “BBBBBB + serial number”, and a copy of the document data of the corresponding electronic entity is obtained. The mail is sent by setting it in the attached file of the mail (step S70).

  Further, for the image processing information, a list corresponding to the mail processing unit 24 serviced on the server (information device 300c) side is described in a text format (for example, XML format) as shown in FIG. A file is created in advance in the storage unit 157 of the portable information terminal 500c, and after this list information is read, it is displayed as indicated by reference numeral 180 to prompt the user to select. The user can select each item 181a and write the selection item character 181b in a predetermined meta information area after confirmation.

  For example, when the image information is held in the Exif standard image format shown in FIG. 17, which is a format generally used as a digital still image data format, a UserComment tag 186 (user is permitted to write freely). Text data (barcode processing in the example shown in FIG. 16), which is the processing information, is stored in the data area of tag No. 37510). As an example of a specific operation method, as shown in FIG. 16, after capturing and storing a target continuous shot image, a predetermined continuous shot image data group is selected and displayed in a playback mode, and a menu screen 180 is activated. The desired image processing keyword item 181b is selected by operating. For example, when a decoding process is instructed for an image group obtained by continuously shooting two-dimensional code images 182 encoded with storage location information printed on a material, a barcode processing item is selected from the processing item menu 181a, and The data is written as text data in the data area of the UserComment tag (tag No. 37510) of the Exif data tag area of each image file in the continuous shot image data group by the saving operation.

  In FIG. 18, in the above-described image processing routine, the processing item is extracted from the UserComment tag of each image file after confirming the presence or absence of text information in the tag, and processing list information using the processing keyword corresponding to the processing item is obtained. Create (step S72). After the list is created, the keywords described in the list information are determined, and predetermined image processing is sequentially executed. Then, after the system confirms that the corresponding image processing has been performed, the processing result of the same continuous shot image group is compared and processed as a file in a predetermined format in a predetermined storage unit 164 and stored. Good.

  The present invention is not limited to the embodiment described above, and various modifications are possible. For example, in the case of the JPEG file format, unique meta information can be set as an application marker segment. It can be described in a format, and more complicated processing items can be described.

  As described above, the image information processing system and the image information processing method according to the present invention are useful for an image information processing system and a method thereof via a network using a portable information terminal. It is suitable for image information processing, image processing using continuous shot images, and the like.

It is explanatory drawing which shows the system configuration | structure concerning the 1st Embodiment of this invention. It is a block diagram which shows the internal structure of the system in FIG. It is a flowchart which shows the write-in procedure of the meta information concerning the 1st Embodiment of this invention. It is explanatory drawing which shows the example of a file concerning the 1st Embodiment of this invention, and an example of tag information. It is explanatory drawing which shows the process example concerning the 1st Embodiment of this invention. It is a flowchart which shows the new preparation procedure of the file concerning the 2nd Embodiment of this invention. It is explanatory drawing which shows the system configuration | structure concerning the 2nd Embodiment of this invention. It is a block diagram which shows the internal structure of the system in FIG. It is explanatory drawing which shows the example of a display list of the portable information terminal concerning the 2nd Embodiment of this invention. It is explanatory drawing which shows the example of a file concerning the 2nd Embodiment of this invention, and an example of tag information. It is explanatory drawing which shows the mail display example of the portable information terminal concerning the 2nd Embodiment of this invention. It is a flowchart which shows the mail processing procedure (1) concerning the 2nd Embodiment of this invention. It is a flowchart which shows the mail processing procedure (2) concerning the 2nd Embodiment of this invention. It is explanatory drawing which shows the system configuration | structure concerning the 3rd Embodiment of this invention. It is a block diagram which shows the internal structure of the system in FIG. It is explanatory drawing which shows the mail display example of the portable information terminal concerning the 3rd Embodiment of this invention. It is explanatory drawing which shows the example of a display list of the portable information terminal concerning the 3rd Embodiment of this invention. It is explanatory drawing which shows the example of a file concerning the 3rd Embodiment of this invention, and an example of tag information. It is a flowchart which shows the mail processing procedure (1) concerning the 3rd Embodiment of this invention. It is a flowchart which shows the mail processing procedure (2) concerning the 3rd Embodiment of this invention. It is explanatory drawing which shows the system configuration example (1) in the past. It is explanatory drawing which shows the system configuration example (2) in the past.

Explanation of symbols

10 shooting unit 11 CPU
12, 14, 112, 118 Storage unit 13 Communication unit 15 Monitoring unit 16 Processing unit 17, 113 Communication unit 18 Display unit 100 Information terminal device 110 Image information editing unit 111 Imaging unit 114 Mail transmission / reception unit 115, 160 Mail server 117, 162 Mail transmission / reception unit 119, 163 Mail processing unit 155 Continuous shooting unit 200 Network 300a, b, c Information device (server)
400 pcs
500a, b, c portable information terminal

Claims (28)

The portable image terminal having at least communication means, photographing means, and conversion means for converting image information into an electronic file in a predetermined format, and the image installed on a network connectable by the communication means An information processing system having image information storage means for storing information,
The portable information terminal has processing information description means for describing predetermined processing information in a predetermined meta information description portion of the image information,
The portable information terminal monitors the image information storage means connectable via a network, and when the image file storing the meta information is transmitted to the image information storage means, the meta information is used based on the meta information. Holding / presenting means for performing predetermined processing on the image information and holding or presenting the information in a form that allows a predetermined target person to confirm at least one of the processing result or the processing process;
An image information processing system comprising:   2. The image information processing system according to claim 1, wherein the portable information terminal comprises text information description means for describing the image processing information as text information in a tag information area of an image format which is a meta information area.   Processing for storing predetermined processing information in a meta information area from selection information of processing items in the list by an operator having storage means for storing the processing item list of the meta information in the portable information terminal in advance The image information processing system according to claim 1, further comprising information description means. Detecting means for detecting that the image information is transmitted and stored in the image information storage means via a network;
Processing means for performing processing based on the meta information when image file information is completely stored in the image information storage means;
The image information processing system according to claim 1, further comprising: Storage means for storing a result processed based on the meta information as a file in a predetermined storage area;
Attribute information storage means for storing the attribute information of the generated file in a predetermined meta information area of the image information;
The image information processing system according to claim 1, further comprising: Storage means for storing the processing result as a file in a predetermined format;
Sending means for sending the result content to a predetermined user via a network;
The image information processing system according to claim 1, further comprising: The portable information terminal having at least a communication unit, a photographing unit, and a conversion unit that converts image information into an electronic file in a predetermined format, and installed on a network connectable by the communication unit An image information processing method in an information processing system having image information storage means for storing image information,
A first step in the portable information terminal comprising the step of describing predetermined processing information in a predetermined meta information description part of the image information;
The portable information terminal monitors the image information storage means connectable via a network, and when the image file storing the meta information is transmitted to the image information storage means, the meta information is used based on the meta information. A second step of performing predetermined processing on the image information;
A third step of holding or presenting information in a form that allows a predetermined target person to confirm information on at least one of a processing result or a processing process;
An image information processing method comprising:   8. The image information processing method according to claim 7, further comprising a text information description step in which the portable information terminal describes the processing information as text information in a tag information area of an image format that is a meta information area. A processing item list storage step of storing the processing information list of the meta information in the portable information terminal in advance;
A processing information description step for describing predetermined processing information in a meta information area according to selection information of processing items in the list by the operator;
The image information processing method according to claim 7, further comprising: A detection step of detecting that the image information is transmitted and stored in the image information storage means via a network;
A processing step of performing processing based on the meta information when the image file information is completely received by the storage device;
The image information processing method according to claim 7, further comprising: A storing step of storing a result processed based on the meta information as a file in a predetermined storage area;
Storing the generated attribute information of the file in a predetermined meta information area of the image information;
The image information processing method according to claim 7, further comprising: A storage step of storing the processing result as a file in a predetermined format; and
A sending step of sending the contents of the processing result to a predetermined user via a network;
The image information processing method according to claim 7, further comprising: A portable information terminal having photographing means capable of acquiring image information as digital information, and an e-mail transmission means capable of transmitting at least the image information as attached information; and a mail with attached image information transmitted from the portable information terminal. An image information processing system comprising: an information processing device for receiving,
The portable information terminal
Processing information insertion means for inserting predetermined processing information into a desired area of the meta information area of the image information;
Instruction data description means for describing predetermined processing instruction data information in a desired area of outgoing mail data;
With
The information processing apparatus includes:
Image information processing means for performing image processing corresponding to the processing information inserted in the meta information to obtain a desired processing result;
An analysis means for analyzing at least one of the operation procedure processing information described in the meta information area in the subject or body of the email or image information;
Processing means for controlling and executing a desired information operation based on the processing result by the image information processing means and the processing procedure obtained by the operation processing procedure analysis;
Presenting means for presenting at least one of processing result or processing process by e-mail in a form that a predetermined target person can confirm;
An image information processing system comprising:   Processing for adding desired processing according to the data referred to in the processing procedure, having additional information reference means for referring to additional information corresponding to the processing result stored in a predetermined database based on the processing result of the image information The image information processing system according to claim 13, further comprising a control unit. List information storage means for storing list information of implemented processing services;
Requesting means for requesting a processing service list indicating the information processing contents executable for a predetermined information processing apparatus in the portable information terminal;
Storage means for storing the service list information from the information processing apparatus;
Operation means for setting processing information in the meta information of the image information by a selection operation from the service list;
The image information processing system according to claim 13, further comprising:   14. The image processing unit according to claim 13, wherein the image information includes a plurality of pieces of image information, and the image information processing unit includes an image processing unit that generates image data for predetermined processing from the plurality of pieces of image information. Image information processing system. A portable information terminal having a photographing unit capable of acquiring image information as digital information, an e-mail transmission unit capable of transmitting at least the image information as attached information, and an image for receiving a mail with attached information transmitted from the terminal An information processing method,
An information insertion step of inserting predetermined information into a desired area of the meta information area of the image information;
An instruction data insertion step of inserting predetermined processing instruction data information into a desired area of the outgoing mail data;
An image information processing step for obtaining a desired processing result by performing image processing corresponding to the information inserted in the meta information in the image information;
An analysis process for analyzing at least one of the operation procedure processing information described in the meta information area in the subject or body of the email or the image information,
A processing step of controlling and executing a desired information operation based on a processing result by the image information processing means and a processing procedure obtained by the operation processing procedure analysis;
A presentation step of presenting at least one of the processing result or the processing process by e-mail in a form that can be confirmed by a predetermined target person; and
An image information processing method comprising: An additional information reference step for referring to additional information stored in a predetermined database according to the processing result of the image information and corresponding to the processing result;
A process control step of adding a desired process in the process procedure according to data referred to in the process procedure;
The image information processing method according to claim 17, further comprising: A list information storing step for storing list information of processing services implemented;
A requesting step for requesting a processing service list indicating the information processing content executable for a predetermined information processing device in the portable information terminal;
A service list information storage step for storing the service list information from the information processing apparatus;
An operation step of setting processing information in the meta information of the image information by a selection operation from the service list;
The image information processing method according to claim 17, further comprising:   The image information processing method according to claim 17, wherein the image information includes a plurality of image information, and includes an image processing step of generating image data for predetermined processing from the plurality of image information. The portable image terminal having at least communication means, photographing means, and conversion means for converting image information into an electronic file in a predetermined format, and the image installed on a network connectable by the communication means Image information acquisition means for acquiring information,
The portable information terminal has description means for describing predetermined processing information in the image file or transmission information when the image information is transmitted to the image information acquisition means via the network,
The image information acquisition unit is monitored, and when the image file to which the attachment information including the processing information is added is transmitted to the image information acquisition unit, a predetermined process is performed on the image information based on the attachment information. An image information processing system,
The processing target image is continuous image information obtained by capturing the same target at least in the same or one or more shooting conditions, and included in the attached information based on image processing results of at least two or more of the image information An image information processing system comprising a process execution means for executing a process based on information.   22. A file attribute adding means for adding information indicating that the continuous image information is image information obtained by photographing the same object to a file attribute such as a file name or meta information of each image information. The image information processing system described in the paragraph. Recognizing means for recognizing that at least two of the image processing results in the continuous image information are matched.
A continuation unit that employs the matching result as an image processing result and continues processing added to the image information;
The image information processing system according to claim 21, further comprising: A comparison and synthesis means for comparing and synthesizing each image processing result of the continuous image information;
Processing continuation means for continuing the processing added to the image information using the comparison and synthesis processing result from the comparison and synthesis means;
The image information processing system according to claim 21, further comprising: The portable image terminal having at least communication means, photographing means, and conversion means for converting image information into an electronic file in a predetermined format, and the image installed on a network connectable by the communication means Image information acquisition means for acquiring information,
Furthermore, the portable information terminal has information description means for describing predetermined processing information in the image file or transmission information when transmitting the image information to the acquisition means via the network,
An image that monitors the image acquisition means and performs predetermined processing on the image information based on the attachment information when an image file to which the attachment information including the processing information is added is transmitted to the image information acquisition means An information processing method,
A photographing step of photographing the same object by changing at least the same or one or more photographing conditions of the processing target image,
A transmission step of transmitting the image information group;
A processing step of executing processing based on processing information included in the attached information based on image processing results of at least two or more of the image information;
An image information processing method comprising:   26. The method according to claim 25, further comprising an attribute adding step of adding information indicating that the continuous image information is image information obtained by photographing the same object to a file attribute such as a file name or meta information of each image information. Image information processing method. A recognition step for recognizing that at least two of the image processing results in the continuous image information are matched.
A continuation step of adopting the matching result as an image processing result and continuing the processing added to the image information;
The image information processing method according to claim 25, further comprising: A comparison and synthesis step of comparing and synthesizing each image processing result of the continuous image information;
A continuation step of continuing the processing added to the image information using the comparison and synthesis processing result from the comparison and synthesis step;
The image information processing method according to claim 25, further comprising:

Images