JP2014042130A - Function sharing in image formation processing apparatus using cloud computing environment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in which: functions to read information embedded in a paper medium and execute various types of image processing functions are compensated by service on a cloud computing environment; however, appropriate determination is required in the system as to which of a device and cloud service is used in executing the functions.SOLUTION: A system provides various types of functions of an image forming apparatus in cooperation between service on a cloud computing environment and a function of a device body. Cloud service analyzes an image on a paper medium having information embedded therein to perform the functions of the image forming apparatus. The cloud service determines whether the device has a function equivalent to the service. The system uses the function of the device when the function of the device is equivalent to the service, and uses the cloud service when the device has no function equivalent to the service.

Description

  The present invention analyzes an image read by an image forming apparatus on a network to extract information, and extracts and analyzes image information for linking various processing functions on the network and the image forming apparatus according to the obtained information. The present invention relates to function execution based on extracted information, or optimization of function sharing between various processing functions on the network and various processing functions of the image forming apparatus.

  By complementing the function of the device having a low-function main body with the cloud service, a function equivalent to that of the device having a high-function main body can be provided. In particular, the present invention relates to image information extraction and analysis on a cloud and a function execution function based on the extracted information.

  At present, image information extraction, analysis, and function execution based on the extracted information require a main body option for a copy prohibition function, for example. Also, the models that can be equipped with options are limited. On the other hand, a function (for example, copy prohibition) realized by image information extraction, analysis, and function execution based on the extracted information can be performed only by compatible devices.

  However, by utilizing the image information extraction and analysis on the cloud of the present invention, the function execution function based on the extracted information, in an environment where low function machines such as offices, high function machines, etc. must be mixed, Almost all devices can use functions (for example, copy prohibition) based on image information extraction, analysis, and function execution based on the extracted information. Also, by embedding and reading information on paper media with a cloud service, it is possible to define and use workflows in the cloud.

  Conventionally, there has been an invention for executing a workflow by embedding information in paper (see, for example, Patent Document 1). The difference between the prior art and the present invention is that the present invention dynamically determines whether a function is provided by the main body or by a cloud service. When the present invention is actually implemented, whether the device functions are used when the functions are used, depending on the presence / absence of main unit options (hardware installation, software installation, etc.) or the timing of option existence (pre-installation, later installation) The user must be able to choose whether to use (otherwise, the user may waste options or use a cloud service that is not needed).

JP 2006-243830 A

  There is a demand for providing a function equivalent to that of a high-performance device by providing the function on the cloud to a device that does not have various functions (image conversion, OCR, etc.) of the MFP in the main body. Especially for devices that do not have various functions such as PDF generation, OCR functions, etc. in the main body such as a low-priced machine, we want to provide information embedding, reading, and functions on paper media by using services on the cloud. (With this function, the function provided on the cloud is set in advance and the information is embedded in the paper medium. The paper medium embedded with the above information and the image information extraction, analysis on the cloud, By linking the function execution function based on the extracted information, it is possible to appropriately set the MFP function in a device that does not have a UI such as setting.

  When providing a function execution function based on image information extraction, analysis, and extraction information on the cloud, and embedding a workflow (function to be executed) on a paper medium, the function specified in the workflow is provided by the device And may be provided in the cloud. In addition, functions may be added to the device later. At that time, there is a problem that it is necessary to appropriately determine whether the function provision in the workflow is performed by the device or the cloud.

In the image forming apparatus (1103) that realizes various image forming apparatus functions (image conversion, OCR, etc.) as a service on the cloud and operates in cooperation with the device main body function,
A cloud service (1101) that analyzes the image (1104) of the paper medium in which the information is embedded, extracts various image processing information (1105), and executes the image forming apparatus function
A cloud service (1601) for determining whether a device function (1606) equivalent to the service exists when executing the cloud service
In the determination, the system uses the device function (1606) when the function exists, and uses the cloud service (1601) when the function does not exist.

  According to the present invention, image information extraction and analysis in the main body such as a low-priced machine, information embedding and reading on a paper medium by using a service on the cloud for a device that does not have a function execution function based on the extracted information, Function can be provided.

  Further, according to the present invention, it is possible to make a setting in advance for a function provided on the cloud and embed information in a paper medium. MFP function to be provided on the cloud in devices that do not have UI such as settings by linking the above-mentioned information embedded paper media with image information extraction and analysis on the cloud, and function execution functions based on the extracted information It becomes possible to perform the setting appropriately.

  According to the present invention, when the MFP function is performed according to the information embedded in the paper medium, it is possible to determine in advance whether the MFP function is executed by the device or the cloud service. As a result, the user can appropriately use the existing or added function in the device, and can optimize the function cooperation between the cloud service and the device.

It is a figure which shows the whole structure of the various apparatuses in a present Example. 2 is a block diagram illustrating an internal configuration of an image forming apparatus 104 according to the present exemplary embodiment. FIG. It is a block diagram which shows the internal structure of the information processing apparatus 106 in a present Example. FIG. 3 is a functional block diagram of each device in the print system according to the present exemplary embodiment. It is the figure which pulled the reference grid in a part of one barcode in a present Example. It is a figure which shows the arbitrary dots of a document image in a present Example. It is a figure which shows one barcode in a present Example. FIG. 3 is a diagram illustrating a relationship between an image forming apparatus and a cloud service in the present embodiment. 4 is a flowchart illustrating processing of the image forming apparatus according to the present exemplary embodiment. 6 is a flowchart of a function sharing determination process of the image forming apparatus according to the present exemplary embodiment. It is a flowchart of the cloud service process in a present Example. 6 is a flowchart of a function sharing determination process of the image forming apparatus according to the present exemplary embodiment. FIG. 3 is a diagram illustrating a relationship between an image forming apparatus and a cloud service in the present embodiment.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

[Example of Cloud Service in the Present Invention]
Hereinafter, a general embodiment of the cloud service of the present invention will be described.

  The cloud service of the present invention refers to various image analysis, conversion, storage, and other services processed by a group of server computers on the network as described below. An image forming apparatus, which will be described later, performs various processes using the service by communicating with the server computer group via a network.

  Each device constituting the print system of the embodiment of the cloud service in the present invention will be described in detail with reference to FIG. FIG. 1 shows a state in which each device constituting the printing system is connected via a network 100. The apparatuses constituting the print system are a server computer group 102, a document server 103, an image forming apparatus 104, and a client computer 105.

  The network 100 is a communication line for exchanging information between the above-described devices. The Internet 101 is a communication line for exchanging information between the above-described devices across a firewall. Through the Internet 101, the network 100 to which the server computer group 102 and the document server 103 belong, and the network 100 to which the image forming apparatus 104 and the client computer 105 belong can communicate with each other across a firewall. The network 100 and the Internet 101 are communication line networks that support, for example, the TCP / IP protocol, and may be wired or wireless. In FIG. 1 of the first embodiment, the server computer group 102 is illustrated as a single server, but includes a plurality of server computers.

  Next, the internal configuration of each apparatus constituting the print system of FIG. 1 will be described in detail. First, the internal configuration of the image forming apparatus 104 will be described with reference to FIG. FIG. 2A is a block diagram illustrating the internal configuration of the image forming apparatus 104.

  The image forming apparatus 104 includes an image processing unit 1041 and a printing unit 1042. The image processing unit 1041 includes a CPU 1043, a direct storage unit 1044, an indirect storage unit 1045, a user interface 1047, and an external interface 1048.

  The CPU 1043 is a unit that executes a predetermined program and instructs various controls of the image processing apparatus 104. The CPU 1043 is realized by a CPU (Central Processing Unit). The direct storage unit 1044 is a work memory used when the CPU 1043 executes a program, and the program executed by the CPU 1043 is loaded into the direct storage unit 1044. The direct storage unit 1044 is realized by a RAM (Random Access Memory). The indirect storage unit 1045 stores various programs including application programs and platform programs. Various programs stored in the indirect storage unit 1045 move to the direct storage unit 1044 when the CPU 1043 executes the program. The indirect storage unit 1045 is realized by an SSD (Solid State Drive) or an HDD (Hard Disc Drive). Note that the CPU 1043 may be a multiprocessor.

  Here, the platform will be described in detail. By realizing the platform, a new application uniquely developed by the user can be executed on the image forming apparatus 102 and the operation screen of the image forming apparatus 102 can be customized.

  A method for realizing the platform will be described. The CPU 1043 moves the platform program stored in the indirect storage unit 1045 to the direct storage unit 1044. When the movement is completed, the CPU 1043 is ready to execute the platform program. In the first embodiment of the present invention, the execution of the platform program by the CPU 1043 is referred to as the activation of the platform. Note that the platform operates on the firmware of the image forming apparatus 104. The platform program provides an environment for executing an application program described in an object-oriented manner.

  A method for executing an application program on the platform will be described in detail. In the first embodiment of the present invention, print software that accepts a print request operates on the platform. The print software can receive print data from a device connected via a network, for example, by a communication protocol such as HTTP (Hyper Text Transfer Protocol). The print software transmits the received print data to the firmware, and the firmware that has received the print data starts print data processing. Note that if the print data can be printed without being processed, the firmware omits the print data processing. As described above, the control of the image forming apparatus 104 can be realized by executing the application program on the platform.

  A method for executing the application program will be described. The activated platform moves the application program stored in the indirect storage unit 1045 to the direct storage unit 1044. When the movement is completed, the platform is ready to execute the application program. The platform then executes the application program. In this way, the platform function that can be provided by executing the application program is referred to as a platform application in the first embodiment of the present invention. Furthermore, the platform can perform a part of each process of the flowchart disclosed in the first embodiment of the present invention.

  The user interface 1047 is a unit necessary for receiving a processing request from a user. For example, a signal corresponding to an instruction input by the user through a keyboard, a mouse, or the like is received. The external interface 1048 can receive data from an external device and transmit data to the external device. For example, the external device includes an external storage device such as an external HDD or an external USB memory, or a separate device such as a separate host computer or image forming device connected via a network. The image forming apparatus 102 can communicate with the client computer 105, the server computer group 102, and the like via the network 100 and the Internet 101.

  Second, the internal configuration of the information processing apparatus including the server computer group 102, the document server 103, and the client computer 105 will be described with reference to FIG. FIG. 2B is a block diagram illustrating the internal configuration of the information processing apparatus 106. The information processing apparatus 106 includes a user interface 1061, a CPU 1062, a direct storage unit 1063, an indirect storage unit 1064, and an external interface 1065.

  The user interface 1061 is a unit necessary for receiving a processing request from a user. For example, a signal corresponding to an instruction input by the user through a keyboard, a mouse, or the like is received.

  The CPU 1062 is a unit that executes a predetermined program and instructs various controls of the information processing apparatus 106. The CPU 1062 is realized by a CPU. The direct storage unit 1063 is a work memory used when the CPU 1062 executes a program, and the program executed by the CPU 1062 is loaded into the direct storage unit 1063. The direct storage unit 1063 is composed of a RAM. The indirect storage unit 1064 stores various programs including an application program and an OS (Operating System). Various programs stored in the indirect storage unit 1064 move to the direct storage unit 1063 when the CPU 1062 executes the program. The indirect storage unit 1064 is configured by a ROM or an HDD. The external interface 1065 is connected to the network 100 and can communicate with other devices connected to the network 100.

  Next, functions of each device in the printing system according to the first embodiment will be described in detail with reference to FIG. FIG. 3 is a functional block diagram of each device in the printing system.

  First, functions of the server computer group 102 will be described. The server computer group 102 has functions of a request receiving unit 4011, a back-end processing unit 4021, a queue service 405, and a storage 406. In Embodiment 1 of the present invention, at least one server computer having the request receiving unit 4011 exists. In addition, at least one server computer having the back-end processing unit 4021 exists. In addition, there is at least one server computer having both functions of the queue service 405 and the storage 406.

  The request receiving unit 4011 has a function of receiving a processing request sent from the client computer 105 or the image forming apparatus 104. The back-end processing unit 4021 has a function of performing processing for a processing request using a processing program. Specifically, the back-end processing unit 4021 loads the processing program into the memory of the server computer that executes the back-end processing unit 4021 and performs processing. The request reception unit 4011 and the back-end processing unit 4021 are loaded with the request reception program or the back-end processing program stored in the indirect storage unit 1064 in FIG. Realized by being executed.

  The queue service 405 has the following functions. First, the request receiving unit 4011 and the back-end processing unit 4021 have a function for asynchronous data communication. The second function is to make the queue message added to the queue invisible or visible.

  The first function will be described. The request receiving unit 4011 and the backend processing unit 4021 communicate with each other by the following method. First, the request receiving unit 4011 that has received a processing request from the user creates a ticket called a queue message in response to the processing request from the user. At this time, a reception ID corresponding to the queue message is also created. The queue message and the reception ID will be described later. The queue message is stored in the queue by the request receiving unit 4011. The back-end processing unit 4021 acquires a queue message from the queue. The back-end processing unit 4021 acquires a queue message, and processes a processing request from a user with reference to the queue message. As a result, the processing request from the user is solved. As described above, by using the queue service 405, the request receiving unit 4011 and the back-end processing unit 4021 can communicate asynchronously. A more detailed description of the first function and a description of the second function will be described later. Note that the queue service 405 is realized by loading the queue service program stored in the indirect storage unit 1064 of FIG. 2B to the direct storage unit 1063 and executing it by the CPU 1062. The queue is realized by the indirect storage unit 1064.

  The storage 406 has a function of storing various data including execution result data processed by the back-end processing unit 4021. The storage 406 is realized by the indirect storage unit 1046 in FIG. The above is a description of the functions of the server computer group 102, and a more detailed description will be given later.

  Next, functions of the document server 103 will be described. The document server 103 has a function of the document repository 301. The document repository 301 is realized by the indirect storage unit 1046 in FIG. For example, the document repository 301 stores content that the user has instructed to print from the client computer 105 or the image forming apparatus 104. The contents stored in the document repository 301 include the following contents in addition to the contents stored in advance.

  The content is content created by an application on the server computer group 102 via the browser 304 described later. Thus, even content created using an application on the server computer group 102 can be easily printed without installing the application on the client computer 105. The applications on the server computer group 102 are various applications such as a document creation application, an image creation application, a form management application, and the like. These applications are held in the indirect storage unit 1064 in FIG. 2B, and when execution is instructed, they are loaded into the direct storage unit 1063 and executed by the CPU 1062.

  Next, the image forming apparatus 104 will be described in detail. The image forming apparatus 104 has functions of a device browser 302 and a platform application 303. The device browser 302 has a function that allows a user to browse data and information stored in a device connected via the network 100. The device browser 302 is realized by loading a device browser program stored in the direct storage unit 1045 in FIG. 2A into the indirect storage unit 1045 and executing it by the CPU 1043. Also, the user can issue a content print instruction using the device browser 302. The device browser 302 is, for example, a web browser.

  The platform application 302 has a function of providing various services. The platform application 302 is realized by an application program that operates on the platform. In the first embodiment of the present invention, the platform application 302 provides a print software service. As described above, this service can send the received print data to the firmware. In addition, this service checks with the request reception unit 4011 whether or not generation of print data has been completed. At this time, this service performs generation confirmation based on the reception ID created by the request reception unit 4011.

  Finally, the client computer 105 will be described in detail. The client computer 105 has a browser 304 function. The browser 304 has a function that allows a user to browse data and information stored in a device connected via the network 100. The browser program stored in the indirect storage unit 1064 in FIG. 2B is implemented by being loaded into the direct storage unit 1063 and executed by the CPU 1062. The browser 304 is, for example, a web browser. The above is a description of the functions of each device in the print system of the first embodiment.

[Embed and read information in image]
In this embodiment, as one of the cloud services, the server computer group 102 performs a service for reading information embedded in an image. As a kind of the platform application 302, there is an application that obtains specific information by decoding information embedded in the following image.

  Here, terms used in the following embodiments of the present invention will be described. The specific information is any of the following information. The first is two pieces of information, copy prohibition information and document ID. The second is three pieces of information including conditional copy permission information, conditions, and document ID. In the embodiment of the present invention, copy prohibition information and conditional copy permission information are collectively referred to as copy control information.

  The specific information may be about an image processing function. For example, it is information on whether or not to execute an OCR function, a PDF document creation function, an image storage function in a document server, and the like.

  Next, processing for creating a document with specific information added will be described. First, embedded information is obtained by encoding specific information. Second, a barcode is generated by imaging the embedded information. Then, the generated barcode is duplicated. A plurality of barcodes obtained as a result are combined to generate a barcode group. Third, the bar code group and the original image are combined to generate a bar code-combined original image. Finally, the original image combined with the barcode is printed. As a result, a manuscript with specific information added thereto as a bar code is created. This series of processing is called “addition” of specific information. Note that the process of encoding and imaging specific information (which generates a barcode) will be referred to as barcode conversion of specific information.

  The reason why the bar code group combining a plurality of bar codes is combined with the original image and printed is to obtain the effect of improving the durability. In this way, by combining the barcode group with the original image and printing it, specific information can be extracted from the original as long as even one unclean barcode exists in the original.

  In this embodiment, the number of barcodes included in the barcode group corresponds to the size of the document image. For example, when the document image is a size printed on a sheet of A4 size (21 cm × 29.7 cm), the barcode group includes 21 × 29 barcodes. As a result, the barcode is included on the entire surface of the created document.

  Next, a process for extracting specific information from a document to which specific information is added with a barcode will be described. First, the original placed on the original table or on an ADF (Auto Document Feeder) is read, and an original image of the read original is generated. Second, a barcode is found from the original image. Third, the found barcode is computerized to obtain embedded information. Fourth, specific information is obtained by decoding embedded information. As a result, specific information can be obtained from a document to which specific information is added by a barcode. The second and subsequent processes in this series of processes are called “extraction” of specific information.

  In this embodiment, it is possible to perform document image analysis on a network service described later. That is, in the process of extracting the specific information from the original document to which the specific information is added by the barcode, the document image generation process shift is performed by the network service. In this case, the MFP directly transmits the read document image from the MFP to the network service after the document image generation process. The “extraction” of the specific information is performed by a network service.

  The embedded information includes an error correction code, and the specific information does not include an error correction code.

  Further, the input for adding specific information may be made from a driver or utility of a PC connected to the MFP. In the first embodiment of the present invention, the copy control information added to one original is only one of copy prohibition information and conditional copy permission information.

  Next, the barcode will be described in detail with reference to FIGS. FIG. 6 shows one barcode. FIG. 4 shows a diagram in which a reference grid is drawn on a part of the one barcode.

  1600 in FIG. 6 is a size of about 1 cm multiplied by 1 cm and indicates one barcode. The bar code 1600 has two areas, a high density area (1605 to 8) and a low density area (1609 to 1612).

  The high-density area includes encoded copy control information, and the low-density area includes encoded conditions. As will be described later, the condition included in the low density area may be the condition itself or may be a hashed condition. If there is no condition, that is, if copy prohibition information (in the case of Example 2, copy prohibition information or copy permission information) is included in the high density area, dummy information ( Information that has no meaning). Note that the high-density area uses a larger amount of error correction codes than the low-density area.

  The reason why the high-density area is smaller in spite of the large amount of error correction codes is that the data size of the copy control information is smaller than the data size of the condition. In this specification, a user ID and a password are disclosed as conditions for omitting the description. However, the conditions are not limited to these. For example, the condition may be other information such as date and time or a department to which the user belongs. Alternatively, the condition may be created by combining various information (for example, combining date and time, user ID, password, department to which the user belongs, etc.). In this specification, the low-density region is larger than the high-density region so that any complicated condition is indicated (although there is still a limit).

  FIG. 4 shows a diagram in which a reference grid is drawn on a part of the one barcode. FIG. 4 shows information dots 1401 and array dots 1402 constituting the barcode. The array dots 1402 exist at equal intervals on the reference grid 1403 indicated by the dotted line (that is, on the intersection of the reference grids 1403).

  The information dot exists at a position shifted from the intersection of the reference grids 1403. The specific information is expressed by the information dot shift direction (the direction of the position where the information dot is shifted with respect to the intersection). Although it is the above-mentioned reference grid, in FIG. 3, it is a line that is drawn in dotted lines but is not actually printed.

  Next, processing for extracting specific information from the document image will be described. As described above, the process of extracting specific information is as follows: (1) A barcode is found from the document image. (2) The found barcode is computerized to obtain embedded information. (3) It consists of a process of obtaining specific information by decoding embedded information.

  First, (1) a method for finding a barcode from an original image will be described in detail with reference to FIG.

  The platform application 302 selects an arbitrary dot 1501 in the document image. The platform application 302 selects an arbitrary dot 1502 existing around the selected dot. The platform application 302 rotates the positions of these selected dots by 90 ° around the center point of both dots. When there is a dot at a position obtained by rotation, the platform application 302 determines that the selected dots are array dots that should be present at equal intervals both vertically and horizontally.

  On the other hand, when there is no dot, the platform application 302 determines that each selected dot is an information dot that should be present at a random position.

  In this way, the platform application 302 finds two array dots, and finds other array dots from the constraint that array dots exist at equal intervals both vertically and horizontally. The platform application 302 finds a plurality of array dots (for example, 100 from the vertical and horizontal sides) and then virtually draws a reference grid on the array dots. In this example, the reference grid is composed of about 400 lines in a total of about 200 lines in the vertical direction and about 200 lines in the horizontal direction. The reason why such a number is obtained is clear from FIG. 3 (in FIG. 4, there are two vertical array dots and three horizontal array dots, and three vertical lines and six horizontal lines are drawn. ing).

  In the embodiment of the present invention, the above process (from the process of selecting an arbitrary dot to the process of virtually drawing the reference grid) is collectively referred to as finding a barcode. This is because one barcode is always present in the drawn area of this reference grid. Incidentally, the size of one barcode (including the high density region and the low density region) disclosed in this embodiment and the following embodiments is 100 vertical lines × 100 horizontal lines (note that two lines are It is assumed that the distance is the same as the size of the region formed from (about 100 μm). Since the platform application 302 draws a reference grid in an area having a size that is twice or more both vertically and horizontally, at least one barcode exists in the reference grid.

  The platform application 302 repeats the above process (from the process of selecting an arbitrary dot to the process of virtually drawing the reference grid) N times (for example, 20 times) while changing the target area. For example, the entire document image is divided into N areas (for example, a total of 20 vertical 4 and horizontal 5), and the above processing is repeated N times. By repeating the above process N times in this way, at least one barcode included in each barcode group can be found even if there are a plurality of barcode groups in the document image.

  For example, if two documents are placed on the document table, copy prohibition information is added to the first document, and conditional copy permission information is added to the second document, the document image There will be a plurality of bar code groups. Even in such a case, the platform application 302 can find at least one barcode included in each barcode group because the reference grid is drawn in various regions. That is, the barcode corresponding to the copy prohibition information and the barcode corresponding to the conditional copy permission information can be found.

  This completes the description of the method for finding the barcode.

  Next, (2) a method of obtaining the embedded information by converting the found barcode into information will be described.

  (2-1) The platform application 302 obtains the direction of information dot shift from the intersection of reference grids. In the above example, there are a total of 40,000 intersections because 200 vertical lines and 200 horizontal lines are drawn. Among these, since array dots exist at 20,000 intersections, the direction of information dot displacement from the remaining 20,000 intersections is obtained. As a result, information of 3 bits per information dot is obtained.

  More specifically, 0 when the information dot is displaced in the upward direction, 1 when the information dot is displaced in the upper right direction, and 2 when the information dot is displaced in the right direction (hereinafter, the value of the information every time the direction is deviated by 45 degrees). In this way, the platform application 302 obtains 0 to 7 information (3-bit information). As a result, information of 3 bits × 20,000 = 60,000 bits is obtained. Embedded information is included in the 60,000 bits of information.

  (2-2) Next, a process for finding embedded information from the information thus obtained (for example, information of 60,000 bits) will be described.

  Although omitted in the description of the encoding, the encoding unit 11 obtains the embedded information so that a predetermined bit string (for example, a bit string consisting of 20 bits of 010101010101010101101) is included first in encoding.

  The platform application 302 finds the predetermined bit string from the information thus obtained (for example, information of 60,000 bits). Then, information until the predetermined bit string is found next is determined as embedded information.

  That is, the platform application 302 determines that “predetermined bit string + information string surrounded by predetermined bit strings” is embedded information. In this way, the platform application 302 obtains embedded information that is “predetermined bit string + information string surrounded by predetermined bit strings”.

  The platform application 302 performs the above processing (the processing of 2-1 and 2-2) for all the reference grids that are drawn (that is, 20).

  The above is the description of (2) the method of obtaining the embedded information by converting the barcode into information.

  Finally, (3) a process for obtaining specific information by decoding embedded information will be described.

  The platform application 302 that has found one barcode decodes the embedded information included in the high-density area of the barcode. Specifically, an error correction code and a predetermined bit string are omitted (deleted) from the embedded information. By performing decryption in this way, the platform application 302 can obtain copy control information and document ID.

  Further, when the platform application 302 obtains conditional copy permission information as copy control information, the platform application 302 decodes embedded information included in the low-density area to obtain the condition. In this way, the low-density area is not always decoded, but only when the conditional copy permission information is obtained, the data size of the embedded information in the low-density area is larger than the data size of the high-density area. This is because it takes time.

  The above is the description of (3) the method of obtaining the specific information by decoding the embedded information.

  The method (3) of obtaining specific information by decoding embedded information can be performed on the network service. That is, an image in which a barcode is embedded is received from a network by communication, and the image received by an information extraction service program existing in a server computer on the network is analyzed.

  The series of processes described above is called “extraction”. By performing the extraction process, specific information can be obtained from the document image.

  The object of the present invention can also be achieved by executing the following processing. That is, a storage medium that records a program code of software that realizes the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU, MPU, etc.) of the system or apparatus is stored in the storage medium. This is the process of reading the code. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code and the storage medium storing the program code constitute the present invention.

[Function sharing between image forming devices and cloud services]
7 and 12 are diagrams in which the relationship between the cloud services provided by the various programs executed on the image forming apparatus 104 in FIG. 1 and the server computer group 102 in FIG. 1 is extracted. Using these three figures, it will be described in detail how the image processing described in the image data embedded with information as described above is executed in cooperation with the image forming apparatus and the cloud service.

  FIG. 7 shows a case where the image forming apparatus side does not have various image processing functions and all processing is performed on the cloud service side.

  FIG. 12 shows a case where the image forming apparatus side has a partial image processing function and performs processing in a shared manner with the cloud service side.

[Function sharing between image forming device and cloud service (when image forming device does not have processing function)]
The function sharing of cloud services provided by various programs executed on the image forming apparatus 104 and the server computer group 102 according to the present embodiment will be described with reference to FIGS. 7, 8, 9, 10, and 11.

  FIG. 7 is a diagram in which the relationship between the cloud services provided by the various programs executed on the image forming apparatus 104 and the server computer group 102 in FIG. 1 is extracted.

  1101 corresponds to various programs executed on the server computer group 102 of FIG. 1, and shows various back-end processing units 4021 / request receiving units 4011 on the cloud service. In this embodiment, there are a plurality of services for processing images scanned by the device. PCAM service that analyzes layers and extracts information from images, copy prohibition service that restricts output from image forming devices, PDF creation service that creates PDF format files, and sends input files to other storage services Storage services for storing, and OCR services for converting images into character codes.

  Reference numeral 1102 denotes a network corresponding to 101 in FIG.

  Reference numeral 1103 denotes an image forming apparatus corresponding to 104 in FIG.

Reference numeral 1104 corresponds to document data with meta information embedded as described above.
Reference numeral 1105 corresponds to meta information of document data in which information is embedded as described above.

  FIG. 8 is a flowchart illustrating processing of the image forming apparatus 104 in the function sharing between the MFP and the cloud service according to the present exemplary embodiment.

  This flowchart starts when the MFP user scans the document data with meta information 1104.

  The image forming apparatus 1103 transmits the scanned image to the cloud service 1101 (step 1201). Next, the image forming apparatus 1103 acquires information on its own image processing and data transmission function (step 1202) and transmits the information to the cloud service 1101 (step 1203).

  Thereafter, the image forming apparatus 1103 waits for a response from the cloud service 1101 (step 1204). If the response is timed out, an error is displayed (step 1208) and the process is terminated. If the response is an error (step 1205), an error is displayed (step 1208) and the process is terminated.

  If there is a normal response from the cloud service 1101, the image forming apparatus 1103 analyzes the response and obtains function information of the cloud service 1101 (step 1206).

  Further, the image forming apparatus 1103 performs a function sharing determination process based on the acquired function information of the cloud service 1101 (step 1207), and ends the process.

  FIG. 9 is a flowchart of the function sharing determination process in step 1207.

  After receiving the function information from the cloud service 1101 in step 1206, the image forming apparatus compares it with the image processing function information acquired in step 1202 (step 1301). In this embodiment, since the image forming apparatus 1103 does not have various processing functions, the image forming apparatus 1103 transmits a processing request to the cloud service (step 1305) and ends the processing.

  If the image forming apparatus 1103 can install various processing functions later, the image forming apparatus 1103 may be equipped with various processing functions. In such a case, the image forming apparatus 1103 compares the image processing function information acquired in step 1202 (step 1301) and executes the function provided in itself (step 1302). As a result, the success or failure of the process is determined (step 1303), and if successful, the execution of the process in the image forming apparatus 1103 is transmitted to the cloud service 1101 (step 1304), and the process ends. If various processes in the image forming apparatus 1103 fail, an error message is displayed (step 1306) (not shown) and the process is terminated.

  FIG. 10 is a flowchart of processing on the cloud service 1101 side after completion of processing on the image forming apparatus 1103 side in FIG. 8 and FIG. 9 and transmission of processing results.

  The cloud service 1101 receives a processing request from the image forming apparatus 1103 or a processing completion notification (step 1501). Here, the received content is confirmed (step 1502), and if it is a process completion notification, the process ends.

  If the received content of the cloud service 1101 is a processing request, various cloud service side processing is performed (step 1503). In the case of the present embodiment, the processing request contents extracted from the image are OCR processing, PDF creation processing, and external storage storage processing, and therefore the cloud service 1101 performs processing by the corresponding back-end processing unit 4021.

  The cloud service 1101 determines the success or failure of the cloud service side processing (step 1503) (step 1504), and if the processing is successful, transmits a completion notification to the image forming apparatus 1103 (step 1505) and ends the processing. If the process fails, an error notification is transmitted to the image forming apparatus 1103 (step 1506), and the process ends.

[Function sharing between image forming device and cloud service (when image forming device has some processing functions)]
The case where the image forming apparatus and the cloud service in this embodiment share the functions, and in particular, the image forming apparatus side has a part of the processing functions will be described with reference to FIGS. 12, 8, 11, and 10.

  FIG. 12 is a diagram in which relationships between cloud services provided by various programs executed on the image forming apparatus and the server computer group 102 in FIG. 1 are extracted.

  1601 corresponds to various programs executed on the server computer group 102 in FIG. 1 and 1101 in FIG. 7, and shows various back-end processing units 4021 / request receiving unit 4011 on the cloud service. In this embodiment, there are a plurality of services for processing images scanned by the device. PCAM service that analyzes layers and extracts information from images, copy prohibition service that restricts output from image forming devices, PDF creation service that creates PDF format files, and sends input files to other storage services Storage services for storing, and OCR services for converting images into character codes.

  Reference numeral 1602 denotes a network corresponding to 101 in FIG. 1 and 1102 in FIG.

  Reference numeral 1603 denotes an image forming apparatus corresponding to 104 in FIG. 1 and 1103 in FIG.

  Reference numeral 1604 corresponds to the document data with meta information 1104 in FIG.

  Reference numeral 1605 corresponds to meta information of document data with meta information 1105 in FIG.

  1606 corresponds to the PDF format creation function 1601 in FIG. 12 and 1101 in FIG.

  In the present embodiment as well, the processing proceeds by sharing the functions of the image forming apparatus 1603 and the various cloud services 1601 as in the above embodiment.

  The main flowchart of the processing of the image forming apparatus (1603) in this embodiment is the same as the flowchart of FIG. 8 shown in the embodiment of FIG.

  In the case of the embodiment of FIG. 12, the function sharing determination process in step 1207 of FIG. 8 is different.

  FIG. 11 is a flowchart of the function assignment determination process in step 1207 in the present embodiment.

  After receiving the function information from the cloud service 1601 in step 1206, the image forming apparatus 1603 compares the function information with the image processing function information acquired in step 1202 (step 1701). In the case of the present embodiment, since the image forming apparatus 1603 has a PDF creation function, the image forming apparatus 1603 can perform the function selection by the user (step 1702). That is, in this embodiment, the user of the image forming apparatus 1603 can select whether the PDF creation processing is performed on the image forming apparatus 1603 side or the cloud service 1601 side. For the selection, the image forming apparatus 1603 may be set in advance to execute processing on the image forming apparatus side or the cloud service side. Further, a user interface for selecting function execution may be displayed (not shown) at the processing execution timing in step 1702 and may be selected by the user of the image forming apparatus 1603.

  If it is determined that the image forming apparatus 1603 does not perform PDF creation processing as a result of the previous process selection setting or selection by the user interface, the image forming apparatus 1103 transmits a processing request to the cloud service. (Step 1708), and the process ends.

  Here, if it is determined that the image forming apparatus 1603 performs the PDF creating process as a result of the above-described processing selection setting or the selection by the user interface, the image forming apparatus 1603 has a PDF creating function provided in itself. Is executed (step 1703). As a result, the success or failure of the process is determined (step 1704), and if successful, the execution of the process in the image forming apparatus 1603 is transmitted to the cloud service 1601 (step 1605), and the process is terminated. If various processes in the image forming apparatus 1603 fail, an error message is displayed (step 1607) (not shown) and the process is terminated.

  Further processing of the cloud service 1601 in the present embodiment is the same as the flowchart of FIG.

1101 Various programs 1102 executed on the server computer group 102 Network 1103 corresponding to 101 in FIG. 1 Image forming apparatus 1104 corresponding to 104 in FIG. 1 Document data with meta information 1105 embedded with information 1105 of document data with embedded information Meta information

Claims (1)

In the image forming apparatus (1103) that realizes various image forming apparatus functions (image conversion, OCR) as a service on the cloud and operates in cooperation with the device main body function,
A cloud service (1101) that analyzes the image (1104) of the paper medium in which the information is embedded, extracts various image processing information (1105), and executes an image forming apparatus function
A cloud service (1601) for determining whether a device function (1606) equivalent to the service exists when executing the cloud service
In the determination, the system uses the device function (1606) when the function exists, and uses the cloud service (1601) when the function does not exist.