JP2008153769A - Image forming apparatus, image processing method, and image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image forming apparatus, an image processing method, and an image processing program that can easily add a marking function for various services. <P>SOLUTION: The image forming apparatus has a plurality of software components which each perform one of input, processing, and output of image data, and connects the software components to provide services associated with the image data, and is equipped with a marking composing means of generating a marking representing information to be embedded in the image data as one of the software components and puts the marking together with the image data. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image forming apparatus, an image processing method, and an image processing program, and more particularly, to an image forming apparatus, an image processing method, and an image processing program capable of executing marking embedding or detection for image data.

  Conventionally, a marking such as a barcode is synthesized when printing a paper document, or a marking added to a paper document is detected when copying a paper document, and control according to the marking is executed. There is an image forming apparatus in which a function (hereinafter referred to as “marking function”) is mounted (for example, Patent Document 1).

On the other hand, although recent image forming apparatuses are severely limited in memory and the like, they have a CPU like a general-purpose computer, and various functions including the above-described marking function are realized by application control. ing. For example, the image forming apparatus described in Patent Document 2 includes a function commonly used by each application as a platform, and the application can be implemented using the API of the platform. According to such an image forming apparatus, since a function that is commonly used is provided as a platform, it is possible to avoid the duplication of a function for each application and to improve the development efficiency of the entire application.
JP 2005-122682 A Japanese Patent No. 3679349

  However, in general, for platforms with commonly used APIs, if the granularity of the functions or interfaces provided by the platform is not designed appropriately, the improvement in application development efficiency will exceed expectations. It may not be possible.

  For example, if the granularity is too small, many API calls are required even though the application provides a simple service, and the source code becomes complicated.

  On the other hand, if the granularity is too large, if you want to implement an application that provides a service that changes some of the functions provided by a certain interface, you must modify the platform, and the development man-hours It can lead to an increase. In particular, when the dependence of each module in the platform is strong, not only a new function is added to the platform but also a modification of an existing part may be required, and the situation becomes more complicated.

  In addition, if you want to implement an application that changes a part of the service provided by an existing application (for example, image input processing), you can call an existing application for other parts. Absent. Therefore, a new application must be implemented by rewriting the source code.

  The same applies to the marking function. That is, when the marking function is implemented as an API, the work for incorporating the marking function for various applications becomes complicated unless the granularity of the API is appropriately designed. On the other hand, if the marking function is implemented in the source code of a certain application, when it is desired to realize the marking function in another application, the source code for the marking function must be described again in the other application.

  The present invention has been made in view of the above points, and an object thereof is to provide an image forming apparatus, an image processing method, and an image processing program capable of easily adding a marking function to various services. To do.

  Accordingly, in order to solve the above-described problem, the present invention has an image that includes a plurality of software components that respectively execute input, processing, or output of image data, and that provides services related to image data by connecting the software components. The forming apparatus may include a marking composition unit that generates markings representing embedded information for the image data and composes the markings with the image data as one of the software components.

  In such an image forming apparatus, it is possible to easily add a marking function to various services.

  According to the present invention, it is possible to provide an image forming apparatus, an image processing method, and an image processing program that can easily add a marking function to various services.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating an example of a hardware configuration of a multifunction machine according to an embodiment of the present invention. Here, the multifunction peripheral refers to an image forming apparatus that realizes a plurality of functions such as a printer, a copy, a scanner, or a FAX in a single casing. As hardware of the multifunction machine 1, there are a controller 201, an operation panel 202, a facsimile control unit (FCU) 203, an imaging unit 121, and a printing unit 122.

  The controller 201 includes a CPU 211, ASIC 212, NB221, SB222, MEM-P231, MEM-C232, HDD (hard disk drive) 233, memory card slot 234, NIC (network interface controller) 241, USB device 242, IEEE 1394 device 243, and Centronics device. 244.

  The CPU 211 is an IC for various information processing. The ASIC 212 is an IC for various image processing. The NB 221 is a north bridge of the controller 201. The SB 222 is a south bridge of the controller 201. The MEM-P 231 is a system memory of the multifunction machine 1. The MEM-C 232 is a local memory of the multifunction machine 1. The HDD 233 is a storage of the multifunction device 1. The memory card slot 234 is a slot for setting the memory card 235. The NIC 241 is a controller for network communication using a MAC address. The USB device 242 is a device for providing a USB standard connection terminal. The IEEE 1394 device 243 is a device for providing a connection terminal of the IEEE 1394 standard. The Centronics device 244 is a device for providing a Centronics specification connection terminal. The operation panel 202 is hardware (operation unit) for an operator to input to the multifunction device 1 and hardware (display unit) for an operator to obtain an output from the multifunction device 1.

  FIG. 2 is a diagram illustrating a software configuration example of the multifunction peripheral according to the embodiment of the present invention. The software shown in FIG. 2 is stored in the MEM-C 232, for example, and is processed by the CPU 211 to cause the MFP to execute its function.

  As shown in FIG. 2, the software in the multifunction device 1 includes a user interface layer 10, a control layer 20, an application logic layer 30, a device service layer 40, a device control layer 50, and the like. In addition, the vertical relationship of each layer in the drawing is based on the calling relationship between layers. That is, basically, the upper layer in the figure calls the lower layer.

  The user interface layer 10 is a part in which functions for receiving execution requests of various services (for example, copy, print, scan, FAX transmission) are implemented. For example, the communication server unit 11 and the local UI unit 12 A program is included. For example, the communication server unit 11 receives a request from a client PC (Personal Computer) (not shown) via a network. For example, the local UI unit 12 receives a request input via the operation panel 202. The request accepted by the user interface layer 10 is transmitted to the control layer 20.

  The control layer 20 is a part in which a function for controlling processing for realizing a requested service is implemented. For example, a program such as a request management unit 21, an in-flight monitoring unit 22, and a plug-in management unit 23 Is included. The request management unit 21 controls, for example, processing for realizing a service requested to be executed via the operation panel 202. The in-machine monitoring unit 22 monitors an event (change in state or the like) that occurs in the multifunction device 1 and controls processing for realizing a service in response to detection of the event. The plug-in management unit 23 manages various software components (programs) in the application logic layer 30. The management includes installation or uninstallation of the various software components.

  The application logic layer 30 is a part on which an application that realizes a service provided by the multifunction device 1 or a group of components that realize a part of the function of the application is mounted.

  Software corresponding to an application that implements a service in the multifunction device 1 is called an “activity”. In the figure, a copy activity 331 and a printer activity 332 are shown as examples of activities. Each activity is constituted by a combination (connection) of one or more software components in the application logic layer 30. In the present embodiment, each software component is referred to as a “filter”. This is because the software architecture of the multifunction device 1 is based on a concept called “pipe & filter”.

  FIG. 3 is a diagram for explaining the concept of the pipe and filter. In FIG. 3, “F” indicates a filter, and “P” indicates a pipe. As shown in the figure, each filter is connected by a pipe. The filter converts the input data and outputs the result. The pipe transmits the data output from the filter to the next filter.

  That is, in the MFP 1 according to the present embodiment, each service is regarded as a series of “conversions” for documents (image data). Each service of the multi-function peripheral can be generalized as being composed of document input, processing, and output. Therefore, “input”, “processing”, and “output” are regarded as “conversion”, and a software component that realizes one “conversion” is configured as a filter. A filter that realizes input is particularly called an “input filter”. A filter that realizes processing is particularly referred to as a “processing filter”. Further, a filter that realizes output is particularly referred to as an “output filter”. Each filter is independent, and basically there is no dependency relationship (call relationship) between the filters. Therefore, addition (installation) or deletion (uninstallation) is possible in units of filters. For the pipe, for example, a storage area such as a memory or a hard disk is used.

  In FIG. 2, the input filter includes a reading filter 301, a stored document reading filter 302, a mail reception filter 303, a FAX reception filter 304, a PC document reception filter 305, a report filter 306, a marking detection filter 307, and the like.

  The reading filter 301 controls reading of image data by the scanner and outputs the read image data. The stored document read filter 302 reads document data (image data) stored in the HDD 233 of the multifunction machine 1 and outputs the read data. The mail reception filter 303 receives an e-mail and outputs data included in the e-mail. The FAX reception filter 304 controls FAX reception and outputs received data. The PC document reception filter 305 receives image data from a client PC (not shown) and outputs the received image data. The report filter 306 outputs various setting information and management information of the multifunction device 1 and history information output from each software component as a report formatted in a predetermined format. The marking detection filter 307 receives input of image data, detects a marking (mark) combined (superimposed) on the input image data, and extracts information represented by the marking.

  The processing filters include a document processing filter 311 and a marking embedding filter 312. The document processing filter 311 performs predetermined image conversion processing (aggregation, enlargement, reduction, etc.) on the input data and outputs it. The marking embedding filter 312 generates a marking image (image data indicating a marking (mark)) according to the input information, and synthesizes (superimposes) the marking image on the image data. Embed.

  The output filters include a print filter 321, a stored document registration filter 322, a mail transmission filter 323, a FAX transmission filter 324, a PC document transmission filter 325, a preview filter 326, and the like.

  The print filter 321 causes the plotter to output (print) the input data. The stored document registration filter 322 stores the input data in the HDD 233 of the multifunction machine 1. The mail transmission filter 323 transmits the input data attached to the e-mail. The FAX transmission filter 324 transmits the input data by FAX. The PC document transmission filter 325 transmits the input data to the client PC. The preview filter 326 displays the input data on the operation panel 202 of the multifunction device 1 as a preview.

  Note that the addition of a new activity in the application layer 30 can be realized by connecting a filter. If there is no filter suitable for the new activity, it is possible to add a new activity by installing the filter and connecting the filter with another filter. Further, addition of a function to an existing activity can be realized by connecting a filter corresponding to the function to a filter constituting the existing activity.

  Returning to FIG. The device service layer 40 is a portion in which lower functions commonly used by the filters in the application logic layer 30 are mounted, and includes, for example, an image pipe 41 and a data management unit 42. The image pipe 41 realizes the above-described pipe function. That is, output data from a certain filter is transmitted to the next filter. The data management unit 42 manages the management information, setting information, history information, and the like in addition to a database in which user information is registered and a database in which document or image data is stored.

  The application logic layer 30 is a portion that can be changed such as addition or deletion of activities or filters, while the device service layer 40 is a fixed portion that restricts at least component deletion.

  The device control layer 50 is a part on which a group of program modules called a driver that controls a device (hardware) is mounted. For example, the scanner control unit 51, the plotter control unit 52, the storage control unit 53, and the FCU control unit 54. And a network control unit 55 and the like. Each control unit controls a device attached to the name of the control unit.

  Of the various functions provided based on the architecture as shown in FIG. 2, the present embodiment mainly describes the marking function. The marking function includes a function for embedding marking in image data (marking embedding function) and a function for detecting marking from image data and extracting data represented by the marking (marking detection function). First, the marking embedding function will be described.

  The marking embedding function is used in the printer activity 332, for example. The printer activity 332 has the following variations in filter configuration depending on the function to be realized. FIG. 4 is a diagram illustrating variations of the filter configuration of the printer activity.

  For example, when realizing printing of a PC document, the printer activity 332 includes a PC document reception filter 305, a document processing filter 311, and a print filter 321. In this case, the printer activity 332 receives image data from the PC by the PC document reception filter 305, performs various conversions on the received image data by the document processing filter 311, and the conversion is performed by the print filter 321. Print the applied image data.

  Further, when the PC document storage is realized, the printer activity 332 includes a PC reception filter 305, a document processing filter 311, and a stored document registration filter 322. In this case, the printer activity 332 receives image data from the PC by the PC document reception filter 305, executes various conversions on the image data received by the document processing filter 311, and performs conversion by the print filter 321. The processed image data is stored in the HDD 233.

  Further, when realizing printing of a stored document, the printer activity 332 includes a stored document read filter 302, a document processing filter 311, and a print filter 321. In this case, the printer activity 332 reads the image data from the HDD 233 by the stored document read filter 302, executes various conversions on the read image data by the document processing filter 311, and the conversion is performed by the print filter 321. Print the applied image data.

  In such a printer activity 332, the marking embedding function is realized by incorporating the marking embedding filter 312 as a processing filter. The marking embedding filter 312 may be incorporated in any of the following ways.

  FIG. 5 is a diagram for explaining a method of incorporating a marking embedding filter. 5A is an example in which the marking embedding filter 312 inherits the document processing filter 311. FIG. That is, the marking embedding filter 312 also has the property (function) of the document processing filter 311. Therefore, by connecting the PC document reception filter 305, the marking embedding filter 312, and the printing filter 321, the marking embedding function can be incorporated (added) to the PC document printing function.

  (B) is an example in which the marking embedding filter 312 and the document processing filter 311 are independent of each other. In this case, the marking embedding function can be incorporated into the printing function of the PC document by connecting the PC document reception filter 305, the document processing filter 311, the marking embedding filter 312, and the printing filter 321.

  Note that the final output result is the same in both cases (A) and (B). That is, the result of combining the marking with the image data is printed.

  The marking embedding filter 312 will be described. FIG. 6 is a diagram illustrating a configuration example of a marking embedding filter. As shown in FIG. 6, the marking embedding filter 312 realizes its function by calling the marking embedding wrapper module 43. The marking embedding wrapper module 43 uses as input information the marking type, data to be embedded as a marking (hereinafter referred to as “embedding data”), and image data to be embedded in the marking. The marking embedded wrapper module 43 converts the embedded data into data of a predetermined format (hereinafter referred to as “embedded format data”), and generates a marking image based on the embedded format data. Further, the marking embedding wrapper module 43 synthesizes the generated marking image with the image data and outputs the image data.

  Various types of embedded data can be targeted within the allowable range of information that can be expressed by the marking. For example, a paper document ID, falsification detection information, confidential setting information, link information to a stored document, output conditions, device adjustment values, destination information, trace information, and the like are input as embedded data. The paper document ID is an ID that uniquely identifies a printed paper document. The falsification detection information is, for example, information for detecting falsification of a printed paper document. The confidential setting information is information indicating the confidential level of a printed paper document. The link information to the stored document is link information between the printed paper document and the image data stored electronically. The output condition is an output condition for copying a printed paper document. The device adjustment value is a parameter value for adjusting the device. The destination information is a mail address of a distribution destination of the printed paper document. The trace information is information for identifying the distribution route of the printed paper document.

  Also, the type of marking that represents the embedded data is not limited to a predetermined type. For example, a bar code (DataMatrix, QR, PDF417, EAN8, EAN13, Code39, Code128, Codebar, Int2Of5, Code2Of5, etc.), a copy-forgery-inhibited pattern used for illegal copy guard, etc. Various codes that can embed information may be used. Further, arbitrary information may be embedded in the printed document separately from the description content by using processing of the edge portion of the image.

  The marking embedded wrapper module 43 belongs to the device service layer 40 and has, for example, the following configuration.

  FIG. 7 is a diagram illustrating a first configuration example of the marking embedded wrapper module. In FIG. 7, an embedded format data generation module 433 is a module that converts embedded data into embedded format data. The embedded format data refers to, for example, data obtained by converting embedded data into a predetermined format and adding header information for identifying the predetermined format. The embedded data and embedded format data do not depend on the type of marking. Therefore, only one embedded format data generation module 433 needs to exist regardless of the number of types of marking.

  The marking generation library 432 exists for each type of marking. Each marking generation library 432 generates a type of marking image corresponding to the marking generation library 432 based on the embedded format data.

  The marking generation wrapper module 431 is a library that exists for each type of marking. Each marking generation wrapper module 431 uses the embedded format data generation module 433 to convert the embedded data into embedded format data, and converts the embedded format data into a marking image into a marking generation library 432 corresponding to the type of marking. To run. The marking generation wrapper module 431 synthesizes the generated marking image with image data.

  There is one marking embedded wrapper module 43a regardless of the type of marking. In the marking embedding wrapper module 43a, embedding data, a marking type, and image data to be embedded are designated from the calling side. The marking embedding wrapper module 43a calls the marking generation wrapper module 431 corresponding to the designated marking type, thereby executing the synthesis of the designated marking with the designated image data.

  Further, the marking embedded wrapper module 43 may be configured as shown in FIG. FIG. 8 is a diagram illustrating a second configuration example of the marking embedded wrapper module. In FIG. 8, the same parts as those of FIG. FIG. 8 shows an example in which the marking embedded wrapper module 43 b is configured to include the function of the marking generation wrapper module 431. However, the interface of the marking embedded wrapper module 43b is the same as that of the marking embedded wrapper module 43a.

  That is, in the marking embedding wrapper module 43b, embedding data, a marking type, and image data to be embedded are designated from the calling side. The marking embedding wrapper module 43b converts the embedding data into embedding format data using the embedding format data generation module 433, and converts the embedding format data into a marking image into a marking generation library 432 corresponding to the designated marking type. To run. The marking embedding wrapper module 43b synthesizes the generated marking image with image data.

  Furthermore, the marking embedded wrapper module 43 may be configured as shown in FIG. FIG. 9 is a diagram illustrating a third configuration example of the marking embedded wrapper module. In FIG. 9, the same parts as those in FIG. 7 or FIG. FIG. 9 shows an example in which the configuration of FIG. 7 and the configuration of FIG. 8 are mixed. The marking embedded wrapper module 43c includes the function of the marking generation wrapper module 431 for some types of marking. However, the interface of the marking embedded wrapper module 43c is the same as that of the marking embedded wrapper module 43a.

  That is, in the marking embedding wrapper module 43c, embedding data, a marking type, and image data to be embedded are designated from the calling side. The marking embedded wrapper module 43c is designated by calling the marking generation wrapper module 431 corresponding to the designated marking type when the designated marking type is a predetermined type (for example, barcode). Performs the specified marking composition on the image data. When the designated marking type is other than a predetermined type (for example, barcode), the marking embedded wrapper module 43c converts the embedded data into embedded format data using the embedded format data generation module 433. Then, the marking generation library 432 corresponding to the designated marking type is executed to convert the embedded format data into a marking image. The marking embedding wrapper module 43c synthesizes the generated marking image with image data.

  Next, the processing procedure of the marking embedding process will be described. FIG. 10 is a flowchart for explaining the processing procedure of the marking embedding process. FIG. 10 illustrates a case where the module configuration is as shown in FIG. However, even in the case of FIG. 7 or FIG. 9, the processing procedure is basically the same, and only the main body (module) that executes each step is different.

  When the marking embedding filter 312 is required to mark the image data, the marking embedding filter 312 calls the marking embedding wrapper module 43 by specifying the marking type, the image data, and the embedding data.

  The marking embedding wrapper module 43 first checks an input value (marking type, image data, and embedding data) (S101). For example, it is checked whether or not an unsupported marking type is specified. Subsequently, the marking embedded wrapper module 43 acquires the data size of the embedded data by inspecting the embedded data.

  Subsequently, the marking embedded wrapper module 43 calls the embedded format data generation module 433 by specifying the embedded data. The embedded format data generation module 433 converts the embedded data into embedded format data (S103). Subsequently, the embedded format data generation module 433 compresses a portion other than the header information in the converted embedded format data (S104). However, data compression may be performed as necessary when the data size of embedded format data is large.

  FIG. 11 is a diagram illustrating a structure example of embedded format data. In FIG. 11, the embedded format data includes header information and embedded format actual data. The embedded format actual data is obtained by converting the embedded data into a predetermined format, and is compressed as necessary. The header information stores information for identifying the format of the embedded format actual data, the data size of the embedded information, and the like.

  The embedded format data generation module 433 returns the converted embedded format data to the marking embedded wrapper module 43.

  Subsequently, the marking embedding wrapper module 43 calls the marking generation library 432 corresponding to the designated marking type by specifying embedding format data. The marking generation library 432 generates a marking image based on the designated embedding format data, and returns the marking image to the marking embedding wrapper module 43 (S105). Note that a known method may be used to generate the marking image.

  Subsequently, the marking embedding wrapper module 43 converts the color depth of the marking image as necessary (according to the embedding target image data) (S106). Subsequently, the marking embedded wrapper module 43 combines the marking image with the image data (S107). The image data in which the marking image is combined is returned to the marking embedding filter 312.

  Next, the marking detection function will be described. The marking detection function is used in the copy activity 331, for example. The copy activity 331 has the following variations in filter configuration depending on the function to be realized. FIG. 12 is a diagram showing variations of the filter configuration of the copy activity.

  For example, when realizing normal copying, the copy activity 331 includes a reading filter 301, a document processing filter 311, and a print filter 321. In this case, the copy activity 331 reads image data from a paper document by the reading filter 301, executes various conversions on the read image data by the document processing filter 311, and the conversion is performed by the print filter 321. Print the image data.

  When realizing copy and document accumulation, the copy activity 331 includes a reading filter 301, a document processing filter 311, a print filter 321, and a stored document registration filter 332. In this case, the copy activity 331 reads image data from a paper document by the reading filter 301, executes various conversions on the read image data by the document processing filter 311, and the conversion is performed by the print filter 321. The stored image data is printed, and the stored document registration filter 332 stores the image data in the HDD 233.

  In such a copy activity 331, the marking detection function is realized by incorporating the marking detection filter 307 as an input filter. As a method for incorporating the marking detection filter 307, any of the following may be used.

  FIG. 13 is a diagram for explaining a method of incorporating a marking detection filter. In FIG. 13, (A) is an example in which the marking detection filter 307 inherits the reading filter 301. That is, the marking detection filter 307 also has the property (function) of the reading filter 301. Therefore, the marking detection function can be incorporated into the copy function by connecting the marking detection filter 307, the document processing filter 311, and the print filter 321.

  (B) is an example in which the marking detection filter 307 and the reading filter 301 are independent of each other. In this case, the marking detection function can be incorporated into the copy function by connecting the reading filter 301, the marking detection filter 307, the document processing filter 311, and the print filter 321.

  Note that the final output result is the same in both cases (A) and (B). That is, the result of combining the marking with the copy source image data is output as the copy result.

  The marking detection filter 307 will be described. FIG. 14 is a diagram illustrating a configuration example of a marking detection filter. As shown in FIG. 14, the marking detection filter 307 realizes its function by calling the marking detection wrapper module 44. The marking detection wrapper module 44 uses the image data combined with the marking and the type of marking as input information. The marking detection wrapper module 44 detects the marking from the image data in which the marking is combined, and extracts (restores) the embedded data by analyzing the data (embedded format data) expressed by the marking.

  The type of marking that can be detected by the marking detection wrapper module 44 corresponds to the marking embedded wrapper module 44.

  The marking detection wrapper module 44 belongs to the device service layer 40 and has, for example, the following configuration.

  FIG. 15 is a diagram illustrating a first configuration example of the marking detection wrapper module. In FIG. 15, an embedded format data analysis module 443 is a module that extracts embedded data from embedded format data. There is only one embedded format data analysis module 443 regardless of the number of types of marking.

  The marking reading library 442 exists for each type of marking. Each marking reading library 442 reads embedded format data from the marking image.

  The marking analysis wrapper module 441 is a library that exists for each type of marking. Each marking analysis wrapper module 441 detects a corresponding type of marking from the image data, and reads (restores) the embedded format data from the detected marking image to the marking reading library 442 corresponding to the marking type. Then, the embedded format data analysis module 443 extracts the embedded data from the read embedded format data.

  There is one marking detection wrapper module 44a regardless of the type of marking. In the marking detection wrapper module 44a, the type of marking and the image data combined with the marking are designated from the calling side. The marking detection wrapper module 44a executes extraction of embedded data from the designated image data by calling the marking analysis wrapper module 441 corresponding to the designated marking type.

  Further, the marking detection wrapper module 44 may be configured as shown in FIG. FIG. 16 is a diagram illustrating a second configuration example of the marking detection wrapper module. In FIG. 16, the same parts as those of FIG. FIG. 16 shows an example in which the marking detection wrapper module 44b is configured to include the function of the marking analysis wrapper module 441 as well. However, the interface of the marking detection wrapper module 44b is the same as that of the marking detection wrapper module 44a.

  That is, in the marking detection wrapper module 44b, the type of marking and the image data combined with the marking are designated from the calling side. The marking detection wrapper module 44b detects the marking of the designated type from the image data, causes the marking reading library 442 corresponding to the type of marking to read the embedded format data from the detected marking image, and The embedded format data analysis module 443 executes extraction of embedded data from the embedded format data.

  Further, the marking detection wrapper module 44 may be configured as shown in FIG. FIG. 17 is a diagram illustrating a third configuration example of the marking detection wrapper module. In FIG. 17, the same parts as those in FIG. 15 or FIG. FIG. 17 shows an example in which the configuration of FIG. 15 and the configuration of FIG. 16 are mixed. The marking detection wrapper module 44c includes the function of the marking analysis wrapper module 441 for some types of marking. However, the interface of the marking detection wrapper module 44c is the same as that of the marking detection wrapper module 44a.

  That is, in the marking detection wrapper module 44c, the type of marking and the image data combined with the marking are designated from the calling side. When the designated marking type is a predetermined type (for example, barcode), the marking detection wrapper module 44c is designated by calling the marking analysis wrapper module 441 corresponding to the designated marking type. Extracting embedded data from image data. If the designated marking type is other than a predetermined type (for example, barcode), the marking detection wrapper module 44c detects the designated type of marking from the image data, and detects the detected marking image. Is read by the marking reading library 442 corresponding to the type of marking, and the embedded format data analysis module 443 is caused to extract embedded data from the read embedded format data.

  Next, the processing procedure of the marking detection process will be described. FIG. 18 is a flowchart for explaining the processing procedure of the marking detection process. FIG. 18 illustrates a case where the module configuration is as shown in FIG. However, even in the case of FIG. 15 or FIG. 17, the processing procedure is basically the same, and only the main body (module) for executing each step is different.

  When the marking detection filter 307 is required to mark the image data, the marking detection filter 307 calls the marking detection wrapper module 44 by designating the marking type and the image data combined with the marking.

  The marking detection wrapper module 44 converts the color depth of the image data as necessary for convenient detection of the marking image (S201). Subsequently, the marking detection wrapper module 44 detects a marking image from the image data (S202). For the detection of the marking image, a known method such as pattern matching may be used. Subsequently, the marking detection wrapper module 44 executes a loop process according to the number of detected marking images (S203).

  First, the marking detection wrapper module 44 designates one marking image from the detected marking images, and uses the marking reading library 442 corresponding to the marking type of the marking image (hereinafter referred to as “current marking image”). call. The marking reading library 442 decodes (restores) the embedded format data from the current marking image. The marking reading library 442 returns the decrypted embedded format data to the marking detection wrapper module 44.

  Subsequently, the marking detection wrapper module 44 specifies the embedded format data and calls the embedded format data analysis module 443. The embedded format data analysis module 443 acquires the data size of the embedded data from the header information of the specified embedded format data (S205). Subsequently, the embedded format data analysis module 443 analyzes the data format of the embedded format actual data based on the header information of the embedded format data (S206), and converts the embedded format actual data into the embedded data based on the analyzed data format. (S207). At this time, if the embedded format actual data is compressed, the embedded format data analysis module 443 expands the embedded format actual data, and then converts it into embedded data (extracts embedded data). The extracted embedded data is returned to the marking detection wrapper module 44.

  When the processing of steps S204 to S207 is completed for all detected marking images, the marking detection wrapper module 44 returns all the embedded data extracted to the marking detection filter 307.

  Next, an example of a detailed data structure of the embedded format data will be described. As described above, in the present embodiment, the paper document ID can also be embedded data. Therefore, in the present embodiment, the structure of the embedded format data is designed in consideration of the document data management system. First, the document data management system in this embodiment will be described.

  FIG. 19 is a diagram showing a document data management system according to the present embodiment. In FIG. 19, a document service 510 is software corresponding to a so-called document management system. Therefore, one or more document data 530 is managed in the document service 510. As shown in the figure, there can be a plurality of document services 510.

  The resource manager service 510 is a system that manages the location of each document service 510. A single resource manager service 510 can manage a plurality of document services 510. There may be a plurality of resource manager services 510.

  In the system configuration as described above, each resource manager service 510 is uniquely identified globally by an ID called “SRMS-UUID”. On the other hand, each document service 510 is uniquely identified globally by an ID called “DS-UUID”. The document service 510 is also uniquely identified by the resource manager service 510 to which the document service 510 belongs by an ID called “DS-LID”. Each document data 530 is uniquely identified by the document service 510 to which the document data 530 belongs by an ID called RS-LID.

  The structure of the embedded format data will be described with reference to FIG. FIG. 20 is a diagram illustrating a detailed structure example of embedded format data. In FIG. 20, five types of types 1 to 5 are shown as the structure of the embedded format data. In each type, the part other than the header information corresponds to embedded format actual data.

  For Type 1 to Type 4, only the paper document ID is included in the embedded format actual data. In type 1, a paper document ID is configured by a combination of SRMS-UUID, DS-UUID, and RS-LID (a document is uniquely specified). In type 2, a paper document ID is configured by a combination of SRMS-UUID, DS-LID, and RS-UID. In type 3, the paper document ID is configured by a combination of DS-UUID and RS-LID. In type 4, the paper document ID is configured by a combination of DS-LID and RS-LID.

  Type 5 is a case where the embedded format actual data is data (RawData) other than the paper document ID.

  By having the above-described variations in the structure of the embedded format actual data, the data amount of the embedded format actual data can be appropriately reduced according to the system configuration.

  On the other hand, the header information has the following structure, for example. FIG. 21 is a diagram illustrating a detailed structure example of the header information. In FIG. 21, header information includes attributes such as format identification information, header version, format type, priority, paper document ID flag, embedded data size, and data format.

  The format identification information is information for identifying whether or not the marking is synthesized by the marking embedding function in the present embodiment. For example, it is information for preventing erroneously recognizing markings printed by devices of other companies. If the value of the format identification information is a predetermined value, it is identified as a marking to be processed.

  The header version is version information of header information. The format type is information for identifying the format (type 1 to type 5) of the embedded format actual data described in FIG. The priority order is information indicating which information extracted from which marking is prioritized when a plurality of markings are detected from one image data. For example, the priority is determined according to the magnitude of this value. The paper document ID flag is information indicating whether or not the data included in the embedded format actual data is a paper document ID. The embedded data size is information indicating the data size of embedded data. The data format is information indicating the data format when the embedded data is not a paper document ID (RawData).

  Among the attributes constituting the header information, there are unnecessary attributes depending on the type of embedded format actual data. For example, in the case of a paper document ID, the data format is not necessary. Therefore, as shown in the column direction of the table of FIG. 21, the amount of data may be reduced by changing the attributes constituting the header information in accordance with the type of embedded format actual data.

  As described above, in the multi-function device 1 according to the embodiment of the present invention, the marking embedding function and the marking detection function are configured by a filter such as the marking embedding filter 312 or the marking detection filter 307. Therefore, when an existing service or a new service is constructed, a filter embedding function or a filter detection function can be implemented for the service by incorporating these filters. Therefore, a marking function can be easily added to various services.

  As mentioned above, although the Example of this invention was explained in full detail, this invention is not limited to such specific embodiment, In the range of the summary of this invention described in the claim, various deformation | transformation・ Change is possible.

FIG. 2 is a diagram illustrating an example of a hardware configuration of a multifunction machine according to an embodiment of the present invention. FIG. 3 is a diagram illustrating a software configuration example of a multifunction machine according to an embodiment of the present invention. It is a figure for demonstrating the concept of a pipe & filter. It is a figure which shows the variation of the filter structure of a printer activity. It is a figure for demonstrating the incorporation system of a marking embedding filter. It is a figure which shows the structural example of a marking embedding filter. It is a figure which shows the 1st structural example of a marking embedding wrapper module. It is a figure which shows the 2nd structural example of a marking embedding wrapper module. It is a figure which shows the 3rd structural example of a marking embedding wrapper module. It is a flowchart for demonstrating the process sequence of a marking embedding process. It is a figure which shows the example of a structure of embedding format data. It is a figure which shows the variation of the filter structure of a copy activity. It is a figure for demonstrating the incorporation system of a marking detection filter. It is a figure which shows the structural example of a marking detection filter. It is a figure which shows the 1st structural example of a marking detection wrapper module. It is a figure which shows the 2nd structural example of a marking detection wrapper module. It is a figure which shows the 3rd structural example of a marking detection wrapper module. It is a flowchart for demonstrating the process sequence of a marking detection process. It is a figure which shows the management system of the document data in this Embodiment. It is a figure which shows the detailed structural example of embedding format data. It is a figure which shows the detailed structural example of header information.

Explanation of symbols

1 MFP 10 User interface layer 11 Communication server unit 12 Local UI unit 20 Control layer 21 Request management unit 22 In-machine monitoring unit 23 Plug-in management unit 30 Application logic layer 40 Device service layer 41 Image pipe 42 Data management unit 43 Marking embedded wrapper Module 43
50 Device Control Layer 51 Scanner Control Unit 52 Plotter Control Unit 53 Storage Control Unit 54 FCU Control Unit 55 Network Control Unit 201 Controller 202 Operation Panel 203 Facsimile Control Unit 211 CPU
212 ASIC
221 NB
222 SB
231 MEM-P
232 MEM-C
233 HDD
234 Memory card slot 235 Memory card 241 NIC
242 USB device 243 IEEE 1394 device 244 Centronics device 301 Reading filter 302 Storage document reading filter 303 Mail reception filter 304 FAX reception filter 305 PC document reception filter 306 Report filter 307 Marking detection filter 311 Document processing filter 312 Marking embedding filter 321 Printing filter 322 Storage Document registration filter 323 Mail transmission filter 324 FAX transmission filter 325 PC document transmission filter 326 Preview filter 431 Marking generation wrapper module 432 Marking generation library 433 Embedded format generation module 441 Marking analysis wrapper module 442 Marking reading library 443 Embedded format data analysis module

Claims (18)

An image forming apparatus that has a plurality of software components that execute any one of input, processing, and output of image data, and that provides services related to image data by connecting the software components,
An image forming apparatus, comprising: a marking composition unit that generates markings representing embedding information for the image data as one of the software components, and synthesizes the markings with the image data. Marking generation means for generating the marking based on the embedded information;
The image forming apparatus according to claim 1, wherein the marking composition unit generates the marking using the marking generation unit. Data format conversion means for converting the embedded information into a predetermined format;
The image forming apparatus according to claim 1, wherein the marking composition unit generates a marking that represents the embedded information converted into the predetermined format. An image forming apparatus that has a plurality of software components that execute any one of input, processing, and output of image data, and that provides services related to image data by connecting the software components,
An image forming apparatus comprising: marking detection means for detecting a marking synthesized with the image data and restoring information represented by the marking as one of the software components. Having information restoration means for restoring the information represented by the marking based on the marking;
The image forming apparatus according to claim 4, wherein the marking detection unit restores information expressed by marking combined with the image data using the information restoration unit. The information expressed by the marking is obtained by converting embedded information for the image data into a predetermined format,
Having embedded information extraction means for extracting the embedded information from the information represented by the marking;
6. The image according to claim 4, wherein the marking detection unit extracts the embedded information from information restored from the marking combined with the image data using the embedded information extraction unit. Forming equipment. An image processing method executed by an image forming apparatus that includes a plurality of software components that execute any one of input, processing, or output of image data, and that provides services related to image data by connecting the software components,
An image processing method comprising: a marking composition procedure in which one of the software components generates a marking that represents embedded information for the image data, and combines the marking with the image data. A marking generation procedure for generating the marking based on the embedded information;
The image processing method according to claim 7, wherein the marking synthesis procedure generates the marking using the marking generation procedure. A data format conversion procedure for converting the embedded information into a predetermined format;
The image processing method according to claim 7 or 8, wherein the marking composition procedure generates a marking representing the embedded information converted into the predetermined format. An image processing method executed by an image forming apparatus that includes a plurality of software components that execute any one of input, processing, or output of image data, and that provides services related to image data by connecting the software components,
An image processing method comprising: a marking detection procedure in which one of the software components detects a marking synthesized with the image data, and restores information represented by the marking. Having an information restoration procedure for restoring the information represented by the marking based on the marking;
The image processing method according to claim 10, wherein the marking detection procedure restores information expressed by marking combined with the image data using the information restoration procedure. The information expressed by the marking is obtained by converting embedded information for the image data into a predetermined format,
An embedded information extraction procedure for extracting the embedded information from the information represented by the marking;
12. The image according to claim 10, wherein the marking detection procedure extracts the embedded information from information restored from the marking synthesized with the image data using the embedded information extraction procedure. Processing method. An image forming apparatus that has a plurality of software components that execute any one of input, processing, and output of image data, and that provides services related to image data by connecting the software components,
An image processing program for generating a marking representing embedded information for the image data as one of the software components and executing a marking composition procedure for compositing the marking with the image data. A marking generation procedure for generating the marking based on the embedded information;
The image processing program according to claim 13, wherein the marking synthesis procedure generates the marking using the marking generation procedure. A data format conversion procedure for converting the embedded information into a predetermined format;
15. The image processing program according to claim 13, wherein the marking composition procedure generates a marking that represents the embedded information converted into the predetermined format. An image forming apparatus that has a plurality of software components that execute any one of input, processing, and output of image data, and that provides services related to image data by connecting the software components,
An image processing program for detecting a marking combined with the image data as one of the software components and executing a marking detection procedure for restoring information expressed by the marking. Having an information restoration procedure for restoring the information represented by the marking based on the marking;
The image processing program according to claim 16, wherein the marking detection procedure restores information expressed by marking combined with the image data using the information restoration procedure. The information expressed by the marking is obtained by converting embedded information for the image data into a predetermined format,
An embedded information extraction procedure for extracting the embedded information from the information represented by the marking;
18. The image according to claim 16 or 17, wherein the marking detection procedure extracts the embedded information from information restored from the marking combined with the image data using the embedded information extraction procedure. Processing program.

Images