JP2010128767A - Image processing apparatus and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve processing efficiency when an image processing unit is configured by many modules or a plurality of module groups which can be operated mutually independently. <P>SOLUTION: A processing flow management unit 46A for managing the performance of processing in the image processing unit 50 previously registers the identification information of respective modules to be managed (normally, all modules of the image processing unit 50) in a management table (refer to (A)), instructs a final image processing module to perform the processing, and when a processing request is inputted from any one of modules to be managed, retrieves the management table, recognizes the preceding module, and instructs the recognized module to perform the processing. But, by dividing the image processing unit 50 into a plurality of module groups allowed to be independently operated in parallel and forming respective processing flow units 46A for managing individual module groups (refer to (B)), the retrieval time of the management table is shortened and the processing efficiency is improved. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing apparatus and an image processing program.

  In an image processing device that performs image processing on input image data, a DTP (desktop publishing) system that can handle images, a print system that records an image represented by input image data on a recording material, etc. Various types of image processing such as enlargement / reduction, rotation, affine transformation, color conversion, filter processing, and image synthesis are performed on the image data. In these apparatuses and systems, for example, when various image data having different color spaces and the number of bits per pixel are input, or when image processing contents, procedures, parameters, and the like are variously changed, an image to be executed A configuration that can change processing flexibly is required.

In order to satisfy such a requirement, Patent Document 1 discloses that each module is connected in a pipeline form or a DAG (Directed Acyclic Graph: Existence) so that a buffer module is connected to at least one of the front and rear stages of the image processing module. The image processing unit is configured to be connected in the form of a non-circular graph), and in each image processing module of the image processing unit, predetermined image processing is performed on the image data acquired from the previous stage of the own module, and predetermined image processing is performed A technique has been proposed in which an image processing unit processes the entire image to be processed by providing a processing management unit that repeats the process of outputting image data or processing results that have undergone processing to the subsequent stage of the own module.
JP 2006-338500 A

  It is an object of the present invention to obtain an image processing apparatus and an image processing program that can realize improvement in processing efficiency when an image processing unit is configured by a large number of modules or a plurality of modules that can operate independently of each other. is there.

  In order to achieve the above object, an image processing apparatus according to the first aspect of the present invention performs image processing different from each other on image data acquired from a previous stage of its own module, and the image data that has undergone the image processing or the image processing A plurality of types of image processing modules that output the processing results of the module to the subsequent stage, and the image data output from the preceding module is written to the buffer and the image data stored in the buffer is read by the subsequent module. A storage unit for storing each of the buffer module programs to be output; and a pre-stage and a post-stage of each of the one or more image processing modules selected from the plurality of types of image processing modules by the program stored in the storage unit The buffer module is provided in at least one of the A construction means for constructing an image processing unit connected in a line form or a directed acyclic graph form, and each module group corresponding to each module group when the image processing part is divided into a plurality of module groups. Is stored as management information in a table, a specific module in the corresponding module group is instructed to execute processing, and a predetermined request is input from any module in the corresponding module group. Each time the module is connected, it is determined based on the management information a module that is connected to the preceding stage or the subsequent stage of the module and that can execute the process that satisfies the predetermined request, and executes the process that satisfies the predetermined request for the determined module Is a processing flow for executing image processing by the corresponding module group in the image processing unit. Including a management unit generating means for generating respectively processing section, a is constituted.

  According to a second aspect of the present invention, in the first aspect of the present invention, the management unit generation unit includes n (n ≧ n) when the image processing unit is divided into a plurality of module groups operable independently of each other. The processing flow management unit is generated for each module group of 1).

  According to a third aspect of the present invention, in the second aspect of the present invention, the management unit generation unit includes the image processing unit and image data stored in a storage medium among the modules constituting the image processing unit. A data reading module that reads and outputs data from the storage medium, a data generation module that generates and outputs image data, and a data branch module that outputs the same image data to a plurality of modules, respectively, or subsequent to the data branch module A plurality of modules capable of operating the image processing unit independently from each other by dividing one of the connected specific modules into a plurality of module groups each having a head and a tail not connected to another module group Divide into groups.

  According to a fourth aspect of the present invention, in the invention according to the third aspect, the management unit generation unit is configured to use the data as a module constituting the image processing unit to be constructed when the construction unit constructs the image processing unit. Each time any one of the reading module, the data generation module, and the data branch module or the specific module connected to the subsequent stage of the data branch module is generated by the construction means, the generated module is set as the head. The processing flow management unit corresponding to the module group is generated, and when the end of the module group starting from the generated module is connected to another module group, the generated module is set to the top. The processing flow management unit corresponding to the module group and the processing corresponding to the other module group Integrating low management unit to a single of the processing flow management unit.

  The invention according to claim 5 is the processing flow management unit in which erasure is instructed when erasure of any of the processing flow management units is instructed in the invention according to any one of claims 1 to 4. Further, an erasure processing unit is provided for performing erasure processing for erasing the processing flow management unit instructed to be erased, while releasing and erasing the resources secured by each module of the module group corresponding to.

  The image processing program according to the invention described in claim 6 performs different image processing on the image data acquired from the previous stage of the own module, and displays the image data that has undergone the image processing or the processing result of the image processing of the own module. A plurality of types of image processing modules to be output to the subsequent stage, and a buffer module program that causes the image data output from the previous module to be written to the buffer and the image data stored in the buffer to be read by the subsequent module. At least one of the preceding and following stages of each of the one or more image processing modules selected from the plurality of types of image processing modules by a program stored in the storage means, each of which includes a storage means for storing. The buffer module is provided in the The construction means for constructing the image processing units connected in the form of the pipeline or the directed acyclic graph, and the module group corresponding to each module group when the image processing unit is divided into a plurality of module groups. Information on individual modules is stored as management information in a table, a specific module in the corresponding module group is instructed to execute processing, and a predetermined request is received from any module in the corresponding module group. Each time an input is made, a module that is connected to a preceding stage or a subsequent stage of the module and that can execute a process that satisfies the predetermined request is determined based on the management information, and a process that satisfies the predetermined request for the determined module is determined. Processing to execute image processing in the corresponding module group in the image processing unit by instructing execution Each function as management unit generating means for generating a low management unit.

  The inventions according to claims 1, 2 and 6 are excellent in that the processing efficiency can be improved when the image processing unit is composed of a large number of modules or a plurality of module groups operable independently of each other. Have

  The invention described in claim 3 has an effect that the image processing unit can be appropriately divided into a plurality of module groups.

  The invention according to claim 4 has an effect that an increase in the number of processing flow management units more than necessary can be prevented.

  The invention according to claim 5 has an effect that the resource can be surely released.

  Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 shows a computer 10 that can function as an image processing apparatus according to the present invention. The computer 10 is incorporated in any image handling apparatus that needs to perform image processing internally, such as a copying machine, a printer, a facsimile machine, a multifunction machine having these functions, a scanner, a photographic printer, or the like. Alternatively, it may be an independent computer such as a personal computer (PC), or may be a computer incorporated in a portable device such as a PDA (Personal Digital Assistant) or a cellular phone.

  The computer 10 includes a CPU 12, a memory 14 including a DRAM or SRAM, a display unit 16, an operation unit 18, a storage unit 20, an image data supply unit 22, and an image output unit 24, which are connected to each other via a bus 26. Has been. When the computer 10 is incorporated in an image handling device as described above, a display panel, a numeric keypad, or the like composed of an LCD or the like provided in the image handling device can be applied as the display unit 16 and the operation unit 18. When the computer 10 is an independent computer, a display, a keyboard, a mouse, or the like connected to the computer can be applied as the display unit 16 or the operation unit 18. The storage unit 20 is preferably an HDD (Hard Disk Drive), but other nonvolatile storage means such as a flash memory can be used instead.

  The image data supply unit 22 only needs to be able to supply image data to be processed. For example, an image reading unit that reads an image recorded on a recording material such as paper or photographic film, and outputs the image data. A receiving unit that receives image data from the outside via a line, an image storage unit (memory 14 or storage unit 20) that stores image data, and the like can be applied. The image output unit 24 only needs to output image data that has undergone image processing or an image represented by the image data. For example, the image recording unit records an image represented by the image data on a recording material such as paper or a photosensitive material. A display unit that displays an image represented by image data on a display, a writing device that writes image data to a recording medium, and a transmission unit that transmits image data via a communication line can be applied. The image output unit 24 may be an image storage unit (memory 14 or storage unit 20) that simply stores image data that has undergone image processing.

  As shown in FIG. 1, the storage unit 20 includes various programs executed by the CPU 12, such as management of resources such as the memory 14, management of execution of programs by the CPU 12, and communication between the computer 10 and the outside. A program of the system 30, an image processing program group 34 for causing the computer 10 to function as an image processing apparatus according to the present invention, and a desired image for the image processing apparatus realized by the CPU 12 executing the image processing program group. Various programs of applications 32 (indicated as application program group 32 in FIG. 1) to be processed are stored.

  The image processing program group 34 reduces the development load when developing the above-described various image handling devices and portable devices, and reduces the development load when developing an image processing program usable on a PC or the like. The purpose is a program developed so that it can be commonly used in various devices (platforms) such as various image handling devices, portable devices, and PCs, and corresponds to the image processing program according to the present invention. The image processing apparatus realized by the image processing program group 34 constructs an image processing unit that performs image processing instructed by the application 32 in accordance with a construction instruction from the application 32, and executes the image processing unit in accordance with an execution instruction from the application 32. The image processing program group 34 instructs the construction of an image processing unit (an image processing unit having a desired configuration) for performing desired image processing, or the constructed image processing unit. The application 32 is provided with an interface for instructing execution of image processing according to the above. For this reason, even when newly developing an arbitrary device that needs to perform image processing internally, regarding the development of a program for performing the image processing, the above-described interface is used to perform the image processing required for the device. It is only necessary to develop the application 32 to be used and executed by the image processing program group 34, and it is not necessary to newly develop a program for actually performing image processing, so that the development load can be reduced.

  Further, as described above, the image processing apparatus realized by the image processing program group 34 constructs an image processing unit that performs image processing instructed by the application 32 according to the construction instruction from the application 32, and constructs the constructed image processing unit. Therefore, for example, when the color space of the image data to be processed and the number of bits per pixel are indefinite or the contents of the image processing to be executed, the procedure / parameter, etc. are indefinite, When the application 32 instructs to reconstruct the image processing unit, the image processing executed by the image processing apparatus (image processing unit) can be flexibly changed according to the image data to be processed.

  Hereinafter, the image processing program group 34 will be described. As shown in FIG. 1, the image processing program group 34 is roughly divided into a module library 36, a process construction unit 42 program, and a process management unit 46 program. As will be described in detail later, the processing construction unit 42 according to the present embodiment, according to an instruction from the application, as illustrated in FIG. 2 as an example, one or more image processing modules 38 that perform predetermined image processing, A buffer module 40 that is arranged in at least one of the preceding stage and the succeeding stage of each image processing module 38 and has a buffer for storing image data, and a pipeline form or a DAG (Directed Acyclic Graph) form An image processing unit 50 formed by linking is constructed. The entity of each image processing module constituting the image processing unit 50 is a first program executed by the CPU 12 and causing the CPU 12 to perform predetermined image processing, or an external unit not shown in FIG. 2 is a second program for instructing execution of processing to the image processing apparatus (for example, a dedicated image processing board), and the module library 36 described above stores predetermined different image processing (for example, input processing and filter processing). , Color conversion processing, enlargement / reduction processing, skew angle detection processing, image rotation processing, image composition processing, output processing, and the like) are registered. Hereinafter, in order to simplify the description, it is assumed that each image processing module constituting the image processing unit 50 is the first program.

  As shown in FIG. 3A as an example, each image processing module 38 includes an image processing engine 38A that performs image processing on image data by a predetermined unit processing data amount, and a front stage and a rear stage of the image processing module 38. The control unit 38B performs input / output of image data with the module and controls the image processing engine 38A. The unit processing data amount in each image processing module 38 is the image processing engine 38A from an arbitrary number of bytes including one line of the image, a plurality of lines of the image, one pixel of the image, one surface of the image, and the like. Is selected and set in advance according to the type of image processing to be performed. For example, in the image processing module 38 that performs color conversion processing and filter processing, the unit processing data amount is one pixel, and the image to be enlarged / reduced is processed. In the processing module 38, the unit processing data amount is equivalent to one line of the image or a plurality of lines of the image, and in the image processing module 38 that performs image rotation processing, the unit processing data amount is equivalent to one image, and the image compression / decompression processing is performed. In the image processing module 38 to be performed, the unit processing data amount is set to N bytes depending on the execution environment.

  The module library 36 also registers image processing modules 38 having the same type of image processing executed by the image processing engine 38A and different contents of the image processing executed (in FIG. 1, this type of image processing is performed). Modules are indicated as “module 1” and “module 2”). For example, with respect to the image processing module 38 that performs enlargement / reduction processing, the image processing module 38 that performs reduction processing to reduce the input image data to 50% by thinning out every other pixel is designated for the input image data. A plurality of image processing modules 38 such as an image processing module 38 that performs enlargement / reduction processing at the enlarged / reduced rate are prepared. For example, the image processing module 38 that performs color conversion processing includes an image processing module 38 that converts the RGB color space to the CMY color space, an image processing module 38 that converts the color space to the opposite, and an L * a * b * color space. Image processing modules 38 for performing other color space conversions are prepared.

  In addition, the control unit 38B of the image processing module 38 receives an image from a module (for example, the buffer module 40) in the previous stage of its own module in order to input image data necessary for the image processing engine 38A to process each unit processing data amount. Data is acquired for each unit read data amount, and image data output from the image processing engine 38A is output for each unit write data amount to a subsequent module (for example, the buffer module 40) (data amount such as compression by the image processing engine 38A). If the image processing with the increase / decrease is not performed, the unit writing data amount = the unit processing data amount) or the result of the image processing by the image processing engine 38A is output to the outside of the module (for example, the image processing engine 38A When performing image analysis processing such as skew angle detection processing, a scan is performed instead of image data. The image analysis processing result such as the angle detection result may be output). However, the module library 36 has the same type and content of the image processing executed by the image processing engine 38A, and the unit processing described above. Image processing modules 38 having different data amounts, unit read data amounts, and unit write data amounts are also registered. For example, the unit processing data amount in the image processing module 38 that performs image rotation processing is not limited to the one image plane described above, and the same image rotation processing is performed and the unit processing data amounts are different from each other (for example, one image). A plurality of image processing modules 38 (for a line, a plurality of lines, etc.) may be included in the module library 36.

  The program of each image processing module 38 registered in the module library 36 is composed of a program corresponding to the image processing engine 38A and a program corresponding to the control unit 38B, but a program corresponding to the control unit 38B. The image processing module 38 having the same unit read data amount and unit write data amount among the individual image processing modules 38 is concerned with the type and content of image processing executed by the image processing engine 38A. However, the program corresponding to the control unit 38B is shared (the same program is used as the program corresponding to the control unit 38B). Thereby, the development load in developing the program of the image processing module 38 is reduced.

  In the image processing module 38, the unit read data amount and the unit write data amount are not fixed when the input image attribute is unknown, and the input image data attribute is acquired and acquired. There is a module in which the unit read data amount and the unit write data amount are determined by substituting the attribute into a predetermined arithmetic expression, and this type of image processing module 38 has a unit read data amount and For the image processing module 38 in which the unit write data amount is derived using the same arithmetic expression, a program corresponding to the control unit 38B may be shared. The image processing program group 34 according to the present embodiment can be mounted on various devices as described above, but the number, type, and the like of the image processing modules 38 registered in the module library 36 in the image processing program group 34. Needless to say, addition, deletion, replacement, and the like can be appropriately performed in accordance with image processing required by various devices that implement the image processing program group 34.

  Further, as shown in FIG. 3B as an example, the individual buffer modules 40 constituting the image processing unit 50 are configured to input / output image data between the buffer 40A and modules before and after the buffer module 40. The buffer control unit 40B manages the buffer 40A. The buffer 40A is composed of a memory area secured from the memory 14 provided in the computer 10 through the operating system 30 and the resource management unit 46C. The buffer control unit 40B of each buffer module 40 is also a program executed by the CPU 12, and the program of the buffer control unit 40B is also registered in the module library 36 (in FIG. 1, the program of the buffer control unit 40B is registered). "Buffer module")

  In addition, the processing construction unit 42 that constructs the image processing unit 50 in accordance with an instruction from the application 32 includes a plurality of types of module generation units 44 as shown in FIG. The plural types of module generation units 44 support different image processing, and are activated by the application 32 to generate a module group including an image processing module 38 and a buffer module 40 for realizing the corresponding image processing. Perform the process. In FIG. 1, the module generation unit 44 corresponding to the type of image processing executed by each image processing module 38 registered in the module library 36 is shown as an example of the module generation unit 44. The image processing corresponding to the generation unit 44 may be image processing realized by a plurality of types of image processing modules 38 (for example, skew correction processing including skew angle detection processing and image rotation processing). When the required image processing is processing combining a plurality of types of image processing, the application 32 sequentially activates the module generation unit 44 corresponding to any of the plurality of types of image processing. As a result, an image processing unit 50 that performs necessary image processing is constructed by the module generation unit 44 that is sequentially activated by the application 32.

  As shown in FIG. 1, the processing management unit 46 includes a processing flow management unit 46 </ b> A that controls execution of image processing in the image processing unit 50, the memory 10 by each module of the image processing unit 50, and the computer 10 such as various files. A resource management unit 46C that manages the use of these resources and an error management unit 46B that manages errors that have occurred in the image processing unit 50 are configured. When an error occurs while the image processing unit 50 is executing image processing, the error management unit 46B acquires error information such as the type and location of the error that has occurred, and the image processing program group 34 is installed. The device environment information representing the type or configuration of the device in which the computer 10 is incorporated is acquired from the storage unit 20 or the like, and an error notification method according to the device environment represented by the acquired device environment information is determined and determined. Performs processing to notify the occurrence of an error using the error notification method.

  Next, the operation of this embodiment will be described. In a device in which the image processing program group 34 is installed, when a situation where it is necessary to perform some kind of image processing, this situation is detected by a specific application 32. In addition, as a situation where it is necessary to perform image processing, for example, an image is read by an image reading unit as the image data supply unit 22, and is recorded as an image on a recording material by an image recording unit as the image output unit 24, or image output Whether the image is displayed on the display unit as the unit 24, the image data is written to the recording medium by the writing device as the image output unit 24, the image data is transmitted by the transmission unit as the image output unit 24, or the image output When the execution of a job to be stored in the image storage unit as the unit 24 is instructed by the user, or received by the reception unit as the image data supply unit 22 or stored in the image storage unit as the image data supply unit 22 For the image data being recorded, recording on the recording material, display on the display unit, writing to the recording medium, transmission, Any execution of a job for the storage of the image storage unit include when instructed by the user. In addition, the situation where image processing needs to be performed is not limited to the above. For example, in a state where the names of processes that can be executed by the application 32 in accordance with an instruction from the user are displayed on the display unit 16 as a list, For example, the execution target process may be selected by the user.

  As described above, when it is detected that the situation where it is necessary to perform some kind of image processing, the application 32 recognizes the type of the image data supply unit 22 that supplies the image data to be processed, and the recognized type is If it is a buffer area (partial area of the memory 14), a parameter for causing the buffer control unit 40B to recognize the buffer area designated as the image data supply unit 22 as the buffer 40A that has already been secured is set, and buffer control is performed. A buffer module 40 including the designated buffer area (as the image data supply unit 22) is generated by generating a thread (which may be a process or an object; the same applies below) that executes the program of the unit 40B (generates the buffer control unit 40B). A functioning buffer module 40) is generated.

  Subsequently, in the same manner as described above, the application 32 recognizes the type of the image output unit 24 as the output destination of the image data subjected to image processing, and the recognized type is the buffer area (partial area of the memory 14). In this case, the buffer module 40 including the buffer area designated as the image output unit 24 is generated in the same manner as described above. The buffer module 40 generated here functions as the image output unit 24. Further, the application 32 recognizes the contents of the image processing to be executed, decomposes the image processing to be executed into a combination of image processing at a level corresponding to each module generation unit 44, and realizes the image processing to be executed. Therefore, the type of image processing necessary for the purpose and the execution order of the individual image processing are determined. In this determination, for example, the type of image processing and the execution order of the individual image processing are registered in advance as information in association with the type of job that can be instructed by the user. Can be realized by reading out information corresponding to the type of job instructed.

  Then, the application 32 activates the module generation unit 44 corresponding to the specific image processing (generates a thread for executing the program of the module generation unit 44) based on the type and execution order of the image processing determined above. Input module identification information for identifying an input module for inputting image data to the module group as information necessary for generating the module group by the module generation unit 44 for the activated module generation unit 44, and the module group Output module identification information for identifying an output module that outputs image data, input image attribute information that represents an attribute of input image data input to the module group, and a corresponding module that notifies parameters of image processing to be executed Instruct the generation of a group. In addition, when the required image processing is a combination of a plurality of types of image processing, the application 32 responds to individual image processing when notified of completion of generation of the module group from the instructed module generation unit 44. The process of starting the other module generation unit 44 and notifying the information necessary for generating the module group is repeated in ascending order of the execution order of the individual image processes.

  In the above input module, the image data supply unit 22 is the input module for the module group with the first execution order, and the last module (usually the buffer) for the module group with the second execution order or later. Module 40) is the input module. As for the above output modules, the image output unit 24 is designated as the output module in the module group whose execution order is the last, so that the image output unit 24 is designated as the output module. Specification by the application 32 is not performed for confirmation, and the module generation unit 44 generates and sets it when necessary. The input image attributes and image processing parameters are registered as information in advance in association with, for example, the type of job that can be instructed by the user, and information corresponding to the type of job instructed to be executed is read out. As a result, the application 32 may recognize it, or the user may specify it.

  On the other hand, the module generation unit 44 performs module generation processing when activated by the application 32. In the module generation process, first, input image attribute information representing an attribute of input image data input to the generation target image processing module 38 is acquired. Note that the processing for acquiring the attributes of the input image data is performed in the case where the buffer module 40 exists in the previous stage of the generation target image processing module 38 and the image processing module in the previous stage that writes image data in the buffer module 40. This can be realized by acquiring the attributes of the output image data from the image data 38.

  Then, based on the attribute of the input image data represented by the acquired information, it is determined whether the generation of the image processing module 38 to be generated is necessary. For example, the module generation unit 44 is a module generation unit that generates a group of modules that perform color conversion processing. When the CMY color space is designated as the color space of the output image data by the image processing parameter from the application 32, the acquired input image When the input image data is found to be RGB color space data based on the attribute information, it is necessary to generate an image processing module 38 that performs RGB → CMY color space conversion as an image processing module 38 that performs color space processing. However, when the input image data is data in the CMY color space, the attribute of the input image data and the attribute of the output image data match with respect to the color space, so that the image processing module 38 that performs color space conversion processing generates Judge as unnecessary.

  If it is determined that the generation target image processing module 38 needs to be generated, it is determined whether the buffer module 40 is required after the generation target image processing module 38. This determination is made when the subsequent stage of the image processing module is the output module (image output unit 24) (see, for example, the last stage image processing module 38 in the image processing unit 50 shown in FIGS. 2A to 2C). As an example, like the image processing module 38 that performs skew angle detection processing in the image processing unit 50 shown in FIG. 2B, the image processing module performs image processing such as analysis on the image data, and the result is the other. In the case other than the above, the determination is affirmed, and the buffer control unit 40B is activated to activate the buffer module 40 connected to the subsequent stage of the image processing module 38. Is generated.

  Subsequently, information on the preceding module (for example, the buffer module 40), information on the succeeding buffer module 40 (only the image processing module 38 that generated the buffer module 40 in the succeeding stage), and input image data input to the image processing module 38 Attributes and processing parameters are given and registered in the module library 36. Among a plurality of candidate modules that can be used as the image processing module 38, the attributes of the input image data acquired earlier and the image processing module 38 An image processing module 38 that matches the processing parameter to be executed is selected and generated.

  For example, the module generation unit 44 is a module generation unit that generates a group of modules that perform color conversion processing. The CMY color space is specified as the color space of the output image data by the processing parameter, and the input image data is data in the RGB color space. If there is, an image processing module 38 that performs RGB → CMY color space conversion is selected and generated from a plurality of types of image processing modules 38 that perform various color space processing registered in the module library 36. The The image processing module 38 is an image processing module 38 that performs enlargement / reduction processing. If the designated enlargement / reduction ratio is other than 50%, the input image data is enlarged at the designated enlargement / reduction ratio. If the image processing module 38 that performs the reduction process is selected and generated and the designated enlargement / reduction ratio is 50%, the enlargement / reduction process specialized for the enlargement / reduction ratio of 50%, that is, the input image data is one pixel. An image processing module 38 that performs a reduction process of reducing to 50% by thinning out at intervals is selected and generated.

  The selection of the image processing module 38 is not limited to the above. For example, a plurality of image processing modules 38 having different unit processing data amounts in image processing by the image processing engine 38A are registered in the module library 36, and the image processing unit The image processing module 38 having an appropriate unit processing data amount is selected according to the operating environment such as the size of the memory area that can be allocated to 50 (for example, the image processing module 38 having a smaller unit processing data amount as the size decreases). Or the application 32 or the user may select it.

  Further, the module generation unit 44 performs image processing realized by a plurality of types of image processing modules 38 (for example, skew correction processing realized by the image processing module 38 that performs skew angle detection processing and the image processing module 38 that performs image rotation processing). When generating a module group for performing the above, the above process is repeated to generate a module group including two or more image processing modules 38. The module generation processing described above is sequentially performed by the individual module generation units 44 that are sequentially activated by the application 32, so that the necessary image processing can be performed as shown in FIGS. An image processing unit 50 to perform is constructed.

  Furthermore, the image processing module 38 generated by the module generation unit 44 is a module that performs image processing using the result of image processing by another image processing module 38 (for example, image analysis processing result such as a histogram). When the image processing module 38 has not been generated, the module generation unit 44 also generates the other image processing module 38 (or a module group including the other image processing module 38). As an example, in the image processing unit 50 shown in FIG. 5A, the image processing module 38 expressed as “image processing B” is expressed as “image processing N1” and “image processing N2”. The image processing module 38 is configured to perform image processing using the result of image processing. When such an image processing unit 50 is constructed, the module generation unit 44 that generates the image processing module 38 of “image processing B” is used. The image processing module 38 of “image processing L1”, the buffer module 40 of “BuffL1”, the image processing module 38 of “image processing M1”, the buffer module 40 of “BuffM1”, and the image processing module of “image processing N1” 38, a module group of “image processing L2”, a buffer module 4 of “BuffL2” The image processing module 38 of the "image processing M2", the buffer module 40 of "BuffM2", and, so that the module group consisting of the image processing module 38 of the "image processing N2" are respectively generated. The above processing corresponds to the construction means according to the present invention.

  As for the execution of the program that operates as the image processing unit 50, a thread for executing the program of each module may be generated and executed by the CPU 12 for each module constituting the image processing unit 50 as a unit. Although a thread is generated in units of module groups (module groups that can operate independently and in parallel) managed by individual process management units 46 generated in the process management unit generation process described below, the CPU 12 It is preferable to make it execute.

  On the other hand, the process construction unit 42 performs the process management unit generation process illustrated in FIG. 4 in parallel with the above-described process of sequentially generating the individual modules constituting the image processing unit 50 in accordance with an instruction from the application 32. Note that the process management unit generation process described below corresponds to the process performed by the management unit generation unit according to the present invention, and the process construction unit 42 includes the management unit generation unit according to the present invention (more specifically, claims 2 to It also functions as the management unit generating means described in item 4.

  In this process management unit generation process, first, in step 100, a thread for executing the program of the process management unit 46 is generated, so that the process flow management unit 46A and the resource management unit 46C of the process management unit 46 operating on the computer 10 are processed. And error management unit 46B. Further, the processing flow management unit 46A includes a management table for registering identification information of modules to be managed. In the next step 102, the management table of the processing flow management unit 46A generated in step 100 is cleared (initially). ). In the next step 104, it is determined whether or not a new image processing module 38 has been generated. If this determination is negative, the process proceeds to step 106 to determine whether or not the construction of the image processing unit 50 is completed. If this determination is also denied, the process returns to step 104, and steps 104 and 106 are repeated until either determination is affirmed.

  When a new image processing module 38 is generated in accordance with an instruction from the application 32, the determination in step 104 is affirmed and the process proceeds to step 108. The image processing module 38 generated this time is transmitted from the image data supply unit 22. A data reading module that reads image data and outputs it to the subsequent stage, a data generation module that generates image data and outputs it to the subsequent stage, and other image processing modules 38 together with the same buffer module 40 (branch module) in the subsequent stage (next stage) In a configuration in which a plurality of module groups are connected to the subsequent stage of the connected image processing module 38 (a single buffer module 40 and the same image data is output (branched) to the plurality of module groups, respectively, each module group The image processing module 38 corresponding to the head: the specific module according to claim 3 It corresponds to any one of the above.

  Although details will be described later, in the process management unit generation process according to the present embodiment, the process flow is performed in units of individual module groups when the image processing unit 50 is divided into a plurality of module groups that can operate in parallel independently of each other. The management unit 46A is provided, and in the determination in step 108 described above, the image processing module 38 generated this time is any of the cases where the image processing unit 50 is divided into a plurality of module groups that can operate in parallel independently of each other. It is determined whether or not the image processing module 38 can be the head of the module group (the module group provided with the corresponding processing flow management unit 46A).

  That is, in the module group starting from the data reading module described above, input of image data to the module group is performed by reading / outputting image data from the image data supply unit 22 by the leading data reading module. Therefore, there is a high possibility of being able to operate in parallel independently of other module groups. For example, each of the image processing modules 38 of “image processing A”, “image processing L1”, and “image processing L2” shown in FIG. 5A is a data reading module, and individual modules starting with these data reading modules Group (first module group consisting of image processing A, Buff A, image processing B, Buff B, image processing C, Buff C, image processing D, second module consisting of image processing L1, Buff L1, image processing M1, Buff M1, and image processing N1 Group, and a third module group consisting of image processing L2, BuffL2, image processing M2, BuffM2, and image processing N2) can operate independently and in parallel.

  In addition, for the module group having the data generation module at the head as described above, the input of the image data to the module group is performed by the generation and output of the image data by the head data generation module, and the processing of the other module group is performed. Since it does not depend on progress, there is a high possibility that it can operate in parallel independently of other module groups. In addition, the module group starting from the module following the branch module (next stage) is also likely to be able to operate in parallel independently of other module groups. For example, each of the image processing modules 38 of “image processing B”, “image processing L1”, and “image processing L2” in the image processing unit 50 shown in FIG. 7A is a subsequent stage (next stage) of the buffer module BuffA as a branch module. ), And each module group starting from these image processing modules (first module group including image processing B, Buff B, image processing C, Buff C, and image processing D, image processing L1, Buff L1, and image processing) The second module group including M1, BuffM1, and image processing N1, and the third module group including image processing L2, BuffL2, image processing M2, BuffM2, and image processing N2) can operate in parallel independently of each other.

  For this reason, when the determination in step 110 is affirmed, it is highly possible that the image processing module 38 generated this time is positioned at the top of a module group that can operate in parallel independently of other module groups. Since the determination can be made, the process proceeds to step 112, and in the processing flow management unit 46A generated by the processing management unit generation processing, the processing flow management unit 46A (which is generated this time) whose management table identification information is not registered in the management table. It is determined whether there is a process flow management unit 46A) that can be assigned to the module group starting with the image processing module 38.

  When the image processing module 38 generated this time is located at the head of the image processing unit 50, the processing flow management unit 46A generated in the previous step 100 is in an unassigned state of the module to be managed. When the determination in step 110 is affirmed, the process proceeds to step 116, and the processing flow management unit 46A for registering the identification information of the image processing module 38 generated this time in the management table as a management target is added to the existing processing flow management unit 46A. Select from. If the determination in the previous step 110 is affirmed, the processing flow management unit 46A described above is a processing flow management unit 46A in which the identification information of the module to be managed is not registered in the management table (generated in step 100). The processing flow management unit 46A) is selected. In the next step 118, it is determined whether the subsequent module of the image processing module 38 generated this time outputs image data to a module group of another system.

  If the determination in step 118 is negative, the process proceeds to step 124, and the identification information (ID) of the image processing module 38 generated this time is used as the identification information (ID of the buffer module 40 connected to the subsequent stage of the image processing module 38 ( ID) and the corresponding processing flow management unit 46A (here, the processing flow management unit 46A selected in step 116) is registered in the management table. The identification information (ID) may be any information that can uniquely identify each module. For example, the identification information (ID) is assigned in the order of generation of each module, or in the object memory of the buffer module 40 or the image processing module 38. The address may be used. If the process of step 124 is performed, it will return to step 104 and will repeat step 104,106.

  Further, when a plurality of image processing modules 38 corresponding to any one of the data reading module, the data generating module, and the module following the branch module (next stage) are generated in the single image processing unit 50, the second and subsequent ones are generated. For the generated image processing module 38, the determination in step 108 is affirmed and the determination in step 110 is denied, and the process proceeds to step 112, and a thread for executing the program of the process management unit 46 is additionally generated. As a result, the process management unit 46 (the process management unit 46 including at least the process flow management unit 46A) corresponding to the image processing module 38 (module group starting from the current generation) generated this time is additionally generated. In the next step 114, the management table of the processing flow management unit 46A generated in step 112 is cleared (initialized). Then, the process proceeds to step 124, where the identification information (ID) of the image processing module 38 generated this time is associated with the identification information (ID) of the buffer module 40 connected to the subsequent stage of the image processing module 38. The generated information is registered in the management table of the corresponding processing flow management unit 46A.

  As described above, each time the determination in step 108 is affirmed and the determination in step 110 is denied, the processing management unit 46 (processing flow management unit 46A) is additionally generated, so that FIG. 7B, as shown in FIG. 7B, the process management unit 46 (processing flow) is performed with a module group starting from any one of the data reading module, the data generation module, and the branch module (next stage) as the head. Each of the management units 46A) is generated (FIG. 5B shows three modules corresponding to the three module groups each starting with the three data reading modules of image processing A, image processing L1, and image processing L2. 7B is generated. FIG. 7B shows a data reading module for image processing A, and three data reading modules for image processing B, image processing L1, and image processing L2. The An example is shown in which four processing management units 46 (processing flow management unit 46A) are generated corresponding to a total of four module groups each starting from the top).

  If the image processing module 38 that does not correspond to any of the data reading module, the data generation module, and the subsequent module of the branch module is generated, the determination in step 108 is negative and the process proceeds to step 116. In this case, as the processing flow management unit 46A for registering the identification information of the image processing module 38 generated this time in the management table as a management target, the same processing as the module existing in the previous stage of the image processing module 38 generated this time The flow management unit 46A is selected. In step 124, the identification information (ID) of the image processing module 38 generated this time and the buffer module 40 connected to the subsequent stage is managed by the processing flow management unit 46A selected in step 116. It will be registered in the table.

  As a result, as shown in FIGS. 5B and 7B, the management table of the processing flow management unit 46A of each processing management unit 46 includes the corresponding module group (module group to be managed). Only the identification information of each module is registered, and the process of managing the execution of image processing in the image processing unit 50 by the processing flow management unit 46A of each processing management unit 46 includes a data reading module, a data generation module, and a branch module. This is performed in units of individual module groups starting from one of the subsequent (next) modules.

  Further, the process management unit 46 additionally generated in the above-described step 112 may be the process management unit 46 provided with at least the process flow management unit 46A. However, in FIG. 5B and FIG. In this example, the process management unit 46 including an error management unit 46B in addition to the management unit 46A is additionally generated. In this case, an error management process for managing an error that has occurred in the image processing unit 50 also includes an individual module group starting from one of the data reading module, the data generation module, and the subsequent module (next stage) of the branch module. Done as a unit. In step 112, a process management unit 46 including a process flow management unit 46A and a resource management unit 46C may be additionally generated, or the process flow management unit 46A, the error management unit 46B, and the resource management unit 46C may be You may make it additionally generate the process management part 46 with which each was provided.

  On the other hand, a program of an image processing module 38 for performing image composition processing is registered in the module library 36. For example, as shown in FIG. 2C, an image using a plurality of image data as in image composition processing or the like. The image processing module 38 that performs processing performs image processing using a plurality of image data output from modules different from each other. Therefore, in the module group that starts with the image processing module 38 that performs image processing using a plurality of image data. The progress of the process is the progress of the process in a plurality of module groups in the preceding stage (a plurality of module groups each having a plurality of modules that output image data to the image processing module 38 that performs image processing using a plurality of image data). The image processing module 38 that performs image processing using a plurality of image data is headed. For the module group, it is desirable in terms of processing efficiency to integrally manage the execution of image processing with the plurality of module groups in the previous stage.

  In step 118 described above, the subsequent module of the image processing module 38 generated this time is connected to output image data to a module group starting with the image processing module 38 that performs image processing using a plurality of image data. If the determination is affirmative, in steps 120 and 122, the processing flow management unit 46A (processing management unit 46) corresponding to the module group including the image processing module 38 generated this time is displayed. Then, a process of integrating with another processing flow management unit 46A (processing management unit 46) corresponding to the module group to which the subsequent module of the image processing module 38 generated this time is connected is performed.

  That is, in step 120, the module subsequent to the image processing module 38 generated this time is connected to the identification information of each module registered in the management table of the processing flow management unit 46A selected in the previous step 116. Copy to the management table of another processing flow management unit 46A corresponding to the module group. In step 122, after deleting (deleting) the thread for executing the program of the processing flow management unit (processing management unit 46) selected in the previous step 116, the process proceeds to step 124.

  As a result, the processing flow management unit 46A (processing management unit 46) selected in the previous step 116 performs another processing flow management corresponding to the module group to which the subsequent module of the image processing module 38 generated this time is connected. In step 124, the identification information (ID) of the image processing module 38 and the buffer module 40 connected to the subsequent stage is integrated with the integrated processing flow management unit 46A. Registered in the management table. Accordingly, the module group including the image processing module 38 generated this time is processed by the same processing flow management unit 46A with another module group to which the module subsequent to the image processing module 38 generated this time is connected. Execution is managed together.

  Next, operations of the individual image processing modules 38 and the buffer modules 40 when image processing is performed by the image processing unit 50 constructed by the above processing will be described in order.

  When executing image processing, a processing request is input from the corresponding processing flow management unit 46A to each image processing module 38 (see also (1) in FIG. 3A). When the processing request is input, the image processing module 38 requests image data from the module (usually the buffer module 40) in front of the own module defined by the preset identification information (FIG. 3 ( (See also A) (2)). If readable readable data is stored in the buffer 40A of the buffer module 40 in a unit read data amount or more, the buffer module 40 notifies the start address of the read area and requests reading of image data. As a result, the image processing module 38 reads the image data of the unit read data amount from the read area of the preceding module notified of the head address (see also (3) in FIG. 3A).

  Next, the image processing module 38 requests an area for data output from the module subsequent to the module itself, and if the data output area (the module at the subsequent stage is the buffer module 40), the start address is notified from the buffer module 40. (See also (4) in FIG. 3A), the image data acquired from the previous module and the data output area (first address) acquired from the subsequent module are converted into an image. The image data is input to the processing engine 38A and predetermined image processing is performed on the input data (see also (5) in FIG. 3A), and the processed data is written in the data output area (FIG. 3 ( (See also A) (6)). When the input of the unit read data amount to the image processing engine 38A is completed and all the data output from the image processing engine 38A is written in the data output area, the output completion is notified to the subsequent module, and The process request source (corresponding process flow management unit 46A) is notified that the process corresponding to the previously input process request has been completed (see also (7) in FIG. 3A). The image processing in the image processing unit 50 is realized by the above processing being repeated in each image processing module 38.

  Depending on the image processing module 38, a processing request may be input from another image processing module 38. For example, in the image processing unit 50 shown in FIG. 5, as described above, the second module group including the image processing L1, BuffL1, image processing M1, BuffM1, and image processing N1, and the image processing L2, BuffL2, image processing M2, A third module group consisting of BuffM2 and image processing N2 is generated in response to an instruction from the image processing module 38 of image processing B, and the last image processing module 38 (image processing N1 and image processing N2 of each module group) is generated. The image processing module 38) realizes the above-described processing sequence when a processing request is input from the image processing module 38 of the image processing B.

  When the buffer controller 40B of the buffer module 40 requests image data from a module (usually the image processing module 38) subsequent to its own module defined by preset identification information (FIG. 3B ) (See also (1))), it is checked whether or not the requested image data is stored in the buffer 40A (see also (2) in FIG. 3B), but readable valid data is stored in the buffer 40A. If no unit read data amount is stored, the processing flow management unit 46A is requested for image data (see also (3) in FIG. 3B). Here, the processing flow management unit 46A searches the management table using the identification information (ID) of the buffer module 40 of the image data request source as a key, and corresponds to the identification information (ID) of the buffer module 40 of the image data request source. In addition, the image processing module 38 in which the identification information (ID) is registered in the management table is recognized as the image processing module 38 located in the preceding stage of the buffer module 40 that requested the image data, and the recognized image processing module 38 is recognized. The processing request is input to (see also (4) of FIG. 3B).

  Then, through the sequence shown in FIG. 3A, the image data is written into the buffer 40A by the image processing module 38 in the previous stage (see also (5) and (6) in FIG. 3B), and from the buffer 40A. When the readable effective data exceeds the unit read data amount, the buffer module 40 notifies the subsequent image processing module 38 of the start address of the reading area, and the subsequent image processing module 38 uses the buffer 40A of the buffer module 40 from the buffer 40A. Image data is read out (see also (7) in FIG. 3B).

  On the other hand, when the processing flow management unit 46A of each processing management unit 46 generated by the previous processing management unit generation processing is instructed to execute image processing from the application 32 that detects completion of the construction of the image processing unit 50, A processing request is input to the image processing module 38 located at the last stage of the module group to be managed in the image processing unit 50 (the module group to be managed is the second module group, the third module group, or the like in FIG. 5). Each time a processing completion notification is input from the image processing module 38 located in the last stage of the module group to be managed, except when generated by an instruction from another image processing module 38 as shown in FIG. Re-inputting the processing request to the image processing module 38 located at the last stage means that the entire processing is performed from the image processing module 38 located at the last stage. The end of the entire process is notified from the image processing module 38 located at the last stage until the end (the end of image processing for the image data to be processed (for example, image data for one frame)) is notified. And notifies the application 32 that has instructed the execution of the image processing of the end of the execution of the image processing in the module group to be managed.

  The processing flow management unit 46A of each processing management unit 46 receives a data request from an arbitrary buffer module 40 of the management target module group while image processing is being performed on the management target module group. In addition, by searching the management table as described above, the image processing module 38 in the previous stage of the buffer module 40 that is the data request input source is recognized, and the processing request is input to the recognized image processing module 38. Here, the number of modules constituting the image processing unit 50 varies depending on the content of image processing performed by the image processing unit 50, the content of image data that the image processing unit 50 performs image processing, and the like. Depending on the contents of the image processing unit 50, the image processing unit 50 may be configured by a huge number of modules of several thousand to several tens of thousands. If the number of modules constituting the image processing unit 50 is enormous, the identification information (ID) of the enormous number of modules is registered in the management table of the processing flow management unit 46A. The time required to search the management table each time is entered increases the processing efficiency.

  On the other hand, in the present embodiment, the processing flow management unit 46A is provided in units of individual module groups when the image processing unit 50 is divided into a plurality of module groups that can operate in parallel independently of each other. As apparent from the comparison of the size of the management table of the individual processing flow management unit 46A shown in FIG. 5B with the size of the management table of the single processing flow management unit 46A shown in FIG. The size of the management table of each processing flow management unit 46A can be reduced, and the time required for searching the management table can be shortened.

  Further, when an error occurs in any of the modules constituting the image processing unit 50 during the execution of the image processing, the error management unit 46B of the process management unit 46 that manages the module group including the module in which the error has occurred. When the occurrence of the error is notified and the error management unit 46B is notified of the occurrence of the error, the error management unit 46B acquires error information such as the type and location of the error that has occurred, and the type of the computer (computer 10) that is operating The device environment information representing the configuration or the like is acquired from the storage unit 20, the error notification method corresponding to the device environment represented by the acquired device environment information is determined, and the occurrence of the error is notified by the determined error notification method.

  Each time the application 32 is notified by the processing flow management unit 46A of each processing management unit 46 that the execution of image processing in the module group to be managed has been completed, the application 32 instructs to delete the notification source processing management unit 46. . As a result, the process management unit 46 that has completed the image processing in the module group to be managed erases the individual modules (threads for executing the program) constituting the module group to be managed, and the process management unit 46 itself ( The thread that executes the program) also performs an erasure process. In the middle of this erasure process, control is temporarily transferred to the resource management unit 46C, and the individual modules to be erased and the process management unit 46 (the process flow management of the module). All resources such as a memory area secured by the unit 46A and the error management unit 46B) are released through the resource management unit 46C.

  As a result, when coding the application 32, each time the completion of the image processing is notified, only the code for instructing the erasure of the processing management unit 46 is described. With the generation of the image processing unit 50 instructing the construction, Secured resources can be released with certainty, and due to the omission of the description of the code that instructs the release of resources that each module has secured, some resources are not released and the effective utilization rate decreases. Can be prevented. The process management unit 46 that performs the above-described erasure processing corresponds to the erasure processing unit according to claim 5 together with the resource management unit 46C that releases resources.

  In the above description, the mode in which the process management unit 46 including the process flow management unit 46A is generated for each module group that can operate independently and in parallel has been described. However, the present invention is limited to this. Instead, only one process management unit 46 may be provided, and each process flow management unit 46A may be generated in units of individual module groups. This can be realized by additionally generating the processing flow management unit 46A without generating the additional processing management unit 46 in step 112 of the processing management unit generation processing (FIG. 4) described above. As an example, FIG. 6 shows a mode in which a processing flow management unit 46A and an error management unit 46B are generated for each module group for the image processing unit 50 shown in FIG. Also in this aspect, since the size of the management table of each processing flow management unit 46A can be reduced, the time required for searching the management table can be shortened.

  Further, in the above, when the image processing unit 50 is configured to include a branch module, as shown in FIG. 7B, a plurality of modules, each having a plurality of modules following the branch module (next stage) as the head, respectively. Although the mode in which the corresponding processing management unit 46 (processing flow management unit 46A) is provided for each module group has been described, the present invention is not limited to this, and as an example, as shown in FIG. A single module group starting from any one of a plurality of modules in the subsequent stage (next stage) is integrated with the module group including the branch module, and the process management unit corresponding to the module group after integration 46 (processing flow management unit 46A) may be provided.

  In the above description, the processing management unit 46 (processing flow management unit 46A) is provided in the same number as the module group constituting the image processing unit 50. However, the present invention is not limited to this, and a plurality of processings are performed. For one or more process management units (process flow management unit 46A) of the management units (process flow management unit 46A), a plurality of module groups may be managed. In this case, the number of processing management units 46 (processing flow management unit 46A) is smaller than the number of module groups, but the present invention includes such an aspect within the scope of rights.

  Further, in the above description, the mode in which the image processing unit 50 is divided into a plurality of individual module groups that can operate independently and in parallel has been described. However, the present invention is not limited to this, and for example, As long as they can operate independently, they do not have to be able to operate in parallel, and the number of modules constituting each module group is averaged regardless of whether each module group can operate independently. Divided into a plurality of module groups, or divided into a plurality of module groups so that the load in each module group or the processing time is leveled, etc. Dividing rules can be applied.

  Further, in the above description, the mode in which the additional generation of the processing management unit 46 (processing flow management unit 46A) is performed in parallel with the generation of the image processing unit 50 has been described, but the present invention is not limited to this, and the image processing unit After the generation of the image processing unit 50 is completed, the generated image processing unit 50 is divided into a plurality of module groups, and based on the result of dividing the image processing unit 50 into a plurality of module groups, the processing management unit 46 (or processing flow) The management unit 46A) may be divided into a plurality of process management units 46 (or a plurality of process flow management units 46A).

  In the above description, the image processing program group 34 corresponding to the image processing program according to the present invention is stored (installed) in the storage unit 20 in advance. However, the image processing program according to the present invention is a CD-ROM. It is also possible to provide it in a form recorded on a recording medium such as a DVD-ROM.

1 is a block diagram showing a schematic configuration of a computer (image processing apparatus) according to an embodiment. It is a block diagram which shows the structural example of an image process part. (A) is an image processing module, and (B) is a block diagram showing a schematic configuration of a buffer module and processing to be executed. It is a flowchart which shows the content of the process management part production | generation process performed by the process construction part. (A) is a block diagram showing an example of the configuration of an image processing unit, and (B) is a block diagram showing an example of a process management unit generated by the process management unit generation process for the image processing unit shown in (A). FIG. 6 is a block diagram illustrating another example of the process management unit generated by the process management unit generation process for the image processing unit illustrated in FIG. (A) is a block diagram showing an example of the configuration of an image processing unit, and (B) is a block diagram showing an example of a process management unit generated by the process management unit generation process for the image processing unit shown in (A). FIG. 8 is a block diagram illustrating another example of the process management unit generated by the process management unit generation process for the image processing unit illustrated in FIG.

Explanation of symbols

10 Computer 12 CPU
14 memory 34 image processing program group 40 buffer module 42 processing construction unit 46 processing management unit 46A processing flow management unit 46B error management unit 46C resource management unit 50 image processing unit

Claims (6)

A plurality of types of image processing modules that perform different image processing on the image data acquired from the previous stage of the own module, and output the image data that has undergone the image processing or the processing result of the image processing to the subsequent stage of the own module, and Storage means for storing each of the programs of the buffer modules for causing the image data output from the previous module to be written in the buffer and for causing the image data stored in the buffer to be read by the subsequent module;
According to the program stored in the storage means, the buffer module is provided in at least one of the preceding stage and the succeeding stage of each of the one or more image processing modules selected from the plurality of types of image processing modules, and each module is piped Construction means for constructing image processing units connected in a line form or a directed acyclic graph form;
Information on individual modules of the corresponding module group is stored in a table as management information in units of individual module groups when the image processing unit is divided into a plurality of module groups, and identification of the corresponding module groups Each time a predetermined request is input from any module of the corresponding module group, a process that is connected to the preceding stage or the subsequent stage of the module and satisfies the predetermined request is performed. An executable module is determined based on the management information, and the determined module is instructed to execute a process that satisfies the predetermined request, whereby the corresponding module group in the image processing unit performs image processing. Management unit generating means for generating each processing flow management unit to be executed;
An image processing apparatus.   The management unit generating means sets each of the processing flow management units in units of n (n ≧ 1) module groups when the image processing unit is divided into a plurality of module groups operable independently of each other. The image processing apparatus according to claim 1 to be generated.   The management unit generating means includes a data reading module that reads the image data stored in a storage medium from the storage medium among the modules constituting the image processing unit, and outputs the image data. A data generation module that generates and outputs, and a data branch module that outputs the same image data to a plurality of modules, or a specific module that is connected to the subsequent stage of the data branch module, each of which starts and ends with another The image processing apparatus according to claim 2, wherein the image processing unit is divided into a plurality of module groups operable independently of each other by being divided into a plurality of module groups not connected to the module group.   The management unit generation unit, when the image processing unit is constructed by the construction unit, as a module constituting the image processing unit to be constructed, the data reading module, the data generation module, and the data branch module or the Each time any one of the specific modules connected to the subsequent stage of the data branch module is generated by the construction means, the processing flow management unit corresponding to the module group starting from the generated module is generated, and When the end of a module group starting from the generated module is connected to another module group, the processing flow management unit corresponding to the module group starting from the generated module and the other module group The processing flow management unit corresponding to the above is integrated into a single processing flow management unit Motomeko third image processing apparatus according.   When erasure of any of the processing flow management units is instructed, the resources reserved by the modules of the module group corresponding to the processing flow management unit instructed to be erased are released and erased. The image processing apparatus according to claim 1, further comprising an erasure processing unit that performs an erasure process for erasing the instructed processing flow management unit. A plurality of types of image processing modules that perform different image processing on the image data acquired from the previous stage of the own module, and output the image data that has undergone the image processing or the processing result of the image processing to the subsequent stage of the own module, and A computer having storage means for storing each of the programs of the buffer module that causes the image data output from the previous module to be written to the buffer and the image data stored in the buffer to be read by the subsequent module;
According to the program stored in the storage means, the buffer module is provided in at least one of the preceding stage and the succeeding stage of each of the one or more image processing modules selected from the plurality of types of image processing modules, and each module is piped Construction means for constructing image processing units connected in line form or directed acyclic graph form,
And the information of each module of the corresponding module group is stored in the table as management information in units of individual module groups when the image processing unit is divided into a plurality of module groups, Each specific module is instructed to execute the process, and each time a predetermined request is input from any module of the corresponding module group, it is connected to the preceding or subsequent stage of the module and satisfies the predetermined request. A module capable of executing processing is determined based on the management information, and the determined module group is instructed to execute processing that satisfies the predetermined request. An image processing program for functioning as a management unit generation unit that generates a processing flow management unit for executing processing Mu.

Images