JP2010146055A - Image processing apparatus, method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve processing efficiency, when respectively applying an identical image processings on a plurality of processing units that constitute the image data. <P>SOLUTION: When an image processing section 50, constituted of a plurality of module groups which can operate independently from each other, applies image processing to three dimensional image data, etc., the image processing is applied to two dimensional image data having different positions of z axis among the three-dimensional image data which is the processing object in respective module groups, after having individual image processing modules 38 carry out initializing processes, including a reference data preparation process the generating and setting of the data to be set for LUT. When image processing is terminated at any of the module groups (the module groups from M<SB>1-1</SB>to M<SB>1-3</SB>in Figure), the image processing is applied to the unprocessed two-dimensional image data by the module group after the initializing process is carried out again that excludes the reference data preparation process from the initializing process in individual image processing modules 38 in the module groups. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, method, and program, and more particularly, a buffer module is provided in at least one of the preceding and following stages of each of one or more image processing modules, and each module is in a pipeline form or a directed acyclic graph form. The present invention relates to an image processing apparatus that performs image processing by constructing an image processing unit connected in the above, an image processing method applicable to the image processing apparatus, and an image processing program for causing a computer to function as the image processing apparatus.

  In an image processing device that performs image processing on input image data, a DTP (desktop publishing) system that can handle images, a print system that records an image represented by input image data on a recording material, etc. Various types of image processing such as enlargement / reduction, rotation, affine transformation, color conversion, filter processing, and image synthesis are performed on the image data. In these apparatuses and systems, for example, when various image data having different color spaces and the number of bits per pixel are input, or when image processing contents, procedures, parameters, and the like are variously changed, an image to be executed A configuration that can change processing flexibly is required.

In order to satisfy such a requirement, Patent Document 1 discloses that each module is connected in a pipeline form or a DAG (Directed Acyclic Graph: Existence) so that a buffer module is connected to at least one of the front and rear stages of the image processing module. The image processing unit is configured to be connected in the form of a non-circular graph), and in each image processing module of the image processing unit, predetermined image processing is performed on the image data acquired from the previous stage of the own module, and predetermined image processing is performed A technique has been proposed in which an image processing unit processes the entire image to be processed by providing a processing management unit that repeats the process of outputting image data or processing results that have undergone processing to the subsequent stage of the own module.
JP 2006-338500 A

  Incidentally, in recent years, with the improvement of the performance of computers and the like, it has become familiar to handle three-dimensional image data and moving image data. However, three-dimensional image data has a data structure in which two-dimensional image data representing a two-dimensional image is connected in the height direction (z-axis direction), and moving image data has two-dimensional image data in the time direction (t-axis direction). ), The amount of data is enormous. On the other hand, the technique described in Patent Document 1 is a technique developed on the premise that image processing is performed on two-dimensional image data, and an image processing unit is constructed and constructed for one frame of two-dimensional image data. This is a configuration for performing image processing by the image processing unit and erasing the image processing unit that has completed the image processing. For this reason, if the above-described technique is applied to image processing for a large amount of image data such as image data or moving image data of a three-dimensional image, the processing takes an enormous amount of time. There is a problem that the application of the above technique is limited, such as being unable to perform image processing on moving image data in parallel.

  The present invention has been made in consideration of the above facts, and is an image processing apparatus, an image processing method, and an image that can realize improvement in processing efficiency when the same image processing is performed for each of a plurality of processing units constituting image data. The purpose is to obtain a processing program.

  In order to achieve the above object, an image processing apparatus according to the first aspect of the present invention performs image processing different from each other on image data acquired from a previous stage of its own module, and the image data that has undergone the image processing or the image processing A plurality of types of image processing modules that output the processing results of the module to the subsequent stage, and the image data output from the preceding module is written to the buffer and the image data stored in the buffer is read by the subsequent module. A storage unit for storing each of the buffer module programs to be output; and a pre-stage and a post-stage of each of the one or more image processing modules selected from the plurality of types of image processing modules by the program stored in the storage unit The buffer module is provided in at least one of the A variable initialization process and an image for initializing variables used at the time of image processing in the image processing module of the constructed image processing unit after constructing an image processing unit connected in a line form or a directed acyclic graph form Construction / initialization means for performing a first initialization process including a reference data preparation process for preparing reference data to be referred to at the time of processing, and image processing on the processing target image data, a plurality of processing target image data The image processing unit performs each processing unit when the image processing unit is divided, and each time the image processing for the single processing unit is completed in the image processing unit, In the image processing module, after performing the first reinitialization process excluding the reference data preparation process from the first initialization process, And an image processing with respect to untreated processing units of the image data is configured to include a, a processing management unit that performed in the image processing unit.

  In the first aspect of the present invention, a plurality of image processings are performed on the image data acquired from the previous stage of the own module, and the image data subjected to the image processing or the processing result of the image processing is output to the subsequent stage of the own module. Various kinds of image processing modules and buffer module programs for causing the image data output from the preceding module to be written to the buffer and reading the image data stored in the buffer by the subsequent module are stored in the storage means. Has been. Further, the construction / initialization means according to the invention of claim 1 includes a first stage of each of one or more image processing modules selected from a plurality of types of image processing modules and a program stored in the storage means. A buffer module is provided in at least one of the subsequent stages, and an image processing unit is constructed in which each module is connected in a pipeline form or a directed acyclic graph form.

  Further, the construction / initialization means is a variable initialization process for initializing variables (for example, a pointer and a counter) used during image processing in the image processing module of the constructed image processing unit after the image processing unit is constructed. In addition, reference data preparation processing for preparing reference data to be referred to during image processing (for example, conversion data to be set in a LUT (Look Up Table) is generated and set in the LUT, or reference data stored in advance in a storage medium is stored in the memory. The first initialization process including the process of reading in (1) is performed. The construction / initialization unit causes the image processing module to perform the first initialization process, so that the image processing unit can perform image processing on the image data to be processed. Image processing is performed on a plurality of processing units (two-dimensional image data for one frame is preferable as this processing unit, but a smaller unit (for example, a two-dimensional image for one frame) May be data representing individual partial images when the image data is divided into a plurality of partial images). As image data to be processed, for example, as described in claim 9, 3D image data or moving image data representing a 3D image is preferable, but 2D image data representing a 2D image, or the like. There may be.

  As described above, when image processing for image data to be processed is performed for each individual processing unit when the image data to be processed is divided into a plurality of processing units, when image processing for a new processing unit is started In this case, it is necessary to perform the variable initialization process for initializing the variables used at the time of image processing again. On the other hand, when the same image processing is performed for each of a plurality of processing units constituting the image data, the reference data referred to by the image processing module at the time of image processing may be the same and does not need to be different for each processing unit. Also, depending on the type of image processing performed by the image processing module, it may take time to generate reference data, or it may be necessary to read a huge amount of reference data into the memory. Often it takes a long time.

  Based on the above, the processing management means according to the first aspect of the invention includes the first initialization in the image processing module of the image processing unit every time the image processing for the single processing unit is completed in the image processing unit. After performing the first re-initialization process excluding the reference data preparation process from the process, the image processing unit performs image processing on an unprocessed processing unit in the processing target image data. As a result, the first re-initialization process performed every time image processing for a certain processing unit is completed can be completed in a short time, and image processing for a new unprocessed processing unit can be started immediately. It is possible to improve the processing efficiency when the same image processing is performed for each of a plurality of processing units constituting the image data.

  In the invention described in claim 1, when the construction / initialization means constructs an image processing unit composed of a plurality of module groups that can operate independently from each other, the process management means is described in claim 2, for example. As described above, each of the module groups of the image processing unit performs image processing for different processing units, and each time image processing for a single processing unit is completed in any one of the plurality of module groups, image processing is performed. After the first re-initialization process is performed in the image processing module in the module group in which the image processing is completed, the image processing for the unprocessed processing unit in the processing target image data is performed in the module group in which the image processing is completed. You may comprise so that it may be performed.

  In the invention described in claim 1 or claim 2, for example, as described in claim 3, the construction / initialization unit constructs the image processing unit and then constructs the buffer module in the constructed image processing unit. And a second initialization process including a process for allocating a memory area used as a buffer, and the process management unit is configured so that the image processing unit In the buffer module, the second re-initialization process for returning the buffer reference position to the top may be performed. In this case, every time image processing for a certain processing unit is completed, instead of the processing for securing the memory area, the buffer reference position that can be processed in a shorter time is updated (reset). It is possible to further improve the processing efficiency when the same image processing is performed for each of a plurality of processing units. In the invention described in claim 3, when an image processing unit composed of a plurality of module groups operable independently of each other is constructed, each module group is divided into units as in the invention described in claim 2. The process management means may be configured to perform the second re-initialization process.

  Further, considering that image processing results stored in the buffer module buffer by performing image processing for a certain processing unit may be referred to when image processing for another processing unit is performed, In the invention described in claim 3, the process management means, for example, as described in claim 4, before the second re-initialization process in the buffer module is performed, the memory area used as the buffer of the buffer module is stored in the memory area. The image processing result may be stored by copying the stored image processing result to another memory area. Thereby, it is possible to refer to an image processing result obtained by image processing for a certain processing unit in image processing for another processing unit.

  In the invention described in claim 1 or claim 2, for example, as described in claim 5, after the construction / initialization unit constructs the image processing unit, the buffer module in the constructed image processing unit And a second initialization process including a process for allocating a memory area to be used as a buffer, and the process management means each time the image processing unit completes image processing for a single processing unit, The memory area used as a buffer in the buffer module is saved, a new buffer module is generated, the generated new buffer module is connected to the image processing unit instead of the existing buffer module, and the new buffer module You may comprise so that a 2nd initialization process may be performed. In this case, similarly to the fourth aspect of the invention, it is possible to refer to an image processing result obtained by image processing for a certain processing unit in image processing for another processing unit.

  According to the fifth aspect of the present invention, a second initial process including a process of securing a memory area with a buffer module newly generated and connected to the image processing unit every time image processing for a certain processing unit is completed. Although the processing efficiency is lower than that of the invention described in claim 3 above, the reference data preparation process is the main cause of the reduction in processing efficiency, and is referred to by the invention described in claim 1. By omitting the data preparation processing, it is possible to realize a significant improvement in processing efficiency compared to the conventional case.

  Further, in the invention according to claim 4 or claim 5, the construction / initialization means performs image processing with reference to image processing results for other processing units having the same configuration and other modules. When constructing an image processing unit including a plurality of linked module groups, for example, as described in claim 6, the processing management unit is configured to process a specific processing unit of image data to be processed with respect to the specific processing unit. Whether the image processing result stored in the buffer of each buffer module of an arbitrary module group that has performed image processing is referred to by a module group that performs image processing for which processing unit of image data to be processed After determining and storing the determination result for each processing unit of the image data to be processed, each module of the image processing unit is stored. Each time a group of images is processed for different processing units, and image processing for an arbitrary processing unit is completed in any one of a plurality of module groups, based on the stored determination results, It is determined whether or not a buffer that has been referred to by another module group of the stored image processing results has appeared, and when it is determined that the corresponding buffer has appeared, the memory area used as the corresponding buffer is released. It is preferable to configure as described above.

  An image processing unit having a plurality of module groups connected to perform image processing with reference to image processing results for other processing units having the same configuration and other module groups is constructed. When image processing for different processing units is performed in individual module groups, even if image processing for a certain processing unit is completed, the image processing result obtained by the image processing is referred to for image processing for other processing units. Therefore, it is necessary to save the memory area for storing the image processing result as in the invention of claim 4 or claim 5, and in accordance with this, the data amount of the image data to be processed is particularly compared. In the case of a large size, there arises a problem that a large amount of resources such as a memory area are used.

  On the other hand, in the invention according to claim 6, the image processing result stored in the buffer of each buffer module of an arbitrary module group that has performed image processing on a specific processing unit of image data to be processed is processed. It is determined for each processing unit of the image data to be processed that each processing unit of the image data to be processed is stored by determining which processing unit of the image data is referred to by a module group that performs image processing, and storing the determination result. At the time of execution of the process, every time image processing for an arbitrary processing unit is completed in any one of a plurality of module groups, based on the stored determination result, other than the image processing result stored at the end of the image processing It is determined whether or not a buffer that has been referenced by the module group has appeared, and when it is determined that the corresponding buffer has appeared, The memory area that was being used is released, so it is possible to prevent the buffer (memory area) from which the stored image processing results are no longer referenced from being left unreleased. The amount of resources used such as areas can be minimized.

  Further, in the invention according to claim 4 or claim 5, the construction / initialization means performs image processing with reference to image processing results for other processing units having the same configuration and other modules. When constructing an image processing unit including a plurality of connected module groups, the process management means, for example, as described in claim 7, for a specific processing unit of image data to be processed, an image for a specific processing unit It is determined whether an arbitrary module group that performs processing refers to an image processing result stored in a buffer of a buffer module included in a module group that performs image processing for which processing unit of image data to be processed, After the determination result is stored for each processing unit of the image data to be processed, each module group of the image processing unit is stored. Whether to instruct execution of image processing for different processing units, and based on the stored determination result, whether or not there is a buffer for storing an image processing result referred to by a specific module group to be subjected to image processing. Judgment is made for each module group to be processed, and if it is determined that there is a nonexistent buffer, a module group including a nonexistent buffer is additionally generated, and a specific module group is generated by the additionally generated module group. It is preferable that the image processing is performed for a specific processing unit in which an image processing result referred to by is obtained.

  An image processing unit having a plurality of module groups connected to perform image processing with reference to image processing results for other processing units having the same configuration and other module groups is constructed. When image processing is performed on different processing units in individual module groups, for example, a specific module group that performs image processing on the first processing unit obtains image processing results for the reference and necessary second processing units. However, the image processing for the second processing unit is scheduled to be performed by the specific module group after the image processing for the first processing unit by the specific module group is completed. There is a possibility that a deadlock occurs like this and the progress of the image processing is stopped.

  On the other hand, in the invention described in claim 7, any module group that performs image processing for a specific processing unit of image data to be processed performs image processing for any processing unit of the image data to be processed. It is determined whether to refer to the image processing result stored in the buffer of the buffer module included in the module group, and the determination result is stored for each processing unit of the image data to be processed. Based on the determination result, whether or not there is a buffer for storing an image processing result referred to by a specific module group that performs image processing is determined for each module group that performs image processing. If it is determined that there is no buffer, an additional module group including the nonexistent buffer is generated, and the additional generated module group More, since to perform image processing for a particular unit of processing is an image processing result reference specific modules obtained, it is possible to prevent the progress of the image processing deadlock will stop.

  Further, in the invention according to any one of claims 1 to 7, the process excluded in the first re-initialization process is not limited to the reference data preparation process. For example, as described in claim 8 The construction / initialization means includes a first module group that operates on the first computer, and a second module group that operates on the second computer connected to the first computer via a communication line. When the image processing unit is constructed, a session is established between the first computer and the second computer in a specific image processing module in which a communication line exists between adjacent modules among the constructed image processing units. A first initialization process including an authentication process for the image processing unit, and the process management unit includes: In the constant image processing module may be configured to cause the first re-initialization process that excluded the authentication process from the first initialization process.

  Authentication processing generally takes time because encrypted information is sent and received, and if authentication processing is repeated, establishment of a session may be rejected by the partner computer for security reasons. On the other hand, in the invention according to claim 8, when the image processing for the single processing unit is completed in the image processing unit, the first initialization process is performed in the specific image processing module of the image processing unit. Since the first re-initialization process excluding the authentication process is performed, the processing efficiency is improved by omitting the authentication process, and the image process for all the processing units constituting the image data to be processed is completed. If the establishment of the session is rejected by the partner computer before the image processing is performed, it is possible to prevent the image processing for the image data to be processed from being interrupted.

  In the image processing method according to the tenth aspect of the present invention, the storage means performs different image processing on the image data acquired from the previous stage of the own module, and the image data subjected to the image processing or the processing result of the image processing. A plurality of types of image processing modules for outputting the image data to the subsequent stage of the own module, and a buffer for causing the image data output from the previous module to be written to the buffer and the image data stored in the buffer to be read by the subsequent module Each of the module programs is stored, and the construction / initialization means includes a first stage of each of the one or more image processing modules selected from the plurality of types of image processing modules according to the program stored in the storage means, and The buffer module is provided in at least one of the subsequent stages, and each module is piped In the image processing module of the constructed image processing unit after constructing the image processing unit connected in the in-form or directed acyclic graph form, a variable initialization process and an image for initializing variables used in image processing A first initialization process including a reference data preparation process for preparing reference data to be referred to at the time of processing is performed, and the process management means performs image processing on the processing target image data, and converts the processing target image data into a plurality of processing target image data. The image processing unit performs each processing unit when divided into processing units, and each time image processing for a single processing unit is completed in the image processing unit, the image processing unit In the image processing module, after performing the first re-initialization process excluding the reference data preparation process from the first initialization process, the image to be processed Since image processing for unprocessed processing units in the data is performed by the image processing unit, the same image processing is performed for each of a plurality of processing units constituting image data, as in the first aspect of the invention. It is possible to improve the processing efficiency.

  An image processing program according to an eleventh aspect of the invention performs different image processing on the image data acquired from the previous stage of the own module, and the image data that has undergone the image processing or the processing result of the image processing is stored in the own module. A plurality of types of image processing modules to be output to the subsequent stage, and a buffer module program that causes the image data output from the previous module to be written to the buffer and the image data stored in the buffer to be read by the subsequent module. At least one of the preceding and following stages of each of the one or more image processing modules selected from the plurality of types of image processing modules by a program stored in the storage means, each of which includes a storage means for storing. The buffer module is provided in the After constructing an image processing unit connected in an ipline form or a directed acyclic graph form, in the image processing module of the constructed image processing unit, a variable initialization process and an image for initializing variables used during image processing Construction / initialization means for performing a first initialization process including a reference data preparation process for preparing reference data to be referred to at the time of processing, and an image process for the process target image data. The image processing unit performs each processing unit when the processing unit is divided into a plurality of processing units, and each time the image processing for the single processing unit is completed in the image processing unit, In the image processing module, after performing the first re-initialization process excluding the reference data preparation process from the first initialization process, Image processing of untreated process unit of the image data to be processed to function as processing management means for causing by the image processing unit.

  The image processing program according to the invention described in claim 11 is a program for causing a computer including the storage means to function as the construction / initialization means and the process management means. By executing the image processing program according to the present invention, the computer functions as the image processing apparatus according to claim 1, and, similarly to the invention according to claim 1, a plurality of processing units constituting image data It is possible to improve the processing efficiency when performing the same image processing.

  As described above, the present invention includes a variable initialization process that initializes variables used during image processing and a reference data preparation process that prepares reference data referenced during image processing when an image processing unit is constructed. When the image processing module finishes the image processing for one processing unit when the image processing module divides the image data to be processed into a plurality of processing units, Since the first re-initialization process excluding the reference data preparation process from the initialization process is performed by the image processing module, the same image process is performed for each of a plurality of processing units constituting the image data. It has an excellent effect of improving the processing efficiency.

  Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings.

[First Embodiment]
Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 shows a computer 10 that can function as an image processing apparatus according to the present invention. The computer 10 is incorporated in any image handling apparatus that needs to perform image processing internally, such as a copying machine, a printer, a facsimile machine, a multifunction machine having these functions, a scanner, a photographic printer, or the like. Alternatively, it may be an independent computer such as a personal computer (PC), or may be a computer incorporated in a portable device such as a PDA (Personal Digital Assistant) or a cellular phone.

  The computer 10 includes a CPU 12, a memory 14 including a DRAM or SRAM, a display unit 16, an operation unit 18, a storage unit 20, an image data supply unit 22, and an image output unit 24, which are connected to each other via a bus 26. Has been. When the computer 10 is incorporated in an image handling device as described above, a display panel, a numeric keypad, or the like composed of an LCD or the like provided in the image handling device can be applied as the display unit 16 and the operation unit 18. When the computer 10 is an independent computer, a display, a keyboard, a mouse, or the like connected to the computer can be applied as the display unit 16 or the operation unit 18. The storage unit 20 is preferably an HDD (Hard Disk Drive), but other nonvolatile storage means such as a flash memory can be used instead.

  The image data supply unit 22 only needs to be able to supply image data to be processed. For example, an image reading unit that reads an image recorded on a recording material such as paper or photographic film, and outputs the image data. A receiving unit that receives image data from the outside via a line, an image storage unit (memory 14 or storage unit 20) that stores image data, and the like can be applied. The image output unit 24 only needs to output image data that has undergone image processing or an image represented by the image data. For example, the image recording unit records an image represented by the image data on a recording material such as paper or a photosensitive material. A display unit that displays an image represented by image data on a display, a writing device that writes image data to a recording medium, and a transmission unit that transmits image data via a communication line can be applied. The image output unit 24 may be an image storage unit (memory 14 or storage unit 20) that simply stores image data that has undergone image processing.

  As shown in FIG. 1, the storage unit 20 includes various programs executed by the CPU 12, such as management of resources such as the memory 14, management of execution of programs by the CPU 12, and communication between the computer 10 and the outside. A program of the system 30, an image processing program group 34 for causing the computer 10 to function as an image processing apparatus according to the present invention, and a desired image for the image processing apparatus realized by the CPU 12 executing the image processing program group. Various programs of applications 32 (indicated as application program group 32 in FIG. 1) to be processed are stored.

  The image processing program group 34 reduces the development load when developing the above-described various image handling devices and portable devices, and reduces the development load when developing an image processing program usable on a PC or the like. The purpose is a program developed so that it can be commonly used in various devices (platforms) such as various image handling devices, portable devices, and PCs, and corresponds to the image processing program according to the present invention. The image processing apparatus realized by the image processing program group 34 constructs an image processing unit that performs image processing instructed by the application 32 in accordance with a construction instruction from the application 32, and executes the image processing unit in accordance with an execution instruction from the application 32. The image processing program group 34 instructs the construction of an image processing unit (an image processing unit having a desired configuration) for performing desired image processing, or the constructed image processing unit. The application 32 is provided with an interface for instructing execution of image processing according to the above. For this reason, even when newly developing an arbitrary device that needs to perform image processing internally, regarding the development of a program for performing the image processing, the above-described interface is used to perform the image processing required for the device. It is only necessary to develop the application 32 to be used and executed by the image processing program group 34, and it is not necessary to newly develop a program for actually performing image processing, so that the development load can be reduced.

  Further, as described above, the image processing apparatus realized by the image processing program group 34 constructs an image processing unit that performs image processing instructed by the application 32 according to the construction instruction from the application 32, and constructs the constructed image processing unit. Therefore, for example, when the color space of the image data to be processed and the number of bits per pixel are indefinite or the contents of the image processing to be executed, the procedure / parameter, etc. are indefinite, When the application 32 instructs to reconstruct the image processing unit, the image processing executed by the image processing apparatus (image processing unit) can be flexibly changed according to the image data to be processed.

  Hereinafter, the image processing program group 34 will be described. As shown in FIG. 1, the image processing program group 34 is roughly divided into a module library 36, a process construction unit 42 program, and a process management unit 46 program. As will be described in detail later, the processing construction unit 42 according to the present embodiment, according to an instruction from the application, as illustrated in FIG. 2 as an example, one or more image processing modules 38 that perform predetermined image processing, A buffer module 40 that is arranged in at least one of the preceding stage and the succeeding stage of each image processing module 38 and has a buffer for storing image data, and a pipeline form or a DAG (Directed Acyclic Graph) form An image processing unit 50 formed by linking is constructed. The entity of each image processing module constituting the image processing unit 50 is a first program executed by the CPU 12 and causing the CPU 12 to perform predetermined image processing, or an external unit not shown in FIG. 2 is a second program for instructing execution of processing to the image processing apparatus (for example, a dedicated image processing board), and the module library 36 described above stores predetermined different image processing (for example, input processing and filter processing). , Color conversion processing, enlargement / reduction processing, skew angle detection processing, image rotation processing, image composition processing, output processing, and the like) are registered. Hereinafter, in order to simplify the description, it is assumed that each image processing module constituting the image processing unit 50 is the first program.

  As shown in FIG. 3A as an example, each image processing module 38 includes an image processing engine 38A that performs image processing on image data by a predetermined unit processing data amount, and a front stage and a rear stage of the image processing module 38. The control unit 38B performs input / output of image data with the module and controls the image processing engine 38A. The unit processing data amount in each image processing module 38 is the image processing engine 38A from an arbitrary number of bytes including one line of the image, a plurality of lines of the image, one pixel of the image, one surface of the image, and the like. Is selected and set in advance according to the type of image processing to be performed. For example, in the image processing module 38 that performs color conversion processing and filter processing, the unit processing data amount is one pixel, and the image to be enlarged / reduced is processed. In the processing module 38, the unit processing data amount is equivalent to one line of the image or a plurality of lines of the image, and in the image processing module 38 that performs image rotation processing, the unit processing data amount is equivalent to one image, and the image compression / decompression processing is performed. In the image processing module 38 to be performed, the unit processing data amount is set to N bytes depending on the execution environment.

  The module library 36 also registers image processing modules 38 having the same type of image processing executed by the image processing engine 38A and different contents of the image processing executed (in FIG. 1, this type of image processing is performed). Modules are indicated as “module 1” and “module 2”). For example, with respect to the image processing module 38 that performs enlargement / reduction processing, the image processing module 38 that performs reduction processing to reduce the input image data to 50% by thinning out every other pixel is designated for the input image data. A plurality of image processing modules 38 such as an image processing module 38 that performs enlargement / reduction processing at the enlarged / reduced rate are prepared. For example, the image processing module 38 that performs color conversion processing includes an image processing module 38 that converts the RGB color space to the CMY color space, an image processing module 38 that converts the color space to the opposite, and an L * a * b * color space. Image processing modules 38 for performing other color space conversions are prepared.

  In addition, the control unit 38B of the image processing module 38 receives an image from a module (for example, the buffer module 40) in the previous stage of its own module in order to input image data necessary for the image processing engine 38A to process each unit processing data amount. Data is acquired for each unit read data amount, and image data output from the image processing engine 38A is output for each unit write data amount to a subsequent module (for example, the buffer module 40) (data amount such as compression by the image processing engine 38A). If the image processing with the increase / decrease is not performed, the unit writing data amount = the unit processing data amount) or the result of the image processing by the image processing engine 38A is output to the outside of the module (for example, the image processing engine 38A When performing image analysis processing such as skew angle detection processing, a scan is performed instead of image data. The image analysis processing result such as the angle detection result may be output). However, the module library 36 has the same type and content of the image processing executed by the image processing engine 38A, and the unit processing described above. Image processing modules 38 having different data amounts, unit read data amounts, and unit write data amounts are also registered. For example, the unit processing data amount in the image processing module 38 that performs image rotation processing is not limited to the one image plane described above, and the same image rotation processing is performed and the unit processing data amounts are different from each other (for example, one image). A plurality of image processing modules 38 (for a line, a plurality of lines, etc.) may be included in the module library 36.

  The program of each image processing module 38 registered in the module library 36 is composed of a program corresponding to the image processing engine 38A and a program corresponding to the control unit 38B, but a program corresponding to the control unit 38B. The image processing module 38 having the same unit read data amount and unit write data amount among the individual image processing modules 38 is concerned with the type and content of image processing executed by the image processing engine 38A. However, the program corresponding to the control unit 38B is shared (the same program is used as the program corresponding to the control unit 38B). Thereby, the development load in developing the program of the image processing module 38 is reduced.

  In the image processing module 38, the unit read data amount and the unit write data amount are not fixed when the input image attribute is unknown, and the input image data attribute is acquired and acquired. There is a module in which the unit read data amount and the unit write data amount are determined by substituting the attribute into a predetermined arithmetic expression, and this type of image processing module 38 has a unit read data amount and For the image processing module 38 in which the unit write data amount is derived using the same arithmetic expression, a program corresponding to the control unit 38B may be shared. The image processing program group 34 according to the present embodiment can be mounted on various devices as described above, but the number, type, and the like of the image processing modules 38 registered in the module library 36 in the image processing program group 34. Needless to say, addition, deletion, replacement, and the like can be appropriately performed in accordance with image processing required by various devices that implement the image processing program group 34.

  Further, as shown in FIG. 3B as an example, the individual buffer modules 40 constituting the image processing unit 50 are configured to input / output image data between the buffer 40A and modules before and after the buffer module 40. The buffer control unit 40B manages the buffer 40A. The buffer 40A is composed of a memory area secured from the memory 14 provided in the computer 10 through the operating system 30 and the resource management unit 46C. The buffer control unit 40B of each buffer module 40 is also a program executed by the CPU 12, and the program of the buffer control unit 40B is also registered in the module library 36 (in FIG. 1, the program of the buffer control unit 40B is registered). "Buffer module")

  In addition, the processing construction unit 42 that constructs the image processing unit 50 in accordance with an instruction from the application 32 includes a plurality of types of module generation units 44 as shown in FIG. The plural types of module generation units 44 support different image processing, and are activated by the application 32 to generate a module group including an image processing module 38 and a buffer module 40 for realizing the corresponding image processing. Perform the process. In FIG. 1, the module generation unit 44 corresponding to the type of image processing executed by each image processing module 38 registered in the module library 36 is shown as an example of the module generation unit 44. The image processing corresponding to the generation unit 44 may be image processing realized by a plurality of types of image processing modules 38 (for example, skew correction processing including skew angle detection processing and image rotation processing). When the required image processing is processing combining a plurality of types of image processing, the application 32 sequentially activates the module generation unit 44 corresponding to any of the plurality of types of image processing. As a result, an image processing unit 50 that performs necessary image processing is constructed by the module generation unit 44 that is sequentially activated by the application 32.

  As shown in FIG. 1, the processing management unit 46 includes a processing flow management unit 46 </ b> A that controls execution of image processing in the image processing unit 50, the memory 10 by each module of the image processing unit 50, and the computer 10 such as various files. A resource management unit 46C that manages the use of these resources and an error management unit 46B that manages errors that have occurred in the image processing unit 50 are configured. When an error occurs while the image processing unit 50 is executing image processing, the error management unit 46B acquires error information such as the type and location of the error that has occurred, and the image processing program group 34 is installed. The device environment information representing the type or configuration of the device in which the computer 10 is incorporated is acquired from the storage unit 20 or the like, and an error notification method according to the device environment represented by the acquired device environment information is determined and determined. Performs processing to notify the occurrence of an error using the error notification method.

  Next, the operation of this embodiment will be described. In a device in which the image processing program group 34 is installed, when a situation where it is necessary to perform some kind of image processing, this situation is detected by a specific application 32. In addition, as a situation where it is necessary to perform image processing, for example, an image is read by an image reading unit as the image data supply unit 22, and is recorded as an image on a recording material by an image recording unit as the image output unit 24, or image output Whether the image is displayed on the display unit as the unit 24, the image data is written to the recording medium by the writing device as the image output unit 24, the image data is transmitted by the transmission unit as the image output unit 24, or the image output When the execution of a job to be stored in the image storage unit as the unit 24 is instructed by the user, or received by the reception unit as the image data supply unit 22 or stored in the image storage unit as the image data supply unit 22 For the image data being recorded, recording on the recording material, display on the display unit, writing to the recording medium, transmission, Any execution of a job for the storage of the image storage unit include when instructed by the user. In addition, the situation where image processing needs to be performed is not limited to the above. For example, in a state where the names of processes that can be executed by the application 32 in accordance with an instruction from the user are displayed on the display unit 16 as a list, For example, the execution target process may be selected by the user.

  As described above, when it is detected that a situation where it is necessary to perform some image processing is performed, the application 32 generates a thread (which may be a process or an object; the same applies below) that executes the program of the processing management unit 46. Thus, a workflow management unit 46A, a resource management unit 46B, and an error management unit 46C of the process management unit 46 operating on the computer 10 are generated. Subsequently, the application 32 recognizes the type of the image data supply unit 22 that supplies the image data to be processed, and if the recognized type is the buffer area (partial area of the memory 14), the image data supply A parameter for causing the buffer control unit 40B to recognize the buffer area designated as the unit 22 as an already secured buffer 40A is set, and a thread for executing the program of the buffer control unit 40B is generated (the buffer control unit 40B is generated). Thus, the buffer module 40 including the designated buffer area (the buffer module 40 functioning as the image data supply unit 22) is generated.

  Subsequently, in the same manner as described above, the application 32 recognizes the type of the image output unit 24 as the output destination of the image data subjected to image processing, and the recognized type is the buffer area (partial area of the memory 14). In this case, the buffer module 40 including the buffer area designated as the image output unit 24 is generated in the same manner as described above. The buffer module 40 generated here functions as the image output unit 24. Further, the application 32 recognizes the contents of the image processing to be executed, decomposes the image processing to be executed into a combination of image processing at a level corresponding to each module generation unit 44, and realizes the image processing to be executed. Therefore, the type of image processing necessary for the purpose and the execution order of the individual image processing are determined. In this determination, for example, the type of image processing and the execution order of the individual image processing are registered in advance as information in association with the type of job that can be instructed by the user. Can be realized by reading out information corresponding to the type of job instructed.

  Then, the application 32 activates the module generation unit 44 corresponding to the specific image processing (generates a thread for executing the program of the module generation unit 44) based on the type and execution order of the image processing determined above. Input module identification information for identifying an input module for inputting image data to the module group as information necessary for generating the module group by the module generation unit 44 for the activated module generation unit 44, and the module group Output module identification information for identifying an output module that outputs image data, input image attribute information that represents an attribute of input image data input to the module group, and a corresponding module that notifies parameters of image processing to be executed Instruct the generation of a group. In addition, when the required image processing is a combination of a plurality of types of image processing, the application 32 responds to individual image processing when notified of completion of generation of the module group from the instructed module generation unit 44. The process of starting the other module generation unit 44 and notifying the information necessary for generating the module group is repeated in ascending order of the execution order of the individual image processes.

  In the above input module, the image data supply unit 22 is the input module for the module group with the first execution order, and the last module (usually the buffer) for the module group with the second execution order or later. Module 40) is the input module. As for the above output modules, the image output unit 24 is designated as the output module in the module group whose execution order is the last, so that the image output unit 24 is designated as the output module. Specification by the application 32 is not performed for confirmation, and the module generation unit 44 generates and sets it when necessary. The input image attributes and image processing parameters are registered as information in advance in association with, for example, the type of job that can be instructed by the user, and information corresponding to the type of job instructed to be executed is read out. As a result, the application 32 may recognize it, or the user may specify it.

  On the other hand, the module generation unit 44 performs module generation processing when activated by the application 32. In the module generation process, first, input image attribute information representing an attribute of input image data input to the generation target image processing module 38 is acquired. Note that the processing for acquiring the attributes of the input image data is performed in the case where the buffer module 40 exists in the previous stage of the generation target image processing module 38 and the image processing module in the previous stage that writes image data in the buffer module 40. This can be realized by acquiring the attributes of the output image data from the image data 38.

  Then, based on the attribute of the input image data represented by the acquired information, it is determined whether the generation of the image processing module 38 to be generated is necessary. For example, the module generation unit 44 is a module generation unit that generates a group of modules that perform color conversion processing. When the CMY color space is designated as the color space of the output image data by the image processing parameter from the application 32, the acquired input image When the input image data is found to be RGB color space data based on the attribute information, it is necessary to generate an image processing module 38 that performs RGB → CMY color space conversion as an image processing module 38 that performs color space processing. However, when the input image data is data in the CMY color space, the attribute of the input image data and the attribute of the output image data match with respect to the color space, so that the image processing module 38 that performs color space conversion processing generates Judge as unnecessary.

  If it is determined that the generation target image processing module 38 needs to be generated, it is determined whether the buffer module 40 is required after the generation target image processing module 38. This determination is made when the subsequent stage of the image processing module is the output module (image output unit 24) (see, for example, the last stage image processing module 38 in the image processing unit 50 shown in FIGS. 2A to 2C). As an example, like the image processing module 38 that performs skew angle detection processing in the image processing unit 50 shown in FIG. 2B, the image processing module performs image processing such as analysis on the image data, and the result is the other. In the case other than the above, the determination is affirmed, and the buffer control unit 40B is activated to activate the buffer module 40 connected to the subsequent stage of the image processing module 38. Is generated.

  Subsequently, information on the preceding module (for example, the buffer module 40), information on the succeeding buffer module 40 (only the image processing module 38 that generated the buffer module 40 in the succeeding stage), and input image data input to the image processing module 38 Attributes and processing parameters are given and registered in the module library 36. Among a plurality of candidate modules that can be used as the image processing module 38, the attributes of the input image data acquired earlier and the image processing module 38 An image processing module 38 that matches the processing parameter to be executed is selected and generated.

  For example, the module generation unit 44 is a module generation unit that generates a group of modules that perform color conversion processing. The CMY color space is specified as the color space of the output image data by the processing parameter, and the input image data is data in the RGB color space. If there is, an image processing module 38 that performs RGB → CMY color space conversion is selected and generated from a plurality of types of image processing modules 38 that perform various color space processing registered in the module library 36. The The image processing module 38 is an image processing module 38 that performs enlargement / reduction processing. If the designated enlargement / reduction ratio is other than 50%, the input image data is enlarged at the designated enlargement / reduction ratio. If the image processing module 38 that performs the reduction process is selected and generated and the designated enlargement / reduction ratio is 50%, the enlargement / reduction process specialized for the enlargement / reduction ratio of 50%, that is, the input image data is one pixel. An image processing module 38 that performs a reduction process of reducing to 50% by thinning out at intervals is selected and generated.

  The selection of the image processing module 38 is not limited to the above. For example, a plurality of image processing modules 38 having different unit processing data amounts in image processing by the image processing engine 38A are registered in the module library 36, and the image processing unit The image processing module 38 having an appropriate unit processing data amount is selected according to the operating environment such as the size of the memory area that can be allocated to 50 (for example, the image processing module 38 having a smaller unit processing data amount as the size decreases). Or the application 32 or the user may select it. Further, the module generation unit 44 performs image processing realized by a plurality of types of image processing modules 38 (for example, skew correction processing realized by the image processing module 38 that performs skew angle detection processing and the image processing module 38 that performs image rotation processing). When generating a module group for performing the above, the above process is repeated to generate a module group including two or more image processing modules 38.

  For example, as shown in FIG. 4A, what is defined (specified) by the application 32 is only the type and arrangement order of the image processing module 38 for realizing the target image processing. As shown in FIG. 2A to FIG. 4C and FIG. 4B as an example, the module generation processing described above is sequentially performed by the individual module generation units 44 of the processing construction unit 42 that is sequentially started by the above. In addition, a buffer module is inserted as necessary, and the image processing unit 50 that performs the target image processing is constructed.

  In addition, the image processing unit 50 according to the present embodiment is configured such that three-dimensional image data having a data structure in which two-dimensional image data is continuously arranged in the height direction (z-axis direction) or two-dimensional image data in the time direction (t-axis direction ), It is possible to process moving image data having a data structure that is connected in large numbers. However, when processing 3D image data or moving image data having a relatively large amount of data, or high-speed processing is possible. For example, as shown in FIG. 4A, “number of module groups = n”, the module configuration is the same (the image processing content is the same), and the modules operate independently and in parallel. The number of generated module groups is also specified (specified) by the application 32. When the generation number of the module group is specified, the process construction unit 42 generates the module group by the specified generation number. FIG. 4B shows a case where three module groups are generated.

  The number of generated module groups is not limited to being specified (designated) by the application 32. For example, image data to be processed is moving image data, and the image processing unit 50 is required to output moving image data that has undergone image processing at a transfer rate of 20 fps. If the processing is at a processing speed corresponding to a transfer rate of 5 fps, the process construction unit 42 calculates the number of modules that satisfy the required performance, and generates the same number of modules as the calculated number of generations = 4. You may do it.

  In addition, the execution of the program that operates as the image processing unit 50 can be executed by the CPU 12 by generating a thread for executing the program of each module in units of individual modules constituting the image processing unit 50. However, in this embodiment, a thread is generated and executed by the CPU 12 in units of module groups having the same module configuration (the same image processing content) and operating in parallel independently of each other.

  As described above, the processing construction unit 42 constructs the image processing unit 50, and the processing construction unit 42 notifies the processing management unit 46 (the workflow management unit 46A) that the construction of the image processing unit 50 is completed. Then, the process management unit 46 (the workflow management unit 46A) performs the process management unit process shown in FIG. Hereinafter, this process management part process is demonstrated.

As shown in FIG. 4B, the process management unit 46 (the workflow management unit 46A) according to the first embodiment is an image processing module 38 (final image processing module 38) located at the end of each module group. ) For registering information of the buffer module 40 (the buffer 40A thereof) in which the image processing result is stored by completing the image processing for an arbitrary processing unit in an arbitrary module group. Storage buffer list and a processing list for registering information of processing units being executed. In step 100, each module constituting the image processing unit 50 constructed by the processing construction unit 42 is stored. The information of the final image processing module 38 of the group is registered in the module list (for example, FIG. Yuru 38 information _{"M 1-3", "M 2-3} ", "M 3-3" indicates the state of being registered in the module list), a buffer list and process in the list stored in the next step 102 To clear.

  In step 104, a variable i for identifying each module group is initialized to 1. In the next step 106, the final image processing module 38 of the module group i is recognized with reference to the module list, and the recognized module group i is recognized. The final image processing module 38 is instructed to execute initialization processing. Thereby, in the final image processing module 38 of the module group i, a variable initialization process for initializing variables used at the time of image processing (for example, a pointer, a counter, intermediate data (for example, a diffusion error value in the dithering process), etc.) Includes reference data preparation processing that prepares reference data to be referred to at the time of processing (for example, generates conversion data to be set in the LUT and sets it in the LUT, or reads the reference data stored in the storage medium in advance into the memory). Initialization processing is performed. This initialization process corresponds to the first initialization process described in claim 1.

  In addition, the final image processing module 38 that has completed the initialization process notifies the previous module of the module that the execution of the initialization process has been instructed. The buffer module 40 is normally present in the previous stage of the final image processing module 38. When the execution of the initialization process is instructed from the module in the subsequent stage of the own module, the buffer module 40 is buffered during the process. An initialization process including a variable initialization process for initializing variables (for example, pointers) used by the control unit 40B and a memory securing process for securing a memory area used as the buffer 40A through the resource management unit 46C is performed. This initialization process corresponds to the second initialization process described in claims 3 and 5. Then, the buffer module 40 that has completed the initialization process notifies the preceding module of the module that the execution of the initialization process has been instructed. As a result, as indicated by white arrows in FIG. 4C, the execution instruction for the initialization process is propagated in order from the final image processing module 38 of the module group i to each module, and each module of the module group i Thus, the above-described initialization process is performed.

  When the initialization process is completed for all modules in the module group i, the process proceeds to step 108, and it is determined whether or not the variable i has reached the module group generation number n. If the determination is negative, the process proceeds to step 110, and after the variable i is incremented by 1, the process returns to step 106. Thus, steps 106 to 110 are repeated until the determination in step 108 is affirmed, and initialization processing is performed in all the module groups of the image processing unit 50. It should be noted that the processing management unit 46 that performs the processing of Step 100 to Step 110 described above, together with the processing construction unit 42 that constructs the image processing unit 50, constructs and initializes according to the present invention. , 5, and the process management unit 46 that performs the processing from step 112 onward is a process management means according to the present invention (more specifically, claims 2 to 7). To process management means).

  In addition, the determination in step 108 is affirmed, and the process proceeds to step 112 to identify a variable i for identifying individual module groups and individual processing units when image data is divided into a plurality of processing units. Are initialized to 1 respectively. In the next step 114, the final image processing module 38 of the module group i is instructed to execute image processing for obtaining data of the processing unit j of the output image (inputs a processing request). In step 116, the processing unit j is processed. Register to the medium list. In the next step 118, it is determined whether or not the variable i has reached the module group generation number n. If the determination is negative, the process proceeds to step 120, and the variable i and the variable j are incremented by 1, respectively, and then the process returns to step 114. Thus, steps 114 to 120 are repeated until the determination in step 118 is affirmed, and execution of image processing for obtaining data of different processing units of the output image is performed for all module groups of the image processing unit 50. Instructed.

  In steps 114 to 120, the processing units are assigned to the individual module groups sequentially. However, the processing units may be assigned in parallel, and in this case, the processing units assigned to the individual module groups are duplicated. In order to avoid this, exclusive control may be performed when determining a processing unit to be assigned to each module group.

  Hereinafter, the processing in each module of the image processing unit 50 when the execution of the image processing is instructed will be described. However, in order to simplify the description, the image data to be processed is three-dimensional image data or a moving image. A case will be described in which individual two-dimensional image data in the image data to be processed is a processing unit.

  As described above, when a processing request is input from the processing management unit 46 (processing flow management unit 46A) (see also (1) in FIG. 3A), the image processing module 38 is a module preceding the own module. The image data is requested to the (usually the buffer module 40) (see also (2) in FIG. 3A). In response to a data request from the subsequent-stage image processing module 38, if more than the unit read data amount is stored in the buffer 40A of the previous-stage buffer module 40, the subsequent-stage image processing module is transferred from the previous-stage buffer module 40. 38 is notified of the start address of the reading area, and reading of image data is requested. As a result, the subsequent image processing module 38 reads the image data of the unit read data amount from the read area of the previous buffer module 40 notified of the head address (see also (3) in FIG. 3A).

  Next, the image processing module 38 requests an area for data output from the module subsequent to the module itself (the image output unit 24 if the final image processing module 38), and the data output area (the module at the subsequent stage is a buffer module). If it is 40, the write area in which the start address is notified from the buffer module 40) can be acquired (see also (4) in FIG. 3A), the image data acquired from the previous module first, The data output area (first address) acquired from the module is input to the image processing engine 38A, and predetermined image processing is performed on the input data (see also (5) in FIG. 3A). The later data is written in the data output area (see also (6) in FIG. 3A). When the input of the unit read data amount to the image processing engine 38A is completed and all the data output from the image processing engine 38A is written in the data output area, the output completion is notified to the subsequent module, and The process request source (process management unit 46) is notified that the process corresponding to the previously input process request has been completed (see also (7) in FIG. 3A). The image processing in the image processing unit 50 is realized by the above processing being repeated in each image processing module 38.

  Further, the buffer control unit 40B of the buffer module 40 is requested when image data is requested from a module (usually the image processing module 38) of its own module (see also (1) in FIG. 3B). It is checked whether or not the image data is stored in the buffer 40A (see also (2) in FIG. 3B). However, if the readable valid data is not stored in the buffer 40A for more than the unit read data amount, Then, the image data is requested to the process management unit 46 (see also (3) in FIG. 3B). The process management unit 46 inputs a process request to the image processing module 38 located in the preceding stage of the buffer module 40 that is the image data request source (see also (4) in FIG. 3B). Then, through the sequence shown in FIG. 3A, the image data is written into the buffer 40A by the image processing module 38 in the previous stage (see also (5) and (6) in FIG. 3B), and from the buffer 40A. When the readable effective data exceeds the unit read data amount, the buffer module 40 notifies the subsequent image processing module 38 of the start address of the reading area, and the subsequent image processing module 38 uses the buffer 40A of the buffer module 40 from the buffer 40A. Image data is read out (see also (7) in FIG. 3B).

  Each image processing module 38 converts the processing unit j of the output image designated at the time of inputting the processing request into the processing unit k of the corresponding input image based on the processing content of the image processing executed by the own module. It has a function. For example, in the image processing module 38 that performs image processing other than image enlargement / reduction or compression / decompression, the input image processing unit k is equal to the output image processing unit j. For example, three-dimensional image data to be processed is processed. In the image processing module 38 that performs image processing that is reduced to 1 / n times in the z-axis direction, the processing unit j of the output image that is instructed is the range of the processing unit k of the input image = nj− ( n-1) to nj. When data is requested from the image processing module 38 to the preceding module, data within the range of the processing unit of the input image obtained by the conversion function (initially, the first data within the range) is requested. . The data request is propagated to the previous module while being converted by the individual image processing module 38, so that the image processing module 38 positioned at the head of each module group is sent to the image data supply unit 22. Of the stored image data to be processed, the processing unit (range) of the input image for causing the final image processing module 38 to output the processing unit data requested from the processing management unit 46 can be recognized. The data of the recognized processing unit is read from the image data supply unit 22.

  On the other hand, when the process management unit 46 instructs execution of image processing to all the module groups of the image processing unit 50 in the previous steps 114 to 120, the determination in step 118 is affirmed and the process proceeds to step 122. It is determined whether or not the end of the whole process (end of image processing for obtaining data of a specific processing unit of the output image instructed earlier) is notified from any of the module groups instructed to execute the image processing. The process management unit 46 repeats step 122 until this determination is affirmed. During this time, every time a data request is input from an arbitrary buffer module 40 of an arbitrary module group, the buffer module 40 that is the data request input source. The processing request is input to the preceding image processing module 38, and each time a processing completion notification is input from the final image processing module 38 of any module group, the processing request is input to the final image processing module 38 again. I do. Thereby, in each module group, image processing for obtaining data of different processing units instructed earlier in the output image is performed independently and in parallel, and the data of each processing unit is sequentially sent to the image output unit 24. Written.

  Further, when the final image processing module 38 of any module group notifies the end of the entire processing (end of the image processing for obtaining data of a specific processing unit of the output image specified earlier), the determination in step 122 is affirmative. Then, the process proceeds to step 124, and the individual buffer modules constituting the module group (the module group including the final image processing module 38 that has notified the end of the entire process) that has completed the image processing for a single processing unit of the output image. 40 information (for example, the address of the memory area constituting the buffer 40A of each buffer module 40) is registered in the save buffer list (see also the save buffer list shown in FIG. 6 as an example).

In the next step 126, it is determined whether or not there is a processing unit in which no image processing is performed (unprocessed) in any module group in the output image. If the determination is affirmative, the process proceeds to step 128, and the same number as the buffer modules 40 provided in the module group for which the image image processing has been completed for a single processing unit of the output image (the information is stored in the storage buffer list in step 124). The same number of buffer modules 40 as the number of registered buffer modules 40 are generated. In step 130, the buffer module 40 additionally generated in step 128 is replaced with the buffer module 40 in which information is registered in the storage buffer list in the previous step 124, and image processing for a single processing unit of the output image is completed. (For example, see also buffer modules B _4-1 and B _4-2 shown in FIG. 6).

  In the next step 132, the final image processing module 38 of the specific module group that has completed the image processing for the single processing unit of the output image is instructed to execute the reinitialization processing. Thereby, the final image processing module 38 of the specific module group performs re-initialization including processing (for example, variable initialization processing) excluding the reference data preparation processing among the initialization processing of the image processing module 38 described above. Processing is performed. This re-initialization process corresponds to the first re-initialization process described in claim 1. In addition, the final image processing module 38 that has completed the reinitialization process notifies the previous module of the module that the execution of the reinitialization process has been instructed. In the buffer module 40 existing in the preceding stage of the final image processing module 38, when the execution of the reinitialization process is instructed from the subsequent module, the buffer module 40 including the variable initialization process and the memory securing process described above. After performing the initialization process, the module in front of the module is notified that execution of the re-initialization process has been instructed.

  As a result, as shown by the white arrow in FIG. 6, the re-initialization processing execution instruction is propagated in order from the final image processing module 38 of the specific module group to each module, and the image processing of the specific module group is performed. Re-initialization processing is performed in the module 38 and initialization processing is performed in the buffer module 40, so that a specific module group can execute image processing for a new processing unit of the output image. Note that the re-initialization process (or initialization process) may be performed in parallel in each module by instructing each module to execute the re-initialization process simultaneously or almost simultaneously from the process management unit 46. Good.

  The reference data preparation process included in the initialization process performed by the image processing module 38 generally takes a long time to process. Depending on the type of image processing performed by the image processing module 38, the reference data preparation process is more than the image processing for image data. Processing time may be long. On the other hand, in particular, in the image processing for 3D image data or moving image data, the same image processing is performed on a large number of 2D image data constituting the 3D image data or moving image data. In most cases, it is not necessary to switch the content of image processing for each two-dimensional image data. Based on the above, in the present embodiment, when an image processing for an arbitrary processing unit of an output image is finished in a certain module group and an unprocessed processing unit remains, individual image processing of the module group is performed. In the module 38, the reinitialization process excluding the reference data preparation process from the initialization process is performed, so that the module group that has finished the image process for an arbitrary processing unit of the output image has a new processing unit for the output image. It is possible to switch to a state where the image processing can be executed in a short time, and the processing efficiency of the image processing in the image processing unit 50 can be improved.

  Thus, for example, when the image data to be processed is moving image data, the low processing efficiency of the image processing in the image processing unit 50 is a factor that hinders the interactivity and real-time property of the moving image data. Therefore, the image processing unit 50 can be applied to image processing for moving image data and three-dimensional image data.

  When a module group that has finished image processing for an arbitrary processing unit of an output image can execute image processing for a new processing unit of the output image in accordance with the execution instruction for the reinitialization processing described above. In step 134, the variable j is incremented by 1. In the next step 136, the output image is output to the final image processing module 38 of the module group that is ready to execute image processing for a new processing unit. The execution of image processing for obtaining data of the processing unit j is instructed, and in the next step 138, the processing unit j is registered in the processing list, and the processing returns to step 122. Thereby, every time a module group that has finished image processing for an arbitrary processing unit of the output image newly appears, the determination in step 122 is affirmed, and the above-described steps 124 to 138 are repeated. If the determination in step 126 is negative, after the image processing has been completed for all the module groups, execution of threads that function as each module group is stopped, and the end of the image processing is notified to the application 32. The process management process ends.

[Second Embodiment]
Next, a second embodiment of the present invention will be described. Since the second embodiment has the same configuration as that of the first embodiment, the same reference numerals are given to the respective parts, description of the configuration is omitted, and the operation of the second embodiment will be described below.

  In the process management unit process (FIG. 5) described in the first embodiment, every time image processing for an arbitrary processing unit of an output image is completed in a certain module group, the buffer of each buffer module 40 of the module group is completed. The information on the memory area used as 40A is registered in the save buffer list, and the image processing results stored in the memory area are saved, but the number of module groups constituting the image processing unit 50, As the number of buffer modules 40 provided in each module group and the amount of image data to be processed increase, a shortage of resources such as a memory area may occur before the image processing in the image processing unit 50 ends. There is a problem that the property becomes high.

Further, in the image processing module 38, the results of image processing for other processing units of the output image by other module groups, such as N × N × N (where N ≧ 2) filter processing, for example, are displayed. Although there is an image processing module 38 that performs image processing with reference, the number n of module groups specified by the application 32 is generated although the image processing unit 50 is constructed to include this type of image processing module 38. Is smaller than the number of image processing results referred to by the image processing module 38, for example, the module group i that performs image processing on the processing unit j ₁ is referred to and required processing unit j _2. while the image processing result for has stopped image processing to not obtained, the image processing of the processing unit j ₂ is the processing unit by module group i j ₁ Deadlock As such image processing with had become the order to be performed by the modules i after the termination occurs, the progress of the image processing in the image processing unit 50 to lead to a stop.

The process management unit process according to the second embodiment solves the above-described problem. Hereinafter, the process management unit process according to the second embodiment will be described with reference to FIG. Hereinafter, as shown in FIG. 8 as an example, the processing construction unit 42 is connected to the image data supply unit 22 to read out image data from the image data supply unit 22 (for example, an image processing module 38). processing module M _1-1, M _1-2), the first image processing module 38 or the first and second buffer module 40 are respectively connected to the rear stage of the second image processing module 38 (e.g., the buffer module B _{1 -1} , B _1-2 ), a third image processing module 38 (for example, an image processing module M _1-3 ) and a third image processing module 38 respectively connected to the subsequent stage of the first and second buffer modules 40. A third buffer module 40 (for example, buffer module B _1-3 ) connected to the subsequent stage, and a third buffer module of the same module group and a plurality of other module groups In the following description, it is assumed that the image processing unit 50 including three module groups each including the fourth image processing module 38 (for example, the image processing module M _1-4 ) connected to the subsequent stage of the module 40 is constructed. In the above configuration, the fourth image processing module 38 corresponds to the image processing module 38 that “performs image processing with reference to the result of image processing for another processing unit by another module group”.

  As shown in FIG. 7, in the process management unit process according to the second embodiment, as in the process management unit process (FIG. 5) described in the first embodiment, the final process of each module group constituting the image processing unit 50 is performed. After the information of the image processing module 38 is registered in the module list (step 100) and the storage buffer list and the processing list are cleared (step 102), the initialization processing is executed for the final image processing module 38 of each module group. (Step 104 to step 110).

  On the other hand, the processing management unit 46 (the workflow management unit 46A) according to the second embodiment, for an arbitrary processing unit of the output image, in addition to the module list, the storage buffer list, and the processing list described in the first embodiment. Each image processing module 38 of the module group that performs the image processing of the image processing unit performs image processing using the image processing result stored in any buffer module 40 of the module group that performs image processing for any processing unit of the output image. Dependency list for registering dependency relationship information indicating whether to perform each processing unit of the output image and each image processing module 38 constituting a single module group, and arbitrary processing of the output image When the image processing for the unit is completed, the buffer module 40 (the buffer 40A of the buffer module 40 in which information is registered in the storage buffer list) Release for registering release condition information indicating conditions for releasing the memory area used for each processing unit of the output image and each buffer module 40 constituting a single module group In the next step 111, information to be registered in the dependency list and release list is generated and registered in each list.

  Note that the dependency relationship information registered in the dependency relationship list can be obtained by the following processing. That is, with respect to a specific image processing module 38, the processing contents of the image processing in the specific image processing module 38, the number of buffer modules 40 connected to the preceding stage of the specific image processing module 38, the specific image processing Based on which module group each buffer module 40 connected to the previous stage of the module 38 belongs to, a specific module group including the specific image processing module 38 is used for a specific processing unit of an output image. When performing image processing, a specific image processing module 38 belongs to any of the buffer modules 40 connected in the previous stage (which belongs to a module group that performs image processing for any processing unit of an output image). Whether to use the image processing result stored in the buffer module 40) Disconnection, and storing a determination result, performs each case a particular module group performs image processing for each processing unit of an output image. Dependency information can be generated by performing the above processing for each image processing module 38 in a single module group.

FIG. 8 schematically shows (part of) the dependency relationship information registered in the dependency relationship list. In FIG. 8 and the like, M _xy is the y-th image processing module 38 in the module group that performs image processing for the output image processing unit x, and B _xy is the module group that performs image processing for the output image processing unit x. Each of the y-th buffer modules 40 means that, for example, the image processing module M _1-3 is associated with the buffer modules B _1-1 and B _1-2 on the dependency relationship list. The third image processing module 38 in the module group that performs image processing for unit 1 performs image processing using the image processing results stored in the first and second buffer modules 40 in the module group. The image processing module M _2-4 is associated with the buffer modules B _1-3 , B _2-3 , and B _{3-3 in} the processing unit 2 of the output image. The fourth image processing module 38 of the module group that performs image processing on the third buffer module 40 of the module group that performs image processing on the output image processing unit 1, and image processing on the output image processing unit 2 The image processing is performed using the image processing results stored in the third buffer module 40 of the module group performing the image processing and the third buffer module 40 of the module group performing the image processing for the processing unit 3 of the output image. Represents what to do.

  The release condition information registered in the release list includes, for example, the dependency relationship information registered in the dependency list, and information on “a specific buffer module 40 of a module group that performs image processing for a specific processing unit of an output image”. Search as a key, extract all the information of the image processing module 38 associated with the information of the buffer module 40 used as the search key, and extract the information of the buffer module used as the search key as individual image processing modules The association with each of the 38 pieces of information can be generated by performing each processing unit of the output image and each buffer module 40 in a single module group.

FIG. 8 also schematically shows (part of) release condition information registered in the release list. For example, the buffer modules B _1-1 and B _1-2 on the release list are image processing modules M _1- Corresponding to ₃ indicates that the memory areas of the buffer modules B _1-1 and B _1-2 can be released when the image processing in the image processing module M _1-3 is completed. The buffer module B _2-3 is associated with the image processing modules M _1-4 , M _2-4 , and M _3-4 on the release list because the memory area of the buffer module B _2-3 is an image. It represents that the image can be released when all the image processing in the processing modules M _1-4 , M _2-4 , and M _3-4 is completed.

Further, in the process management unit process according to the second embodiment, in the next step 112 to step 120, the individual processing of the image processing unit 50 is performed as in the process management unit process (FIG. 5) described in the first embodiment. The module group is instructed in order to execute image processing for obtaining data of processing units different from each other in the output image. In step 114, the data of the processing unit j of the output image is sent to the final image processing module 38 of the module group i. After instructing the execution of the obtained image processing, in the next step 140, among the dependency relationship information registered in the dependency relationship list, the individual image processing modules 38 of the module group that performs image processing for the processing unit j. _Refers to dependency information (dependency information of image processing module M _jx ), and corresponds to each image processing module M _jx with the referenced dependency information It is determined whether or not all attached buffer modules 40 (buffer modules 40 in which individual image processing modules M _jx refer to image processing results) exist.

  If this determination is affirmed, the process proceeds to step 116, but if the determination in step 140 is negative, the process in the image processing unit 50 may stop due to deadlock, and thus the process proceeds to step 142. The module group including the buffer module 40 detected as not existing in step 140 is generated, and the module list is also updated. In step 116, the final image processing module 38 of the additionally generated module group generated in step 142 is instructed to execute initialization processing. Thereby, initialization processing is performed in each module of the additionally generated module group, and the additionally generated module group is in a state where image processing can be executed. In the next step 146, the number of module groups additionally generated in step 142 is added to the module group generation number n, and then the process proceeds to step 116.

The additional generation of the above-described module group will be further described with an example. As apparent from the fact that the image processing module M _3-4 is associated with the buffer modules B _2-3 , B _3-3 , and B _4-3 in the dependency relationship list shown in FIG. The fourth image processing module 38 of the module group that performs image processing for the processing unit 3 is the third buffer module 40 of the module group that performs image processing for the processing unit 2 of the output image, and the processing unit 3 of the output image. The image processing results stored in the third buffer module 40 of the module group that performs the image processing and the third buffer module 40 of the module group that performs the image processing for the output image processing unit 4 are used. Although the image processing is performed, the image processing unit 50 in the state illustrated in FIG. 8 includes a module group that performs image processing for the processing unit 4 of the output image. Razz, since the third buffer module 40 of the modules may not exist, the image processing module M _3-4 is to perform image processing using the image processing results stored in the buffer module B _4-3 It is necessary to wait until the buffer module B _4-3 appears and the image processing result is stored in the buffer module B _4-3 .

  In this example, when the image processing for the processing unit 1 is completed in the module group that has performed the image processing for the processing unit 1 of the output image, the processing is performed after the reinitialization processing is performed by the individual image processing modules 38. Since the image processing for the unit 4 is started, deadlock does not occur. For example, an image processing module 38 that performs image processing using image processing results for a larger number of processing units exists in the module group. If the number n of modules specified at the beginning is smaller, deadlock occurs.

On the other hand, in the process management unit process according to the second embodiment, in the above example, when the execution of the image process is instructed to the module group that performs the image process for the processing unit 3 of the output image, There is no buffer module 40 (third buffer module 40 in the module group that performs image processing for the output image processing unit 4) from which the fourth image processing module 38 in the module group reads out the image processing result. As a result, the determination in step 140 is denied. As an example, as shown in FIG. 9, a new module group including the buffer module 40 (buffer module B _4-3 ) that has been detected not to exist. Are additionally generated, and initialization processing is performed on each module of the additionally generated module group. Then, since execution of image processing is instructed to the additionally generated module group (the final image processing module 38), the constructed image processing unit 50 performs other processing of the output image by other module groups. Even when the image processing module 38 that performs image processing with reference to the result of image processing for each unit is included, it is possible to reliably prevent the occurrence of deadlock.

  Note that the processing management unit 46 that performs the processing of the above-described steps 140 to 146 and the generation of the dependency relationship information and the registration to the dependency relationship list in the previous step 111 corresponds to the processing management unit according to claim 7. is doing. Further, the timing for generating additional module groups is not limited to instructing execution of image processing to individual module groups as described above, and any of the module groups during execution of image processing is not limited. A module including the buffer module 40 that is notified of the absence of the buffer module 40 from which the image processing result is to be read out from any one of the image processing modules 38 Additional groups may be generated.

  Further, in the process management unit process according to the second embodiment, similarly to the process management unit process (FIG. 5) described in the first embodiment, an output image is simply output from the final image processing module 38 of an arbitrary module group. When the end of the image processing for one processing unit is notified (when the determination in step 122 is affirmative), the individual buffers constituting the module group in which the image processing for the single processing unit of the output image is completed After registering the information of the module 40 in the storage buffer list (step 124), in the next step 150, among the release condition information registered in the release list, individual buffer modules whose information is registered in the storage buffer list Each of the 40 release condition lists is referred to, and in the buffer module 40 in which information is registered in the storage buffer list, Ryo determines whether the buffer module 40 is present, which satisfies the release condition releasing condition information indicating the notification.

If this determination is denied, the process proceeds to step 126. If the determination in step 150 is affirmed, the process proceeds to step 152, and the memory area used as the buffer 40A of the buffer module 40 that satisfies the release condition is used as a resource. After releasing through the management unit 46C, the process proceeds to step 152. For example, when it is notified that the image processing has been completed in the module group that has performed image processing for the processing unit 1 of the output image, the image processing in the image processing module M _1-3 in the module group is completed. Therefore, the memory areas of the buffer modules B _1-1 and B _1-2 are released in step 152. On the other hand, with respect to the memory area of the buffer module B _1-3 , the image processing in the image processing module M _2-4 has not been completed although the image processing in the image processing module M _1-4 has been completed. Is not released, but is released when it is notified that the image processing has been completed in the module group that has performed image processing for the output image processing unit 2.

  As described above, in the process management unit process according to the second embodiment, every time it is notified that the image processing for an arbitrary processing unit of the output image is completed in a certain module group, the individual module group Although the information of the buffer module 40 (the memory area used as the buffer 40A) is temporarily registered in the storage buffer list, the buffer module 40 in which information is registered in the storage buffer list based on the release condition information registered in advance in the release list. When it is determined that the reference (reading by the image processing module 38) of the image processing result stored in is completed, the memory area used as the buffer 40A of the buffer module 40 is released, so that the image processing unit 50 The number of module groups constituting the buffer module 40 and the buffer modules 40 provided in the individual module groups Even when the number is relatively large or when the amount of image data to be processed is relatively large, it is possible to prevent a shortage of resources such as a memory area before the image processing in the image processing unit 50 ends. can do. Note that the processing management unit 46 that performs the processing in steps 150 and 152 described above and registers the release condition information in the generation / release list in the previous step 111 corresponds to the processing management unit according to claim 6. ing.

  Further, in the process management unit process according to the second embodiment, as in the process management unit process (FIG. 5) described in the first embodiment, the module group that has finished the image process for a certain processing unit of the output image. When performing image processing on another processing unit of the output image (when an unprocessed processing unit of the output image remains), reinitialization is performed on the final image processing module of the module group. By instructing the execution of processing, the individual image processing modules 38 of the module group perform reinitialization processing in which the reference data preparation processing is excluded from the initialization processing, and the individual buffer modules 40 perform initialization processing. Therefore, as in the first embodiment, the module group is switched to a state in which image processing for a new processing unit of the output image can be executed in a short time, thereby enabling image processing. The processing efficiency of the image processing in the unit 50 can be improved.

In the above, when the image processing for a certain processing unit of the output image is finished in an arbitrary module group, the individual image processing modules 38 of the module group re-exclude the reference data preparation process from the initialization process. Although the mode for performing the initialization process has been described, the present invention is not limited to this. As an example, as shown in FIG. 10, the image processing unit 50 is composed of a plurality of partial image processing units operating on different computers (first / second computers), and the first computer and the second computer communicate with each other through a communication line. when connected via, among the image processing unit 50, an image processing module M _1-2 at a specific image processing module 38 (FIG. 10 that the communication line is present between the adjacent modules, M _{2- 2} , M _3-2 ), as an initialization process, an authentication process for establishing a session between the first computer and the second computer by transmitting / receiving encrypted information to / from the other computer is also performed. Since initialization processing was performed every time image processing for one frame was completed, authentication processing is repeatedly performed when processing three-dimensional image data or moving image data. As well as significantly reduced in image processing by, possibly it is denied established from other computer session for security reasons. Therefore, every time image processing for a certain processing unit of an output image is completed in an arbitrary module group, reference data preparation is performed as re-initialization processing to be performed by the specific image processing module 38 in the module group. In addition to the processing, it is preferable to perform the above-described authentication processing that is excluded from the initialization processing. As a result, the module group that has completed the image processing for a certain processing unit of the output image can execute the image processing for the new processing unit in a short time, and the processing efficiency of the image processing is improved. By rejecting the establishment of the session from the computer, it is possible to prevent the image processing for the image data to be processed from being interrupted. As described above, the process to be performed as the reinitialization process is not limited to the process in which the reference data preparation process is excluded from the initialization process, and the above authentication process and other processes may be added to the exclusion target.

  Further, in the above, when image processing for a certain processing unit of an output image is finished in an arbitrary module group, information on each buffer module 40 (memory area used as the buffer 40A) of the module group is saved. The mode of registering in the buffer list and generating a new buffer module 40 and connecting to the image processing unit 50 in place of the original buffer module 40 (a mode corresponding to the invention of claim 5) has been described. For example, an image processing module 38 that performs image processing with reference to a result of image processing for another processing unit of an output image by another module group exists in the image processing unit 50. However, it is stored in each buffer module 40 of the module group in which image processing for a certain processing unit of the output image is completed. When the reference is not used for the image processing result to be processed, the individual buffer module 40 is caused to perform a process of returning the reference position of the buffer 40A to the head as a reinitialization process. Also good. In this case, since it is not necessary to generate a new buffer module 40, the processing efficiency of image processing can be further improved. The above aspect corresponds to the invention described in claim 3, and the process of returning the buffer reference position to the head in the above aspect corresponds to the second re-initialization process described in claim 3.

  Further, when image processing for a certain processing unit of an output image is finished in an arbitrary module group, reference is used for the image processing result stored in each buffer module 40 of the module group. In the case where (or there is a possibility), a new buffer module 40 is generated, and instead of connecting to the image processing unit 50 instead of the original buffer module 40, a result storage for storing the image processing result A memory area is reserved in advance, and the image processing results stored in the individual buffer modules 40 of the module group that has finished image processing for a certain processing unit of the output image are copied to the result storage memory area. May be saved. In this case, processing for copying the image processing result is required, but processing such as reconnecting the buffer module 40 becomes unnecessary. The above aspect corresponds to the invention described in claim 4.

  In the above description, 3D image data and moving image data have been described as examples of image data to be processed. However, the present invention can also be applied to the case where image processing is performed on 2D image data. Needless to say. In the above description, the embodiment in which the present invention is applied to the image processing unit 50 including a plurality of module groups that can operate independently from each other has been described. For example, as illustrated in FIGS. It is also possible to apply the present invention to an image processing unit having a configuration including the module group.

  In the above description, the image processing program group 34 corresponding to the image processing program according to the present invention has been described in advance as being stored (installed) in the storage unit 20 or the like of the computer 10. It is also possible to provide the information recorded in a recording medium such as a CD-ROM or a DVD-ROM.

It is a block diagram which shows schematic structure of the computer (image processing apparatus) which concerns on this embodiment. It is a block diagram which shows the structural example of an image process part. (A) is an image processing module, and (B) is a block diagram showing a schematic configuration of a buffer module and processing to be executed. It is the schematic for demonstrating construction | assembly and initialization of an image process part. It is a flowchart which shows the content of the process management part process which concerns on 1st Embodiment. It is the schematic for demonstrating a process when an image process is complete | finished about the single process unit in a certain module group of an image process part. It is a flowchart which shows the content of the process management part process which concerns on 2nd Embodiment. It is the schematic which each shows an example of the content of the image process part which concerns on 2nd Embodiment, and various lists. . It is the schematic which shows the additional production | generation of the module group in 2nd Embodiment. It is the schematic for demonstrating the initialization process and re-initialization process in case an image process part consists of several module groups which operate | move on a mutually different computer.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Computer 14 Memory 20 Storage part 22 Image data supply part 24 Image output part 34 Image processing program group 38 Image processing module 40 Buffer module 42 Process construction part 46 Process management part 50 Image processing part

Claims (11)

A plurality of types of image processing modules that perform different image processing on the image data acquired from the previous stage of the own module, and output the image data that has undergone the image processing or the processing result of the image processing to the subsequent stage of the own module, and Storage means for storing each of the programs of the buffer modules for causing the image data output from the previous module to be written in the buffer and for causing the image data stored in the buffer to be read by the subsequent module;
According to the program stored in the storage means, the buffer module is provided in at least one of the preceding stage and the succeeding stage of each of the one or more image processing modules selected from the plurality of types of image processing modules, and each module is piped A variable initialization process and an image for initializing variables used at the time of image processing in the image processing module of the constructed image processing unit after constructing an image processing unit connected in a line form or a directed acyclic graph form Construction / initialization means for performing a first initialization process including a reference data preparation process for preparing reference data to be referred to during processing;
The image processing on the processing target image data is performed by the image processing unit for each processing unit when the processing target image data is divided into a plurality of processing units, and the image processing unit Each time the image processing for the processing unit is completed, the image processing module of the image processing unit performs a first reinitialization process excluding the reference data preparation process from the first initialization process. And processing management means for causing the image processing unit to perform image processing for an unprocessed processing unit in the processing target image data.
An image processing apparatus. The construction / initialization means constructs an image processing unit composed of a plurality of module groups operable independently of each other,
The processing management unit causes each module group of the image processing unit to perform image processing for different processing units, and completes image processing for a single processing unit in any of the plurality of module groups. Each time the image processing module of the module group in which image processing is completed performs the first re-initialization processing, the image processing for the unprocessed processing unit in the processing target image data is performed. The image processing apparatus according to claim 1, wherein the image processing is performed in a module group for which the image processing has been completed. The construction / initialization unit performs a second initialization process including a process of securing a memory area used as the buffer in the buffer module of the constructed image processing unit after constructing the image processing unit. Let
Each time the image processing unit completes image processing for the single processing unit, the processing management unit performs a second re-transmission of returning the buffer reference position to the top in the buffer module of the image processing unit. The image processing apparatus according to claim 1, wherein initialization processing is performed.   The processing management means stores the image processing result stored in the memory area used as the buffer of the buffer module in another memory area before causing the buffer module to perform the second re-initialization process. The image processing apparatus according to claim 3, wherein the image processing result is stored by copying. The construction / initialization unit performs a second initialization process including a process of securing a memory area used as the buffer in the buffer module of the constructed image processing unit after constructing the image processing unit. Let
The processing management means saves the memory area used as the buffer in the existing buffer module of the image processing unit each time image processing for the single processing unit is completed in the image processing unit, and A new buffer module is generated, the generated new buffer module is connected to the image processing unit instead of the existing buffer module, and the second initialization process is performed in the new buffer module. The image processing apparatus according to claim 2. The construction / initialization unit includes an image processing unit including a plurality of module groups that are configured in the same manner and connected to perform image processing with reference to an image processing result for another processing unit by another module group. Build and
The processing management means, for a specific processing unit of the processing target image data, the image processing result stored in the buffer of each buffer module of any module group that has performed image processing for the specific processing unit, It is determined for each processing unit of the processing target image data that the processing unit for performing the image processing for which processing unit of the processing target image data is referred to, and the determination result is stored. After the image processing unit, each image group of the image processing unit is caused to perform image processing for different processing units, and each time the image processing for an arbitrary processing unit is completed in any one of the plurality of module groups, the data is stored. Based on the determination result, the image processing result stored at the end of the image processing is referred to by another module group. Finished buffer determines whether appeared, corresponding image processing apparatus of the buffer releases the memory area which has been used as the applicable buffer when it is determined that emerged claim 4 or claim 5, wherein. The construction / initialization unit includes an image processing unit including a plurality of module groups that are configured in the same manner and connected to perform image processing with reference to an image processing result for another processing unit by another module group. Build and
The processing management unit is configured such that an arbitrary module group that performs image processing on a specific processing unit of a specific processing unit of the processing target image data is an image for any processing unit of the processing target image data. Whether to refer to the image processing result stored in the buffer of the buffer module included in the module group to be processed is determined, and the determination result is stored for each processing unit of the image data to be processed Later, each module group of the image processing unit is instructed to execute image processing for different processing units, and based on the stored determination result, an image processing result referred to by a specific module group to be subjected to image processing For each module group to be processed by the image processing, If it is determined that there is a non-existing buffer, a module group including the non-existing buffer is additionally generated, and the additional generated module group provides an image processing result referred to by the specific module group. The image processing apparatus according to claim 4, wherein image processing is performed on the processing unit. The construction / initialization means includes: a first module group that operates on a first computer; and a second module group that operates on a second computer connected to the first computer via a communication line. When the image processing unit including the image processing unit is constructed, in the specific image processing module in which the communication line exists between adjacent modules among the constructed image processing units, between the first computer and the second computer. To perform a first initialization process including an authentication process for establishing a session,
The processing management means, in the specific image processing module of the image processing unit, from the first initialization processing to the processing each time image processing for the single processing unit is completed in the image processing unit. The image processing apparatus according to claim 1, wherein the first re-initialization process excluding the authentication process is performed.   The image processing apparatus according to any one of claims 1 to 8, wherein the image data to be processed is three-dimensional image data or moving image data representing a three-dimensional image. The storage means performs different image processing on the image data acquired from the previous stage of the own module, and outputs the image data that has undergone the image processing or the processing result of the image processing to the subsequent stage of the own module. A module and a buffer module program for causing the image data output from the previous module to be written to the buffer and reading the image data stored in the buffer by the subsequent module;
The construction / initialization means includes the buffer module in at least one of the preceding stage and the succeeding stage of each of the one or more image processing modules selected from the plurality of types of image processing modules according to the program stored in the storage means. After constructing an image processing unit in which each module is connected in a pipeline form or a directed acyclic graph form, the variables used at the time of image processing are initialized in the image processing module of the constructed image processing unit A first initialization process including a variable initialization process to be performed and a reference data preparation process for preparing reference data to be referred to during image processing;
The processing management unit causes the image processing unit to perform image processing on the processing target image data for each processing unit when the processing target image data is divided into a plurality of processing units. Each time image processing for a single processing unit is completed, the image processing module of the image processing unit performs a first re-exclusion of the reference data preparation processing from the first initialization processing. An image processing method for causing an image processing unit to perform image processing for an unprocessed processing unit in the processing target image data after performing initialization processing. A plurality of types of image processing modules that perform different image processing on the image data acquired from the previous stage of the own module, and output the image data that has undergone the image processing or the processing result of the image processing to the subsequent stage of the own module, and A computer having storage means for storing each of the programs of the buffer module that causes the image data output from the previous module to be written to the buffer and the image data stored in the buffer to be read by the subsequent module;
According to the program stored in the storage means, the buffer module is provided in at least one of the preceding stage and the succeeding stage of each of the one or more image processing modules selected from the plurality of types of image processing modules, and each module is piped A variable initialization process and an image for initializing variables used at the time of image processing in the image processing module of the constructed image processing unit after constructing an image processing unit connected in a line form or a directed acyclic graph form Construction / initialization means for performing a first initialization process including a reference data preparation process for preparing reference data to be referred to during processing;
In addition, image processing on the processing target image data is performed by the image processing unit for each processing unit when the processing target image data is divided into a plurality of processing units. Each time image processing for one processing unit is completed, a first reinitialization process in which the reference data preparation process is excluded from the first initialization process in the image processing module of the image processing unit. An image processing program for causing the image processing unit to perform image processing on an unprocessed processing unit in the processing target image data after the image processing is performed.

Images