JP5880418B2 - Image processing apparatus and program - Google Patents

Description

  The present invention relates to an image processing apparatus and a program.

  There are image processing apparatuses that perform image processing such as format conversion, color conversion, enlargement, reduction, etc. on an image. Japanese Patent Application Laid-Open No. 2004-228561 describes a technique for interpreting an execution order represented by a script and executing image processing in the interpreted execution order. Patent Document 2 describes a technique for converting an acquired image into a plurality of types of images designated by instructions.

JP 2001-243460 A JP 2004-112514 A

  One of the objects of the present invention is to allow a user to create image processing instruction information in which a plurality of image processing execution instructions are described without being conscious of the type of attribute used in the image processing instruction. It is in.

  The invention according to claim 1 is an image processing apparatus, wherein an acquisition unit that acquires identification information of a plurality of image processes and image processing instruction information in which a conditional branch is described, and a condition in the conditional branch For each, a first setting means for setting an instruction associated with the identification information described in the image processing instruction information to be executed when a condition is satisfied as an instruction to be executed, and the conditional branch For each of the above conditions, the execution result of the instruction set by the first setting means is returned as an instruction to be executed after the instruction set by the first setting means is executed. A second setting means for setting an instruction to return as a value and returning a return value indicating that there is no value when the condition is not satisfied; and the first setting means for all the conditions in the conditional branch and Of the return values of the instructions set by the second setting means for each of the conditions in the conditional branch as instructions executed after the instruction set to be executed by the second setting means is executed A third setting means for setting an instruction to return a return value different from a return value indicating no value as a final return value in an instruction according to the image processing instruction information; and the first setting means, The second setting means and the execution means for executing the command set by the third setting means are included.

  A second aspect of the present invention is the image processing apparatus according to the first aspect, wherein each of the conditions in the conditional branch is executed before the instruction set by the first setting means is executed. If the condition is satisfied, the execution result of the instruction executed before the instruction is returned as a return value. If the condition is not satisfied, an instruction that returns a return value indicating no value is set. And a fourth setting unit, wherein the execution unit executes the command set by the first setting unit, the second setting unit, the third setting unit, and the fourth setting unit. Is.

  The invention according to claim 3 is the image processing apparatus according to claim 1 or 2, wherein the image processing instruction information includes identification information of image processing executed before conditional branching, The first setting means may execute an instruction associated with the identification information described in the image processing instruction information to be executed before conditional branching when the condition is satisfied. An instruction executed before the instruction associated with the identification information described in the information is set, and the third setting means describes the image processing executed when satisfied in the image processing instruction information. When there is a condition in the conditional branch that has not been executed, after the instruction set to be executed by the first setting means and the second setting means is executed for all of the conditions in the conditional branch Executed If the return value of the instruction set by the second setting means for each of the conditions in the conditional branch is a return value indicating that there is no value, the instruction is executed before the conditional branch Is to set a command that returns a return value of a command associated with the identification information described in the image processing instruction information as a final return value in a command corresponding to the image processing instruction information. is there.

  A fourth aspect of the present invention is the image processing apparatus according to any one of the first to third aspects, wherein the execution means is provided when each of the conditions in the conditional branch does not satisfy the condition. Further, it includes suppression means for suppressing output of an error that occurs when an instruction is executed.

  The invention according to claim 5 is a program, wherein each of the plurality of image processing identification information, the acquisition means for acquiring the image processing instruction information describing the conditional branch, and each of the conditions in the conditional branch, A first setting means for setting an instruction associated with the identification information described in the image processing instruction information to be executed when a condition is satisfied, as an instruction to be executed; For each of the instructions executed after the instruction set by the first setting means is executed, the execution result of the instruction set by the first setting means is returned as a return value when the condition is satisfied. Second setting means for setting an instruction to return a return value indicating that there is no value when the condition is not satisfied, the first setting means for all the conditions in the conditional branch, and the first As an instruction to be executed after an instruction set to be executed by the setting means is executed, a value among the return values of the instructions set by the second setting means for each of the conditions in the conditional branch is A third setting means, a first setting means, and a second setting for setting an instruction to return a return value different from a return value indicating that there is no return value as a final return value in an instruction corresponding to the image processing instruction information The computer is caused to function as a means and an execution means for executing the instruction set by the third setting means.

  According to the first and fifth aspects of the present invention, the user can create image processing instruction information in which a plurality of image processing execution instructions are described without being aware of the attribute type used in the image processing instruction. It becomes.

  According to the second aspect of the present invention, the processing load is reduced as compared with the case where the present configuration is not provided.

  According to the third aspect of the present invention, even when there is a conditional branch condition in which the image processing to be executed when satisfied is not described in the image processing instruction information, the user can Image processing instruction information describing a plurality of image processing execution instructions can be created without being conscious of the type of attribute used.

  According to the fourth aspect of the present invention, it is possible to prevent an error occurring for an instruction set in association with a condition that is not satisfied from being output.

It is a functional block diagram which shows an example of the function implement | achieved by the image processing apparatus which concerns on one Embodiment of this invention. It is a figure which shows an example of an image processing instruction document. It is the figure which showed typically an example of the content described in the image processing instruction sheet. It is a flowchart which shows an example of the flow of the process performed by the image processing apparatus which concerns on one Embodiment of this invention. It is a figure which shows an example of a subpipeline typically. It is a flowchart which shows an example of the flow of the process performed by the image processing apparatus which concerns on one Embodiment of this invention. It is the figure which showed typically an example of the content described in the image processing instruction sheet. It is a figure which shows an example of a subpipeline typically. It is the figure which showed typically an example of the content described in the image processing instruction sheet. It is a figure which shows an example of a subpipeline typically. It is a figure which shows an example of a subpipeline typically.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a functional block diagram illustrating an example of functions realized by the image processing apparatus 10 according to the present embodiment. As illustrated in FIG. 1, the image processing apparatus 10 according to the present embodiment functionally includes, for example, an acquisition unit 12, an interpretation unit 14, and an execution unit 16.

  The image processing apparatus 10 according to the present embodiment is, for example, a personal computer, a control unit that is a program control device such as a CPU that operates according to a program installed in the image processing apparatus 10, a storage element such as a ROM or a RAM, A storage unit such as a hard disk drive, a display, a keyboard, a mouse, and the like are included. The function of each unit illustrated in FIG. 1 is executed by the control unit of the image processing apparatus 10 including a command that is installed in the image processing apparatus 10 that is a computer and that includes a command corresponding to the function of each unit illustrated in FIG. It is realized by. This program is supplied to the image processing apparatus 10 via a computer-readable information storage medium such as an optical disk, a magnetic disk, a magnetic tape, a magneto-optical disk, or a flash memory, or via communication means such as the Internet. .

  The acquisition unit 12 acquires image processing instruction information describing a plurality of image processing execution instructions. In the present embodiment, for example, the acquisition unit 12 acquires the image processing instruction sheet 20 illustrated in FIG. 2 that is stored in advance in the storage unit of the image processing apparatus 10 as an example of image processing instruction information.

The image processing instruction sheet 20 illustrated in FIG. 2 is an XML document. In the image processing instruction sheet 20 according to the present embodiment, a plurality of pieces of image processing identification information and conditional branches are described. FIG. 3 is a diagram schematically illustrating an example of contents described in the image processing instruction sheet 20 illustrated in FIG. The image processing instruction sheet 20 illustrated in FIG. 2 describes the following processing. In FIG. 2, for each of the following processes, the number assigned to the process in the following description and the position in the image processing instruction sheet 20 where the character string corresponding to the process is described. The same number is arranged.
(1-1) The image processing apparatus 10 sets the file path “/tmp/input.tiff” as information indicating the location of the file input storage that is the output source of the byte stream.
(1-2) The image processing apparatus 10 reads the information from the file input storage set in (1-1) by interpreting the byte stream as the TIFF format.
(1-3) The image processing apparatus 10 acquires image information from the byte stream read in (1-2).
(1-4) The image processing apparatus 10 acquires the number of bits per channel from the image information acquired in (1-3).
(1-5) When the number of bits acquired in (1-4) is 1, the image processing apparatus 10 converts the image into 8 bits.
(1-6) The image processing apparatus 10 grays an image when the number of bits acquired in (1-4) is not 1.
(1-7) The image processing apparatus 10 sets the file path “/tmp/output.jpg” as information indicating the location of the file output storage that is the output destination of the byte stream.
(1-8) The image processing apparatus 10 writes the byte stream of the 8-bit or grayed image in the JPEG format in the file output storage set in (1-7).
(1-9) The image processing apparatus 10 executes the command set as described above.

  In this embodiment, one or a plurality of instructions serving as a processing unit is managed as a module such as an image processing library. A program corresponding to the module is stored in the storage unit of the image processing apparatus 10 in advance. Then, the interpreter 14 interprets the image processing instruction sheet 20 and constructs a pipeline composed of a plurality of modules. Further, the pipeline according to the present embodiment may be composed of a plurality of sub-pipelines.

  In the present embodiment, the interpretation unit 14, for example, processes (1-1) to (1-4) described above (1-1) to (1-4) that are processes up to conditional branching. A sub-pipeline composed of modules associated with the respective processes is constructed in which the order is defined as the execution order. Then, the interpretation unit 14 performs processing executed when the condition is satisfied for each of the conditions in the conditional branch as the sub-pipeline subsequent to the sub-pipeline (1-5), ( 1-6) are connected to sub pipelines (here, for example, two sub pipelines). The processes (1-5) and (1-6) described above correspond to the portion in the area surrounded by the broken line in FIG. Then, the interpretation unit 14 defines the above-described order (1-7) and (1-8) as the execution order as a sub-pipeline subsequent to the sub-pipeline group configured as described above. A sub-pipeline composed of modules associated with each process is connected. In this way, a pipeline composed of a plurality of sub-pipelines is constructed.

  Then, the execution unit 16 executes an instruction corresponding to the pipeline constructed by the interpretation unit 14. In the present embodiment, for example, in order from the first module that configures the pipeline, the output of the module is used as an input to a module that follows the module, and thus corresponds to the entire module group that configures the pipeline. The instruction will be executed.

  Here, an example of the flow of the construction process of the sub-pipeline associated with the process executed when the condition is satisfied for each condition in the conditional branch by the interpretation unit 14 is illustrated in FIG. This will be described with reference to the drawings.

  First, the interpretation unit 14 determines a module corresponding to an instruction for copying and branching an image to be input to the constructed sub-pipeline as many as the number of conditions in the conditional branch (here, n, for example) as the first module. (S101). Thereby, in this embodiment, for example, the input image can be referred to from each element of the array ary having n elements. Each element of the array ary will be referred to as ary [0] to ary [n−1].

  Then, the interpretation unit 14 sets 0 as the value of the condition number counter i (S102). And the interpretation part 14 confirms whether the value of the counter i is less than n (S103). If the value of the counter i is less than n (S103: Y), the first condition is set as a module following the (i + 1) th branch, that is, the ary [i] that is the (i + 1) th array element. A determination module is connected (S104). Here, when the (i + 1) th condition in the conditional branch is satisfied, the first condition determination module returns the execution result of the immediately preceding process as a return value, and does not satisfy the (i + 1) th condition in the conditional branch. Is a module corresponding to an instruction that returns a return value indicating no value, that is, returns Null as a return value.

  Then, the interpretation unit 14 is one or a plurality of image processing units corresponding to image processing described to be executed when the (i + 1) th condition in the conditional branch is satisfied as a module subsequent to the first condition determination module. Modules (sub-pipelines) are connected (S105). The process shown in S105 is, for example, an input module to one or a plurality of modules (sub-pipelines) corresponding to image processing described to be executed when the (i + 1) th condition in the conditional branch is satisfied The name is changed to the name of the first condition determination module, and then the sub pipeline is constructed.

  Then, the interpretation unit 14 connects the second condition determination module as a module subsequent to the one or more modules (sub-pipelines) connected in the process shown in S105 (S106). Here, when the (i + 1) th condition in the conditional branch is satisfied, the second condition determination module returns the execution result of the immediately preceding process as a return value, and does not satisfy the (i + 1) th condition in the conditional branch. Is a module corresponding to an instruction that returns a return value indicating no value, that is, returns Null as a return value.

  Then, the interpretation unit 14 replaces ary [i], which is the (i + 1) th array element, with the output of the second condition determination module (S107).

  Then, the interpretation unit 14 increments the value of the counter i by 1 (S108), and returns to the process shown in S103.

  When it is confirmed in the process shown in S103 that the value of the counter i is not less than n (S103: N), the interpretation unit 14 sets ary [i] (here, the (i + 1) th array element) Among the outputs (return values) of the second condition determination module), a module that outputs a non-Null one with the smallest value i is a pipe constructed by the processing shown in S101 to S108 described above. It is set as a module to be executed after execution of the modules constituting the line (S109), and the processing shown in this processing example is ended. In the sub-pipeline constructed in this way, among the (i + 1) -th array elements, ary [i], the non-null ones with the smallest value i are output, and these elements are It becomes an input to the sub pipeline following the sub pipeline constructed as described above.

  As described above, in the present embodiment, it is described in the image processing instruction sheet 20 that the interpretation unit 14 is executed when each condition in the conditional branch is satisfied in the process shown in S105. An instruction associated with the identification information is set as an instruction to be executed.

  In the present embodiment, in the process shown in S104, the interpretation unit 14 executes an instruction set as an instruction corresponding to the sub-pipeline connected in the process shown in S105 for each condition in the conditional branch. As an instruction to be executed before the execution, the execution result of the instruction executed before the instruction is returned as a return value when the condition is satisfied, and a return value indicating that there is no value when the condition is not satisfied ( Here, an instruction to return (Null) is set.

  In the present embodiment, in the process shown in S106, the interpretation unit 14 is executed after the instruction corresponding to the sub-pipeline connected in the process shown in S105 is executed for each condition in the conditional branch. As an instruction, an execution result of an instruction set as an instruction to be executed is returned as a return value when the condition is satisfied, and a return value (in this case, Null) indicating that there is no value when the condition is not satisfied Set the instruction to return.

  In the present embodiment, the interpretation unit 14 is executed after the instruction set to be executed in the process shown in S101 to S108 is executed for all the conditions in the conditional branch in the process shown in S109. As an instruction, an instruction that returns a non-null return value among return values for each condition in a conditional branch as a final return value in the sub-pipeline constructed as described above is set.

  FIG. 5 is a diagram schematically illustrating an example of a sub-pipeline corresponding to the processes (1-5) and (1-6) described above in the image processing instruction sheet illustrated in FIG. 2 by the process described above. is there. FIG. 5 shows two sub-pipelines that are divided into upper and lower parts.

  On the left side of the upper sub-pipeline shown in FIG. 5, if the number of bits of ary [0] is 1, ary [0] is returned as the return value and input to the 8-bit module. It has been shown that Further, when the number of bits of ary [0] is not 1, Null is returned as a return value, indicating that it is an input to the 8-bit module. In this case, since Null is input to the 8-bit conversion, the 8-bit conversion is not executed.

  Also, on the right side of the upper sub-pipeline shown in FIG. 5, when the number of bits of ary [0] is 1, bitconv0, which is the return value of 8-bit conversion for ary [0], is When set to [0] and the number of bits of ary [0] is not 1, it is indicated that Null is set to ary [0].

  Also, on the left side of the lower sub-pipeline shown in FIG. 5, if the number of bits of ary [1] is not 1, ary [1] is returned as a return value, and It is shown to be input. Also, when the number of bits of ary [1] is 1, Null is returned as a return value, indicating that it is an input to the graying module. In this case, since Null is input to the graying, the graying is not executed.

  In addition, on the right side of the lower sub-pipeline illustrated in FIG. 5, when the number of bits of ary [1] is not 1, gray0 which is the graying return value for ary [1] is set to ary [1]. 1] and the number of bits of ary [1] is 1, it is indicated that Null is set to ary [1].

  At the right end of FIG. 5, the first non-Null element of ary [0] or ary [1] becomes an input to the sub-pipeline that follows the sub-pipeline shown in FIG. 5. It is shown.

  Next, another example of the flow of the pipeline construction process associated with the process executed when the condition is satisfied for each condition in the conditional branch by the interpretation unit 14 is illustrated in FIG. This will be described with reference to a flow diagram.

  First, the interpretation unit 14 determines a module corresponding to an instruction for copying and branching an image to be input to the constructed sub-pipeline as many as the number of conditions in the conditional branch (here, n, for example) as the first module. (S201). Thereby, in this embodiment, for example, the input image can be referred to from each element of the array ary having n elements. Each element of the array ary will be referred to as ary [0] to ary [n−1].

  Then, the interpretation unit 14 sets 0 as the value of the condition number counter i (S202). And the interpretation part 14 confirms whether the value of the counter i is less than n (S203). If the value of the counter i is less than n (S203: Y), the (i + 1) th branch, that is, the (i + 1) th array element, ary [i], is replaced with the (i + 1) th in the conditional branch. One or a plurality of modules (sub-pipelines) corresponding to image processing described to be executed when the above condition is satisfied are connected (S204). The processing shown in S204 is implemented, for example, by changing the input module name to the sub-pipeline to the (i + 1) th array element ary [i] and then constructing the sub-pipeline.

  Then, the interpretation unit 14 connects the condition determination module in this processing example as a module subsequent to one or more modules (sub-pipelines) connected in the process shown in S204 (S205). Here, with the condition determination module connected in the process shown in S205, when the (i + 1) th condition in the conditional branch is satisfied, the execution result of the immediately preceding process is returned as a return value, and (i + 1) in the conditional branch. When the second condition is not satisfied, the module returns a return value indicating that there is no value, that is, a module corresponding to an instruction that returns Null as a return value.

  Then, the interpretation unit 14 replaces ary [i], which is the (i + 1) th array element, with the output of the condition determination module (S206).

  Then, the interpretation unit 14 increments the value of the counter i by 1 (S207), and returns to the process shown in S203.

  In the process shown in S203, when it is confirmed that the value of the counter i is not less than n (S203: N), the interpretation unit 14 sets ary [i] (here, the (i + 1) th array element) Among the outputs (return values) of the condition determination module), a module that outputs a non-Null one with the smallest value i is a pipeline constructed by the processing shown in S201 to S207 described above. The module is set as a module to be executed after execution of the module to be configured (S208), and the processing shown in this processing example is ended. In the sub-pipeline constructed in this way, among the (i + 1) -th array elements, ary [i], the non-null ones with the smallest value i are output, and these elements are It becomes an input to the sub pipeline following the sub pipeline constructed as described above.

FIG. 7 is a diagram schematically illustrating an example of contents described in the image processing instruction sheet 20 that is a target of the processing shown in S201 to S208. As shown in FIG. 7, the following processing is described in the image processing instruction sheet 20 that is the target of the processing shown in S <b> 201 to S <b> 208.
(2-1) The image processing apparatus 10 sets the file path “/tmp/input.tiff” as information indicating the location of the file input storage that is the output source of the byte stream.
(2-2) The image processing apparatus 10 reads the information from the file input storage set in (2-1) by interpreting the byte stream as the TIFF format.
(2-3) The image processing apparatus 10 acquires image information from the byte stream read in (2-2).
(2-4) The image processing apparatus 10 acquires the number of bits per channel from the image information acquired in (2-3).
(2-5) When the number of bits acquired in (2-4) is 1, the image processing apparatus 10 uses the file path “/tmp/input.jpeg” as a file serving as an output source of a new byte stream. Set as information indicating the location of the input storage.
(2-6) The image processing apparatus 10 reads the information by interpreting the byte stream as the JPEG format from the file input storage set in (2-5).
(2-7) The image processing apparatus 10 grays an image when the number of bits acquired in (2-4) is not 1.
(2-8) The image processing apparatus 10 sets the file path “/tmp/output.jpg” as information indicating the location of the file output storage that is the output destination of the byte stream.
(2-9) The image processing apparatus 10 adds the byte stream read from the file input storage set in (2-5) to the file output storage set in (2-8), or (2- 7) Write the byte stream of the image grayed out in JPEG format.
(2-10) The image processing apparatus 10 executes the command set as described above.

  In the above-described example, for example, the interpretation unit 14 processes (2-1) to (2-4) described above (2-1) to (2-4) as processes up to conditional branching. A sub-pipeline composed of modules associated with the respective processes is constructed in which the order is defined as the execution order. Then, the interpretation unit 14 is a process executed when the condition is satisfied for each of the conditions in the conditional branch as a sub-pipeline subsequent to the sub-pipeline. 2-7) are connected to sub pipelines (here, for example, two sub pipelines). The processes (2-5) to (2-7) described above correspond to the portion in the area surrounded by the broken line in FIG. Then, the interpretation unit 14 defines the execution order of the above (2-8) and (2-9) as the sub-pipeline subsequent to the sub-pipeline group configured as described above. A sub-pipeline composed of modules associated with each process is connected. In this way, a pipeline composed of a plurality of sub-pipelines is constructed.

  Then, the execution unit 16 executes an instruction corresponding to the pipeline constructed by the interpretation unit 14. In the present embodiment, for example, in order from the first module that configures the pipeline, the output of the module is used as an input to a module that follows the module, and thus corresponds to the entire module group that configures the pipeline. The instruction will be executed.

  FIG. 8 is a diagram schematically illustrating an example of a sub-pipeline corresponding to the processes (2-5) to (2-7) described above. FIG. 8 shows two sub-pipelines that are divided into upper and lower parts.

  In the upper sub-pipeline illustrated in FIG. 8, when the number of bits of ary [0] is 1, read1 that is a return value of JPEG reading is set to ary [0], and ary [0] ] Is not set to 1, it is indicated that Null is set to ary [0].

  In the lower sub-pipeline shown in FIG. 8, when the number of bits of ary [1] is not 1, gray0 which is the graying return value for ary [1] is set to ary [1]. When the number of bits of the TIFF image input to the pipeline is 1, it is indicated that Null is set to ary [1].

  At the right end of FIG. 8, the first non-Null element of ary [0] or ary [1] becomes an input to the sub-pipeline that follows the sub-pipeline shown in FIG. It is shown.

  In the processing shown in S201 described above, the number of conditions in the conditional branch is 1 instead of the module corresponding to the instruction that replicates and branches the input image by the number of conditions in the conditional branch (here, n, for example). A module corresponding to an instruction for copying and branching the input image by the added number (here, for example, n + 1) may be set as the first module.

FIG. 9 shows the processing target when the module corresponding to the instruction that duplicates and branches the input image by the number of conditions in the conditional branch plus 1 (here, for example, n + 1) is set as the first module. It is the figure which showed typically an example of the content described in the image processing instruction sheet 20 used. As shown in FIG. 9, when a module corresponding to an instruction that duplicates and branches an input image by a number (in this case, for example, n + 1) added to the number of conditions in the conditional branch is set as the first module. The following processing is described in the image processing instruction sheet 20 to be processed.
(3-1) The image processing apparatus 10 sets the file path “/tmp/input.tiff” as information indicating the location of the file input storage that is the output source of the byte stream.
(3-2) The image processing apparatus 10 reads the information from the file input storage set in (3-1) by interpreting the byte stream as the TIFF format.
(3-3) The image processing apparatus 10 acquires image information from the byte stream read in (3-2).
(3-4) The image processing apparatus 10 acquires the number of bits per channel and the number of channels from the image information acquired in (3-3).
(3-5) When the product of the number of bits acquired in (3-4) and the number of channels is 1, the image processing apparatus 10 converts the image into 8 bits.
(3-6) If the product of the number of bits and the number of channels acquired in (3-4) is 32, the image processing apparatus 10 converts the image into YCbCr.
(3-7) The image processing apparatus 10 sets the file path “/tmp/output.jpg” as information indicating the location of the file output storage that is the output destination of the byte stream.
(3-8) The image processing apparatus 10 stores, in the file output storage set in (3-7), an 8-bit image in (3-5), an YCbCr image in (3-6), Alternatively, a byte stream of an image for which the above processing (3-5) or (3-6) has not been executed is written in the JPEG format.
(3-9) The image processing apparatus 10 executes the command set as described above.

  In the above description, the number of channels refers to the number of components in the image color space. For example, the number of image channels represented by pixel values in the CMYK color space is four. The number of channels of the image expressed in the RGB color space and the YCbCr color space is 3, and the number of channels of the image expressed in the gray scale is 1.

  Further, in (3-8) in the above description, when the product of the number of bits acquired in (3-4) and the number of channels is neither 1 nor 32, the above (3-5) or (3-6) A byte stream of an image that has not been processed is written out in JPEG format.

  In the above-described example, for example, the interpretation unit 14 processes (3-1) to (3-4) described above (3-1) to (3-4) for the processes up to conditional branching. A sub-pipeline composed of modules associated with the respective processes is constructed in which the order is defined as the execution order. Then, the interpretation unit 14 performs processing executed when the condition is satisfied for each of the conditions in the conditional branch as a sub-pipeline subsequent to the sub-pipeline (3-5), ( 3-6) are connected to sub pipelines (here, for example, three sub pipelines). The processes (3-5) and (3-6) described above correspond to the portion in the area surrounded by the broken line in FIG. Then, the interpretation unit 14 defines the order of the above (3-7) and (3-8) as the execution order as a sub-pipeline subsequent to the sub-pipeline group configured as described above. A sub-pipeline composed of modules associated with each process is connected. In this way, a pipeline composed of a plurality of sub-pipelines is constructed.

  Then, the execution unit 16 executes an instruction corresponding to the pipeline constructed by the interpretation unit 14. In the present embodiment, for example, in order from the first module that configures the pipeline, the output of the module is used as an input to a module that follows the module, and thus corresponds to the entire module group that configures the pipeline. The instruction will be executed.

  FIG. 10 is a diagram schematically illustrating an example of a pipeline corresponding to the processes (3-5) and (3-6) described above. FIG. 10 shows three sub-pipelines divided into upper, middle, and lower sides.

  In the upper sub-pipeline illustrated in FIG. 10, when the product of the number of bits of ary [0] and the number of channels is 1, bitconv0 that is a return value of 8-bit conversion for ary [0] is set. , [0] and Null is set to ary [0] when the product of the number of bits of ary [0] and the number of channels is not 1.

  In the central sub-pipeline shown in FIG. 10, when the product of the number of bits of ary [1] and the number of channels is 32, colorconv0 that is a return value of YCbCr conversion for ary [1] is When ary [1] is set and the product of the number of bits of ary [1] and the number of channels is not 32, it is indicated that Null is set to ary [1].

  In the lower sub-pipeline shown in FIG. 10, it is shown that ary [2] is directly input to the module shown at the right end of FIG.

  The right end of FIG. 10 indicates that the first element that is not Null among ary [0], ary [1], or ary [2] is returned as a return value, and is input to subsequent processing. Has been.

  As described above, when there are conditions in the conditional branch in which the image processing to be executed when satisfied is not described in the image processing instruction sheet 20, the interpretation unit 14 executes all of the conditions in the conditional branch. As an instruction to be executed after the set instruction is executed, all return values corresponding to the sub-pipelines corresponding to the conditions in the conditional branch are all return values (in this case, indicating no value) , Null), the return value of the instruction associated with the identification information described in the image processing instruction sheet 20 to be executed before the conditional branch is the sub-pipeline constructed as described above. An instruction to be returned as a final return value in an instruction corresponding to may be set.

  Further, in the processing shown in S101 described above, the number of conditions in the conditional branch is 1 instead of the module corresponding to the instruction that duplicates and branches the input image by the number of conditions in the conditional branch (here, n, for example). A module corresponding to an instruction for copying and branching the input image by the added number (here, for example, n + 1) may be set as the first module.

  In this embodiment, the attribute type is handled only on the module side such as the image processing library, and it is necessary to be aware of the attribute type on the interpreter side such as the image processing instruction sheet 20 and the interpretation unit 14 for constructing the pipeline. There is no. According to the present embodiment, the user of the image processing apparatus 10 can create image processing instruction information in which a plurality of image processing execution instructions are described without being conscious of the type of attribute used in the image processing instruction. Become.

  In this embodiment, the user of the image processing apparatus 10 can create image processing instruction information without specifying the attribute type in the module to be used.

  In addition, this invention is not limited to the above-mentioned embodiment.

  For example, when executing the contents of the image processing instruction sheet 20 schematically shown in FIG. 7 and the above (2-1) to (2-10), processing in a sub-pipeline that meets the conditions Only the error that occurred in step 1 may be output to the outside. Specifically, for example, when executing the contents of the image processing instruction sheet 20 schematically shown in FIG. 7 described above, only errors that occur in processing in the sub-pipeline that meets the conditions are displayed on the display. You may make it notify a user via a screen.

  FIG. 11 is a diagram schematically illustrating an example of a pipeline corresponding to the processes (2-5) to (2-7) described above in this case. FIG. 11 shows two sub-pipelines that are divided into upper and lower parts.

  For the pipeline, the execution unit 16 selects branch selection state data that takes one of the values “unselected”, “selected”, or “selected” when starting execution of the instruction. st is generated and stored in the storage unit of the image processing apparatus 10.

  On the left side of the upper sub-pipeline shown in FIG. 11, when the value of the branch selection state data st is “unselected” and the number of bits of ary [0] is 1, the branch selection state data The value of st is changed to “selected”, and ary [0] is returned as a return value, which is an input to the JPEG reading module. Otherwise, Null is returned as a return value and sent to the JPEG reading module. It is shown that it becomes the input of.

  On the right side, when the number of bits of ary [0] is 1, read1 which is a return value of JPEG reading is set to ary [0], and when the number of bits of ary [0] is not 1, Null Is set to ary [0].

  Further to the right, when the value of the branch selection state data st is not “selected”, the error generated in the processing in the sub-pipeline for ary [0] is cleared, and if not, the branch is executed. It is shown that the value of the selection state data st is changed to “selected”.

  On the left side of the lower sub-pipeline shown in FIG. 11, when the value of the branch selection state data st is “unselected” and the number of bits of ary [1] is not 1, the branch selection state data While the value of st is changed to “selected”, ary [1] is returned as a return value and is input to the graying module; otherwise, Null is returned as the return value and passed to the graying module. It is shown that it becomes the input of.

  To the right, when the number of bits of ary [1] is not 1, gray0, which is the graying return value for ary [1], is set to ary [1], and the number of bits of ary [1] is 1. In the case of Null, it is indicated that Null is set to ary [1].

  Furthermore, on the right side, when the value of the branch selection state data st is not “selected”, the error generated in the processing in the sub-pipeline for ary [1] is executed. It is shown that the value of the selection state data st is changed to “selected”.

  The right end of FIG. 11 indicates that the first element that is not Null among ary [0] or ary [1] is returned as a return value and becomes an input to the subsequent processing.

  In realizing the above processing, for example, the interpretation unit 14 may execute the processing shown in S101 to S109 described above except for the points described below.

  Here, instead of the process shown in S104 described above, the interpretation unit 14 uses the branch selection state data as a module following the (i + 1) th branch, that is, the ary [i] which is the (i + 1) th array element. When the value of st is “unselected” and the (i + 1) th condition in the conditional branch is satisfied, the value of the branch selection state data st is changed to “selected” and ary [i] is returned. If not, processing for connecting the third condition determination module, which is a module that returns a return value indicating that there is no value, may be executed.

  Then, instead of the process shown in S108 described above, the interpretation unit 14 determines the error that occurred in the process in the sub-pipeline for ary [i] when the value of the branch selection state data st is not “selected”. If clear is executed, otherwise, the process of changing the value of the branch selection state data st to “selected” is executed, then the value of the counter i is incremented by 1, and the process returns to the process shown in S103. May be.

  When executing the instruction corresponding to the pipeline constructed as described above, the execution unit 16 sets the sub-pipeline corresponding to the condition when each of the conditions in the conditional branch does not satisfy the condition. The output of an error that occurs when the corresponding instruction is executed is suppressed.

  Note that the image processing apparatus 10 according to the present embodiment may include a plurality of housings. Further, specific character strings and numerical values in the specification, and specific character strings and numerical values in the drawings are examples, and are not limited to these character strings and numerical values.

  DESCRIPTION OF SYMBOLS 10 Image processing apparatus, 12 Acquisition part, 14 Interpretation part, 16 Execution part, 20 Image processing instruction sheet.

Claims (5)

A plurality of image processing identification information, and acquisition means for acquiring image processing instruction information in which conditional branches are described;
For each of the conditions in the conditional branch, a command that is associated with the identification information described in the image processing instruction information to be executed when a condition is satisfied is set as a command to be executed. Setting means;
For each of the conditions in the conditional branch, as an instruction to be executed after the instruction set by the first setting means is executed, execution of the instruction set by the first setting means when the condition is satisfied A second setting means for setting an instruction to return a result as a return value and to return a return value indicating that there is no value when the condition is not satisfied;
For each of the conditions in the conditional branch, the instruction executed after the instruction set to be executed by the first setting means and the second setting means is executed for all the conditions in the conditional branch. A command that returns a return value different from a return value indicating that there is no value among the return values of the command set by the second setting means as a final return value in a command corresponding to the image processing instruction information Third setting means for setting
Execution means for executing instructions set by the first setting means, the second setting means, and the third setting means;
An image processing apparatus comprising: For each of the conditions in the conditional branch, as an instruction to be executed before the instruction set by the first setting means is executed, execution of the instruction executed before the instruction when the condition is satisfied A fourth setting means for setting a command for returning a result as a return value and returning a return value indicating that there is no value when the condition is not satisfied;
The execution means executes instructions set by the first setting means, the second setting means, the third setting means, and the fourth setting means;
The image processing apparatus according to claim 1. In the image processing instruction information, identification information of image processing executed before conditional branching is described,
The first setting means may execute an instruction associated with the identification information described in the image processing instruction information to be executed before conditional branching when the condition is satisfied. Set as an instruction to be executed before the instruction associated with the identification information described in the information,
When there is a condition in the conditional branch that is not described in the image processing instruction information, the third setting unit performs the processing for all of the conditions in the conditional branch. Instructions set by the second setting means for each condition in the conditional branch as instructions executed after execution of instructions set to be executed by the first setting means and the second setting means Are all return values indicating that there is no value, the return value of the instruction associated with the identification information described in the image processing instruction information to be executed before the conditional branching, Setting an instruction to be returned as a final return value in an instruction according to the image processing instruction information;
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. For each of the conditions in the conditional branch, further includes a suppression unit that suppresses output of an error that occurs when an instruction is executed by the execution unit when the condition is not satisfied.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. Acquisition means for acquiring identification information of a plurality of image processes, and image processing instruction information in which conditional branches are described;
For each of the conditions in the conditional branch, a command that is associated with the identification information described in the image processing instruction information to be executed when a condition is satisfied is set as a command to be executed. Setting means,
For each of the conditions in the conditional branch, as an instruction to be executed after the instruction set by the first setting means is executed, execution of the instruction set by the first setting means when the condition is satisfied Second setting means for setting a command for returning a result as a return value and returning a return value indicating that there is no value when the condition is not satisfied;
For each of the conditions in the conditional branch, the instruction executed after the instruction set to be executed by the first setting means and the second setting means is executed for all the conditions in the conditional branch. A command that returns a return value different from a return value indicating that there is no value among the return values of the command set by the second setting means as a final return value in a command corresponding to the image processing instruction information Third setting means for setting
Execution means for executing instructions set by the first setting means, the second setting means, and the third setting means;
A program characterized by causing a computer to function.

Images