JP5983720B2 - Information processing apparatus, control method thereof, and program - Google Patents

Description

The present invention relates to an information processing apparatus that can identify whether or not an image buffer is set in a module constituting a processing flow capable of executing image processing , a control method thereof, and a program.

  2. Description of the Related Art Conventionally, for example, image processing apparatuses that perform image processing of image data to be inspected with a camera with a certain logic for the purpose of positioning a substrate or a component in a chip mounter or inspecting a finished product have been widely used. Yes.

  As such an image processing apparatus, for example, a general-purpose type image processing apparatus equipped with a predetermined image processing logic, or a dedicated user that can construct a logic that meets the user's needs. There are types of image processing devices.

  Here, the general-purpose type image processing apparatus does not require the construction of a new image processing logic, so it does not require the user's labor when introducing it into an actual manufacturing process, etc., but the logic completely satisfies the user's needs. There are few. On the other hand, a dedicated type image processing apparatus can construct image processing logic that completely satisfies the user's needs. For this reason, it is necessary to develop the image processing logic each time, so a great amount of development effort is required. The development period and the cost were high.

  Therefore, conventionally, for example, a technique for improving the efficiency of logic development as shown in Patent Document 1 below has been proposed. Specifically, in Patent Document 1, a plurality of image processing modules are registered in advance in a computer that develops logic, the developer selects a module that meets the needs of the user, and is necessary for the selected module. By setting parameters and creating source code after creating source code, logic development is made more efficient.

JP 2003-296112 A

  When constructing such image processing logic, an application that generates an image processing program (hereinafter referred to as an image processing program) by constructing an image processing module in a flow chart format on a GUI (Graphical User Interface). Exists. In such an application, when each image processing module is constructed in a flowchart format by drag and drop, etc., the source code corresponding to each module is combined based on the order of the flowchart (hereinafter referred to as processing flow), and the image processing program is combined. Is to be generated.

  In the above-described Patent Document 1 and such an application, image data used for image processing and image data as an output result thereof are stored in an image buffer (a storage area such as a RAM for performing predetermined processing on the image data). I / O is in progress. This image buffer is automatically created with a predetermined capacity in a storage area when a module that conventionally requires an image buffer is added to the processing flow. That is, an image buffer is created for each module arranged in the processing flow.

  However, when the number of modules arranged in the processing flow increases, the number of image buffers created in the storage area increases, resulting in a problem that the storage area becomes insufficient. Therefore, instead of securing an image buffer for each module, a mechanism is considered in which a predetermined number of image buffers are created and used by a plurality of modules arranged in the processing flow.

  However, in the case of such a mechanism, in order to confirm the image buffer used in each module, it is necessary to display the parameter of the module by selecting the module. That is, since the parameters (image buffer) are checked for each module, the listability is poor. It is possible to generate a screen that displays the parameters (image buffer) of each module in a list and display it. However, it is possible to check which module in the processing flow corresponds to the displayed module. It was a hassle.

The present invention relates to modules constituting the executable processing flow of the image processing, and to provide an identifiable mechanism whether the image buffer is set in the processing flow.

In order to achieve the above object, an information processing apparatus of the present invention is an information processing apparatus that generates an image processing program capable of executing image processing on image data, and is a module capable of executing predetermined processing. An operation accepting unit that accepts an operation for adding a module that can configure a process flow in the process order specified by the user to the process flow, and a module that adds the module that accepted the operation by the operation accepting unit to the process flow And a display control means for displaying an area capable of displaying information indicating the image buffer in the processing flow in a form capable of identifying that no image buffer is set in the module added by the module adding means. And a setting reception for accepting an image buffer setting for the module added by the module adding means. And means, wherein the display control unit, when receiving the setting of the image buffer in the setting accepting means, by displaying the information indicating the image buffer to the region of the module which has received the setting, the module In addition, the fact that the image buffer is set is displayed for identification .

According to the present invention, whether or not an image buffer is set in a module constituting a processing flow capable of executing image processing can be identified in the processing flow .

2 is a diagram illustrating an example of a hardware configuration of an information processing apparatus 100. FIG. 2 is a diagram illustrating an example of a functional configuration of the information processing apparatus 100. FIG. 4 is a diagram illustrating an example of a table configuration of a module table 300. FIG. 5 is a diagram illustrating an example of a table configuration of a processing flow table 400. FIG. It is a figure which shows an example of a table structure of the loop table. It is a figure which shows an example of the table structure of the branch table. 4 is a diagram illustrating an example of a table configuration of a switch table 700. FIG. 5 is a diagram illustrating an example of a table configuration of a search result table 800. FIG. 5 is a diagram illustrating an example of a table configuration of an image buffer table 900. FIG. It is a flowchart which shows the flow of a series of processes of this invention. 5 is a diagram showing an example of a screen configuration of a process flow construction screen 1100. FIG. 5 is a diagram illustrating an example of a screen configuration of an image buffer setting screen 1200. FIG. It is a flowchart which shows the detail of a module addition process. It is a figure which shows the input image buffer display area and output image buffer display area at the time of adding the module which can set an input image buffer and an output image buffer. It is a figure which shows the input image buffer display area and output image buffer display area at the time of adding the module which can set an input image buffer but cannot set an output image buffer. It is a figure which shows the input image buffer display area and output image buffer display area at the time of adding the module which cannot set an input image buffer and an output image buffer. It is a flowchart which shows the detail of a module selection process. FIG. 10 is a diagram in which an input image buffer and an output image buffer of another module in which the same image buffer as the image buffer set in the selected module is set are identified and displayed. It is a figure which shows an example when there is no input image buffer and output image buffer of the other module in which the same image buffer as the image buffer set to the selected module is set. It is a flowchart which shows the detail of a parameter change process. FIG. 21 is a flowchart illustrating details of the parameter changing process following FIG. 20. It is a figure which shows an example of the screen which notifies that the image buffer newly set to the input image buffer is not set as an output image buffer of another module. It is a figure which shows an example of the screen which notifies that the image buffer newly set to the output image buffer is set as an output image buffer of another module. It is a flowchart which shows the detail of an image buffer search process. FIG. 25 is a flowchart illustrating details of an image buffer search process following FIG. 24. It is a flowchart which shows the detail of the parameter change process in 2nd Embodiment. FIG. 27 is a flowchart illustrating details of parameter change processing according to the second embodiment, following FIG. 26; It is the figure which identifies and displays the output image buffer of the other module in which the same image buffer as the image buffer set to the selected module is set. It is the figure which identifies and displays the output image buffer of the other module in which the same image buffer as the image buffer set to the selected module is set.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram illustrating an example of a hardware configuration of the information processing apparatus 100. The information processing apparatus 100 of the present invention is an apparatus that can generate a program that can execute image processing (hereinafter, an image processing program). An application for constructing an image processing program (hereinafter referred to as an image processing program construction application) is installed in the information processing apparatus 100, and an image processing program is generated using the application.

  In the image processing program construction application, an image processing program is constructed by combining modules prepared in advance in a flowchart format. Each module includes a module that can execute image processing, a module that performs loops and branches, and the like. Since these are prepared in the source code format, the user combines these modules into a flowchart (hereinafter referred to as a processing flow) so as to obtain a desired image processing program, and combines the module source code in the processing order of the flowchart. Thus, an image processing program can be generated.

  The CPU 101 comprehensively controls each device and controller connected to the system bus 104.

  In addition, the ROM 102 or the external memory 111 (storage means) implements a BIOS (Basic Input / Output System), an operating system program (hereinafter referred to as OS), which is a control program of the CPU 101, and a function executed by the information processing apparatus 100. Various programs and the like which will be described later are stored. The RAM 103 functions as a main memory, work area, and the like for the CPU 101.

  The CPU 101 implements various operations by loading a program or the like necessary for execution of processing into the RAM 103 and executing the program.

  An input controller (input C) 105 controls input from an input device 109 such as a keyboard or a pointing device such as a mouse (not shown).

  A video controller (VC) 106 controls display on a display device such as the display 110. The type of the display device is assumed to be a CRT or a liquid crystal display, but is not limited thereto.

  The memory controller (MC) 107 is an adapter to a hard disk (HD), flexible disk (FD), or PCMCIA card slot that stores a boot program, browser software, various applications, font data, user files, editing files, various data, and the like. Controls access to an external memory 111 such as a card-type memory connected via the.

  A communication I / F controller (communication I / FC) 108 connects and communicates with an external device via a network, and executes communication control processing in the network. For example, Internet communication using TCP / IP is possible.

  Note that the CPU 101 enables display on the display 110 by, for example, executing outline font rasterization processing on a display information area in the RAM 103. Further, the CPU 101 enables a user instruction with a mouse cursor (not shown) on the display 110.

  Various programs and the like used by the information processing apparatus 100 of the present invention to execute various processes described later are recorded in the external memory 111 and are executed by the CPU 101 by being loaded into the RAM 103 as necessary. is there. Furthermore, definition files and various information tables used by the program according to the present invention are stored in the external memory 111.

  Next, a functional configuration diagram showing a functional configuration of the information processing apparatus 100 will be described with reference to FIG. Note that the functional configuration of FIG. 3 is an example, and there are various configuration examples depending on the application and purpose.

  The information processing apparatus 100 includes a table storage unit 200, a processing flow creation unit 210, a source code conversion unit 220, a compilation unit 230, a processing flow execution unit 240, a processing flow storage unit 250, and an image buffer management unit 260.

  The table storage unit 200 is a functional unit that stores various tables used in the present embodiment. The table storage unit 200 stores a module table 300, a processing flow table 400, a loop table 500, a branch table 600, a switch table 700, a search result table 800, and an image buffer table 900.

  Here, in the present embodiment, the table storage unit 200 in FIG. 3 is configured in the external memory 111 illustrated in FIG. 1, for example (including a case in which the table storage unit 200 is configured in the external memory 111 after being configured in the RAM 103 once). . Further, the processing flow creation unit 210, the source code conversion unit 220, the compilation unit 230, the processing flow execution unit 240, the processing flow storage unit 250, and the image buffer management unit 260 in FIG. And a program stored in the external memory 111.

  The module table 300 is a table that stores information about modules used in the image processing logic construction program. An example of the table configuration of the module table 300 is shown in FIG.

  The module table 300 is stored in the external memory 111 or the like of the information processing apparatus 100, and includes an INDEX 301, a module name 302, a source code 303, an input parameter 304, and an output parameter 305.

  The INDEX 301 is identification information allocated for each record of the module table 300. The module name 302 indicates the name of the module. The source code 303 stores the source code of the module. The storage destination of the source code may be stored. The input parameter 304 and the output parameter 305 indicate input parameters and output parameters that can be set when the module executes processing of the module. For example, in the binarization module with INDEX 301 “7”, “input image buffer” and “threshold value” can be set as input parameters, and “output image buffer” can be set as output parameters. The input image buffer is an image buffer that is an input source of image data used when the module executes processing. The output image buffer refers to an image buffer that is an output destination of image data as a result of execution of processing by the module.

  Further, the processing flow table 400 is a table that stores information regarding modules constituting the processing flow. An example of a table configuration of the processing flow table 400 is shown in FIG.

  The processing flow table 400 is stored in the external memory 111 or the like of the information processing apparatus 100, and includes an INDEX 401, a module ID 402, a module name 403, an input parameter 404, an output parameter 405, and a reference destination table 406.

  The INDEX 401 is identification information allocated so as to be in ascending order from the upstream to the downstream of the processing flow. That is, the INDEX 401 of the module arranged at the most upstream in the processing flow becomes “1”. The INDEX 401 of the module arranged at the next position becomes “2”. The module ID 402 is identification information that is uniquely assigned to the modules arranged in the processing flow. The module name 403 stores the name of the module corresponding to the module name 302 of the module. The input parameter 404 and the output parameter 405 store the input parameter and the output parameter set in the module. For example, in the camera module in which the INDEX 401 of the processing flow table 400 of FIG. 4 is “1”, “image buffer 1” is set as the output image buffer among the output parameters. The reference table 406 indicates another table to be referred to when the module is a module such as a loop or a branch. For example, “TD003-1” and “TD003-2” are set as branch destinations in the reference destination table 406 of the branch module whose INDEX 401 is “3” in the processing flow table 400 of FIG. That is, it indicates that one of these two tables is referred to according to the determination result of the branch module. The various tables shown in the reference table 406 also store information related to the modules arranged in the processing flow as in the processing flow table 400.

  Tables indicated by the reference table 406 include a loop table 500, a branch table 600, and a switch table 700.

  The loop table 500 (see FIG. 5) is a table used as a reference destination of the loop module. The loop table 500 is stored in the external memory 111 or the like of the information processing apparatus 100, and includes an INDEX 501, a module ID 502, a module name 503, an input parameter 504, an output parameter 505, and a reference destination table 506. Each item constituting the loop table 500 is the same as each item constituting the processing flow table 400 described above.

  The branch table 600 (see FIG. 6) is a table used as a reference destination of the branch module, and includes a branch THEN table 610 and a branch ELSE table 620. The branch THEN table 610 is referred to when the determination result of the branch module is true (TRUE), and the determination result of the branch module is referred to false (FALSE) in the branch ELSE table 620.

  The branch THEN table 610 is stored in the external memory 111 or the like of the information processing apparatus, and includes an INDEX 611, a module ID 612, a module name 613, an input parameter 614, an output parameter 615, and a reference destination table 616. The branch ELSE table 620 is stored in the external memory 111 of the information processing apparatus, and includes an INDEX 621, a module ID 622, a module name 623, an input parameter 624, an output parameter 625, and a reference table 626.

  The items constituting the branch THEN table 610 and the items constituting the branch ELSE table 620 are the same as the items constituting the processing flow table 400 described above.

  Furthermore, the switch table 700 (see FIG. 7) is a table used as a reference destination of the switch module, and includes a switch condition table 710, a switch ELSE table 720, a switch CASE table 730, and a switch CASE table 740. The switch condition table 710 stores conditions for branching in multiple directions. The switch ELSE table 720 is referred to when none of the conditions is met, and the switch CASE table 730 and the switch CASE table 740 are switch conditions. Reference is made according to the conditions stored in the table 710.

  The switch condition table 710 is stored in the external memory 111 or the like of the information processing apparatus 100, and includes an INDEX 711, a CASE condition 712, and a reference destination table 713. INDEX 711 is identification information allocated for each condition. The CASE condition 712 indicates a condition for branching. The reference destination table 713 indicates a switch CASE table that is referred to when the determination result of the condition is true (TRUE). In the example of the switch condition table 710 illustrated in FIG. 7, there are two branch conditions, and if it is determined to be true in any of the two conditions, the switch CASE table 730 or the switch set to the condition determined to be true. The CASE table 740 will be referred to. On the other hand, if none of the conditions match, the switch ELSE table 720 is referred to.

  The switch ELSE table 720 is stored in the external memory 111 or the like of the information processing apparatus 100, and includes an INDEX 721, a module ID 722, a module name 723, an input parameter 724, an output parameter 725, and a reference destination table 726. The switch CASE table 730 is stored in the external memory 111 of the information processing apparatus 100, and includes an INDEX 731, a module ID 732, a module name 733, an input parameter 734, an output parameter 735, and a reference destination table 736. The switch CASE table 740 is stored in the external memory 111 of the information processing apparatus 100 and includes an INDEX 741, a module ID 742, a module name 743, an input parameter 744, an output parameter 745, and a reference table 746. Each item constituting the switch ELSE table 720, each item constituting the switch CASE table 730, and each item constituting the switch CASE table 740 are the same as each item constituting the processing flow table 400 described above.

  A search result table 800 (see FIG. 8) is a table used in an image buffer search process to be described later. Among the modules arranged in the processing flow, another module having the same image buffer as the image buffer of the module designated by the user is searched. A table storing the modules identified as a result of the search is a search result table 800.

  The search result table 800 is stored in the external memory 111 or the like of the information processing apparatus 100, and includes an INDEX 801, a module ID 802, a module name 803, a matching image buffer 804, and an upstream flag 805. INDEX 801 is identification information allocated for each search result. Module ID 802 and module name 803 store information corresponding to module ID 802 and module name 302 of the module specified as a result of the search. The coincidence image buffer 804 is information indicating whether the image buffer determined to be the same image buffer is set as the input image buffer or the output image buffer. The upstream flag 805 indicates whether or not the module identified as a result of the search is one that is located upstream of the module that is the search source (the process that is executed before the module that is the search source). That is, it is a flag indicating whether or not the module specified as a result of the search is earlier in processing order than the module that is the search source. If “1” is stored in the upstream flag 805, the module identified as a result of the search is arranged upstream of the module that is the search source. If “0” is stored in the upstream flag 805, the module specified as a result of the search is arranged downstream of the module that is the search source.

  The image buffer table 900 (see FIG. 9) shows information related to the image buffer used by each module constituting the processing flow. The image buffer table 900 is stored in the external memory 111 or the like of the information processing apparatus 100, and includes an INDEX 901 and an image buffer name 902. INDEX 901 is identification information assigned to each created image buffer. An image buffer name 902 indicates the name of the created image buffer. The name of the image buffer can be freely assigned.

  The table storage unit 200 stores various tables as described above.

  Returning to FIG. The processing flow creation unit 210 is a functional unit that constructs each module stored in the module table 300 in a flowchart format in accordance with an instruction from the user. It is possible to add a module to the processing flow, delete a module arranged in the processing flow from the processing flow, move the position of the module arranged in the processing flow, change parameters of the module arranged in the processing flow, and the like.

  The source code conversion unit 220 is a functional unit that converts the image processing logic indicated by the processing flow created by the processing flow creation unit 210 into source code. The source code 303 of each module constituting the processing flow is acquired, and the acquired source codes are combined so as to be in the processing order indicated by the processing flow.

  The compiling unit 230 is a functional unit that compiles the source code converted by the source code converting unit 220 and generates an object code.

  The processing flow execution unit 240 is a functional unit that executes the object code compiled by the compiling unit 230.

  The processing flow storage unit 250 is a functional unit that stores the processing flow created by the processing flow creation unit 210.

  The image buffer management unit 260 is a functional unit that manages the image buffer used by the modules constituting the processing flow created by the processing flow creation unit 210. The image buffer is created in advance by the user.

  Next, a flow of a series of processes in the embodiment of the present invention will be described with reference to FIG.

  First, in step S <b> 1001, the CPU 101 of the information processing apparatus 100 activates an image processing logic construction application in accordance with an instruction from the user, and displays a processing flow construction screen 1100 on the display 110.

  An example of the screen configuration of the processing flow construction screen 1100 is shown in FIG. The process flow construction screen 1100 includes a process flow drawing area 1101, a module list area 1102, a parameter list area 1103, and a notification area 1104. The user selects a module necessary for constructing a desired image processing logic from the module list indicated by the module table 300 displayed in the module list area 1102, and the process flow drawing area 1101 process flow by drag and drop. Will continue to add. By selecting a module whose parameters are to be viewed / set from among the modules constituting the processing flow displayed in the processing flow drawing area 1101, the parameters of the selected module are displayed in the parameter list area 1103. If there is something to be notified to the user, a notification area 1104 is notified.

  In step S1002, the CPU 101 of the information processing apparatus 100 determines whether an input has been received from the user through the input device 109 (operation receiving unit). If it is determined that the input has been accepted, the process proceeds to step S1003. If it cannot be determined that the input has been accepted, that is, if no input has been accepted, the process waits until there is an input from the user.

  In step S1103, the CPU 101 of the information processing apparatus 100 determines whether or not the input from the user is an instruction to set the image buffer. More specifically, the determination is made based on whether an image buffer setting item (not shown) included in the project menu of the processing flow construction screen 1100 is selected. If it is determined that the input from the user is an instruction to set the image buffer, the process proceeds to step S1004. If it is determined that the input from the user is not an instruction to set the image buffer, the process proceeds to step S1005.

  In step S1104, the CPU 101 of the information processing apparatus 100 displays the image buffer setting screen 1200, and sets the image buffer according to an instruction from the user. FIG. 12 shows an example of the screen configuration of the image buffer setting screen 1200. In the image buffer setting screen 1200, it is possible to add or delete an image buffer used in the processing flow drawn in the processing flow drawing area 1101. When the pressing of the add button 1201 is accepted, a new image buffer storage area is secured. When a check is received in the check box 1202 corresponding to the image buffer to be deleted and the delete button 1203 is pressed, the instructed image buffer is deleted from the storage area. By adding or deleting an image buffer, the above-described image buffer table 900 is updated. If an image buffer is added, a new record is created. If the image buffer is deleted, the record of the target image buffer is deleted. The image buffer name 902 is assigned a unique name for each image buffer. A necessary number of image buffers are generated in advance through such a screen. When the process ends (when the close button or the like is pressed), the process returns to step S1002.

  In step S1005, the CPU 101 of the information processing apparatus 100 determines whether or not an input from the user is an instruction to add a module to the processing flow. More specifically, the determination is made according to whether any module is dragged and dropped from the module list area 1102 into the processing flow. If it is determined that the input from the user is an instruction to add a module to the processing flow, the process proceeds to step S1106. If it is determined that the input from the user is not an instruction to add a module to the processing flow, the process proceeds to step S1007.

  In step S1006, the CPU 101 of the information processing apparatus 100 performs processing for adding a module to the processing flow. Details of the module addition processing are shown in FIG. When the module addition process ends, the process returns to step S1002.

  In step S1007, the CPU 101 of the information processing apparatus 100 determines whether or not the input from the user is an instruction (selection operation) for selecting a module arranged in the processing flow. That is, it is determined whether any of the modules arranged in the processing flow has been selected by the user. If it is determined that the input from the user is an instruction to select a module arranged in the process flow, the process proceeds to step S1008. If it is determined that the input from the user is not an instruction to select a module arranged in the processing flow, the process proceeds to step S1009.

  In step S1008, the CPU 101 of the information processing apparatus 100 performs a process of selecting a module arranged in the process flow. Details of the module selection processing are shown in FIG. When the module selection process ends, the process returns to step S1002.

  In step S1009, the CPU 101 of the information processing apparatus 100 determines whether or not the input from the user is an instruction to change the parameter of the module arranged in the processing flow. That is, when a module is selected by the user, the parameters of the module are displayed in the parameter list area 1103. Therefore, it is determined whether or not a parameter setting change has been accepted in the parameter list area 1103. If it is determined that the input from the user is an instruction to change the parameter of the module arranged in the process flow, the process proceeds to step S1010. If it is determined that the input from the user is not an instruction to change the parameter of the module arranged in the processing flow, the process proceeds to step S1011.

  In step S1010, the CPU 101 of the information processing apparatus 100 performs a process of changing the parameter of the module selected by the user. Details of the parameter changing process are shown in FIG. When the parameter change process ends, the process returns to step S1002.

  In step S1011, the CPU 101 of the information processing apparatus 100 determines whether the input from the user is an instruction to change the arrangement position of the module arranged in the processing flow. That is, it is determined whether the module arranged in the processing flow has been moved to any position in the processing flow by drag and drop. If it is determined that the input from the user is an instruction to change the arrangement position of the module arranged in the processing flow, the process proceeds to step S1012. If it is determined that the input from the user is not an instruction to change the arrangement position of the module arranged in the processing flow, the process proceeds to step S1013.

  In step S1012, the CPU 101 of the information processing apparatus 100 moves the module on the processing flow selected by the user to a position on the processing flow instructed by the user. Since the processing order of the processing flow is changed with this movement, a record of the moved module is acquired from any one of the processing flow table 400, the loop table 500, the branch table 600, and the switch table 700, and an appropriate one of these tables is acquired. Insert the retrieved record at the position. Then, the INDEX is updated for each of these tables so that the processing order is obtained. Further, when the module is moved to a position on the processing flow designated by the user, the input image buffer display area and the output image buffer display area displayed on the processing flow in the processing flow drawing area 1101 in the module addition process to be described later Move with the movement of the module. That is, the input image buffer display area and the output image buffer display area are displayed in the vicinity of the destination module. When the process ends, the process returns to step S1002.

  In step S1013, the CPU 101 of the information processing apparatus 100 determines whether or not the input from the user is an instruction to delete the module arranged in the processing flow. That is, it is determined whether a module to be deleted is selected from the modules arranged in the processing flow and a delete button (not shown) is selected. If it is determined that the input from the user is an instruction to delete the module arranged in the process flow, the process proceeds to step S1014. If it is determined that the input from the user is not an instruction to delete the module arranged in the process flow, the process proceeds to step S1015.

  In step S1014, the CPU 101 of the information processing apparatus 100 deletes the module on the processing flow selected by the user from the processing flow. With this deletion, the processing order of the processing flow is changed. Therefore, the target module is deleted from any one of the processing flow table 400, the loop table 500, the branch table 600, and the switch table 700 so that the INDEX becomes the processing order. Update to When the module is deleted from the processing flow, the input image buffer display area and the output image buffer display area displayed on the processing flow in the processing flow drawing area 1101 are also deleted (or hidden) by module addition processing described later. ). When the process ends, the process returns to step S1002.

  In step S1015, the CPU 101 of the information processing apparatus 100 determines whether or not the input from the user is an instruction to execute the image processing logic constructed in the processing flow. More specifically, it is determined whether or not an execution button (not shown) has been pressed. If it is determined that the input from the user is an instruction to execute the image processing logic constructed in the processing flow, the process proceeds to step S1016. If it is determined that the input from the user is not an instruction to execute the image processing logic constructed in the processing flow, the process proceeds to step S1017.

  In step S1016, the CPU 101 of the information processing apparatus 100 executes each module arranged in the processing flow in the processing order indicated by the processing flow. More specifically, the source code of each module arranged in the processing flow is acquired from the source code 303 of the module table 300, and the acquired source codes are combined in the processing order and compiled. This is realized by executing the object code obtained as a result of compilation. When the process is finished, the process returns to step S1002.

  In step S1017, the CPU 101 of the information processing apparatus 100 determines whether or not the input from the user is an instruction to save the processing flow. More specifically, it is determined whether or not a save button (not shown) has been pressed. If it is determined that the input from the user is an instruction to save the processing flow, the process proceeds to step S1018. If it is determined that the input from the user is not an instruction to save the processing flow, the process proceeds to step S1019.

  In step S <b> 1018, the CPU 101 of the information processing apparatus 100 stores the processing flow constructed in the processing flow drawing area 1101. More specifically, the processing flow table 400, the loop table 500, the branch table 600, and the switch table 700 are stored in the external memory 111 or the like. This way, you can resume your work later.

  In step S1019, the CPU 101 of the information processing apparatus 100 determines whether the input from the user is an instruction to end the image processing logic construction application. More specifically, it is determined whether or not an end button (not shown) has been pressed. If it is determined that the input from the user is an instruction to end the image processing logic construction application, the process proceeds to step S1020. If it is determined that the input from the user is not an instruction to end the image processing logic construction application, that is, processing other than the processing described above is executed, or an input content cannot be specified, an error is notified, and the processing returns to step S1002.

  In step S1020, the CPU 101 of the information processing apparatus 100 closes the processing flow construction screen 1100 displayed in step S1001, and ends the image processing logic construction application.

  Next, module addition processing will be described with reference to FIG.

  First, in step S1301, the CPU 101 of the information processing apparatus 100 identifies a module to be added to the processing flow. More specifically, the module dragged from the module list area 1102 is specified.

  In step S1302, the CPU 101 of the information processing apparatus 100 specifies a position to be added to the processing flow. More specifically, the position on the processing flow where the module dragged from the module list area 1102 is dropped is specified.

  In step S1303, the CPU 101 of the information processing apparatus 100 adds the module specified in step S1301 to the position specified in step S1302 (module addition means). More specifically, any one of the processing flow table 400, the loop table 500, the branch table 600, and the switch table 700 corresponding to the position specified in step S1302 is specified. Then, a record corresponding to the position specified in step S1302 is generated in the specified table. For example, a case is assumed where a median module is added to the processing flow drawing area 1101 shown in FIG. In this case, the position to be added is inside the branch module and is a position that is executed when the branch condition is false (FALSE), so the branch ELSE table 620 is specified. Then, a new record is generated in the branch ELSE table 620, information regarding the median module is acquired from the module table 300, and stored in the record. At this time, the INDEX 621 is reassigned so as to be in the processing order in the branch ELSE table 620. Further, identification information that is unique in the entire processing flow is allocated and stored in the module ID 622, and empty values are input in the input parameter 624 and the output parameter 625.

  In step S1304, the CPU 101 of the information processing apparatus 100 determines whether the added module is a module that can set an image buffer. More specifically, it is determined whether the input image buffer or the output image buffer can be set by referring to the input parameter 304 and the output parameter 305 of the added module. If it is determined that the added module is a module that can set the image buffer, the process advances to step S1305. If it is determined that the added module is not a module for which an image buffer can be set, that is, neither an input image buffer nor an output image buffer can be set, the module addition process ends.

  In step S1305, the CPU 101 of the information processing apparatus 100 determines whether an input image buffer can be set for the added module. More specifically, it is determined whether the input image buffer can be set by referring to the input parameter 304 of the added module. If it is determined that the input image buffer can be set in the added module, the process proceeds to step S1306. If it is determined that the input image buffer cannot be set in the added module, that is, only the output image buffer can be set, the process proceeds to step S1307.

  In step S1306, the CPU 101 of the information processing apparatus 100 displays an area in which information indicating an image buffer set in the input image buffer of the module added in step S1303 can be displayed (hereinafter referred to as an input image buffer display area) as the process. Display in the flow. FIG. 14 shows an example of the input image buffer display area. FIG. 14 shows a case where a median module is added to the addition position 1105 in the processing flow of FIG. Since an input image buffer can be set in this median module, an input image buffer display area 1401 is displayed in the vicinity of the median module. When the input image buffer display area is displayed, if the input image buffer is set in the input parameter 304 of the added module, information indicating the set image buffer is displayed in the input image buffer display area. To do. Otherwise, the input image buffer display area is displayed and information indicating the image buffer is not displayed.

  Conventionally, parameters such as an image buffer can be confirmed only at a location shown in the parameter list area 1103. However, displaying information about the image buffer in the vicinity of each module in the processing flow in this way makes it easy to grasp which image buffer is used by which module.

  In step S1307, the CPU 101 of the information processing apparatus 100 determines whether an output image buffer can be set for the added module. More specifically, it is determined whether the output image buffer can be set by referring to the output parameter 305 of the added module. If it is determined that an output image buffer can be set for the added module, the process advances to step S1308. If it is determined that the output image buffer cannot be set for the added module, that is, only the input image buffer can be set, the module addition process is terminated.

  In step S1308, the CPU 101 of the information processing apparatus 100 displays an area in which information indicating an image buffer set in the output image buffer of the module added in step S1303 can be displayed (hereinafter referred to as an output image buffer display area) as the process. Display in the flow. FIG. 14 shows an example of the output image buffer display area. FIG. 14 shows a case where a median module is added to the addition position 1105 in the processing flow of FIG. Since an output image buffer can be set in this median module, an output image buffer display area 1402 is displayed in the vicinity of the median module. When the output image buffer display area is displayed, if an output image buffer is set in the output parameter 305 of the added module, information indicating the set image buffer is displayed in the output image buffer display area. To do. Otherwise, the output image buffer display area is displayed and the information indicating the image buffer is not displayed.

  In this way, when a module capable of setting the input image buffer and the output image buffer is added to the processing flow, the input image buffer display area and the output image buffer display area are displayed.

  Here, depending on the module, there is a module in which only one of the input image buffer and the output image buffer can be set. That is, only one of step S1306 and step S1308 is executed. In this case, only one of the input image buffer display area and the output image buffer display area is displayed. FIG. 15 shows a case where an image display module is added to the addition position 1105 in the processing flow of FIG. Referring to the module table 300, it can be seen that the image display module can set only the input image buffer. Therefore, step S1306 is executed and step S1308 is not executed. Therefore, the input image buffer display area 1401 is displayed and the output image buffer display area 1402 is not displayed.

  Furthermore, some modules do not use an image buffer. That is, it is a module that has been determined in step S1304 that the image buffer cannot be set. In this case, neither the input image buffer display area nor the output image buffer display area is displayed. FIG. 16 shows a case where a branch module is added to the addition position 1105 in the processing flow of FIG. Referring to the module table 300, it can be seen that the branch module cannot set either the input image buffer or the output image buffer. Therefore, neither the input image buffer display area 1401 nor the output image buffer display area 1402 is displayed.

  Thus, the display control of the input image buffer display area or the output image buffer display area can be performed depending on whether the module added to the processing flow is a module that can set the image buffer. This has the effect of not displaying unnecessary information. In particular, if the input image buffer display area and the output image buffer display area are displayed on all modules, the processing flow becomes difficult to view. Therefore, this is solved by the mechanism as described above.

  Next, module selection processing will be described with reference to FIG.

  First, in step S <b> 1701, the CPU 101 of the information processing apparatus 100 specifies a module selected by the user from among the modules that construct the processing flow.

  In step S1702, the CPU 101 of the information processing apparatus 100 acquires the input parameter and the output parameter of the module specified in step S1701. More specifically, the input parameter and the output parameter set in the specified module are acquired from any one of the processing flow table 400, the loop table 500, the branch table 600, and the switch table 700. Which table to obtain depends on the position where the identified module is arranged. In the processing flow shown in FIG. 18, when the median module with the module ID “U00031” is selected, the input parameters and output parameters of the median module are acquired from the branch table 600.

  In step S1703, the CPU 101 of the information processing apparatus 100 displays the input parameter and output parameter acquired in step S1702 in the parameter list area 1103 of the processing flow construction screen 1100. Each parameter displayed in this way can be freely changed by an input from the user.

  In step S1704, the CPU 101 of the information processing apparatus 100 determines whether an input image buffer has been set for the module specified in step S1701. More specifically, it is determined whether or not the input image buffer of the input parameter acquired in step S1702 includes the image buffer name of the image buffer created in advance. If it is determined that the input image buffer has been set, the process advances to step S1705. If it is determined that the input image buffer has not been set, the process advances to step S1710.

  In step S1705, the CPU 101 of the information processing apparatus 100 specifies the image buffer set in the input image buffer of the module specified in step S1701 (image buffer specifying unit). More specifically, the image buffer name 902 of the image buffer is specified.

  In step S1706, the CPU 101 of the information processing apparatus 100 performs a module for performing image processing using the image buffer specified in step S1705 out of modules different from the module specified in step S1701 (the image buffer is an input image buffer or an output image). A process for searching for modules set in the image buffer from modules arranged in the processing flow is executed (module specifying means). Details of the image buffer search processing are shown in FIG.

  In step S1707, the CPU 101 of the information processing apparatus 100 determines whether or not a module that executes processing using the image buffer specified in step S1705 has been specified as a result of the search in step S1706. More specifically, if a search result is stored in the search result table 800 output in step S1706, it is determined that the identification has been made. If it is determined that identification has been made, the process proceeds to step S1708. If it is determined that it cannot be specified, the process proceeds to step S1709.

  In step S1708, the CPU 101 of the information processing apparatus 100 identifies and displays the image buffer of the module searched and specified in step S1706, which is the same as the image buffer specified in step S1705 (display control unit).

  In the example of FIG. 18, when the median module having the module ID “U00031” is selected, “image buffer 1” is set in the input image buffer of the median module, so “image buffer 1” is used. In step S1706, the current module is searched. Then, a search result table 800 as shown in FIG. 8 is generated.

  In step S 1708, the search result table 800 is referred to, and a module on the processing flow (a camera module with a module ID “U00001”, a median module with a module ID “00022”, an image display module with a module ID “00041”). ). Then, information related to the image buffer set in the input image buffer or the output image buffer indicated by the matching image buffer 804 of the specified module, or both is identified and displayed.

  For example, information indicating a camera module having a module ID “U00001” is stored in a record in which the index 801 of the search result table 800 is “1”. In step S1706, since the image buffer set in the output image buffer of the camera module is specified to be the same as the image buffer specified in step S1705, an “output image buffer” is stored in the matching image buffer 804 of the record. And stored. That is, based on the information in this record, the character string “image buffer 1” displayed in the output image buffer display area of the camera module in the processing flow is identified and displayed. In this way, information relating to the image buffer can be identified and displayed by the module using the same image buffer as the image buffer set for the module selected by the user.

  In the present embodiment, information related to the image buffer displayed in the input image buffer display area is identified and displayed, but it is only necessary that the user can recognize that the same image buffer is used. In other words, the module itself that uses the same image buffer as the module selected by the user may be identified and displayed on the processing flow.

  On the other hand, in step S1709, the CPU 101 of the information processing apparatus 100 selects from the user to notify that there is no module that performs processing using the image buffer specified in step S1705 as a result of searching in step S1706. The image buffer set in the input image buffer of the selected module is identified and displayed (display control means). More specifically, information relating to the image buffer displayed in the input image buffer display area of the module selected by the user is identified and displayed. In the example shown in FIG. 19, the median module having the module ID “U00031” is selected. However, the “image buffer 3” set in the input image buffer of this median module is not used by any module in the processing flow. Therefore, the “image buffer 3” itself is identified and displayed to notify that the “image buffer 3” is not set in any module in the processing flow.

  In step S1710, the CPU 101 of the information processing apparatus 100 determines whether an output image buffer has been set for the module specified in step S1701. More specifically, it is determined whether or not the output buffer of the output parameter acquired in step S1702 includes the image buffer name of the image buffer created in advance. If it is determined that the output image buffer has been set, the process advances to step S1711. If it is determined that the output image buffer has not been set, the module selection process ends.

  In step S1711, the CPU 101 of the information processing apparatus 100 specifies the image buffer set as the output image buffer of the module specified in step S1701. More specifically, the image buffer name 902 of the image buffer is specified.

  In step S1712, the CPU 101 of the information processing apparatus 100 performs a module for performing image processing using the image buffer specified in step S1711 among modules different from the module specified in step S1701 (the image buffer is an input image buffer or an output image). A process of searching for modules set in the image buffer from modules arranged in the processing flow is executed. Details of the image buffer search processing are shown in FIG.

  In step S <b> 1713, the CPU 101 of the information processing apparatus 100 determines whether the module that executes the process can be specified using the image buffer specified in step S <b> 1711 as a result of the search in step S <b> 1712. More specifically, if a search result is stored in the search result table 800 output in step S1712, it is determined that it has been specified. If it is determined that identification has been made, the process proceeds to step S1714. If it is determined that it cannot be specified, the process proceeds to step S1715.

  In step S1714, the CPU 101 of the information processing apparatus 100 identifies and displays the image buffer of the module searched and specified in step S1706, which is the same as the image buffer specified in step S1705 (display control unit). Also in step S1714, the same processing as step S1708 described above is executed. If the identification display is made in step S1708 or step S1709, the identification display different from step S1708 or step S1709 is performed in step S1714 or step S1715 described later. That is, the identification display of information related to the same image buffer as the image buffer set in the input image buffer of the module selected by the user, and the same image buffer set in the output image buffer of the module selected by the user The identification display of information related to the image buffer is expressed in a different color or shape. In FIG. 18, in the median module with the module ID “U00031”, “image buffer 1” is set as the input image buffer, and “image buffer 2” is set as the output image buffer. That is, since both step S1708 and step S1714 are executed, it is necessary for the user to identify which execution result is displayed. Therefore, in FIG. 18, each is identified with a different color.

  In step S1715, the CPU 101 of the information processing apparatus 100 is selected by the user to notify that there is no module that performs processing using the image buffer specified in step S1711 as a result of searching in step S1712. The image buffer set in the output image buffer of the selected module is identified and displayed (display control means).

  Next, parameter change processing will be described with reference to FIGS. 20 and 21. FIG.

  First, in step S2001, the CPU 101 of the information processing apparatus 100 determines whether or not the input image buffer of a module on the currently selected processing flow (for example, the module selected in the module selection process described above) has been set. judge. More specifically, it is determined whether or not an image buffer created in advance as an input image buffer is selected in the parameter list area 1103 of the selected module. If it is determined that the input image buffer has been set, the process proceeds to step S2002. If it is determined that the input image buffer is not set, the process proceeds to step S2101 in FIG.

  In step S2002, the CPU 101 of the information processing apparatus 100 specifies the image buffer selected in the parameter list area 1103 (image buffer specifying unit). In step S2003, the CPU 101 of the information processing apparatus 100 sets the image buffer specified in step S2002 as the input image buffer of the selected module. More specifically, the selected image buffer is set in the input parameter of the record of the selected module stored in any of the processing flow table 400, the loop table 500, the branch table 600, and the switch table 700. .

  In step S2004, the CPU 101 of the information processing apparatus 100 displays the image buffer name 902 of the image buffer set in step S2003 in the parameter list area 1103.

  In step S2005, the CPU 101 of the information processing apparatus 100 performs a module for performing image processing using the image buffer specified in step S2002 among modules different from the modules selected in the processing flow (the image buffer is an input image). The module which is set in the buffer or the output image buffer) is searched from the modules arranged in the processing flow (module specifying means). Details of the image buffer search processing are shown in FIG.

  In step S2006, the CPU 101 of the information processing apparatus 100 performs step S2002 from among the modules arranged upstream of the position where the selected module is arranged (processing is executed before the selected module). It is determined whether or not there is a module in which the same image buffer as the image buffer specified in step 1 is set as the output image buffer. For example, since the module upstream of the median module whose module ID is “U00031” in FIG. 22 is processed before the median module, from the camera module whose module ID is “U00001”, The modules arranged up to the branch module with the module ID “U00003” correspond to this. Then, among these, it is determined whether or not there is a module in which the same image buffer as that specified in step S2002 is set as the output image buffer. More specifically, among the modules in which “1” is stored in the upstream flag 805 of the search result table 800 output in step S2005, there is a module in which the matching image buffer 804 is “output image buffer”. It is determined whether or not. If it is determined that the image buffer specified in step S2002 is not set in the output image buffer of the module upstream of the selected module, the process proceeds to step S2007. If it is determined that the image buffer specified in step S2002 is set in the output image buffer of the module upstream of the selected module, the process proceeds to step S2008.

  In step S2007, the CPU 101 of the information processing apparatus 100 notifies that the image buffer specified in step S2002 is not set in the output image buffer of the module upstream of the currently selected module. The notification method is not particularly limited. For example, notification may be performed in a notification area 1104 as shown in FIG. By notifying the user that the image buffer specified in step S2002 is not set in the output image buffer of the module upstream from the currently selected module, there is an effect of allowing the user to recognize a setting error. Image data must be output to the image buffer set as the input image buffer. That is, a module that can set an input image buffer acquires image data from the image buffer set in the input image buffer and executes a predetermined process, but nothing is stored in the image buffer in the first place. If it is not, the predetermined process cannot be executed. In order to execute the predetermined processing, the image buffer must be set as an output image buffer in a module (upstream module) whose processing order is before the module for setting the input image buffer. Therefore, in step S2006, it is determined whether or not the image buffer specified in step S2002 is set in the output image buffer of the module upstream from the currently selected module, and if not set, the user is notified. Yes. In the example of FIG. 22, “image buffer 2” that is the input image buffer of the median module is not set in the output image buffer of the module arranged upstream of the median module having the module ID “U00031”. Recognize. Therefore, this is notified to the user in the notification area 1104.

  In step S2008, the CPU 101 of the information processing apparatus 100 determines whether the module that executes the process can be specified using the image buffer specified in step S2002 as a result of the search in step S2005. Detailed processing is the same as that in step S1707.

  In step S2009, the CPU 101 of the information processing apparatus 100 identifies and displays the image buffer of the module searched and specified in step S2005, which is the same as the image buffer specified in step S2002 (display control unit). Detailed processing is the same as that in step S1708.

  In step S2010, the CPU 101 of the information processing apparatus 100 has been selected by the user to notify that there is no module that performs processing using the image buffer specified in step S2002 as a result of searching in step S2005. The image buffer set in the input image buffer of the selected module is identified and displayed (display control means). Detailed processing is the same as that in step S1709.

  When the process in step S2009 or step S2010 is completed, the process proceeds to step S2101 in FIG.

  Subsequently, the explanation will move to the explanation of FIG. In step S2101, the CPU 101 of the information processing apparatus 100 determines whether an output image buffer of a module on the currently selected processing flow (for example, a module selected in the module selection process described above) has been set. . More specifically, it is determined whether or not an image buffer created in advance as an output image buffer is selected in the parameter list area 1103 of the selected module. If it is determined that the output image buffer has been set, the process advances to step S2102. If it is determined that the output image buffer is not set, the parameter change process is terminated.

  In step S2102, the CPU 101 of the information processing apparatus 100 specifies the image buffer selected in the parameter list area 1103 (image buffer specifying unit). In step S2103, the CPU 101 of the information processing apparatus 100 sets the image buffer specified in step S2102 as the output image buffer of the selected module. Detailed processing is the same as in step S2003.

  In step S2104, the CPU 101 of the information processing apparatus 100 displays the image buffer name 902 of the image buffer set in step S2103 in the parameter list area 1103.

  In step S2105, the CPU 101 of the information processing apparatus 100 performs a module for performing image processing using the image buffer specified in step S2102 among modules different from the modules selected in the processing flow (the image buffer is an input image). The module which is set in the buffer or the output image buffer) is searched from the modules arranged in the processing flow (module specifying means). Details of the image buffer search processing are shown in FIG.

  In step S <b> 2106, the CPU 101 of the information processing apparatus 100 includes step S <b> 2102 among the modules arranged upstream of the position where the selected module is arranged (processing is executed before the selected module). It is determined whether or not there is a module in which the same image buffer as the image buffer specified in step 1 is set as the output image buffer. Detailed processing is the same as that in step S2006. If it is determined that the image buffer specified in step S2102 is set in the output image buffer of the module upstream of the selected module, the process proceeds to step S2107. If it is determined that the image buffer specified in step S2102 is not set in the output image buffer of the module upstream from the selected module, the process proceeds to step S2108.

  In step S2107, the CPU 101 of the information processing apparatus 100 notifies that the image buffer specified in step S2102 is set in the output image buffer of the module upstream of the currently selected module. The notification method is not particularly limited. For example, notification may be performed in a notification area 1104 as shown in FIG. By notifying the user that the image buffer specified in step S2002 is set in the output image buffer of the module upstream from the currently selected module, there is an effect of allowing the user to recognize the setting error. Depending on the user, it may be desirable to leave the image data of the processing result output from a certain module in the image buffer. However, if another module outputs the processed image data to the image buffer, the image data temporarily stored in the image buffer is overwritten. In order to prevent this, in step S2106, it is determined whether or not the image buffer specified in step S2102 is set in the output image buffer of the module upstream from the selected module. I'm trying to notify you. In the example of FIG. 23, it can be seen that “image buffer 1” that is the output image buffer of the median module is set in the output image buffer of the module arranged upstream of the median module having the module ID “U00031”. . Therefore, this is notified to the user in the notification area 1104.

  In step S <b> 2108, the CPU 101 of the information processing apparatus 100 determines whether the module that executes the process can be identified using the image buffer identified in step S <b> 2102 as a result of the search in step S <b> 2105. Detailed processing is the same as that in step S1713.

  In step S2109, the CPU 101 of the information processing apparatus 100 identifies and displays the image buffer of the module searched and specified in step S2105, which is the same as the image buffer specified in step S2102 (display control unit). Detailed processing is the same as that in step S1714.

  In step S2110, the CPU 101 of the information processing apparatus 100 has been selected by the user to notify that there is no module that performs processing using the image buffer specified in step S2102 as a result of searching in step S2105. The image buffer set in the output image buffer of the selected module is identified and displayed (display control means). Detailed processing is the same as in step S1715.

  Next, the image buffer search process will be described with reference to FIGS.

  First, in step S2401, the CPU 101 of the information processing apparatus 100 refers to the module (the module with the earliest processing order) arranged at the top of the processing flow constructed in the processing flow drawing area 1101. The record with the smallest INDEX 401 in the processing flow table 400 may be referred to.

  In step S2402, the CPU 101 of the information processing apparatus 100 determines whether the module being referred to is a branch module. What is necessary is just to determine according to the module name of the module under reference. If it is determined that the module being referred to is a branch module, the process advances to step S2403. If it is determined that the module being referred to is not a branch module, the process advances to step S2407.

  In step S2403, the CPU 101 of the information processing apparatus 100 refers to the branch THEN table 610 to search for a branch destination module because the module being referred to is a branch module. In step S2404, the CPU 101 of the information processing apparatus 100 sets the same image buffer as the target image buffer as the input image buffer or the output image buffer for each module included in the referenced branch THEN table 610. Search module (execute image buffer search processing). That is, a recursive call is executed.

  In step S2405, the CPU 101 of the information processing apparatus 100 refers to the branch ELSE table 620 to search for another branch destination module. In step S2406, the CPU 101 of the information processing apparatus 100 sets the same image buffer as the target image buffer as the input image buffer or the output image buffer for each module included in the referenced branch ELSE table 620. Search module (execute image buffer search processing). That is, a recursive call is executed.

  In step S2407, the CPU 101 of the information processing apparatus 100 determines whether the module being referred to is a loop module. What is necessary is just to determine according to the module name of the module under reference. If it is determined that the module being referred to is a loop module, the process advances to step S2408. If it is determined that the module being referred to is not a loop module, the process advances to step S2410.

  In step S2408, the CPU 101 of the information processing apparatus 100 refers to the loop table 500 to search for a looping module because the module being referred to is a loop module. In step S2409, the CPU 101 of the information processing apparatus 100 sets the same image buffer as the target image buffer as the input image buffer or the output image buffer for each module included in the referenced loop table 500. Search for a module that is running (executes image buffer search processing). That is, a recursive call is executed.

  In step S2410, the CPU 101 of the information processing apparatus 100 determines whether the module being referred to is a switch module. What is necessary is just to determine according to the module name of the module under reference. If it is determined that the module being referred to is a switch module, the process proceeds to step S2411. If it is determined that the module being referred to is not a switch module, the process proceeds to step S2501 in FIG.

  In step S2411, the CPU 101 of the information processing apparatus 100 refers to the switch ELSE table 720 to search for a branch destination module because the module being referred to is a switch module. In step S2409, the CPU 101 of the information processing apparatus 100 sets the same image buffer as the target image buffer as the input image buffer or the output image buffer for each module included in the switch ELSE table 720 being referred to. Search module (execute image buffer search processing). That is, a recursive call is executed.

  In step S2413, the CPU 101 of the information processing apparatus 100 refers to the switch CASE table 730 to search for another branch destination module. In step S2414, the CPU 101 of the information processing apparatus 100 sets the same image buffer as the target image buffer as the input image buffer or the output image buffer for each module included in the switch CASE table 730 being referred to. Search module (execute image buffer search processing). That is, a recursive call is executed.

  In step S2415, the CPU 101 of the information processing apparatus 100 determines whether there is an unprocessed switch CASE table in step S2414. If it is determined that there is an unprocessed switch CASE table, the process proceeds to step S2416. If it is determined that there is no unprocessed switch CASE table, the process proceeds to step S2501 in FIG.

  In step S2416, the CPU 101 of the information processing apparatus 100 refers to an unprocessed switch CASE table. For example, the switch table 700 shown in FIG. 7 includes two switch CASE tables, a switch CASE table 730 and a switch CASE table 740. If the switch CASE table 730 is referred to in step S2413 and step S2414 is executed, the remaining switch CASE table 740 must be processed. In step S2416, the switch CASE table 740 is referred to.

  The description will be moved to FIG. In step S2501, the CPU 101 of the information processing apparatus 100 determines whether an input image buffer can be set for the module being referred to. Judgment is made with reference to the input parameters of the module being referenced. If it is determined that the input image buffer can be set in the module being referred to, the process advances to step S2502. If it is determined that the input image buffer cannot be set in the module being referred to, the process advances to step S2506.

  In step S2502, the CPU 101 of the information processing apparatus 100 determines whether the same image buffer as the target image buffer is set as the input image buffer of the module being referred to. More specifically, it is determined whether or not the name of the image buffer set in the input image buffer among the input parameters of the module being referred to is the same as the name of the target image buffer. If it is determined that the same image buffer as the target image buffer is set as the input image buffer of the module being referred to, the process advances to step S2503. If it is determined that the same image buffer as the target image buffer is not set as the input image buffer of the module being referred to, the process proceeds to step S2506.

  In step S2503, the CPU 101 of the information processing apparatus 100 determines whether the module determined to have the same image buffer as the module selected in step S2502 set as the input image buffer is upstream of the module being selected. It is determined whether (processing order is early) or not. If it is determined that the module is located upstream from the selected module, the process advances to step S2504. If it is determined that the module is not located upstream from the selected module, the process advances to step S2505.

  In step S2504, the CPU 101 of the information processing apparatus 100 adds a new record to the search result table 800, stores the module ID of the referenced module in the module ID 802, and stores the module name of the referenced module in the module name 803. To do. Then, “input image buffer” is stored in the coincidence image buffer 804, and “1” is stored in the upstream flag 805.

  On the other hand, in step S2505, the CPU 101 of the information processing apparatus 100 adds a new record to the search result table 800, and stores information in the same manner as in step S2504. However, “0” is stored in the upstream flag 805.

  In step S2506, the CPU 101 of the information processing apparatus 100 determines whether an output image buffer can be set for the module being referred to. Judgment is made with reference to the output parameter of the module being referenced. If it is determined that the output image buffer can be set in the module being referred to, the process advances to step S2507. If it is determined that the output image buffer cannot be set in the module being referred to, the process proceeds to step S2511.

  In step S2507, the CPU 101 of the information processing apparatus 100 determines whether the same image buffer as the target image buffer is set as the output image buffer of the module being referred to. More specifically, it is determined whether or not the name of the image buffer set in the output image buffer among the output parameters of the module being referred to is the same as the name of the target image buffer. If it is determined that the same image buffer as the target image buffer is set as the output image buffer of the module being referred to, the process advances to step S2508. If it is determined that the same image buffer as the target image buffer is not set as the output image buffer of the module being referred to, the process proceeds to step S2511.

  In step S2508, the CPU 101 of the information processing apparatus 100 determines whether the module determined to have the same image buffer as the module selected in step S2507 set as the output image buffer is upstream of the selected module. It is determined whether (processing order is early) or not. If it is determined that the module is located upstream of the selected module, the process advances to step S2509. If it is determined that the module is not located upstream from the selected module, the process advances to step S2510.

  In step S2509, the CPU 101 of the information processing apparatus 100 adds a new record to the search result table 800, stores the module ID of the module being referenced in the module ID 802, and stores the module name of the module being referenced in the module name 803. To do. Then, “output image buffer” is stored in the coincidence image buffer 804, and “1” is stored in the upstream flag 805.

  On the other hand, in step S2510, the CPU 101 of the information processing apparatus 100 adds a new record to the search result table 800, and stores information in the same manner as in step S2509. However, “0” is stored in the upstream flag 805.

  In step S2511, the CPU 101 of the information processing apparatus 100 determines that the processing order of the module being referred to is a reference table (processing flow table 400, loop table 500, branch THEN table 610, branch ELSE table 620, switch ELSE table 720, switch In the CASE table 730 and the switch CASE table 740), it is determined whether or not it is the last. That is, it is determined whether or not the processing in steps S2402 to S2510 has been executed for all modules stored in the table being referenced. If it is determined that the processing order is the last, the process proceeds to step S2512. If it is determined that the processing order is not the last, the image buffer search process is terminated.

  In step S2512, the CPU 101 of the information processing apparatus 100 refers to the module next to the module being referred to, and returns the process to step S2402. Since the module selected by the user is not referred to, the module next to the module is referred to.

  As described above, the modules constituting the processing flow are referred to in the processing order instructed by the user, and the same image buffer as the image buffer set in the module selected by the user is the input image buffer or the output image buffer. Search for modules that are set to. If there is a corresponding module, the result is recorded in the search result table 800, so that information related to the image buffer of the module in which the same image buffer is set is identified and displayed in the module selection process and parameter change process described above. be able to.

  As described above, according to the present embodiment, it is possible to display an area for displaying information related to an image buffer set in a module constituting a processing flow for executing image processing in the processing flow. Play.

  Next, the second embodiment will be described. The second embodiment is a modification of the parameter changing process shown in FIGS. 20 and 21 of the above-described embodiment.

  The above-described embodiment is a mechanism for identifying and displaying which module uses the same image buffer as the set image buffer when the input image buffer or the output image buffer of the selected module is set. The second embodiment is a mechanism for further improving this.

  When setting the input image buffer, it is difficult to know which module processing result is output to the image buffer to be set. For this reason, in the above-described embodiment, which module uses the same image buffer as the set image buffer is identified and displayed. However, it does not make much sense to identify and display a module downstream from the module that sets the input image buffer.

  Therefore, in the second embodiment, out of modules using the same image buffer as the set image buffer, a module upstream from the module that sets the image buffer is specified. Of the specified modules, the module located at the most downstream is identified and displayed. That is, it is a mechanism for identifying and displaying a module that outputs a processing result immediately before the image buffer to be set. Also, by executing the same processing when setting the output image buffer, it becomes easy to understand which module processing result is overwritten.

  Hereinafter, such a second embodiment will be described. As described above, the second embodiment is a modification of the parameter changing process shown in FIGS. 20 and 21 of the above-described embodiment. Therefore, the hardware configuration, the functional configuration, the table configuration, the flowchart, and the like are the same as those in the above-described embodiment, and the description thereof is omitted.

  FIG. 26 and FIG. 27 are flowcharts showing the flow of parameter change processing (modified examples of FIG. 20 and FIG. 21). The same number is attached | subjected about the process same as the parameter change process in embodiment mentioned above. In the description of the second embodiment, a description will be given of portions that are different from the processing in the above-described embodiment.

  Steps S2001 to S2007 in FIG. 26 are the same as steps S2001 to S2007 in FIG.

  In step S2601, the CPU 101 of the information processing apparatus 100 returns the information related to the image buffer in the image buffer display area, which is identified and displayed in the processing of step S1708 in FIG. 17 described above, to the original display form. That is, the state before the identification display is restored. By doing so, it is possible to reset what has been identified and displayed in the past, and to make the user recognize which is identified and displayed according to the current operation. When the process of step S2601 is completed, the process proceeds to step S2008 in FIG. Step S2008 in FIG. 26 is the same processing as step S2008 in FIG. 20 described above. If it is determined that the result of the search has been specified, the process proceeds to step S2602. If it is determined that it has not been specified, the process proceeds to step S2010 in FIG.

  In step S2602, the CPU 101 of the information processing apparatus 100 specifies a module arranged upstream of the selected module from the module image buffers searched and specified in step S2005 of FIG. Then, the output image buffer of the module arranged most downstream among the specified modules is identified and displayed.

  This will be described more specifically. An upstream flag 805 exists in the search result table 800 generated in step S2005 of FIG. The module having the upstream flag 805 of “1” is identified, and the record having the largest INDEX 801 among the modules and the matching image buffer 804 being “output image buffer” is identified. Then, the output image buffer of the module indicated by the module ID 802 of this record is identified and displayed on the processing flow drawing area 1101.

  FIG. 28 shows a processing flow construction screen 1100 when the icon “U00031: median” is selected in the processing flow and the setting of the input image buffer is accepted in the parameter list area 1103. As shown in FIG. 28, when the input image buffer of “U00031: median” is set to “image buffer 1”, the module in which “image buffer 1” is set is searched by the image buffer search process. As a result, “U00001: Camera”, “U00022: Median”, and “U00041: Image display” are specified. Among these three, “U00022: median” whose processing order is close to “U00031: median” is specified, and information on the output image buffer of “U00022: median” is identified and displayed as shown in FIG.

  The description is moved to FIG. Steps S2101 to S2107 in FIG. 27 are the same as steps S2101 to S2107 in FIG.

  In step S2701, the CPU 101 of the information processing apparatus 100 returns the information related to the image buffer in the image buffer display area, which is identified and displayed in the processing of step S1708 in FIG. 17 described above, to the original display form. That is, the state before the identification display is restored. In step S2701, the information regarding the image buffer identified and displayed by the processing in step S2602 or S2010 in FIG. 26 is left in the display form.

  When the process of step S2701 is completed, the process proceeds to step S2108 of FIG. Step S2108 in FIG. 27 is the same processing as step S2108 in FIG. If it is determined that the search result has been specified, the process advances to step S2702. If it is determined that it cannot be specified, the process proceeds to step S2010 in FIG.

  In step S2702, the CPU 101 of the information processing apparatus 100 specifies a module arranged upstream of the selected module from the module image buffers searched and specified in step S2105 of FIG. Then, the output image buffer of the module arranged most downstream among the specified modules is identified and displayed. Details of the processing are the same as in step S2602.

  FIG. 29 shows a processing flow construction screen 1100 when the icon “U00031: median” is selected in the processing flow and the setting of the output image buffer is accepted in the parameter list area 1103. As shown in FIG. 29, when the output image buffer of “U00031: median” is set to “image buffer 1”, the module in which “image buffer 1” is set is searched by the image buffer search process. As a result, “U00001: Camera”, “U00022: Median”, and “U00041: Image display” are specified. Among these three, “U00022: median” whose processing order is close to “U00031: median” is specified, and information on the output image buffer of “U00022: median” is identified and displayed as shown in FIG.

  As described above, according to the second embodiment, there is an effect that allows the user to easily grasp the usage status of the image buffer set when the image processing program is created.

  The present invention can be implemented as a system, apparatus, method, program, storage medium, or the like, and can be applied to a system including a plurality of devices. You may apply to the apparatus which consists of one apparatus.

  Note that the present invention includes a software program that implements the functions of the above-described embodiments directly or remotely from a system or apparatus. The present invention also includes a case where the system or the computer of the apparatus is achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, or the like.

  Examples of the recording medium for supplying the program include a flexible disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, and CD-RW. In addition, there are magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R), and the like.

  As another program supply method, a browser on a client computer is used to connect to an Internet home page. The computer program itself of the present invention or a compressed file including an automatic installation function can be downloaded from the homepage by downloading it to a recording medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. Let It is also possible to execute the encrypted program by using the downloaded key information and install the program on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. In addition, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can also be realized by the processing.

  Further, the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are realized by the processing.

  Note that the above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

100 Information processing apparatus 101 CPU
102 ROM
103 RAM
104 System Bus 105 Input Controller 106 Video Controller 107 Memory Controller 108 Communication I / F (Interface) Controller 109 Input Device 110 Display 111 External Memory

Claims (7)

An information processing apparatus for generating an image processing program capable of executing image processing on image data,
An operation accepting unit that accepts an operation of adding a module that can execute a predetermined process and that can configure a process flow in a process order specified by a user to the process flow;
Module addition means for adding a module that has received an operation by the operation reception means to the processing flow;
Display control means for displaying in the processing flow an area capable of displaying information indicating the image buffer in a form in which it is possible to identify that no image buffer is set in the module added by the module addition means ;
Setting accepting means for accepting the setting of an image buffer for the module added by the module adding means ,
When the setting accepting unit accepts the image buffer setting by the setting accepting unit, the display control unit displays information indicating the image buffer in the area of the module that accepted the setting, thereby setting the image buffer in the module. An information processing apparatus characterized by identifying and displaying the information. 2. The display control means for identifying and displaying that no image buffer is set in the module added by the module adding means by not displaying information indicating the image buffer in the area. The information processing apparatus described in 1. The display control means displays an area in which information indicating an image buffer set in the module added by the module addition means can be displayed in the vicinity of the module added in the processing flow. The information processing apparatus according to claim 1 or 2 . The display control means includes an image buffer that can be set in the module added by the module addition means, an image buffer for inputting image data used in the image processing of the module, and a result of executing the image processing of the module. If any one of the image buffers for outputting the image data is displayed, an area capable of displaying information indicating one of the image buffers that can be set in the module is displayed in the processing flow. The information processing apparatus according to any one of claims 1 to 3, wherein the information processing apparatus is characterized in that: Wherein the display control unit, when the image buffer added modules in the module addition unit can not be set, according to claim 1 to 4, characterized in that no display area capable of displaying information indicating the image buffer The information processing apparatus according to any one of claims. An information processing apparatus control method for generating an image processing program capable of executing image processing on image data,
An operation reception step for receiving an operation in which the operation reception unit of the information processing apparatus is a module capable of executing a predetermined process and adds a module capable of configuring a process flow in the processing order designated by the user to the process flow. When,
A module addition unit for adding a module that has received an operation in the operation reception step to the processing flow by a module addition unit of the information processing apparatus;
An area in which information indicating the image buffer can be displayed in a form in which the display control means of the information processing apparatus can identify that the image buffer is not set in the module added in the module adding step. A display control step for displaying in
A setting receiving step for receiving a setting of an image buffer for the module added in the module adding step, wherein the setting receiving unit of the information processing apparatus includes :
In the display control step, when the setting of the image buffer is received in the setting receiving step, the image buffer is set in the module by displaying information indicating the image buffer in the area of the module that has received the setting. A method for controlling an information processing apparatus, characterized in that the information is displayed . A program capable of executing a control method of an information processing apparatus for generating an image processing program capable of executing image processing on image data,
The information processing apparatus;
An operation accepting unit that accepts an operation of adding a module that can execute a predetermined process and that can configure a process flow in a process order specified by a user to the process flow;
Module addition means for adding a module that has received an operation by the operation reception means to the processing flow;
Display control means for displaying in the processing flow an area capable of displaying information indicating the image buffer in a form in which it is possible to identify that no image buffer is set in the module added by the module addition means ;
Function as a setting accepting means for accepting the setting of an image buffer for the module added by the module adding means ;
When the setting accepting unit accepts the image buffer setting by the setting accepting unit, the display control unit displays information indicating the image buffer in the area of the module that accepted the setting, so that the image buffer is displayed on the module. A program characterized by displaying that it is set .

Images