JP2011186650A - Apparatus and method for processing information, computer program, and recording medium with computer program recorded thereon - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve such a problem that a developer has to perform a large load work, when adjusting a module, since an image of measured result in each processing cannot be confirmed each time a module is adjusted. <P>SOLUTION: A module is selected by an operation from a user, and the record of a processing result table 418 associated with the module is obtained, and an identification place 1203 and an identification result 1204 stored in the obtained record as well as a processed image are displayed to achieve the support of program creation for performing image processing. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an information processing apparatus that performs image processing, an information processing method, a computer program, and a recording medium on which the computer program is recorded, and information processing that displays each image processing result together with an image that identifies the content of each image processing The present invention relates to an apparatus, an information processing method, a computer program, and a recording medium on which the computer program is recorded.

  2. Description of the Related Art Conventionally, for example, an image processing apparatus that performs image processing of image data to be inspected with a camera with a certain logic (processing flow) for the purpose of positioning a substrate or a component in a chip mounter or inspecting a finished product. Widely used.

  As such an image processing apparatus, for example, a general-purpose type image processing apparatus equipped with a predetermined image processing logic, or a dedicated user that can construct a logic that meets the user's needs. There are types of image processing devices.

  Here, the general-purpose type image processing apparatus does not require the construction of a new image processing logic, so it does not require the user's labor when introducing it into an actual manufacturing process, etc., but the logic completely satisfies the user's needs. There are few. On the other hand, a dedicated type image processing apparatus can construct image processing logic that completely satisfies the user's needs. For this reason, it is necessary to develop the image processing logic each time, so a great amount of development effort is required. The development period and the cost were high.

  Therefore, conventionally, for example, a technique for improving the efficiency of logic development as shown in Patent Document 1 below has been proposed. Specifically, in Patent Document 1, a plurality of image processing modules are registered in advance in a computer that develops logic, the developer selects a module that meets the needs of the user, and is necessary for the selected module. By setting parameters and creating source code after creating source code, logic development is made more efficient.

JP 2003-296112 A

  However, when resetting the parameters of such a module, in the technique of Patent Document 1 described above, the processing procedure is determined, and the result of execution based on the processing procedure is confirmed as a result of each series of processing. There is a problem that can not be.

  The present invention creates a processing result table corresponding to a module for which a processing procedure has been determined after the processing is executed, and selects each module by an operation from the user. An object of the present invention is to provide a mechanism for displaying identification contents together.

  An information processing apparatus according to the present invention is an information processing apparatus for executing an application program for causing a computer to perform image processing and displaying an image as a result of the processing, and one or a plurality of processing items constituting the application program And processing item specifying information storage means for storing the processing item specifying information for specifying the processing item in association with each other, processing means for executing the application program, and processing for storing the processing image processed by the executing means Image storage means, the processing item identification information, identification result information indicating at least the identification location and identification content of the processing item, indicating the execution result of the application program, and processing image identification information associated with the processing image Processing result information storage means for storing Among the process items, a designation accepting unit that accepts designation of a process item that displays an in-process result of the application program, and the process item specifying information corresponding to the process item accepted by the designation accepting unit is the process item. From the processing item identification information acquisition unit acquired from the identification information storage unit, the processing item identification information acquired by the processing item identification information acquisition unit, and the processing image identification information stored in the processing result information storage unit, From the identification result information acquisition means for acquiring the identification result information stored in the processing result information storage means and the identification result information acquired by the identification result information acquisition means, on the processed image stored in the processing image storage means And a display means for displaying the identification location and the identification contents.

  The information processing method of the present invention is a processing item for storing one or more processing items constituting an application program for causing a computer to perform image processing in association with processing item specifying information for specifying the processing item. An information processing method comprising an identification information storage device, executed by the information processing device for executing the application program and displaying an image as a result of the processing, wherein the execution step executes the application program, and is processed by the execution means Corresponding to the processed image, the processed image storage step for storing the processed image, the processed item specifying information, the identification result information including at least the identification location of the processed item and the identification content indicating the execution result of the application program Paired with the processed image identification information A processing result information storing step to be stored, a designation receiving step for accepting designation of a processing item for displaying the processing result of the application program among the processing items, and a processing item for which designation has been accepted in the designation accepting step. In the processing item specification information acquisition step for acquiring the corresponding processing item specification information from the processing item specification information storage device, the processing item specification information acquired in the processing item specification information acquisition step, and the processing result information storage step From the stored processing image specifying information, the identification result information acquisition step for acquiring the identification result information stored in the processing result information storage step, and the identification result information acquired in the identification result information acquisition step, Process stored in processed image storage step Characterized in that it comprises a display step of displaying the identification contents as the identification point on the image

  The computer program of the present invention is a process item specification for storing one or more process items constituting an application program for causing a computer to perform image processing in association with process item specifying information for specifying the process item. A computer program comprising an information storage device, causing the application program to execute and function as an information processing device that displays an image as a result of processing, the execution means for executing the application program, and the execution Processing image storage means for storing the processed image processed by the means, the processing item specifying information, the identification result information including at least the identification location of the processing item and the identification content indicating the execution result of the application program, Processing image Processing result information storage means for storing the processing image specifying information associated with each other, designation receiving means for accepting designation of a processing item for displaying the processing result of the application program among the processing items, Process item identification information acquisition means for acquiring the process item identification information corresponding to the process item whose designation has been received by the designation reception means from the process item identification information storage device, and the process acquired by the process item identification information acquisition means Identification result information acquisition means for acquiring the identification result information stored in the processing result information storage means from item specification information and the processing image specification information stored in the processing result information storage means, and the identification result information From the identification result information acquired by the acquisition means, the processing stored in the processed image storage means Characterized in that to function as a display means for displaying identification contents as identification points on the image.

  A computer-readable recording medium according to the present invention stores the computer program according to claim 6.

  According to the present invention, it is possible to provide an information processing apparatus, an information processing method, a computer program, and a recording medium on which the computer program is recorded, which can realize support for creating a program for performing image processing.

1 is a schematic diagram illustrating an example of a schematic configuration of an image processing system according to an embodiment of the present invention. It is a schematic diagram which shows an example of the hardware constitutions inside the information processing apparatus 110 shown in FIG. It is a schematic diagram which shows an example of the hardware constitutions of the image input controller 115f shown in FIG. It is a schematic diagram which shows an example of a function structure of the information processing apparatus 110 shown in FIG. FIG. 5 is a schematic diagram illustrating an example of a module / source code master table 411 illustrated in FIG. 4. FIG. 5 is a schematic diagram illustrating an example of a processing flow / input / output parameter table 412 illustrated in FIG. 4. It is a schematic diagram which shows an example of the process sequence of the control method by the information processing apparatus 110 shown in FIG. It is a schematic diagram which shows an example of an image processing flow construction screen. It is a flowchart which shows an example of the detailed process sequence of the "execution process" of the module in step S117 of FIG. An example of the window which displays the progress image in the iterative process is shown. It is a schematic diagram which shows an example of the process result of the module selected by operation from a user. FIG. 5 is a schematic diagram illustrating an example of a processing result table 418 illustrated in FIG. 4. 10 is a flowchart illustrating an example of a detailed processing procedure of “process execution” of a module in step S202 of FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a schematic diagram illustrating an example of a schematic configuration of an image processing system 100 according to an embodiment of the present invention. As shown in FIG. 1, the image processing system 100 includes an information processing device 110, an input device 120, a display device 130, a camera 140, a lighting device controller 150, a lighting device 160, an external device controller 170, and an inspection. It has a stage 180 on which an object 181 is placed.

  The information processing apparatus 110 is an apparatus that comprehensively controls operations in the image processing system 100. Here, in the present embodiment, an example in which the information processing apparatus 110 is applied as an apparatus that supports development of an image processing application program that operates on an image processing apparatus introduced into an actual manufacturing process will be described. However, the present invention is not limited to this. For example, the present invention includes a form applied as an image processing apparatus introduced into an actual manufacturing process.

  The information processing apparatus 110 is configured to be able to communicate with a camera 140 that captures an image of the inspection target 181 via a predetermined cable or the like. Further, the information processing apparatus 110 is configured to be able to communicate with an illumination apparatus controller 150 that controls the illumination apparatus 160 via a predetermined cable or the like. The information processing apparatus 110 is configured to be able to communicate with an external device controller 170 such as a programmable controller (PCL) that controls the stage 180 via a predetermined cable or the like. Furthermore, the information processing device 110 is configured to be able to communicate with the input device 120 and the display device 130 via a predetermined cable or the like. In other words, the information processing apparatus 110 controls the input device 120, the display device 130, the camera 140, the lighting device controller 150, and the external device controller 170 connected via a predetermined cable or the like, so that the image processing system 100 includes the information processing device 110. Control the overall operation.

  The input device 120 is operated by the user when the user inputs various instructions to the information processing apparatus 110, for example, and the input instruction is sent to the information processing apparatus 110 according to the input instruction operation from the user. In contrast, it is input. The input device 120 is composed of, for example, a keyboard (KB) and a pointing device.

  The display device 130 displays various images and various information on the display screen according to the control of the information processing device 110.

  The camera 140 performs imaging (imaging) of the inspection object 181 placed on the stage 180 according to the control of the information processing apparatus 110, and the image data obtained by the imaging is processed via a predetermined cable or the like. Send to.

  The lighting device controller 150 controls the lighting of the lighting device 160 according to the control of the information processing device 110. Based on the control of the lighting device controller 150, the lighting device 160 performs switching of lighting on / off of the lighting of the inspection target 181 and adjustment of brightness according to the inspection content of the inspection target 181.

  The external device controller 170 controls the stage 180 according to the control of the information processing apparatus 110. The stage 180 moves the placed inspection object 181 to a target position and carries in or out the inspection object 181 based on the control of the external device controller 170. The above is an example of the configuration of the image processing system.

  Next, the hardware configuration of the information processing apparatus 110 will be described. FIG. 2 is a schematic diagram illustrating an example of a hardware configuration of the information processing apparatus 110 illustrated in FIG. In FIG. 2, in addition to the internal configuration of the information processing apparatus 110, various apparatuses connected to the information processing apparatus 110 are also described.

As illustrated in FIG. 2, the information processing apparatus 110 includes a CPU 111, a RAM 112, a ROM 113, a system bus 114, various controllers 115 (115 a to 115 g), and an external memory 116. As various controllers 115, an input controller 115a, a video controller 115b, a memory controller 115c, communication I / F controllers 115d, 115e, and 115g, and an image input controller 115f are configured. The CPU 111 controls each device connected to the system bus 114 based on a program or the like stored in the ROM 113 or the external memory 116 so as to comprehensively control the operation in the information processing apparatus 110. The RAM 112 functions as a main memory and work area for the CPU 111. The CPU 111 implements various operations in the information processing apparatus 110 by loading a necessary program or the like into the RAM 112 and executing the program when executing the processing. The ROM 113 has a BIOS (Basic Input) which is a control program of the CPU 111.
/ Output System) is stored.

  The system bus 114 connects the CPU 111, RAM 112, ROM 113, input controller 115a, video controller 115b, memory controller 115c, communication I / F controllers 115d and 115e, 115g, and image input controller 115f so that they can communicate with each other.

  The input controller 115a controls input from the input device 120 including a keyboard (KB) and a pointing device. The video controller 115b controls display on the display device 130 which is a display device. The memory controller 115 c controls access to the external memory 116. Here, the external memory 116 is composed of, for example, a hard disk (HD) or a flexible disk (FD), and stores a boot program, various application programs, editing files, various data, various information, and the like. In addition, the external memory 116 is an operating system (hereinafter referred to as “OS”), a program for causing the CPU 111 to execute various processes described later, and various types used when performing processes according to the control of the programs. A table, various inspection result information, and the like are also stored.

  The communication I / F controller 115d controls communication with the external device controller 170. Further, the communication I / F controller 115e controls communication with the lighting device controller 150. The image input controller 115 f is configured to be able to receive image data from the camera 140 by communicating with the camera 140. Here, the image input controller 115f may be equipped with hardware capable of performing arithmetic processing on the controller. In the present embodiment, the description is based on the assumption that image data is input from the camera 140, but an image file may be read and input. Further, the communication I / F controller 115g is connected to a network such as a local area network (LAN) 190, and controls communication with various devices connected to the network.

  Next, the hardware configuration of the image input controller 115f will be described with reference to FIG. As shown in FIG. 3, the image input controller 115 f includes a CPU (arithmetic chip) 301, a memory controller 302, an input controller 303, and an on-board memory 304.

  A CPU (arithmetic chip) 301 executes various image processing described later. The memory controller 302 controls the input / output of various data to the on-board memory 304 according to the control of the CPU (arithmetic chip) 301. An input controller 303 controls input of image data from the camera 140. The on-board memory 304 functions as a main memory of the CPU (arithmetic chip) 301. The above is the description of the hardware configuration of the image input controller 115f.

  Next, an example of a functional configuration of the information processing apparatus 110 will be described. FIG. 4 is a schematic diagram illustrating an example of a functional configuration of the information processing apparatus 110 illustrated in FIG.

  As shown in FIG. 4, the information processing apparatus 110 includes a table storage unit 410, a flow creation unit 420, a source code conversion unit 430, a compilation unit 440, a (verification) execution unit 450, a data storage unit 460, and a data input Each functional configuration of the output unit 470 is configured. The table storage unit 410 stores a module / source code master table 411, a processing flow / input / output parameter table 412, a source code table 413, an object code table 414, and a project file table 415. In addition, a conditional expression table 416, a node processing flag table 417, and a processing result table 418 are also stored.

  Here, in the present embodiment, the table storage unit 410 of FIG. 4 is configured in the external memory 116 shown in FIG. 2, for example (including the case where it is configured once in the RAM 112 and then in the external memory 116). . Also, the flow creation unit 420, source code conversion unit 430, compilation unit 440, (verification) execution unit 450, data storage unit 460, and data input / output unit 470 of FIG. And a program stored in the external memory 116.

  The module / source code master table 411 stored in the table storage unit 410 of FIG. 4 will be described with reference to FIG. FIG. 5 is a schematic diagram showing an example of the configuration of the module / source code master table 411.

  As shown in FIG. 5, in the module / source code master table 411, for each index 501, a processing item 502 related to image processing, a source code 503 corresponding to each processing item, and the processing item are realized. An initial value 504 and a processing entity 505 for the module for doing so are associated. This source code is used when the source code conversion unit 430 converts a module to be processed into a source code.

  Next, the processing flow / input / output parameter table 412 stored in the table storage unit 410 of FIG. 4 will be described with reference to FIG. FIG. 6 is a schematic diagram showing an example of the configuration of the processing flow / input / output parameter table 412 shown in FIG. As shown in FIG. 6, the processing flow / input / output parameter table 412 includes, for each index 601, a module 603 relating to image processing, an order 602 of each module 603, and a flow registration name 604 of each module 603. The input parameter 605 and the output parameter 606 in each module 603 are associated with each other. An input parameter 605 indicates an image buffer, a storage area, or the like in which various data used by each module is stored. An output parameter 606 indicates a storage area for storing a result image buffer when each module is executed, a threshold value used for various processes, and the like. A next step 607 indicates an index 601 of a step to be processed next. The next step 607 may have a plurality of indexes. The branch reference 608 indicates a conditional expression table for designating which step is to be processed next by each condition (node) when the “iterative processing” module and the “conditional branch processing” module are set in the module 603. . Further, the processing main body 609 is an item indicating whether the processing is performed in each module by the CPU 111 or the CPU (arithmetic chip) 301 of the image input controller 115f.

  The index (Index) 601 in the processing flow / input / output parameter table 412 shown in FIG. 6 and the index (Index) in the module / source code master table 411 shown in FIG. In this case, each table may be created. In the processing flow / input / output parameter table T600, 2 and 3 of the index (Index) 601 are examples of iterative processing, and 2 to 4 of the index (Index) 601 of the processing flow / input / output parameter table T601 are examples of conditional branch processing. is there.

  The source code table 413 converts all the modules 603 stored in the processing flow / input / output parameter table 412 into source codes using the module / source code master table 411 and registers them. The source code in the module or a part of the modules is stored.

  The object code table 414 stores object code that is an executable module obtained by converting the source code stored in the source code table 413 by the compiling unit 440. The project file table 415 stores initial setting parameters relating to image processing, processing flow sequences, source codes, input / output parameters, and the like. In addition, the conditional expression table 416 stores a conditional expression or the like when the “conditional branch processing” module is set, and the node processing flag table 417 stores the conditional expression when the “parallel branch processing” module is set. Stores the node name and the like.

  The processing result table 418 stored in the table storage unit 410 in FIG. 4 will be described with reference to FIG. FIG. 12 is a schematic diagram illustrating an example of the configuration of the processing result table 418.

  As shown in FIG. 12, the processing result table 418 includes an index 1201 associated with the index 601 in the processing flow / input / output parameter table 412, an identification ID 1202 allocated for each processing result, and a processing target. The identification location 1203 indicating the identification location in coordinates, the identification result 1204 indicating the processing result of the identification location 1203, and the processed image name 1205 indicating the image name to be processed are associated. The identification location 1203 is composed of coordinates having the upper left vertex of the processed image as (0, 0), and is stored in combination with the upper left coordinate of the identification location and the lower right coordinate of the identification location. Since the identification location is rectangular, the identification location is not limited to this as long as the identification location can be specified.

  Next, the flow creation unit 420, the source code conversion unit 430, the compilation unit 440, the execution unit 450, the data storage unit 460, and the data input / output unit 470 of FIG. 4 will be described.

  The flow creation unit 420 creates a processing flow / input / output parameter table 412 for managing the processing sequence of modules included in the module / source code master table 411, and a processing flow drawing area (802 in FIG. 8 described later). It has a function to draw a module in

  The source code conversion unit 430 collates the processing data of each module stored in the processing flow / input / output parameter table 412 created by the flow creation unit 420 with the module / source code master table 411 to source each module. It has a function of converting into code and storing it in the source code table 413.

  The table modules shown in FIGS. 5 and 6 include not only processing for images but also processing for external devices including pre-processing for acquiring images and post-processing for outputting processing results. But of course. For example, a control command for setting the imaging conditions of the camera 140, a control command for the lighting device controller 150 for controlling the lighting device 160, or a control command for the external device controller 170 for controlling movement of the stage, etc. A control command such as transmitting data to a PC connected on the LAN may be performed.

  The compiling unit 440 has a function of generating executable object code from the source code stored in the source code table 413 and storing the generated object code in the object code table 414.

  There are two types of compilation performed by the compiling unit 440: debug compilation and release compilation. Here, in this embodiment, during the process flow creation, debugging / compilation that enables step execution at the source code level is performed, and release / compilation that generates a file that can be used online is performed when data is saved. Do. At this time, both the debug compilation and the release compilation refer to the source code generated by the same conversion method.

  The (verification) execution unit 450 executes the object code stored in the object code table 414 created by the compiling unit 440, results image display area (803 in FIG. 8 described later), processing flow / input / output parameter table 412 is updated.

  For example, the data storage unit 460 outputs the source code table 413, the object code table 414, and the project file table 415 in the RAM 112 to the external memory 116, and performs data storage processing.

  The data input / output unit 470 has a function of managing input / output parameters used in each module.

  Next, the overall processing in this embodiment will be described with reference to FIG. FIG. 7 is a flowchart illustrating an example of a processing procedure of “project construction processing” performed by the CPU 111 of the information processing apparatus 110. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step S101, the CPU 111 of the information processing apparatus 110 displays an image processing project development screen 800 for developing the image processing system illustrated in FIG. 8 based on an input instruction from the input apparatus 120, for example. Process to be displayed.

  FIG. 8 is a schematic diagram illustrating an example of the image processing project development screen 800. The image processing project development screen 800 shown in FIG. 8 includes a tool box 801 that displays available processing units (that is, modules related to image processing), and an execution order of image processing (that is, an execution order of each module). A processing flow drawing area 802 for drawing a flowchart, a result image display area 803 for displaying a result image executed in each image processing (that is, processing of each module), a tool bar 807, and a processing result for displaying a processing execution result A display area 808, an image selection area 809 for selecting an image when there are a plurality of processed images, a previous button 810, a next button 811 provided in the image selection area 809, and an image processing program There is also provided a close button (not shown) that is operated when the development is completed. Further, the image processing project development screen 800 shown in FIG. 8 includes parameters used in each step (that is, each module) of the flowchart of the processing flow drawing area 802 when, for example, a new module is registered or a parameter is edited. Is displayed, and a result image display area 803 for displaying a result image executed by setting the parameters is displayed. The example of the project construction screen in FIG. 8 also includes a module for controlling the flow by branch processing. Here, the result image display area 803 is an area for displaying the result image of each module in the processing flow drawing area 802. This may be a preview image or a reduced image. In the case of conditional branch processing, an image of a node (branch) that satisfies the condition is displayed, and a blackout image is displayed because processing is not performed for a node that does not satisfy the condition. In the present invention, the blacked-out image is displayed in the result image display area 803, but the result image processed by the previous module may be displayed. At this time, if the results of all processing flows do not fit in the result image display area 803, the display area may be changed using horizontal and vertical scroll bars.

  The processing result display area 808 is an area for displaying a result image of the module when one of the modules in the processing flow drawing area 802 is selected by a user operation. If the module selected by the operation from the user is a conditional branch process, a blacked-out image is displayed in the process result display area 808. In the present invention, the blacked-out image is displayed in the processing result display area 808, but the result image processed in the previous module may be displayed. The above is an example of the configuration of the image processing project development screen.

  Returning to the description of FIG. When the process of step S101 ends, the CPU 111 advances the process to step S102. In step S102, the CPU 111 of the information processing apparatus 110 determines whether or not to newly develop an image processing program using the image processing project development screen 800 displayed in step S101 based on an input instruction from the input device 120. to decide.

  As a result of the determination in step S102, when a new image processing program is not developed, that is, when editing an already created image processing flow (step S102 / NO), the process proceeds to step S103.

  In step S 103, the CPU 111 of the information processing apparatus 110 reads the project file table 415 stored in the external memory 116 and stores it in the RAM 112. Also, by pre-setting

  After the process of step S103 is completed, or when it is determined in step S102 that a new image processing program is to be developed (step S102 / YES), the CPU 111 advances the process to step S104.

  In step S104, the CPU 111 of the information processing apparatus 110 determines whether or not there is an input instruction from the input apparatus 120 (specifically, an input instruction for the image processing project development screen 800 displayed in step S101).

  As a result of the determination in step S104, if it is determined that an input instruction from the input device 120 is not received (step S104 / NO), the process waits in step S104 until an input instruction is received from the input device 120. On the other hand, as a result of the determination in step S104, if it is determined that an input instruction from the input device 120 has been received (input is present) (step S104 / YES), the process proceeds to step S105.

  In step S <b> 105, the CPU 111 of the information processing apparatus 110 performs a process for determining the selected process content based on the input instruction received from the input apparatus 120. In this example, the processing contents determined in step S105 are “new addition processing”, “change processing”, “move processing”, “insertion processing”, and “deletion processing”. Note that the processing content given here is an example, and it is of course possible to determine other processing content in step S105.

  Subsequently, in step S106, the CPU 111 of the information processing apparatus 110 executes the processing content determined in step S105. For example, in the case of “insertion processing”, a new module is inserted between designated modules. If it is “delete processing”, the specified module is deleted. Note that the processing content given here is an example.

  For example, when a “binarization” module selected by a user operation from the toolbox 801 in the state where there is no module in the processing flow drawing area 802 is dragged and dropped into the processing flow drawing area 802, “new addition processing” ”, A setting property (not shown) in which the setting content of“ binarization ”can be set is displayed, and input of the input parameter 605 and the output parameter 606 is accepted. The processing flow / input / output parameter table 412 is newly added based on the setting contents input by the user operation, the corresponding record of the module / source code master table 411 corresponding to the module, and the position order of the added module. Add a record. Each module arranged in the processing flow drawing area 802 and each record stored in the processing flow / input / output parameter table 412 are stored in association with each other.

  In step S116, the CPU 111 of the information processing apparatus 110 determines whether or not the execution process button has been pressed by an operation from the user. If it is determined that the execution process button has been pressed (step S116 / YES), the CPU 111 advances the process to step S117.

  In step S <b> 117, the CPU 111 of the information processing apparatus 110 performs “execution processing” set in the processing flow drawing area 802. Details of the execution process of step S117 will be described later with reference to FIG. When the process of step S117 ends, the process returns to step S104 and waits until the next input instruction is received from the input device 120.

  On the other hand, in the determination process of step S116, when it cannot be determined that the execution process button has been pressed (step S116 / NO), the CPU 111 advances the process to step S118.

  In step S118, the CPU 111 of the information processing apparatus 110 determines whether the save button has been pressed by an operation from the user. If it is determined that the save button has been pressed (step S118 / YES), the CPU 111 advances the process to step S119.

  In step S 119, the CPU 111 of the information processing apparatus 110 performs “save processing” set on the image processing project development screen 800. When the process of step S119 ends, the image processing project development screen 800 is ended.

  On the other hand, if it is not determined in step S118 that the save button has been pressed (NO in step S118), the process returns to step S104 and waits for an input instruction from the input device 120.

Next, a detailed procedure of the execution process in step S117 in FIG. 7 will be described with reference to FIG. FIG. 9 is a flowchart illustrating an example of a detailed processing procedure of the “execution process” in step S117 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step S201, the CPU 111 (for example, the compiling unit 440) debugs and compiles the object code stored in the source code table 413 by the source code conversion process in the final step of each process, and the object code table Store in 414.

  In step S202, the CPU 111 of the information processing apparatus 110 executes processing for executing the object code debugged and compiled in step S201. Details of the process execution in step S202 will be described later with reference to FIG. Thereafter, the process proceeds to step S203, and the result of each module executed in step S202 is drawn in the result image display area 803. At this time, if the processing flow includes an iterative process, by double-clicking the iterative processing module or selecting a result display from the menu, the elapsed image window at each number of times is shown as an example in FIG. Is displayed.

  In step S204, the CPU 111 of the information processing apparatus 110 determines whether one of the modules arranged in the processing flow drawing area 802 has been selected by an operation from the user. If it is determined that it has been selected (step S204 / YES), the CPU 111 advances the process to step S205.

  On the other hand, if it is not possible to determine that the selection has been made in the determination process in step S204 (step S204 / NO), the process returns to step S204 and waits for an input instruction from the input device 120.

  In step S <b> 205, the CPU 111 of the information processing apparatus 110 acquires from the external memory 116 the first processed image that has been processed among the processed images processed in step S <b> 202. The processing order is determined from the file names and the like assigned in sequential order in the processing order. It is assumed that the processed image is stored in the external memory 116 in step S304 described later. In this embodiment, for the sake of convenience, the first processed image is acquired from the external memory 116, but may be acquired from any processed image.

  In step S206, the CPU 111 of the information processing apparatus 110 identifies the module selected by the operation from the user in step S204, searches the processing flow / input / output parameter table 412 for a record corresponding to the selected module, and identifies the module. To do.

  In step S207, the CPU 111 of the information processing apparatus 110 performs processing image name 1205 that matches the file name of the processing image acquired in step S205 and index (Index) 601 that matches the index (Index) 601 specified in step S206. Based on (Index) 1201, all corresponding records are searched from the processing result table 418 and specified. If the module selected in step S206 is a module that performs processing for displaying all the processing results, search for all processed image names 1205 that match the file names of the processed images acquired in step S205. And identify. Thereby, all the processing results can be acquired from the processing result table 418.

  In step S208, the CPU 111 of the information processing apparatus 110 acquires all the records specified in step S207 and stores them in the RAM 112.

  In step S209, the CPU 111 of the information processing apparatus 110 performs processing on the processing image acquired in step S205, step S215 described later, or step S217 described later using the identification part 1203 of the record stored in the RAM 112 in step S208. The part that has been displayed is displayed. For example, in the processing result screen 1100 shown in FIG. 11, the matching part 1102 is a part that displays the part processed in step S <b> 209 so that it can be identified.

  FIG. 11 is a schematic diagram illustrating an example of the processing result screen 1100. The processing result screen 1100 illustrated in FIG. 11 includes a character recognition location 1101 that indicates the result of character recognition and a matching location 1102 that indicates the result of comparison with a predetermined image. The above is an example of the configuration of the processing result screen 1100.

  In step S210, the CPU 111 of the information processing apparatus 110 searches the processing flow / input / output parameter table 412 for an index (Index) 601 that matches the index (Index) 1201 of the record stored in the RAM 112 in step S208. It is determined whether or not the module 603 of the record includes character recognition processing. If it is determined that the character recognition process is included (step S210 / YES), the CPU 111 advances the process to step S211.

  In step S211, the CPU 111 of the information processing apparatus 110 displays the identification result 1204 at the location processed in step S209 using the record identification result 1204 stored in the RAM 112 in step S208. However, nothing is displayed when “NULL” is stored in the identification result 1204.

  For example, in the processing result screen 1100 shown in FIG. 11, the character recognition location 1101 portion is a display of the location processed in steps S209 and S211. In step S209, the location processed for each character is displayed, and in step S211, the identification result 1204 of the processing result table 418 is displayed at the location displayed in step S209. As a result, the processing result of the module selected by the user in the processing flow drawing area 802 can be displayed in an identifiable manner, and the contents of the identification result can be additionally displayed.

  On the other hand, if it is not determined in step S210 that the character recognition process is included (step S210 / NO), the CPU 111 advances the process to step S212.

  In step S212, the CPU 111 of the information processing apparatus 110 displays the processing results in steps S209 to S211 in the processing result display area 808 on the display device 130 from the video controller 115b.

  In step S213, the CPU 111 of the information processing apparatus 110 determines whether there are a plurality of images processed in step S202. As a determination method, the processing image name 1205 stored in the processing result table 418 is searched, and when different file names exist, it is determined that a plurality of images exist. The determination method is not limited to this. If it is determined that there are a plurality of sheets (step S213 / YES), the CPU 111 advances the process to step S214.

  In step S214, the CPU 111 of the information processing apparatus 110 determines whether or not the next button 811 provided in the image selection area 809 has been pressed. If it is determined that the next button 811 has been pressed (step S214 / YES), the CPU 111 advances the process to step S215. However, if there is no image processed next to the currently displayed image, it cannot be pressed and cannot be determined to have been pressed.

  In step S <b> 215, the CPU 111 of the information processing apparatus 110 acquires a processed image next to the image currently displayed in the processing result display area 808. The processing order of images may be determined from the processing image name 1205 if sequential numbers are assigned to the file names in the processing order. The determination method of the image processing order is not limited to this. After obtaining the image, the process returns to step S206. Thereby, the processing result performed on the next image can be displayed.

  On the other hand, if the determination process in step S214 cannot determine that the next button 811 has been pressed (step S214 / NO), the CPU 111 advances the process to step S216.

  In step S216, the CPU 111 of the information processing apparatus 110 determines whether the previous button 810 provided in the image selection area 809 has been pressed. If it is determined that the previous button 810 has been pressed (step S216 / YES), the CPU 111 advances the process to step S216. However, if there is no processed image before the currently displayed image, it cannot be pressed and cannot be determined to have been pressed.

  In step S <b> 217, the CPU 111 of the information processing apparatus 110 acquires an image processed before the image currently displayed in the processing result display area 808. The processing order of images may be determined from the processing image name 1205 if sequential numbers are assigned to the file names in the processing order. The determination method of the image processing order is not limited to this. After obtaining the image, the process returns to step S206. Thereby, the processing result performed with respect to the previous image can be displayed.

  On the other hand, in the determination process of step S216, when it cannot be determined that the previous button 810 has been pressed (NO in step S216), the process returns to step S104 and waits for an input instruction from the input device 120. The above is the detailed description of the execution process.

Next, a detailed procedure of the execution process of step S202 of FIG. 9 will be described with reference to FIG. FIG. 13 is a flowchart illustrating an example of a detailed processing procedure of “execution processing” in step S202 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step S <b> 301, the CPU 111 of the information processing apparatus 110 captures all the images input from the camera 140 from the image input controller 115 f and stores them in the external memory 116. An image already stored in the external memory 116 and prepared may be used. In this case, step S301 is not necessary.

  In step S302, the CPU 111 of the information processing apparatus 110 determines whether one of the modules arranged in the processing flow drawing area 802 has been selected by an operation from the user. If it is determined that it has been selected (step S302 / YES), the CPU 111 advances the process to step S303.

  On the other hand, if it is not possible to determine that the selection has been made in the determination process in step S302 (step S302 / NO), the process proceeds to step S315.

  In step S303, the CPU 111 of the information processing apparatus 110 executes the object code stored in the object code table 414 in step S201, and the process described in the source code for the image stored in the external memory 116 in step S301. I do. The order of images to be processed is not particularly limited. However, it is necessary to perform processing such as assigning sequential numbers to file names in order of processing so that the processing order can be identified. The identification method of the processing order is not limited to this.

  In step S304, the CPU 111 of the information processing apparatus 110 stores the result executed in step S303 in the processing result table 418. The index (Index) 1201 stores the index (Index) 601 of the module that performed the processing, the identification ID 1202 is assigned a number for identifying each process for each module, and the identification location 1203 is externally displayed in step S301. As a result of processing on the image stored in the memory 116, the identified location is stored in a coordinate format or the like, the identification result 1204 stores the identification result of the identified location 1203, and the processed image name 1205 contains an external name in step S301. The image name of the image stored in the memory 116 is stored.

  In step S305, the CPU 111 of the information processing apparatus 110 stores the processed image stored in the external memory 116 in step S301 so that it can be identified as a processed image. The method of identifying may be made identifiable by changing the file name, or may be distributed to a folder for processed images. The identification method is not limited to this.

  In step S306, the CPU 111 of the information processing apparatus 110 identifies the module selected by the user's operation in step S302, searches the processing flow / input / output parameter table 412 for a record corresponding to the selected module, and identifies the module. To do.

  In step S307, the CPU 111 of the information processing apparatus 110 compares the processing image name 1205 that matches the file name of the processing image stored in step S305 and the index (index) 601 that matches the index (Index) 601 specified in step S306. Based on (Index) 1201, all corresponding records are searched from the processing result table 418 and specified. If the module selected in step S302 is a module that performs processing for displaying all processing results, all processed image names 1205 that match the processed image names stored in step S305 are searched, Identify. Thereby, all the processing results can be acquired from the processing result table 418.

  In step S308, the CPU 111 of the information processing apparatus 110 acquires all the records specified in step S307 and stores them in the RAM 112.

  In step S309, the CPU 111 of the information processing apparatus 110 displays the processed part on the processed image stored in step S305 using the identification part 1203 of the record stored in the RAM 112 in step S308. For example, it is displayed so as to be identifiable like a matching portion 1102 on the processing result screen 1100 shown in FIG. The display method is the same as in step S209.

  In step S310, the CPU 111 of the information processing apparatus 110 searches the processing flow / input / output parameter table 412 for an index (Index) 601 that matches the index (Index) 1201 of the record stored in the RAM 112 in step S308. It is determined whether or not the module 603 of the record includes character recognition processing. If it is determined that the character recognition process is included (step S310 / YES), the CPU 111 advances the process to step S311.

  In step S311, the CPU 111 of the information processing apparatus 110 displays the identification result 1204 at the location processed in step S309, using the record identification result 1204 stored in the RAM 112 in step S308. However, nothing is displayed when “NULL” is stored in the identification result 1204. For example, it is displayed like a character recognition location 1101 on the processing result screen 1100 shown in FIG. The display method is the same as in step S211.

  On the other hand, if it is not determined in step S310 that the character recognition process is included (step S310 / NO), the CPU 111 advances the process to step S312.

  In step S312, the CPU 111 of the information processing apparatus 110 displays the processing results in steps S309 to S311 in the processing result display area 808 on the display device 130 from the video controller 115b. In this embodiment, the processing result is displayed after all the processing in step S303 is performed. However, the processing result is displayed in the processing result display area 808 immediately after the module selected by the user operation in step S302 operates in step S303. May be displayed. In this case, the processing result may be displayed by executing steps S304 to S312 simultaneously with the end of the processing of the module, or another method may be used.

  In step S313, the CPU 111 of the information processing apparatus 110 determines whether there is an unprocessed image among the images stored in the external memory 116 in step S301. In step S305, the processed image and the unprocessed image are stored so as to be identifiable, and determination is made based on this. If it is determined that an unprocessed image exists (step S313 / YES), the CPU 111 returns the process to step S303. Thereby, the image processing can be repeated until there is no unprocessed image. In addition, the processing result of the module selected by the user in the processing flow drawing area 802 is displayed so as to be identifiable for each image processing, and the contents of the identification result 1204 are additionally displayed, so that the processing result is synchronized with the image processing. Can be displayed.

  On the other hand, when it cannot be determined in step S313 that there is an unprocessed image (step S313 / NO), the process returns to step S202.

  Steps S315 to S317 are the same as steps S303 to S305, and a description thereof will be omitted.

  In step S318, the CPU 111 of the information processing apparatus 110 determines whether there is an unprocessed image among the images stored in the external memory 116 in step S315. In step S317, the processed image and the unprocessed image are stored so as to be identifiable, and determination is made based on this. When determining that there is an unprocessed image (step S318 / YES), the CPU 111 returns the process to step S315. Thereby, the image processing can be repeated until there is no unprocessed image.

  On the other hand, if it is not determined in step S318 that there is an unprocessed image (step S318 / NO), the process returns to step S202. The above is the detailed description of the execution process.

  As described above, according to the present embodiment, each image processing result can be displayed together with an image for identifying the contents of each image processing by selecting a module by an operation from the user. Support for creating a program for performing processing can be realized.

  Although the embodiment has been described in detail above, the present invention can take an embodiment as a method, a program, a storage medium, or the like.

  The program according to the present invention is a program that allows a computer to execute (read) each processing method, and the storage medium according to the present invention stores a program that allows the computer to execute each processing method.

  The program in the present invention may be a program for each processing method of each device.

  As described above, a recording medium that records a program that implements the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by performing reading.

  In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk or the like can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on an instruction of the program is actually It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the processing and the processing is included.

  Furthermore, after the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion board or It goes without saying that the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Further, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device.

  Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

  Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network by a communication program, the system or apparatus can enjoy the effects of the present invention.

  In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

DESCRIPTION OF SYMBOLS 100 Image processing system 110 Information processing apparatus 120 Input apparatus 130 Display apparatus 140 Camera 150 Illumination apparatus controller 160 Illumination apparatus 170 External apparatus controller 180 Stage 181 Inspection object 190 LAN (Local Area Network)
111 CPU
112 RAM
113 ROM
114 System bus 115a Input controller 115b Video controller 115c Memory controller 115d, 115e, 115g Communication I / F controller 115f Image input controller 116 External memory

Claims (7)

An information processing apparatus for executing an application program for causing a computer to perform image processing and displaying an image as a result of the processing,
Processing item specifying information storage means for storing one or more processing items constituting the application program and processing item specifying information for specifying the processing item in association with each other;
Execution means for executing the application program;
Processed image storage means for storing a processed image processed by the execution means;
The processing item identification information, the identification result information including at least the identification location of the processing item and the identification content, indicating the execution result of the application program, and the processing image identification information associated with the processing image are associated with each other. Processing result information storage means for storing;
Among the process items, a designation accepting unit that accepts designation of a process item for displaying a process intermediate result of the application program;
A process item specifying information acquiring unit that acquires the process item specifying information corresponding to the process item received by the specification receiving unit from the process item specifying information storage unit;
The identification result information stored in the processing result information storage unit is acquired from the processing item specification information acquired by the processing item specification information acquisition unit and the processing image specification information stored in the processing result information storage unit. Identification result information acquisition means for
From the identification result information acquired by the identification result information acquisition means, display means for displaying the identification location and the identification content on the processed image stored by the processed image storage means;
An information processing apparatus comprising:   The execution means displays the identification location and the identification content on the processed image stored in the processed image storage means from the identification result information acquired by the identification result information acquisition means during execution of the application program. The information processing apparatus according to claim 1, further comprising means. Further comprising character recognition determining means for determining whether or not the processing item received by the designation receiving means is a character recognition process;
The information processing apparatus according to claim 1, wherein the display unit displays the identification content when the character recognition determination unit determines that the character recognition process is being performed. The processed image storage means further comprises storing all processed images when a plurality of images are processed,
4. The display unit according to claim 1, wherein the display unit displays a processed image other than the displayed processed image, an identification location and an identification content associated with the other processed image. The information processing apparatus according to item 1. A processing item specifying information storage device for storing one or more processing items constituting an application program for causing a computer to perform image processing and processing item specifying information for specifying the processing item in association with each other; An information processing method executed by an information processing apparatus that executes an application program and displays an image as a result of processing,
An execution step of executing the application program;
A processed image storage step for storing a processed image processed by the execution means;
The processing item identification information, the identification result information including at least the identification location of the processing item and the identification content, indicating the execution result of the application program, and the processing image identification information associated with the processing image are associated with each other. A processing result information storage step for storing;
A designation receiving step for accepting designation of a processing item for displaying an intermediate processing result of the application program among the processing items;
A process item specifying information acquiring step for acquiring the process item specifying information corresponding to the process item whose specification has been received in the specifying receiving step from the process item specifying information storage device;
The identification result information stored in the processing result information storage step is acquired from the processing item specification information acquired in the processing item specification information acquisition step and the processing image specification information stored in the processing result information storage step. An identification result information acquisition step to be performed;
From the identification result information acquired in the identification result information acquisition step, a display step for displaying the identification location and the identification content on the processed image stored in the processed image storage step;
An information processing method comprising: A processing item specifying information storage device for storing one or more processing items constituting an application program for causing a computer to perform image processing and processing item specifying information for specifying the processing item in association with each other; A computer program for executing an application program and causing it to function as an information processing apparatus that displays an image as a result of processing,
The computer,
Execution means for executing the application program;
Processed image storage means for storing a processed image processed by the execution means;
The processing item identification information, the identification result information including at least the identification location of the processing item and the identification content, indicating the execution result of the application program, and the processing image identification information associated with the processing image are associated with each other. Processing result information storage means for storing;
Among the process items, a designation accepting unit that accepts designation of a process item for displaying a process intermediate result of the application program;
A process item specifying information acquiring unit that acquires the process item specifying information corresponding to the process item received by the specifying receiving unit from the process item specifying information storage device;
The identification result information stored in the processing result information storage unit is acquired from the processing item specification information acquired by the processing item specification information acquisition unit and the processing image specification information stored in the processing result information storage unit. Identification result information acquisition means for
A computer program for functioning as display means for displaying identification locations and identification contents on a processed image stored in the processed image storage means from identification result information acquired by the identification result information acquisition means.   A computer-readable recording medium storing the computer program according to claim 6.

Images