JP2021022296A - Information management system, and information management method - Google Patents

Abstract

To obtain information with which analysis in a manufacturing process can be easily performed.SOLUTION: An information management system comprises: a control unit that controls processing executed for an object; an image processing apparatus that is arranged in association with the control unit and executes processing on one or more pieces of image data obtained by picking up an image of the object; and a storage unit. The control unit notifies the image processing apparatus of an imaging timing of the object and transmits, to the image processing apparatus, identification information on the object, and stores, in the storage unit, first data in which the identification information and information on processing related to the object are linked to each other in correspondence with the imaging timing. The image processing apparatus performs processing on the one or more pieces of image data obtained by picking up an image of the object in correspondence with the imaging timing notified from the control unit to obtain information on the object, and stores, in the storage unit, second data in which the information on the object, the image data, and the identification information are linked to each other.SELECTED DRAWING: Figure 1

Description

The present invention relates to a technique for managing information used for analysis of defects in the manufacturing process of various products.

In the manufacturing process of various products, various information in each manufacturing process, for example, detection values of various sensors, image data when image recognition processing is performed, and recognition results are recorded for process control (for example, (Refer to JP-A-2001-144979).

By the way, in the conventional process control as described above, for example, when recording image data or the like, the image data or the like is recorded in association with the collection time (or serial number) thereof. Further, the detection values of various sensors are collected, for example, at regular intervals, or are collected when one process is completed for each product individually, and the collection time and the detection value of the sensor are recorded in association with each other. It was. Therefore, for example, when trying to analyze a defect, it is necessary to find a combination of necessary image data and the like and a sensor detection value by relying on the collection time. Further, if the detection value of the sensor is collected at the completion of each process, it does not necessarily match the collection time of the image data or the like. On the other hand, if the detected values of the sensor are collected at regular intervals, the amount of data will be enormous.

From the above, when trying to utilize the recorded information for defect analysis or the like, there is an inconvenience that it takes a lot of time and effort to find out accurate information. In particular, when a plurality of image data and the like are collected, the labor becomes even greater. Further, even when it is desired to analyze a defect between each process, the time and effort becomes even greater.

Japanese Unexamined Patent Publication No. 2001-144979

Therefore, the present invention provides an information management system and an information management method that can obtain information that can be easily analyzed in a manufacturing process.

The information management system according to one aspect of the present disclosure is arranged in association with a control device that controls processing executed on the object and one or a plurality of image data obtained by imaging the object. A storage device that is communicably connected to each of the control device and the image processing device is provided, and the control device notifies the image processing device of the imaging timing of the object. At the same time, the identification information about the object is transmitted, and the first data in which the information related to the processing related to the object and the identification information are associated with each other corresponding to the imaging timing is stored in the storage device, and the image processing device controls. Information related to the object is obtained by processing one or more image data obtained by imaging the object in accordance with the imaging timing notified from the device, and the information related to the object and the image data are obtained. It is an information management system that stores the second data in which the identification information is associated with the data in the storage device.

According to this aspect, by adding the identification information for each imaging timing, it becomes easy to synchronously manage the information obtained from the control device and the information obtained from the image processing device, so that the analysis in the manufacturing process can be easily performed. It is possible to provide an information management system that can obtain information that can be obtained.

In the above aspect, the identification information includes information for specifying the time related to the imaging timing, information for identifying the individual object, information for specifying the process related to the processing for the object, and information for specifying the equipment related to the processing for the object. At least one of them may be included.

According to this aspect, identification information can be obtained by using information that can be easily obtained in a general manufacturing process without generating new information.

In the above aspect, each of the first data and the second data may be stored in the storage device in a data format in which items are separated by a delimiter.

According to this aspect, the number of items that can be included in each of the first data and the second data can be made variable. Moreover, since it is not necessary to use a special database, maintenance is easy and the configuration can be simplified.

In the above aspect, the information related to the processing related to the object may include the value detected by the sensor.

According to this aspect, various control values (for example, torque, pressure, flow rate, etc.) related to the manufacturing process can be obtained for each imaging timing and used for analysis or the like as appropriate.

In the above aspect, the information relating to the object may include a measured value obtained based on the image data.

According to this aspect, measured values (for example, height, width, etc.) based on image data can be obtained for each imaging timing and used for analysis or the like as appropriate.

The information processing method according to another aspect of the present disclosure includes a control device, an image processing device arranged in association with the control device, and a storage device communicably connected to each of the control device and the image processing device. An information management method in a system including the first step in which a control device controls a process executed on an object, and one or a plurality of image data obtained by an image processing device capturing an image of the object. In the first step, the control device notifies the image processing device of the imaging timing of the object, transmits the identification information about the object, and performs the imaging. The first data in which the information related to the processing related to the object and the identification information are linked according to the timing is stored in the storage device, and in the second step, the image processing device corresponds to the imaging timing notified from the control device. By performing processing on one or more image data obtained by imaging the object, information related to the object is obtained, and the information related to the object, the image data, and the identification information are linked. 2 This is an information management method for storing data in a storage device.

According to this aspect, by adding the identification information for each imaging timing, it becomes easy to synchronously manage the information obtained from the control device and the information obtained from the image processing device, so that the analysis in the manufacturing process can be easily performed. It is possible to provide an information management method for obtaining information that can be obtained.

It is possible to provide an information management system and an information management method that can obtain information that can be easily analyzed in a manufacturing process.

It is a functional block diagram which shows the whole structure of the information management system which concerns on this embodiment. It is a figure which shows the configuration example of the equipment control system. It is a figure which shows the configuration example of an image processing system. It is a figure which shows the configuration example of a storage. It is a figure which shows the configuration example of an information processing apparatus. It is a figure which shows the structural example of the data stored in the storage by each of an equipment control system and an image processing system. It is a flowchart which shows the operation procedure concerning the notification of the imaging timing and the generation of sensor data in an equipment control system. It is a flowchart which shows the operation procedure which concerns on the transmission of the sensor data in an equipment control system. It is a flowchart which shows the operation procedure concerning transmission of image data and measurement data in an image processing system. It is a figure for demonstrating the data which can be referred from the storage in an information processing apparatus. It is a figure for demonstrating the data which can be referred from the storage in an information processing apparatus.

Hereinafter, embodiments according to one aspect of the present invention (hereinafter, referred to as “the present embodiment”) will be described with reference to the drawings. In each figure, those having the same reference numerals have the same or similar configurations.

§1 Application example First, an example of a situation in which the present invention is applied will be described with reference to FIG. FIG. 1 is a functional block diagram showing the overall configuration of the information management system according to the present embodiment. The information management system 1 is arranged in association with a control device 10 that controls a process executed by a robot 12 or the like with respect to an object 82 continuously conveyed by a conveyor 80, and the object 82. An image processing device 20 that executes processing on one or a plurality of image data obtained by imaging, and a storage device 30 that is communicably connected to each of the control device 10 and the image processing device 20 via a network 50. Be prepared. The control device 10 notifies the image processing device 20 of the imaging timing of the object 82, transmits the identification information about the object 82, and the information related to the processing related to the object 82 corresponding to the imaging timing. The first data (sensor data) associated with the identification information is stored (recorded) in the storage device 30. The image processing device 20 obtains information related to the object 82 by processing one or a plurality of image data obtained by imaging the object 82 with the camera 70 in response to the imaging timing notified from the control device 10. Then, the second data (image data, measurement data) in which the information related to the object, the image data, and the identification information are associated with each other is stored (recorded) in the storage device.

The identification information includes information for specifying the time related to the imaging timing, information for identifying the individual of the object 82, information for specifying the process related to the processing for the object 82, information for specifying the equipment related to the processing for the object 82, and the like. Of these, any one or more can be preferably used. The information for specifying the time related to the imaging timing is typically the time when the imaging timing is notified.

Further, the information related to the processing related to the object 82 is, for example, a physical quantity or a character string that can be detected by the sensor regarding the processing in the process, and examples thereof include torque, flow rate, pressure, and length. Further, the information related to the object 82 is, for example, a measured value or a character string obtained by performing an image recognition process or the like based on image data, and as an example, indicates a length, a tint, and the presence or absence of defects. Information etc. can be mentioned.

In the information management system 1, the above identification information is used as common information and is associated with each of the first data and the second data and stored in the storage device 30. Therefore, when it is desired to analyze the manufacturing process or the like, the information management system 1 stores the identification information. Using the information processing device 40, each information in a specific scene (for example, a specific time, a specific process, etc.) can be extracted and used based on the identification information. It is desirable that each of the first data and the second data is stored in the storage device 30 in a general-purpose data format in which items are separated by delimiters (delimiters / symbols). As a result, the number of items can be changed and it is not necessary to use a special database.

§2 Configuration example Next, an example of the functional configuration of the information management system according to the present embodiment will be described with reference to FIG. The information management system 1 according to the present embodiment is used to manage information used for analysis of defects in the manufacturing process of various products, and includes an equipment control system (control device) 10 and an image processing system ( The image processing device) 20, the storage (storage device) 30, the information processing device 40, and the network 50 are included. The equipment control system 10, the image processing system 20, the storage 30, and the information processing device 40 are each connected to the network 50, and are configured to enable information communication between each other. The network 50 is, for example, a local area network.

Although the equipment control system 10 and the image processing system 20 are shown one by one in FIG. 1 for convenience of explanation, in reality, the equipment control system 10 and the image processing are shown for each process included in the manufacturing process. The system 20 is provided in association with each other.

The equipment control system 10 controls the robot 12 and other manufacturing equipment in order to execute processing such as predetermined processing in each process, and acquires the detection values of various sensors which are information at the time of processing and the data thereof. (Hereinafter referred to as "sensor data") Record in the storage 30. The sensor data is set according to the content of the machining process in the target process, and as an example, various data such as torque value, speed, position, length such as height and width, flow rate value, pressure value, etc. Can be mentioned.

The image processing system 20 refers to parts, semi-finished products, etc. (hereinafter, collectively referred to as "work 82") which are objects to be processed 82 when a process such as predetermined processing in each process is executed. Measurement data related to the work 82 is obtained by performing predetermined image processing on the image obtained by taking a picture with the camera 70, and the measurement data and the image data are recorded in the storage 30. The measurement data is set according to the information desired to be obtained in the target process, and examples thereof include various data such as lengths such as height and width, and character strings obtained by character recognition.

The storage 30 is for storing various data transmitted from the equipment control system 10 and the image processing system 20 via the network 50.

The information processing device 40 is configured by using, for example, a general-purpose personal computer, and is used for referring to various data stored in the storage 30 and analyzing a defect or the like.

As shown in FIG. 1, in the information management system 1 of the present embodiment, when processing such as processing is performed in each process, the time when the image of the work 82 to be taken should be taken (hereinafter referred to as “imaging timing”). Is notified from the equipment control system 10 to the image processing system 20, and identification information, which is information for identifying (identifying) the work 82 corresponding to the notification, is transmitted from the equipment control system 10 to the image processing system 20. Send. Then, the equipment control system 10 associates (adds) the above identification information with the sensor data collected corresponding to the shooting timing and records it in the storage 30. Further, the image processing system 20 associates (adds) the above identification information with the image data (s) and the measurement data collected corresponding to the shooting timing and records the data in the storage 30. By doing so, when performing analysis in the information processing apparatus 40, the sensor data, image data, and measurement data for each shooting timing can be uniquely identified, extracted, and used by using the identification information as common information. Can be done. Hereinafter, it will be described in more detail.

FIG. 2 is a diagram showing a configuration example of an equipment control system. The equipment control system 10 shown is a processor 101, a system controller 102, an I / O controller 103, a RAM 104, a storage unit 105, an input interface (IF) 107, an output interface (IF) 108, and a communication interface. (IF) 109 and a memory card interface (IF) 110 are included. Each of these components is data communicably coupled to each other around the system controller 102.

The processor 101 exchanges various programs including the operating system (OS: Operating System) and the equipment control program 106 stored in the storage unit 105 with the system controller 102, and executes them in a predetermined order. Controls the entire manufacturing equipment system 10.

The system controller 102 is connected to the processor 101, the I / O controller 103, the RAM 104, and the storage unit 105 via a bus, and exchanges data with each unit.

The I / O controller 103 is connected to each of the storage unit 105, the input IF 107, the output IF 108, the communication IF 109, and the memory card IF 110, and controls data exchange with each of them.

The RAM 104 provides a work area for storing data necessary for program execution on the processor 101.

The storage unit 105 non-volatilely stores a program or the like executed by the processor 101, and is configured by using, for example, a hard disk drive (HDD). The equipment control program 106 described above is stored in the storage unit 105.

The input IF 107 mediates data exchange between various sensors 60 provided in the manufacturing equipment and the processor 101. As each sensor 60, various sensors that can be used in manufacturing equipment can be considered, and examples thereof include a pressure sensor, a flow rate sensor, a torque sensor, a speed sensor, and a position sensor.

The output IF 108 is provided in the manufacturing equipment and mediates data exchange between various servos 61 and other equipment 62 to be controlled by the equipment control system 10 and the processor 101.

The communication IF 109 mediates data communication between the processor 101 and the image processing system 20 and the storage 30 described above via the network 50.

The memory card IF 110 writes data to and from the removable memory card 63, reads data from the memory card 63, and the like.

FIG. 3 is a diagram showing a configuration example of an image processing system. The illustrated image processing system 20 includes a main processor 201, an image processing processor 202, an I / O controller 203, a RAM 204, a storage unit 205, a camera interface (IF) 207, a communication interface (IF) 208, and the like. It is configured to include a memory card interface (IF) 209. Each of these components is data communicably coupled to each other.

The main processor 201 controls the image processing system 20 by exchanging various programs including an operating system (OS: Operating System) and an image processing program 206 stored in the storage unit 205 and executing them in a predetermined order. To do.

The image processing processor 202 obtains measurement data related to the work 82 by performing image processing based on the images obtained from each camera 70 via the camera IF 207.

The I / O controller 203 is connected to each of the RAM 204, the storage unit 205, the camera IF207, the communication IF208, and the memory card IF209, and controls data exchange with each of them.

The RAM 204 provides a work area for storing data necessary for program execution on the main processor 201.

The storage unit 205 non-volatilely stores a program or the like executed by the main processor 201, and is configured by using, for example, a hard disk drive (HDD). The image processing program 206 described above is stored in the storage unit 205.

The camera IF 207 mediates data exchange between each camera 70 provided in the manufacturing equipment and the main processor 201 and the image processing processor 202. Each camera 70 is installed in the manufacturing equipment to capture the state of the work 82 from a plurality of directions.

The communication IF 208 mediates data communication between the main processor 201 and the manufacturing equipment system 10 and the storage 30 described above via the network 50.

The memory card IF 209 writes data to the removable memory card 71, reads data from the memory card 71, and the like.

FIG. 4 is a diagram showing a configuration example of the storage. The illustrated storage 30 includes a main processor 301, an I / O controller 302, a RAM 303, a communication interface (IF) 304, and a storage unit 305. Each of these components is data communicably coupled to each other.

The main processor 301 controls the storage 30 by exchanging various programs including an operating system (OS: Operating System) and a control program stored in the storage unit 305 and executing them in a predetermined order.

The I / O controller 302 is connected to each of the RAM 303, the communication IF 304, and the storage unit 305, and controls data exchange with each of them.

The RAM 303 provides a work area for storing data necessary for program execution on the main processor 301.

The communication IF 304 mediates data communication between the main processor 301 and the manufacturing equipment system 10 and the image processing system 20 described above via the network 50.

The storage unit 305 non-volatilely stores programs and various data executed by the main processor 301, and is configured by using, for example, a hard disk drive (HDD). Image data 306 and measurement data 307 transmitted from the image processing system 20, and sensor data 308 transmitted from the equipment control system 10 are stored in the storage unit 305.

FIG. 5 is a diagram showing a configuration example of the information processing device. The illustrated information processing device 40 is configured by using, for example, a general-purpose personal computer, and includes a main processor 401, an I / O controller 402, a RAM 403, a communication interface (IF) 404, and a storage unit 405. It is configured to include. Each of these components is data communicably coupled to each other.

The main processor 401 is stored in the storage 30 by exchanging various programs including the operating system (OS: Operating System) and the reference / analysis program 406 stored in the storage unit 405 and executing them in a predetermined order. The processing for reference and analysis of the image data 306, the measurement data 307, and the sensor data 308 is performed. References and analyzes based on each data are performed in response to input using an input unit (for example, a keyboard, a mouse, etc.) (not shown), and the contents are displayed on the screen of a display unit (for example, a liquid crystal display) (not shown).

The I / O controller 402 is connected to each of the RAM 403, the communication IF 404, and the storage unit 405, and controls data exchange with each of them.

The RAM 403 provides a work area for storing data necessary for program execution on the main processor 401.

The communication IF 404 mediates data communication between the main processor 401 and the storage 30 via the network 50.

The storage unit 405 non-volatilely stores programs and various data executed by the main processor 401, and is configured by using, for example, a hard disk drive (HDD).

FIG. 6 is a diagram showing a structural example of data stored in the storage by each of the equipment control system and the image processing system. Here, the data stored in the storage 30 by the equipment control system 10 is referred to as "equipment control system information", and the data stored in the storage 30 by the image processing system 20 is referred to as "image processing system information".

The equipment control system information is roughly classified into "association information" which is information used for associating with image processing system information and "sensor data (sensor information)" obtained from each sensor. The equipment control system information is recorded from the equipment control system 10 to the storage 30 in a file of a general-purpose data format (for example, CSV format: Conmma Separated Value) in which each information is separated by, for example, a delimiter (delimiter / code). Will be done. As a result, the number of items can be changed and database maintenance can be eliminated.

The associative information includes individual identification information (lot No.), which is information for identifying each of the workpieces 82 to be processed such as processing, individual identification information (serial No. in lot No.), process information, and equipment. Includes information, product number information, and imaging time.

The individual identification information (lot No.) is a number assigned to the lot to which the work 82 belongs. The individual identification information (serial number in lot No.) is a number assigned to each work 82 in each lot, and for example, a serial number is used. If only one individual identification information is required depending on the target of the individual, either the individual identification information (lot No.) or the individual identification information (serial number in the lot No.) may be omitted.

The process information is information that identifies each process that performs processing such as processing on the work 82. The equipment information is information for identifying equipment used when performing processing such as processing on the work 82. If the process information can be covered by the equipment information, the process information can be omitted. The product number information is information such as a number assigned to each product corresponding to the work 82. The imaging time is information for specifying the time when the above-mentioned imaging timing is notified.

Of these information, at least one of individual identification information (lot No.), individual identification information (serial No. in lot No.), process information, equipment information, and imaging time, which is the same information, can be used as "identification information". it can.

The sensor data includes sensor information item master allocation information, one or more sensor values (numerical values), one or more sensor values (character strings), and other dependent information. The sensor information item master allocation information is allocation information such as the number, name, and unit of sensor values. The sensor value (numerical value) is represented by numerical data among the detection results obtained by each sensor 60. The sensor value (character string) is represented by character string data among the detection results obtained by each sensor 60. Other dependent information is, for example, arbitrary information such as information accompanying each sensor value described above.

The image processing system information is roughly classified into "association information" which is information used for associating with equipment control system information and "measurement data (measurement information)" obtained by image processing. The image processing system information is recorded from the image processing system 20 to the storage 30 in a file of a general-purpose data format (for example, CSV format: Conmma Separated Value) in which each information is separated by, for example, a delimiter (delimiter / code). Will be done. As a result, the number of items can be changed and database maintenance can be eliminated.

The associative information includes individual identification information (lot No.), which is information for identifying each of the workpieces 82 to be processed such as processing, individual identification information (serial No. in lot No.), process information, and equipment. Includes information, product number information, and imaging time. Each of these pieces of information is passed from the equipment control system 10 to the image processing system 20 with notification of the imaging timing. Therefore, detailed description of the contents of each information will be omitted.

The measurement data includes an imaging camera number, an imaging order, measurement data management master allocation information, one or more measured values (numerical values), one or more measured values (character strings), and other dependent information. The imaging camera number is a number for identifying each camera 70. The imaging order is information that specifies the imaging order of the images used for the measurement. The measurement data management master allocation information is allocation information such as the number, names, and units of measured values. The measured value (numerical value) is represented by numerical data among the measured values obtained by image processing based on the image obtained by each camera 70. The measured value (character string) is represented by character string data among the measured values obtained by image processing based on the image obtained by each camera 70. Other dependent information is, for example, arbitrary information such as information accompanying each of the above-mentioned measured values.

§3 Operation example FIG. 7 is a flowchart showing an operation procedure related to notification of imaging timing and generation of sensor data in the equipment control system. Note that this flowchart is an example, and the order of each step may be changed as long as the processing results do not cause contradiction or inconsistency, or other processing steps (not shown) may be further included (described below). The same applies to other flowcharts.

When the processing loop starts when the power is turned on or the like, the processor 101 of the equipment control system 10 determines whether or not to end the processing (step S11). For example, when the power is turned off or the process is temporarily intermediated, the processor 101 determines that the process is finished (step S11; Yes), and a series of processes. End the loop.

When it is not necessary to end the process (step S11; No), the processor 101 performs predetermined equipment control (step S12). Specifically, the processor 101 gives an operation instruction to each servo 61 and other equipment 62.

Next, the processor 101 determines whether or not it is the shooting timing for acquiring the image of the work 82 or its surroundings (step S13). The shooting timing is set in advance, and can be set in various ways, such as when the detection by each sensor 60 is performed during processing such as processing, and when the processing is completed.

When it is the shooting timing (step S13; Yes), the processor 101 stores the sensor data including the detection result (numerical value, character string) by each sensor 60 in the RAM 104 (step S14).

Next, the processor 101 notifies the image processing system 20 of the identification information (step S15), and also notifies the image processing system 20 that it is the imaging timing (step S16). As described above, as the identification information, individual identification information (lot No.), individual identification information (serial No. in lot No.), process information, equipment information, product number information, and imaging time are notified.

Next, the processor 101 generates a file of sensor data (step S17). Here, a file summarizing the identification information and the sensor data as described with reference to FIG. 6 is generated and stored in the memory card 63. As described above, in the present embodiment, a file having a general-purpose data format such as a CSV format is generated.

Next, the processor 101 stores the transmission request of the file generated in step S17 in the RAM 104 (step S18). After that, the process returns to step S11.

FIG. 8 is a flowchart showing an operation procedure related to transmission of sensor data in the equipment control system.

The processor 101 of the equipment control system 10 determines whether or not to end the processing when the processing loop starts when the power is turned on or the like (step S21). For example, when the power is turned off or the process is temporarily intermediated, the processor 101 determines that the process is finished (step S21; Yes), and a series of processes. End the loop.

When it is not necessary to end the process (step S21; No), the processor 101 is in a state of waiting for a file transmission request in the RAM 104 (step S22). This standby state is maintained while there is no file transmission request in the RAM 104 (step S23; No).

When a file transmission request exists in the RAM 104 (step S23; Yes), the processor 101 acquires a file of sensor data from the memory card 63 (step S24) and transmits this file to the storage 30 (step S25). As a result, the sensor data file is stored in the storage 30.

Next, the processor 101 deletes the sensor data file stored in the memory card 63 (step S26), and confirms the file transmission request in the RAM 104 (step S27). After that, the process returns to step S21.

FIG. 9 is a flowchart showing an operation procedure related to transmission of image data and measurement data in an image processing system.

When the processing loop starts when the power is turned on or the like, the main processor 201 of the image processing system 10 determines whether or not to end the processing (step S31). For example, when an operation of turning off the power is performed or an operation of temporarily performing the middle stage of the process is performed, the processor 201 determines that the process is completed (step S31; Yes), and a series of processes. End the loop.

When it is not necessary to end the process (step S31; No), the main processor 201 is in a state of waiting for notification of the imaging timing (step S32). While the equipment control system 10 does not notify the imaging timing (imaging request) (step S33; No), this standby state is maintained.

When the image pickup timing (imaging request) is notified from the equipment control system 10 (step S33; Yes), the main processor 201 acquires image data (camera images) from each camera 70 and causes the image processing processor 202 to input the image data (camera image). (Step S34). Based on the input image, the image processing processor 202 performs predetermined measurement processing and determination processing (step S35).

Next, the main processor 201 generates a file (image data file) that summarizes the image data acquired from each camera 70 and the identification information acquired from the equipment control system 10, and transmits the file (image data file) to the storage 30 (step S36).

Similarly, the main processor 201 generates a file (measurement data file) that summarizes the measurement data such as the measurement value generated by the process of step S35 and the identification information acquired from the equipment control system 10 and transmits it to the storage 30 (measurement data file). Step S37). After that, the process returns to step S31.

10 and 11 are diagrams for explaining data that can be referred to from the storage in the information processing apparatus. As shown in FIG. 10, by accessing the storage 30 by the information processing device 40, the image processing system information 502 including the measurement data and the equipment control system information including the sensor data are based on the association information 501 including the identification information. 503 can be uniquely identified and referred to, and various data analyzes can be performed as needed. Further, as shown in FIG. 11, by accessing the storage 30 by the information processing device 40, the image data file 504 including the image data is uniquely identified and referred to based on the association information 501 including the identification information. Further, if necessary, the image data file 504, the image processing system information 502, and the equipment control system information 503 can be uniquely specified and referred to based on the identification information, and various data analyzes can be performed as needed.

The embodiments described above are for facilitating the understanding of the present invention, and are not for limiting and interpreting the present invention. Each element included in the embodiment and its arrangement, material, condition, shape, size, etc. are not limited to those exemplified, and can be changed as appropriate.

[Appendix 1]
A control device (10) that controls the processing executed for the object, and
An image processing device (20) that is arranged in association with the control device and executes processing on one or more image data obtained by imaging the object.
A storage device (30) communicatively connected to each of the control device and the image processing device, and
With
The control device notifies the image processing device of the imaging timing of the object, transmits identification information (501) regarding the object, and performs the processing regarding the object in response to the imaging timing. The first data in which the information (503) related to the above and the identification information (501) are linked is stored in the storage device.
The image processing device performs processing on one or a plurality of the image data obtained by imaging the object in response to the imaging timing notified from the control device, thereby performing information (502) related to the object. ), And stores the second data in which the information (502) related to the object, the image data (504), and the identification information (501) are associated with each other in the storage device.
Information management system.

[Appendix 2]
The identification information (501) is related to information for specifying a time related to the imaging timing, information for identifying an individual of the object, information for specifying a process related to the process for the object, and information for specifying the process for the object. Contains at least one piece of equipment-identifying information,
The information management system described in Appendix 1.

[Appendix 3]
Each of the first data and the second data is stored in the storage device (30) in a data format in which items are separated by a delimiter.
The information management system according to Appendix 1 or 2.

[Appendix 4]
The information (503) related to the processing regarding the object includes the value detected by the sensor (60).
The information management system according to any one of Appendix 1 to 3.

[Appendix 5]
The information related to the object includes a measured value obtained based on the image data (504).
The information management system according to any one of Appendix 1 to 4.

[Appendix 6]
In a system including a control device (10), an image processing device (20) arranged in association with the control device, and a storage device (30) communicatively connected to each of the control device and the image processing device. It is an information management method
The first step in which the control device (10) controls the processing executed on the object,
A second step in which the image processing apparatus (20) executes processing on one or a plurality of image data obtained by imaging the object.
Including
In the first step, the control device (10) notifies the image processing device (20) of the imaging timing of the object, transmits identification information (501) regarding the object, and the object. The first data in which the information (503) related to the processing related to the object and the identification information (501) are associated with each other in accordance with the imaging timing is stored in the storage device (30).
In the second step, the image processing device (20) obtains one or a plurality of the image data (504) obtained by imaging the object in accordance with the imaging timing notified from the control device (10). ) Is performed to obtain information (502) related to the object, and the information (502) related to the object, the image data (504), and the identification information (501) are linked to each other. The data is stored in the storage device (30).
Information management method.

1: Information management system, 10: Equipment control system (control device), 12: Robot, 20: Image processing system (image processing device), 30: Storage (storage device), 40: Information processing device, 50: Network, 60 : Sensor, 61: Servo, 62: Equipment, 63: Memory card, 70: Sensor, 71: Memory card, 80: Conveyor, 82: Object (work), 101: Processor 101, 102: System controller, 103: I / O controller, 104: RAM, 105: storage device, 106: equipment control program, 107: input interface (IF), 108: output interface (IF), 109: communication interface (IF), 110: memory card interface (IF) ), 201: Main processor, 202: Image processing processor, 203: I / O controller, 204: RAM, 205: Storage device, 206: Image processing program, 207: Camera interface (IF), 208: Communication interface (IF) , 209: Memory card interface (IF), 301: Main processor, 302: I / O controller, 303: RAM, 304: Communication interface (IF), 305: Storage device, 306: Image data, 307: Measurement data, 308 : Sensor data, 401: Main processor, 402: I / O controller, 403: RAM, 404: Communication interface (IF), 405: Storage device, 406: Reference / analysis program, 501: Linking information (identification information), 502: Image processing system information, 503: Equipment control system information, 504: Image data file

The information management system according to one aspect of the present disclosure is arranged in association with a control device that controls a process executed on the object and the control device, and one or a plurality of image data obtained by imaging the object. A storage device that is communicably connected to each of the control device and the image processing device, and the control device notifies the image processing device of the imaging timing of the object. When the identification information about the object is transmitted and the current time is the shooting timing, the first data in which the information related to the processing executed for the object and the identification information are linked is stored in the storage. Stored in the device, the image processing device performs processing on one or more image data obtained by imaging the object when the current time is the imaging timing notified from the control device. The information related to the object is obtained, and the second data in which the information related to the object, the image data, and the identification information are linked is stored in the storage device.

In the above aspect, the identification information includes information for specifying a time related to imaging timing, information for identifying an individual object, information for specifying a process related to processing performed on the object, and equipment related to processing on the object. It may contain at least one of the information that identifies.

In the above aspect, the information related to the processing performed on the object may include the value detected by the sensor.

Claims (6)

A control device that controls the processing performed on the object,
An image processing device that is arranged in association with the control device and executes processing on one or more image data obtained by imaging the object.
A storage device communicatively connected to each of the control device and the image processing device,
With
The control device notifies the image processing device of the imaging timing of the object, transmits identification information about the object, and information related to the processing regarding the object in response to the imaging timing. The first data in which the identification information is associated with the identification information is stored in the storage device.
The image processing device obtains information related to the object by performing processing on one or a plurality of the image data obtained by imaging the object in accordance with the imaging timing notified from the control device. The second data in which the information related to the object, the image data, and the identification information are associated with each other is stored in the storage device.
Information management system. The identification information specifies information for specifying a time related to the imaging timing, information for identifying an individual of the object, information for specifying a process related to the process for the object, and equipment related to the process for the object. Contains at least one of the information to be
The information management system according to claim 1. Each of the first data and the second data is stored in the storage device in a data format in which items are separated by a delimiter.
The information management system according to claim 1 or 2. The information related to the processing regarding the object includes the value detected by the sensor.
The information management system according to any one of claims 1 to 3. The information related to the object includes a measured value obtained based on the image data.
The information management system according to any one of claims 1 to 4. An information management method in a system including a control device, an image processing device arranged in association with the control device, and a storage device communicatively connected to each of the control device and the image processing device.
The first step in which the control device controls the processing performed on the object,
A second step in which the image processing apparatus executes processing on one or a plurality of image data obtained by imaging the object.
Including
In the first step, the control device notifies the image processing device of the imaging timing of the object, transmits identification information about the object, and corresponds to the imaging timing of the object. The first data in which the information related to the processing and the identification information are linked is stored in the storage device.
In the second step, the image processing device performs processing on one or a plurality of the image data obtained by imaging the object in accordance with the imaging timing notified from the control device, thereby performing the target. Obtaining information related to an object, and storing the second data in which the information related to the object, the image data, and the identification information are associated with each other in the storage device.
Information management method.