CN113906357A

CN113906357A - Information management system, information management method, and computer program

Info

Publication number: CN113906357A
Application number: CN202080041053.1A
Authority: CN
Inventors: 笠嶋隆则; 松尾信幸
Original assignee: Omron Corp
Current assignee: Omron Corp
Priority date: 2019-07-30
Filing date: 2020-03-10
Publication date: 2022-01-07
Also published as: WO2021019821A1; JP6788235B1; JP2021022296A

Abstract

An information management system comprising: a control device that controls a process performed on an object; an image processing device, which is configured in association with the control device, and executes processing of one or more pieces of image data obtained for the object to be photographed; and a storage device, wherein the control device notifies the image processing device of the shooting time of the object and transmits identification information related to the object, and stores first data in the storage device corresponding to the shooting time, the first data is obtained by associating the related information of the processing of the object with the identification information, the image processing device performs the processing of one or more image data obtained for the shooting object corresponding to the shooting time notified by the control device, thereby obtaining the information related to the object, and stores second data in the storage device, the second data is obtained by associating the information related to the object, the image data and the identification information.

Description

Information management system, information management method, and computer program

Technical Field

The present invention relates to a technique for managing information used for analysis of a failure or the like in a process of manufacturing various products.

Background

In the production of various products, various information in each production process, for example, detection values of various sensors, image data at the time of image recognition processing, and information such as recognition results, are recorded for process management (see, for example, japanese patent laid-open No. 2001-144979).

In the conventional process management as described above, for example, when recording image data or the like, the image data or the like is recorded in association with the acquisition time (or serial number) thereof. The detection values of the various sensors are collected at a fixed cycle, for example, or are collected individually for each product at the completion of one process, and the collection time is recorded in association with the detection values of the sensors. Therefore, for example, when analyzing a failure, it is necessary to find a combination of necessary image data and the like and detection values of the sensor depending on the acquisition timing. Further, if the detection value of the sensor is acquired at the completion of each process, it does not necessarily match the acquisition timing of the image data and the like. On the other hand, if the detection values of the sensors are collected at fixed intervals, the data amount thereof becomes enormous.

In view of the above, there is a problem that a great deal of time and effort is required to find accurate information when the recorded information is to be used for analysis of a failure or the like. In particular, in the case where a plurality of image data and the like are acquired, the time effort becomes more enormous. Further, the time and effort are also increased when analyzing the failure among the respective processes.

Documents of the prior art

Patent document

Patent document 1: japanese patent laid-open No. 2001-144979

Disclosure of Invention

Problems to be solved by the invention

Accordingly, the present invention provides an information management system and an information management method that can obtain information that can be easily analyzed in a manufacturing process.

Means for solving the problems

An information management system of an embodiment of the present disclosure includes: a control device that controls a process performed on an object; an image processing device, which is configured in association with the control device, and executes processing of one or more pieces of image data obtained for the object to be photographed; and a storage device which is communicably connected to the control device and the image processing device, respectively, wherein the control device notifies the image processing device of an imaging timing of an object and transmits identification information on the object, and stores, in the storage device, first data in which information on processing of the object and the identification information are associated with each other, and the image processing device performs processing of one or a plurality of pieces of image data obtained for the object in accordance with the imaging timing notified from the control device, thereby obtaining information on the object, and stores, in the storage device, second data in which information on the object, the image data, and the identification information are associated with each other.

According to this embodiment, by giving the identification information at each shooting timing, the synchronous management of the information obtained from the control apparatus and the information obtained from the image processing apparatus becomes easy, and therefore it is possible to provide an information management system that can obtain information that can be easily analyzed in the manufacturing process.

In the above embodiment, the identification information may include at least one of information for specifying a time related to the imaging timing, information for identifying an individual of the object, information for specifying a process related to the process for the object, and information for specifying a device related to the process for the object.

According to this embodiment, even if new information is not intentionally generated, it is possible to obtain identification information using information that can be easily acquired in a general manufacturing process.

In the embodiment, the first data and the second data may be stored in the storage device in a data format in which items are separated by delimiters (delimiters).

According to this embodiment, the number of items that can be included in each of the first data and the second data can be made variable. Further, since a special database is not required, maintenance is easy and simplification of the structure can be achieved.

In the above embodiment, the information related to the process on the object may include a detection value obtained by the sensor.

According to this embodiment, various management values (for example, torque, pressure, flow rate, and the like) relating to the manufacturing process can be obtained at each shooting timing, and appropriately used for analysis and the like.

In the above embodiment, the information on the object may include a measurement value obtained based on the image data.

According to this embodiment, it is possible to obtain a measurement value (height, width, and the like, as an example) based on image data at each shooting timing, and to appropriately use for analysis and the like.

An information processing method of another embodiment of the present disclosure is an information management method in a system including a control apparatus, an image processing apparatus configured in association with the control apparatus, and a storage apparatus communicably connected with each of the control apparatus and the image processing apparatus, the information management method including: a first step in which a control device controls a process performed on an object; and a second step in which the image processing device executes processing of one or more image data obtained for the subject, in the first step, the control device notifies the image processing device of the timing of photographing the object and transmits the identification information related to the object, and first data obtained by associating information related to processing of the object with identification information is stored in a storage device in accordance with the imaging timing, in the second step, the image processing means performs processing of one or more image data obtained for the subject in accordance with the imaging timing notified from the control means, information on the object is thus obtained, and second data, which is obtained by associating the information on the object, the image data, and the identification information, is stored in a storage device.

According to this embodiment, by giving the identification information at each shooting timing, the synchronous management of the information obtained from the control apparatus and the information obtained from the image processing apparatus becomes easy, and therefore it is possible to provide an information management method that can obtain information that can be easily analyzed in the manufacturing process.

ADVANTAGEOUS EFFECTS OF INVENTION

It is possible to provide an information management system and an information management method capable of obtaining information that can be easily analyzed in a manufacturing process.

Drawings

Fig. 1 is a functional block diagram showing the overall configuration of the information management system according to the present embodiment.

Fig. 2 is a diagram showing a configuration example of the plant control system.

Fig. 3 is a diagram showing a configuration example of the image processing system.

Fig. 4 is a diagram showing a structural example of the reservoir.

Fig. 5 is a diagram showing a configuration example of the information processing apparatus.

Fig. 6 is a diagram showing an example of the configuration of data stored in the storage by each of the device control system and the image processing system.

Fig. 7 is a flowchart showing an operation flow related to notification of imaging timing and generation of sensor data in the device control system.

Fig. 8 is a flowchart showing an operation flow related to transmission of sensor data in the plant control system.

Fig. 9 is a flowchart showing an operation flow related to transmission of image data and measurement data in the image processing system.

Fig. 10 is a diagram for explaining data that can be referred to from a storage by the information processing apparatus.

Fig. 11 is a diagram for explaining data that can be referred to from a storage by the information processing apparatus.

Detailed Description

Hereinafter, an embodiment (hereinafter, referred to as "the present embodiment") according to one aspect of the present invention will be described with reference to the drawings. In the drawings, the same or similar structures are denoted by the same reference numerals.

Application example § 1

First, an example of a scenario to which the present invention is applied will be described with reference to fig. 1. Fig. 1 is a functional block diagram showing the overall configuration of the information management system according to the present embodiment. The information management system 1 includes: a control device 10 that controls processing performed by the robot 12 or the like on the object 82 continuously conveyed by the conveyor 80; an image processing device 20, which is disposed in association with the control device 10, and which executes processing for one or more pieces of image data obtained with respect to the photographic subject 82; and a storage device 30 communicably connected to the control device 10 and the image processing device 20 via a network 50. The control device 10 notifies the image processing device 20 of the imaging timing of the object 82 and transmits the identification information on the object 82, and stores (records) first data (sensor data) in the storage device 30 in accordance with the imaging timing, the first data being obtained by associating the identification information with the information on the processing of the object 82. The image processing device 20 obtains information on the object 82 by performing processing on one or more pieces of image data obtained by imaging the object 82 with the camera 70 in accordance with the imaging timing notified from the control device 10, and stores (records) second data (image data, measurement data) in which the information on the object, the image data, and the identification information are associated with each other in the storage device.

As the identification information, any one or more of information for specifying a time related to the imaging timing, information for identifying an individual of the object 82, information for specifying a process related to the process for the object 82, information for specifying a facility related to the process for the object 82, and the like can be preferably used. The information for specifying the timing related to the imaging timing is typically the timing for notifying the imaging timing.

The information related to the processing of the object 82 is, for example, a physical quantity or a character string that can be detected by a sensor with respect to the processing in the process, and examples thereof include a torque, a flow rate, a pressure, a length, and the like. The information on the object 82 is, for example, a measurement value or a character string obtained by performing image recognition processing or the like based on image data, and includes, for example, length, color, information indicating the presence or absence of a defect, and the like.

In the information management system 1, since the identification information described above is stored in the storage device 30 as the common information in association with each of the first data and the second data, when it is desired to analyze the manufacturing process or the like, the information processing device 40 can be used to extract and use each piece of information in a specific scene (for example, a specific time, a specific process, or the like) based on the identification information. In addition, each of the first data and the second data is preferably stored in the storage device 30 in a general data format in which items are separated by delimiters (separation characters/symbols). This makes it possible to change the number of items and eliminate the need to use a special database.

Construction example 2

Next, an example of the functional configuration of the information management system according to the present embodiment will be described with reference to fig. 1. The information management system 1 of the present embodiment is used to manage information used for analysis of failures and the like in the manufacturing process of various products, and includes a device control system (control device) 10, an image processing system (image processing device) 20, a storage (storage device) 30, an information processing device 40, and a network 50. The device control system 10, the image processing system 20, the storage 30, and the information processing apparatus 40 are connected to a network 50, respectively, and configured to be capable of information communication therebetween. The network 50 is, for example, a local area network.

Note that, in fig. 1, for convenience of explanation, the device control system 10 and the image processing system 20 are shown as one system, but actually, the device control system 10 and the image processing system 20 are provided in association with each other for each process included in the manufacturing process.

The equipment control system 10 controls the robot 12 or other manufacturing equipment to execute a predetermined process such as machining in each step, acquires detection values of various sensors, which are information at the time of the process, and records the data (hereinafter referred to as "sensor data") in the storage 30. The sensor data is set according to the contents of the processing in the target process, and examples thereof include various data such as a torque value, a speed, a position, a length such as a height or a width, a flow rate value, and a pressure value.

When performing a predetermined process such as machining in each step, the image processing system 20 obtains measurement data relating to the workpiece 82 by performing a predetermined image processing on an image obtained by capturing an image of a part or a semi-finished product or the like (hereinafter, these will be collectively referred to as "workpiece 82") as a processing object 82 by the camera 70, and records the measurement data and the image data in the storage 30. The measurement data is set in accordance with information to be obtained in a target process, and examples thereof include various data such as a length such as a height or a width, and a character string obtained by character recognition.

The storage 30 is used to store various data transmitted from the apparatus control system 10 or the image processing system 20 via the network 50.

The information processing device 40 is configured using a general/general-purpose personal computer, for example, and is used to analyze a failure or the like with reference to various data stored in the storage 30.

As shown in fig. 1, in the information management system 1 of the present embodiment, when processing such as machining is performed in each step, a timing at which an image of a target workpiece 82 should be captured (hereinafter referred to as "imaging timing") is notified from the equipment control system 10 to the image processing system 20, and identification information that is information for identifying (specifying) the workpiece 82 corresponding to the notification is transmitted from the equipment control system 10 to the image processing system 20. And, the apparatus control system 10 records the identification information in the storage 30 in association with (in addition to) the sensor data acquired corresponding to the shooting timing. The image processing system 20 also records the identification information in the storage 30 by associating (adding) the identification information with the image data (or a plurality of image data) and the measurement data acquired corresponding to the shooting timing. With this, when the information processing device 40 performs analysis, the sensor data, the image data, and the measurement data for each shooting timing can be uniquely determined and extracted to use by using the identification information as the common information. The following is a further detailed description.

Fig. 2 is a diagram showing a configuration example of the plant control system. The illustrated device control system 10 includes a processor 101, a system controller 102, an Input/Output (I/O) controller 103, a Random Access Memory (RAM) 104, a storage unit 105, an Input Interface (IF) 107, an Output Interface (IF)108, a communication Interface (IF)109, and a Memory card Interface (IF) 110. The components are coupled in data communication with each other, centered on the system controller 102.

The processor 101 and the System controller 102 control the entire manufacturing facility System 10 by interacting with various programs including an Operating System (OS) and a facility control program 106 stored in the storage unit 105 and executing the programs in a predetermined order.

The system controller 102 is connected to the processor 101, the I/O controller 103, the RAM104, and the storage unit 105 via buses, and exchanges data with each unit.

The I/O controller 103 is connected to the storage unit 105, the input IF107, the output IF108, the communication IF109, and the memory card IF110, respectively, and controls data exchange with each unit.

The RAM104 provides a work area for saving data necessary for program execution in the processor 101.

The storage unit 105 stores a program or the like executed by the processor 101 in a nonvolatile manner, and is configured using, for example, a Hard Disk Drive (HDD). The device control program 106 is stored in the storage unit 105.

The input IF107 mediates data exchange between various sensors 60 provided in the manufacturing apparatus and the processor 101. Further, as each sensor 60, various sensors usable in manufacturing facilities are considered, and examples thereof include a pressure sensor, a flow rate sensor, a torque sensor, a speed sensor, a position sensor, and the like.

The output IF108 is provided in the manufacturing equipment, and mediates data exchange between the processor 101 and various servers 61 and other equipment 62 to be controlled by the equipment control system 10.

The communication IF109 mediates data communication between the processor 101 and the image processing system 20 or the storage 30 via the network 50.

The memory card IF110 writes data into the removable memory card 63, reads data from the memory card 63, and the like.

Fig. 3 is a diagram showing a configuration example of the image processing system. The illustrated image processing system 20 includes a main processor 201, an image processing processor 202, an I/O controller 203, a RAM204, a storage unit 205, a camera Interface (IF)207, a communication Interface (IF)208, and a memory card Interface (IF) 209. The components are coupled in data communication with each other.

The main processor 201 controls the image processing System 20 by performing a session between various programs including an Operating System (OS) and an image processing program 206 stored in the storage unit 205 and executing the programs in a predetermined order.

The image processing processor 202 obtains measurement data relating to the workpiece 82 by performing image processing based on the images obtained from the respective cameras 70 via the camera IF 207.

The I/O controller 203 is connected to the RAM204, the storage unit 205, the camera IF207, the communication IF208, and the memory card IF209, respectively, and controls data exchange with each unit.

The RAM204 provides a work area for saving data necessary for program execution in the main processor 201.

The storage unit 205 stores a program or the like executed by the main processor 201 in a nonvolatile manner, and is configured using, for example, a Hard Disk Drive (HDD). The image processing program 206 is stored in the storage unit 205.

The camera IF207 mediates data exchange between each camera 70 provided in the manufacturing apparatus and the main processor 201 and the image processing processor 202. In addition, each camera 70 is provided for photographing the state of the workpiece 82 from a plurality of directions in the manufacturing apparatus.

The communication IF208 mediates data communication between the main processor 201 and the manufacturing equipment system 10 or the storage 30 via the network 50.

The memory card IF209 performs data writing to the removable memory card 71, data reading from the memory card 71, and the like.

Fig. 4 is a diagram showing a structural example of the reservoir. The illustrated storage 30 includes a main processor 301, an I/O controller 302, a RAM303, a communication Interface (IF)304, and a storage unit 305. The components are coupled in data communication with each other.

The main processor 301 controls the storage 30 by performing an interactive operation on various programs including an Operating System (OS) and a control program stored in the storage unit 305 and executing the programs in a predetermined order.

The I/O controller 302 is connected to the RAM303, the communication IF304, and the storage unit 305, respectively, and controls data exchange with each unit.

The RAM303 provides a work area for saving data necessary for program execution in the main processor 301.

The communication IF304 mediates data communication between the main processor 301 and the manufacturing equipment system 10 or the image processing system 20 via the network 50.

The storage unit 305 stores a program executed by the main processor 301, various data, and the like in a nonvolatile manner, and is configured using, for example, a Hard Disk Drive (HDD). The storage unit 305 stores image data 306 and measurement data 307 transmitted from the image processing system 20, and sensor data 308 transmitted from the device control system 10.

Fig. 5 is a diagram showing a configuration example of the information processing apparatus. The illustrated information processing apparatus 40 is configured using, for example, a general-purpose personal computer, and includes a main processor 401, an I/O controller 402, a RAM403, a communication Interface (IF)404, and a storage unit 405. The components are coupled in data communication with each other.

The main processor 401 performs processing for referring to or analyzing the image data 306, the measurement data 307, and the sensor data 308 stored in the storage unit 30 by performing an interactive operation on various programs including an Operating System (OS) and a reference/analysis program 406 stored in the storage unit 405 and executing the programs in a predetermined order. The reference or analysis based on each data is performed in response to an input using an input unit (e.g., a keyboard, a mouse, etc.), not shown, and the content thereof is displayed on a screen of a display unit (e.g., a liquid crystal display), not shown.

The I/O controller 402 is connected to the RAM403, the communication IF404, and the storage unit 405, respectively, and controls data exchange with each unit.

The RAM403 provides a job area for saving data necessary for program execution in the main processor 401.

The communication IF404 mediates data communication between the main processor 401 and the storage 30 via the network 50.

The storage unit 405 stores a program, various data, and the like executed by the main processor 401 in a nonvolatile manner, and is configured using a Hard Disk Drive (HDD), for example.

Fig. 6 is a diagram showing an example of the configuration of data stored in the storage by the device control system and the image processing system, respectively. Here, the data held in the storage 30 by the device control system 10 is referred to as "device control system information", and the data held in the storage 30 by the image processing system 20 is referred to as "image processing system information".

The device control system information roughly includes: the "related information" which is information for relating to the image processing system information, and the "sensor data (sensor information)" obtained from each sensor. The device control system information is, for example, a file in a common data format (for example, a Comma Separated Value (CSV) format) in which information is separated by delimiters (separation characters/symbols), and is recorded from the device control system 10 to the storage 30. This makes it possible to change the number of items and to eliminate database maintenance.

The related information includes individual identification information (lot No) that is information for identifying each workpiece 82 to be processed such as machining, individual identification information (serial No within lot No) that is the same information, process information, equipment information, item number information, and imaging time.

The individual identification information (lot No) is a number assigned to the lot to which the workpiece 82 belongs. The individual identification information (serial No within the lot No) is a number assigned to each workpiece 82 within each lot, and for example, a serial number is used. In addition, when there is only one piece of individual identification information, depending on the individual target, either one of the individual identification information (lot No) and the individual identification information (serial No within the lot No) may be omitted.

The process information is information for identifying each process in which processing such as machining of the workpiece 82 is performed. The device information is information for identifying a device used when processing such as machining is performed on the workpiece 82. In addition, in the case where the process information can be provided by the equipment information, the process information can be omitted. The product number information is information such as a number assigned to each product corresponding to the workpiece 82. The shooting time is information for specifying a time at which the shooting time is notified.

Among the pieces of information, at least one of individual identification information (lot No), individual identification information (serial No within lot No) as the same information, process information, equipment information, and imaging time can be used as "identification information".

The sensor data includes sensor information items, primary control information, one or more sensor values (numerical values), one or more sensor values (character strings), and other ancillary information. The sensor information item master collation information is collation information of the number, name, unit, and the like of sensor values. The sensor value (numerical value) is information represented by numerical data in the detection result obtained by each sensor 60. The sensor value (character string) is information represented by character string data in the detection result obtained by each sensor 60. Other ancillary information is, for example, arbitrary information such as information accompanying the sensor values.

The image processing system information roughly includes: information for association with the device control system information, that is, "association information", and "measurement data (measurement information)" obtained by image processing. The image processing system information is, for example, a file in a common data format (for example, a Comma Separated Value (CSV) format) in which information is Separated by delimiters (separation characters/symbols), and is recorded from the image processing system 20 to the storage 30. This makes it possible to change the number of items and to eliminate database maintenance.

The related information includes individual identification information (lot No) that is information for identifying each workpiece 82 to be processed such as machining, individual identification information (serial No within lot No) that is the same information, process information, equipment information, item number information, and imaging time. The information is delivered from the device control system 10 to the image processing system 20 with notification of the shooting timing. Thus, detailed description of the contents of each information is omitted.

The measurement data includes a shooting camera number, a shooting order, measurement data management master control information, one or more measurement values (numerical values), one or more measurement values (character strings), and other accessory information. The shooting camera number is a number for identifying each camera 70. The shooting order is information that determines the shooting order of the images used for measurement. The measurement data management master collation information is collation information such as the number, name, and unit of measurement values. The measurement values (numerical values) are information expressed in numerical data among the measurement values obtained by image processing based on the images obtained by the respective cameras 70. The measurement values (character strings) are information expressed in character string data among the measurement values obtained by image processing based on the images obtained by the respective cameras 70. Other ancillary information is for example any information accompanying the measured values.

Action example 3

Fig. 7 is a flowchart showing an operation flow related to notification of imaging timing and generation of sensor data in the device control system. Note that this flowchart is an example, and the order of the steps may be changed as long as the processing results do not contradict or are not harmonious, and other processing steps (the same applies to other flowcharts described below) not shown may be further included.

When the processing cycle starts with the power on or the like, the processor 101 of the device control system 10 determines whether or not to end the processing (step S11). For example, when the power supply is turned off or when the temporary intermediate processing is performed, the processor 101 determines that the processing is ended (step S11; yes), and ends the series of processing cycles.

If the termination processing is not necessary (step S11; no), the processor 101 performs predetermined device control (step S12). Specifically, the processor 101 gives an operation instruction to each servo 61 or other device 62.

Next, the processor 101 determines whether or not the timing is the capturing timing for acquiring the image of the workpiece 82 or its periphery (step S13). The imaging timing is set in advance, and may be set to various timings such as a timing of detection by each sensor 60 during processing such as machining, or a timing of completion of processing.

When the timing is the imaging timing (step S13; yes), the processor 101 stores sensor data including the detection results (numerical values, character strings) obtained by the sensors 60 in the RAM104 (step S14).

Next, the processor 101 notifies the image processing system 20 of the identification information (step S15), and notifies the image processing system 20 of the intention of being a shooting timing (step S16). As described above, the individual identification information (lot No), the individual identification information (serial No within lot No), the process information, the equipment information, the item number information, and the imaging time are notified as the identification information.

Next, the processor 101 generates a file of sensor data (step S17). Here, a file in which the identification information and the sensor data are integrated as described in fig. 6 is generated and stored in the memory card 63. As described above, in the present embodiment, a file in a general data format such as the CSV format is generated.

Next, the processor 101 causes the transmission request of the file generated in step S17 to be stored to the RAM104 (step S18). Subsequently, the process returns to step S11.

When the processing cycle starts with the power on or the like, the processor 101 of the device control system 10 determines whether or not to end the processing (step S21). For example, when the power supply is turned off or when the temporary intermediate processing is performed, the processor 101 determines that the processing is ended (step S21; yes), and ends the series of processing loops.

If the processing does not need to be ended (step S21; NO), the processor 101 becomes in a state of waiting for a file transmission request in the RAM104 (step S22). The standby state is maintained while no file transmission request is present in the RAM104 (step S23; no).

If a file transmission request exists in the RAM104 (step S23; yes), the processor 101 acquires a file of the sensor data from the memory card 63 (step S24), and transmits the file to the repository 30 (step S25). Thereby, a file of sensor data is stored to the storage 30.

Next, the processor 101 deletes the file of the sensor data saved in the memory card 63 (step S26), and determines a file transmission request within the RAM104 (step S27). Subsequently, the process returns to step S21.

When the processing cycle starts with a power-on or the like, the main processor 201 of the image processing system 10 determines whether or not to end the processing (step S31). For example, when the power supply is turned off or when the temporary intermediate processing is performed, the processor 201 determines to end the processing (step S31; yes), and ends the series of processing loops.

If the process does not need to be ended (step S31; no), the main processor 201 enters a state of waiting for notification of the shooting timing (step S32). The standby state is maintained while the notification of the shooting timing (shooting request) is not made from the apparatus control system 10 (step S33; no).

When the slave device control system 10 notifies the presence of a shooting timing (shooting request) (step S33; yes), the main processor 201 acquires image data (camera image) from each camera 70 and inputs the image data to the image processing processor 202 (step S34). Based on the input image, predetermined measurement processing or determination processing is performed by the image processing processor 202 (step S35).

Next, the main processor 201 generates a file (image data file) that aggregates the image data acquired from each camera 70 and the identification information acquired from the device control system 10, and transmits the file to the repository 30 (step S36).

Similarly, the main processor 201 generates a file (measurement data file) in which the measurement data such as the measurement values generated by the processing of step S35 and the identification information acquired from the device control system 10 are integrated, and transmits the file to the repository 30 (step S37). Subsequently, the process returns to step S31.

Fig. 10 and 11 are diagrams for explaining data that can be referred to from a storage by the information processing apparatus. As shown in fig. 10, by accessing the storage 30 through the information processing apparatus 40, it is possible to uniquely determine and refer to the image processing system information 502 including measurement data and the device control system information 503 including sensor data based on the association information 501 including identification information, and perform various data analyses as necessary. Further, as shown in fig. 11, by accessing the storage 30 through the information processing apparatus 40, it is possible to uniquely identify and refer to the image data file 504 containing the image data based on the association information 501 containing the identification information, and also, uniquely identify and refer to these image data file 504 and the image processing system information 502 or the device control system information 503 based on the identification information as necessary, and perform various data analyses as necessary.

The embodiments described above are for the purpose of facilitating understanding of the present invention, and are not intended to be restrictive. The elements included in the embodiments, their arrangement, materials, conditions, shapes, sizes, and the like are not limited to those exemplified above and may be appropriately changed.

[ Note 1]

An information management system comprising:

a control device (10) that controls processing performed on an object;

an image processing device (20) configured in association with the control device, and configured to execute processing for one or more pieces of image data obtained by capturing an image of the object; and

a storage device (30) communicably connected to each of the control device and the image processing device,

the control device notifies the image processing device of the shooting timing of the object and transmits identification information (501) related to the object, and stores first data in the storage device corresponding to the shooting timing, the first data being obtained by associating the related information (503) related to the processing of the object with the identification information (501),

the image processing device acquires information (502) relating to the object by performing processing for one or more pieces of image data acquired by imaging the object in accordance with the imaging timing notified from the control device, and stores second data in the storage device, the second data being obtained by associating the information (502) relating to the object, the image data (504), and the identification information (501).

[ Note 2]

The information management system according to supplementary note 1, wherein

The identification information (501) includes at least one of information for specifying a time related to the imaging timing, information for identifying an individual of the object, information for specifying a process related to the process for the object, and information for specifying a device related to the process for the object.

[ Note 3]

The information management system according to

supplementary note

1 or 2, wherein

The first data and the second data are each saved to the storage device (30) in a data format in which items are separated by delimiters.

[ Note 4]

The information management system according to any one of supplementary notes 1 to 3, wherein

The information (503) related to the processing of the object includes a detection value obtained by a sensor (60).

[ Note 5]

The information management system according to any one of supplementary notes 1 to 4, wherein

The information related to the object includes a measurement value obtained based on the image data (504).

[ Note 6]

An information management method in a system including a control device (10), an image processing device (20), and a storage device (30), wherein the image processing device (20) is disposed in association with the control device, and the storage device (30) is communicably connected to the control device and the image processing device, the information management method comprising:

a first step in which the control device (10) controls a process to be executed on an object; and

a second step in which the image processing device (20) executes processing for one or more image data obtained by capturing the subject,

in the first step, the control device (10) notifies the image processing device (20) of an imaging timing of the object and transmits identification information (501) related to the object, and stores first data in the storage device (30) in accordance with the imaging timing, the first data being obtained by associating the identification information (501) with information (503) related to the processing of the object,

in the second step, the image processing device (20) acquires information (502) relating to the object by performing processing on one or more pieces of the image data (504) acquired by imaging the object in accordance with the imaging timing notified from the control device (10), and stores second data in the storage device (30), the second data being obtained by associating the information (502) relating to the object, the image data (504), and the identification information (501).

Description of the symbols

1: information management system

10: equipment control system (control device)

12: robot

20: image processing system (image processing device)

30: storage (storage device)

40: information processing apparatus

50: network

60: sensor with a sensor element

61: servo system

62: device

63: memory card

70: sensor with a sensor element

71: memory card

80: conveyor

82: object (workpiece)

101: processor with a memory having a plurality of memory cells

101. 102: system controller

103: I/O controller

104：RAM

105: storage device

106: device control program

107: input Interface (IF)

108: output Interface (IF)

109: communication Interface (IF)

110: memory card Interface (IF)

201: main processor

202: image processing processor

203: I/O controller

204：RAM

205: storage device

206: image processing program

207: camera Interface (IF)

208: communication Interface (IF)

209: memory card Interface (IF)

301: main processor

302: I/O controller

303：RAM

304: communication Interface (IF)

305: storage device

306: image data

307: measurement data

308: sensor data

401: main processor

402: I/O controller

403：RAM

404: communication Interface (IF)

405: storage device

406: reference/analysis program

501: associated information (identification information)

502: image processing system information

503: device control system information

504: an image data file.

Claims

1. An information management system, comprising:

a control device that controls a process performed on an object;

an image processing device, configured in association with the control device, that performs processing for one or more image data obtained by capturing the subject; and

a storage device communicably connected to each of the control device and the image processing device,

the control device notifies the image processing device of an imaging timing of the object and transmits identification information related to the object, and stores first data in the storage device in accordance with the imaging timing, the first data being obtained by associating information related to the processing of the object with the identification information,

the image processing device acquires information related to the object by performing processing on one or more pieces of the image data acquired by imaging the object in accordance with the imaging timing notified from the control device, and stores second data in the storage device, the second data being obtained by associating the information related to the object, the image data, and the identification information.

2. The information management system according to claim 1,

the identification information includes at least one of information for specifying a time associated with the imaging timing, information for identifying an individual of the object, information for specifying a process associated with the process for the object, and information for specifying a device associated with the process for the object.

3. The information management system according to claim 1 or 2,

the first data and the second data are each saved to the storage device in a data format that separates items by delimiters.

4. The information management system according to any one of claims 1 to 3, wherein

The information related to the process on the object includes a detection value obtained by a sensor.

5. The information management system according to any one of claims 1 to 4, wherein

The information related to the object includes a measurement value obtained based on the image data.

6. An information management method in a system including a control device, an image processing device, and a storage device, the image processing device being disposed in association with the control device, the storage device being communicably connected to the control device and the image processing device, the information management method comprising:

a first step in which the control device controls a process performed on an object; and

a second step of executing processing for one or more image data obtained by photographing the object by the image processing apparatus,

in the first step, the control device notifies the image processing device of an imaging timing of the object and transmits identification information on the object, and stores first data in the storage device in accordance with the imaging timing, the first data being obtained by associating information on the processing of the object with the identification information,

in the second step, the image processing device acquires information on the object by performing processing on one or more pieces of the image data acquired by imaging the object in accordance with the imaging timing notified from the control device, and stores second data in the storage device, the second data being obtained by associating the information on the object, the image data, and the identification information.