JP6856236B2 - Systems, terminals, server devices, programs and methods - Google Patents

Description

The present invention relates to a technique for recording information regarding the manufacture of a product.

A mechanism has been proposed in which an image of the manufacturing state of a product is stored, and the image is read out and displayed as needed so that the state of manufacturing performed in the past can be confirmed. For example, in the mechanism described in Patent Document 1 relating to the application by the applicant of the present application, images taken by a photographing device provided for each workplace are accumulated, and among a plurality of progress display columns displayed on the display device. When any of the progress display fields is specified by the user, an image corresponding to the specified progress display field is displayed on the display device.

Japanese Patent No. 5416322

An object of the present invention is to facilitate confirmation of information regarding past manufacturing.

The present invention includes a first image data representing an image photographed by the photographing device manufacturing apparatus which manufactures the product, the related to producing physical quantity results measured by the meter measuring device the first display device is displayed a data acquisition means for acquiring second image data representing an image, the data acquisition means acquired generated first image data and in association with the second image data at the same time in the storage device A storage control means for storing, and a display instruction means for simultaneously displaying an image represented by each of the first image data and the second image data stored in association with the storage device on the second display device. to provide Cie system equipped with.

In the above system, the data acquisition unit, the acquired manufacturing management data indicating the management information of the production, the storage control unit, in association with the production management data which the data acquisition means has acquired, the data The first image data and the second image data acquired by the acquisition means are stored in the storage device, and the display instruction means is stored in association with the storage device with the first image data. Along with the images represented by each of the second image data, the second image data and the management information indicated by the manufacturing control data stored in the storage device in association with the second image data are obtained. A configuration may be adopted in which the data is displayed on the display device of.

In the above system, the data acquisition means acquires a third image data representing the image photographed by the photographing apparatus an operator for operating the production apparatus, the storage control unit, said data acquisition means acquires The first image data, the second image data, and the third image data generated at the same time are associated with each other and stored in the storage device, and the display instruction means is associated with the storage device. A configuration may be adopted in which the stored images represented by the first image data, the second image data, and the third image data are simultaneously displayed on the second display device.

Further, in the present invention, from the first terminal device, the first image data representing an image taken by the manufacturing device for manufacturing the product by the photographing device and the result of measuring the physical quantity related to the manufacturing by the measuring device are obtained. The receiving means for receiving the second image data representing the image displayed by the display device, the first image data generated at the same time received by the receiving means, and the second image data are stored in association with each other. A server device including a storage control means for storing in the device and a transmission means for transmitting the first image data and the second image data stored in association with the storage device to the second terminal device. provide.

Further, in the present invention, the display device displays the first image data representing an image taken by the photographing device of the manufacturing device that manufactures the product from the server device and the result of measuring the physical quantity related to the manufacturing by the measuring device. A display instruction for simultaneously displaying on the display device a receiving means for receiving the second image data representing the displayed image and an image represented by each of the first image data and the second image data received by the receiving means. Provided is a terminal device including means.

Further, in the present invention, the computer measures the first image data representing an image taken by the photographing apparatus of the manufacturing apparatus for manufacturing the product from the first terminal apparatus and the physical quantity related to the manufacturing by the measuring apparatus. The process of receiving the second image data representing the image displayed by the display device and the storage device in association with the first image data generated at the same time as the reception and the second image data. Provided is a program for executing a process of storing and a process of transmitting the first image data and the second image data stored in association with the storage device to a second terminal device.

Further, the present invention provides a computer with first image data representing an image taken by a manufacturing device for manufacturing a product from a server device and a result of measuring a physical quantity related to the manufacturing by the measuring device. a process of receiving the second image data representing an image display device displaying, and a process of displaying simultaneously on the display device an image, each representing the received first image data and the second image data Provide a program to execute.

Further, the present invention, the system includes a first image data representing an image photographed by the photographing device manufacturing apparatus which manufactures the product, said the results measured by the meter measuring device a physical quantity related to the production first The step of acquiring the second image data representing the image displayed by the display device of the above, and the system stores the first image data generated at the same time as the acquisition and the second image data in association with each other. The step of storing in the device and the system simultaneously display the image represented by each of the first image data and the second image data stored in association with the storage device on the second display device. Provide a method of providing steps and.

According to the present invention, it becomes easy to confirm information on the manufacturing performed in the past.

The figure which showed the whole structure of the system which concerns on embodiment. The figure which shows an example of the screen displayed on the display device of a control computer. The figure which shows an example of the screen displayed on the display device of a control computer. The figure which shows an example of the screen displayed on the display device of a control computer. The figure which shows an example of the screen displayed on the display device of a control computer. The figure which showed the basic structure of the computer which can be used as the hardware of the control computer which concerns on embodiment. The figure which showed the functional structure of the control computer which concerns on embodiment. The figure which showed the basic structure of the computer which can be used as the hardware of the server apparatus which concerns on embodiment. The figure which showed the functional structure of the server apparatus which concerns on embodiment. The figure which showed the basic structure of the computer which can be used as the hardware of the server apparatus which concerns on embodiment. The figure which showed the functional structure of the server apparatus which concerns on embodiment. The figure which illustrated the structure of the manufacturing control table stored in the server apparatus which concerns on embodiment. The figure which illustrated the structure of the correspondence table stored in the server apparatus which concerns on embodiment. The figure which showed the basic structure of the computer which can be used as the hardware of the terminal which concerns on embodiment. The figure which showed the functional structure of the terminal which concerns on embodiment. Sequence chart showing an example of recording operation according to the embodiment Sequence chart showing an example of browsing operation according to the embodiment The figure which shows an example of the screen displayed on the display device. The figure which shows an example of the screen displayed on the display device. The figure which showed the whole structure of the system which concerns on the modification. The figure which shows the outline of the photographing apparatus which concerns on the modification.

[Embodiment]
FIG. 1 is a diagram showing an overall configuration of a recording system 1 according to an embodiment of the present invention. The recording system 1 is a system for recording information related to the manufacture of products and the like. The recording system 1 records information such as attribute values (temperature, humidity, etc.) of the operating environment of the manufacturing devices 11a and 11b and the amount of material used for manufacturing. The recording system 1 includes photographing devices 12a and 12b, a control computer (an example of a terminal device) 13a and 13b, a terminal 14, a server device 15, and a server device 16. The control computers 13a and 13b are examples of the terminal device according to the present invention. The server device 15 and the server device 16 are examples of the server device according to the present invention.

The manufacturing devices 11a and 11b are devices for manufacturing such as assembling products. The manufacturing devices 11a and 11b may be, for example, a device for sheet metal processing or a device for painting a product. In the following description, for convenience of explanation, when the configurations and operations common to the manufacturing devices 11a and 11b are described, these are referred to as "manufacturing device 11". In this embodiment, the product is manufactured through one or more steps, and the work of each step is performed by one or more manufacturing devices 11.

Each of the manufacturing apparatus 11 is provided with (or is connected to) one or a plurality of sensors S for measuring various physical quantities related to the operation of each apparatus. The types of physical quantities measured by the sensor S (an example of a measuring device) are, for example, temperature, humidity, illuminance, material flow rate, equipment power value, motor rotation speed, water tank cleanliness related to painting, and pH value. Not limited to these. The type of physical quantity measured by the sensor S differs depending on the type of the manufacturing apparatus 11 to be recorded and the type of the product. In this embodiment, a type of sensor S corresponding to each manufacturing apparatus 11 is provided in advance. The sensor S outputs measurement result data indicating the measurement result to the control computer 13. The sensor S may measure a physical quantity at a predetermined sampling cycle such as "1 minute interval" or "5 minute interval".

There are various types and manufacturers of the sensor S provided (or connected) to the manufacturing apparatus 11 and the manufacturing apparatus 11, and each of the manufacturing apparatus 11 inputs / outputs to / from an external device such as the sensor S. Data formats and interface standards are different. The manufacturing apparatus 11 and the sensor S may input / output data according to their own interface standard.

The photographing devices 12a and 12b photograph and output image data representing the photographed image (still image or moving image). In this embodiment, the photographing device 12a photographs the manufacturing device 11a, and the photographing device 12b photographs the manufacturing device 11b. In the following description, when the configurations and operations common to the photographing devices 12a and 12b are described, these are referred to as "photographing devices 12". In this embodiment, the photographing device 12 captures the operating state of the manufacturing apparatus 11 and the operation of the operator with respect to the manufacturing apparatus 11 at predetermined timings (for example, every second), and an image representing the captured still image. Generate data (hereinafter referred to as "shooting data"). The photographing device 12 transmits the shooting data, the time information (time stamp) indicating the shooting time of the shooting data, and the shooting identifier (hereinafter referred to as “shooting ID”) that identifies the shooting device 12 to the server device 15. When the shooting data is a moving image, the shooting device 12 assigns a shooting time for each unit time predetermined in the moving image data format. In the example of FIG. 1, one photographing device 12 is provided for one manufacturing device 11, but one manufacturing device 11 may be photographed by a plurality of photographing devices 12.

The control computer 13a is a computer that controls the manufacturing apparatus 11a, and the control computer 13b is a computer that controls the manufacturing apparatus 11b. The control computer 13a is connected to the manufacturing apparatus 11a by a wired cable. The control computer 13b is configured integrally with the manufacturing apparatus 11a. In the following description, for convenience of explanation, when the configurations and operations common to the control computer 13a and the control computer 13b are described, these are referred to as "control computer 13". The control computer 13 may be configured as a separate body from the manufacturing apparatus 11, or may be built in the manufacturing apparatus 11. The control computer 13 may be, for example, a personal computer. In the example of FIG. 1, one control computer 13 is provided for one manufacturing apparatus 11, but the number of each apparatus is not limited to this. For example, one control computer 13 may be provided for a plurality of manufacturing devices 11. Further, a plurality of control computers 13 may be provided for one manufacturing apparatus 11.

The control computer 13 has a display device 130 that displays various information related to the control of the manufacturing device 11. The display device 130 may be built in the control computer 13, or may be configured separately from the control computer 13 and connected to the control computer 13 by wire or wirelessly. Further, for example, the display device 130 may be an operation panel provided in the manufacturing device 11. The display device 130 displays the measured values of the various sensors S acquired by the control computer 13 and the information related to the control of the manufacturing device 11 by the control computer 13. The information related to the control of the manufacturing apparatus 11 may include, for example, a program number for identifying the control program of the manufacturing apparatus 11 and information indicating an operating state of the manufacturing apparatus 11. The control computer 13 is operated by the operator OP. The screen displayed on the display device 130 may be an operation screen that accepts the operation of the operator OP or a screen that can be edited by the operator OP.

2 to 5 are diagrams showing an example of a screen displayed on the display device 130. The screen illustrated in FIG. 2 is a screen displaying the energy management of power receiving and distribution equipment and the energy usage / operation status of production equipment in a factory energy management system such as FEMS (Factory Energy Management System). In the example of FIG. 2, the electric power value, the amount of steam, the state of the valve, and the like of various installed devices are schematically displayed.

The screen illustrated in FIG. 3 includes a plurality of windows W1, W2, W3. The window W1 displays a predetermined set value for the measurement target and an actual measured value. Information such as control commands for the manufacturing apparatus 11 is displayed in the window W2 and the window W3. The screen illustrated in FIG. 4 includes an image of a meter showing the rotation speed, temperature, and the like of the engine provided in the manufacturing apparatus 11 to be measured. The screen illustrated in FIG. 5 includes information indicating the amount of electricity used for the equipment to be measured.

In addition to the measurement result by the sensor S, the display device 130 may display a message indicating that an error has occurred, a message indicating the type and content of the error, or an error code. The manager of the manufacturing device 11 manages and maintains the manufacturing line while checking the screen displayed on the display device 130 of the control computer 13.

The hardware of the control computer 13 may be a dedicated device designed for the recording system 1 or a general-purpose computer. The form of the computer that can be used as the hardware of the control computer 13 is not limited. The hardware of the control computer 13 may be, for example, a notebook PC (Personal Computer) or a tablet PC. Further, the control computer 13 may be a tablet PC (so-called smartphone) having a call function.

FIG. 6 is a diagram showing a basic configuration of a computer 10 which is an example of a computer that can be used as hardware of the control computer 13. The computer 10 includes a memory 101 that stores various data, a processor 102 that performs data processing according to a program stored in the memory 101, a clock 103 that performs timing, and a communication IF 104 that is an interface for data communication. It is provided with an operation device 105 such as a touch panel. The computer 10 may include a touch display in which a display device (for example, a liquid crystal display) and an operation device (for example, a touch panel) are integrally configured.

FIG. 7 is a diagram showing a functional configuration of the control computer 13. That is, when the computer 10 performs data processing according to the program, the control computer 13 having the components shown in FIG. 7 is realized. The functional components included in the control computer 13 will be described below.

The measurement result acquisition unit 131 acquires the measurement result data generated by the measurement device (sensor S) that measures the physical quantity related to the manufacture of the product. The physical quantities measured by the measuring device include, for example, measured values related to the operation of the manufacturing device 11 (equipment power value, motor rotation speed, material flow rate), temperature of the environment in which the manufacturing device 11 is provided, and so on. It may be the humidity, the illuminance, and the temperature of the parts included in the manufacturing apparatus 11.

The measurement result display instruction means 132 causes a display device (touch display or the like) to display the measurement result represented by the measurement result data acquired by the measurement result acquisition means 131.

The image data acquisition means 133 acquires image data representing the measurement result measured by the measuring device (sensor S) for measuring the physical quantity related to the manufacture of the product. In this embodiment, the image data acquisition means 133 acquires image data (hereinafter referred to as “capture data”) generated by capturing the screen displayed on the display device 130. The acquired capture data is attached with time information (time stamp) indicating the time of capture and a control ID for identifying the control computer 13.

The transmission means 134 transmits the manufacturing control data related to the manufacture of the product to the server device (server device 16) that stores the image data acquired by the image data acquisition unit 133 or the information related to the image data in the storage device. To do.

The instruction acquisition means 135 acquires start instruction data indicating a recording start instruction and end instruction data indicating a recording end instruction. The condition data acquisition means 136 acquires condition data indicating a condition relating to the timing of acquiring the screen.

The control computer 13 stores a first program for controlling the manufacturing apparatus 11 and a second program that captures the displayed screen and uploads it to the server apparatus 15. When the control computer 13 executes the first program, the measurement result acquisition means 131 and the measurement result display instruction means 132 are realized. When the control computer 13 executes the second program, the image data acquisition means 133 and the transmission means 134 are realized. More specifically, the control computer 13 acquires measurement result data from various sensors S by executing the first program, and causes the display device 130 to display the measurement result indicated by the acquired measurement result data. Further, the control computer 13 captures the screen showing the measurement result displayed on the display device 130 by executing the second program, uploads the captured data to the server device 15, and transfers the manufacturing control data to the server device. Send to 16.

In this embodiment, the first program and the second program are executed in parallel by the multitasking OS. That is, in this embodiment, the control process of the manufacturing apparatus 11 and the upload process of the captured image are executed in parallel by the control computer 13.

Returning to the description of FIG. The server device 15 is, for example, a general-purpose server computer, and stores image data such as shooting data output from the shooting device 12 and captured data captured by the control computer 13. The hardware of the server device 15 may be a dedicated device designed for the recording system 1, but a general-purpose computer may be used. The form of the computer that can be used as the hardware of the server device 15 is not limited. For example, it may be a desktop PC or a notebook PC.

FIG. 8 is a diagram showing a basic configuration of a computer 20 which is an example of a computer that can be used as hardware of the server device 15. The computer 20 includes a memory 201 that stores various data, a processor 202 that performs data processing according to a program stored in the memory 201, and a communication IF 203 that is an interface for data communication.

FIG. 9 is a diagram showing a functional configuration of the server device 15. That is, when the computer 20 performs data processing according to the program, the server device 15 having the components shown in FIG. 9 is realized. The functional configuration unit included in the server device 15 will be described below.

The image data acquisition means 151 receives the shooting data from the shooting device 12. A time stamp and a shooting ID are attached to the received shooting data. Further, the image data acquisition means 151 receives the captured data from the control computer 13. A time stamp and a control ID are attached to the received capture data.

The storage control means 152 stores the received image data (photographed data or captured data) in the image database 153 in association with the manufacturing control data or the information related to the manufacturing control data. In this embodiment, the control ID or the photographing ID is used as the information regarding the manufacturing control data. In the image database 153, the shooting data is stored in association with the time information and the shooting ID, and the capture data is stored in association with the time information and the control ID. In this embodiment, the device ID is included in the manufacturing management data, and the shooting ID and the control ID are attached to the image data stored in the image database 153. Since the correspondence between the device ID, the shooting ID, and the control ID is stored in the correspondence table described later, the manufacturing control data and the image data are linked by the device ID, the control ID, and the shooting ID. The information related to the manufacturing control data attached to the image data is not limited to the control ID and the shooting ID. The information regarding the manufacturing control data may be other information.

The transmission means 154 reads an image data group from the image database 153 in response to a request from the terminal 14, and transmits the read image data group to the request source terminal 14. The request received from the terminal 14 may include information indicating the type of image data (information indicating whether it is shooting data or captured data), time information, shooting ID, or control ID.

The image database 153 is stored in the server device 15. As described above, the image database 153 stores the photographed data photographed by the photographing apparatus 12 and the captured data captured by the control computer 13. Each data stored in the image database 153 is accompanied by time information (time stamp) indicating the time when the image was taken and the time when the image was captured.

Returning to the description of FIG. The server device 16 is, for example, a general-purpose server computer, and performs various processes for managing the manufacturing process of the manufacturing device 11. The server device 16 receives the measurement result data indicating the measurement result of the sensor S. In FIG. 1, the photographing device 12, the control computer 13, the terminal 14, the server device 15, and the server device 16 are connected to a communication network 200 such as a LAN (Local Area Network) or the Internet.

The hardware of the server device 16 may be a dedicated device designed for the recording system 1, but a general-purpose computer may be used. The form of the computer that can be used as the hardware of the server device 16 is not limited. For example, it may be a desktop PC or a notebook PC.

FIG. 10 is a diagram showing a basic configuration of a computer 30 which is an example of a computer that can be used as hardware of the server device 16. The computer 30 includes a memory 301 that stores various data, a processor 302 that performs data processing according to a program stored in the memory 301, and a communication IF 303 that is an interface for data communication.

FIG. 11 is a diagram showing a functional configuration of the server device 16. That is, when the computer 30 performs data processing according to the program, the server device 16 having the component shown in FIG. 11 is realized. The functional configuration unit included in the server device 16 will be described below.

The manufacturing control data acquisition means 162 acquires manufacturing control data related to the manufacture of the product. In this embodiment, the manufacturing control data acquisition unit 162 receives the manufacturing control data by receiving the manufacturing control data from the control computer 13.

The storage control means 163 stores the manufacturing control data acquired by the manufacturing control data acquisition means 162 in the storage device in association with the image data (photographed data or captured data) or the information related to the image data. In this embodiment, a shooting ID and a control ID are used as information related to the image data. In this embodiment, the device ID is included in the manufacturing management data, and the shooting ID and the control ID are attached to the image data stored in the image database 153. Since the correspondence between the device ID, the shooting ID, and the control ID is stored in the correspondence table described later, the manufacturing control data and the image data are linked by the device ID, the control ID, and the shooting ID. The information related to the image data attached to the manufacturing control data is not limited to the shooting ID and the control ID. The information regarding the image data may be other information.

When the display instruction means 164 displays the content represented by the manufacturing control data on the display device, the display instruction means 164 displays an image represented by the image data corresponding to the manufacturing control data. In this embodiment, the display instruction means 164 transmits the manufacturing control data and the image data to the terminal 14 and instructs the terminal 14 to display the data. The shooting data acquisition means 165 acquires shooting data generated by the shooting device 12 that shoots a shooting object (manufacturing device 11 or the like) related to manufacturing. The condition data transmission means 166 reads the condition data indicating the condition regarding the acquisition timing of the image data according to the manufacturing control data from the storage device and transmits the condition data to the terminal which is the transmission source of the image data.

FIG. 12 is a diagram illustrating the configuration of the manufacturing control table stored in the server device 16. Data for controlling manufacturing in the recording system 1 (an example of manufacturing control data) is recorded in the manufacturing control table.

The manufacturing control table includes [product type], “process type”, [device ID], [time information], [shooting timing condition], and [capture timing condition] as fields. [Product type] stores data indicating the type of the manufacturing target such as "Product 01". [Process type] stores data indicating the type of process such as "process 01". In many cases, a plurality of manufacturing processes are performed for one product (object). The [device ID] stores data that identifies the manufacturing device 11 such as the “device 01”. [Time information] stores time information indicating the start time and end time of the manufacturing operation. The fields after [Shooting timing condition] following [Time information] store data corresponding to each of the data stored in [Time information].

[Shooting timing condition] stores shooting timing condition data indicating conditions related to shooting timing according to the manufacture of the object. A typical condition regarding the shooting timing is the elapse of a predetermined time such as "60 second interval". When this condition is followed, imaging is performed by the imaging device 12 at predetermined time intervals according to the production of the object. Further, as a condition regarding the imaging timing, for example, "temperature change = 1 ° C." can be considered. When this condition is followed, imaging is performed by the imaging device 12 every time the temperature measured by the sensor S changes by 1 ° C.

[Capture timing condition] stores capture timing condition data indicating a condition relating to the timing at which the control computer 13 captures the screen of the display device 130. A typical condition regarding the capture timing is a condition such as "every 5 minutes". In this case, the screen of the display device 130 is captured every 5 minutes. Further, as a condition regarding the capture timing, for example, "synchronization with the shooting timing" can be considered. When this condition is followed, the screen of the display device 130 is captured at a timing synchronized with the timing at which the imaging device 12 performs imaging.

The manufacturing control table may include fields other than those described above. For example, the manufacturing control table may include a field of [Measurement timing condition] that stores continuous timing condition data indicating a condition regarding the measurement timing of the sensor S. The physical quantity of the measurement target differs depending on the object to be manufactured, and a plurality of physical quantities may be the measurement target according to one manufacturing apparatus 11. The condition regarding the measurement timing may be, for example, "temperature: every 5 minutes". When this condition is used, the temperature is measured by the sensor S every 5 minutes. The condition regarding the measurement timing may be "humidity: synchronized with the shooting timing". When this condition is used, the humidity is measured by the sensor S at the timing when the imaging device 12 performs imaging. Further, for example, the manufacturing control table may include a field for storing information indicating the delivery date of the product, a field for storing information indicating the operator, and a field for indicating the progress status.

The above-mentioned conditions relating to the shooting timing, the capture timing, and the measurement timing are merely examples, and various other types of conditions can be adopted.

FIG. 13 is a diagram illustrating the configuration of the correspondence table stored in the server device 16. The correspondence table is a table that stores the correspondence between the manufacturing apparatus 11, the photographing apparatus 12, and the control computer 13. The record management table includes [device ID], [shooting ID], and [control ID] as fields. [Device ID] stores an identification ID that identifies the manufacturing device 11. The [shooting ID] stores a shooting ID that identifies the shooting device 12 that shoots the manufacturing device 11. [Control ID] stores a control ID that identifies the control computer 13 that controls the manufacturing apparatus 11.

Returning to the description of FIG. The terminal 14 performs various processes according to the operation of the user. The terminal 14 is, for example, a personal computer. The terminal 14 is used by the administrator of the recording system 1. The manager uses the terminal 14 to grasp various information such as the progress status regarding the manufacturing of the product. The terminal 14 may be provided in a place other than the place where the control computer 13 and the manufacturing apparatus 11 are provided. While the control computer 13 is not used for recording, the control computer 13 may be used for viewing information. In this case, the control computer 13 is temporarily used as the terminal 14.

The hardware of the terminal 14 may be a dedicated device designed for the recording system 1 or a general-purpose computer. The form of the computer that can be used as the hardware of the terminal 14 is not limited. The hardware of the terminal 14 may be, for example, a notebook PC or a tablet PC. Further, the terminal 14 may be a tablet-type PC having a call function.

FIG. 14 is a diagram showing a basic configuration of a computer 40, which is an example of a computer that can be used as the hardware of the terminal 14. The computer 40 includes a memory 401 that stores various data, a processor 402 that performs data processing according to a program stored in the memory 401, a clock 403 that performs timing, and a communication IF 404 that is an interface for data communication. It includes a touch display 405 in which a display device (for example, a liquid crystal display) and an operation device (for example, a touch panel) are integrally configured.

FIG. 15 is a diagram showing a functional configuration of the terminal 14. That is, when the computer 40 performs data processing according to the program, the terminal 14 having the component shown in FIG. 15 is realized. In the figure, the display instruction means 141 receives the image data transmitted from the transmission means 134 of the server device 16, and causes the display device 142 to display the image represented by the received image data. The display device 142 displays an image according to an instruction from the display instruction means 141.

FIG. 16 is a sequence chart showing an example of the recording operation of the recording system 1. The manufacturing apparatus 11 performs operations such as manufacturing a product under the control of the control computer 13. In step S101, the control computer 13 obtains data (an example of manufacturing management data) including the device ID of the manufacturing device 11 controlled by the own device at a predetermined timing such as a timing according to the operation of the administrator. Send to. In step S102, when the server device 16 receives data from the control computer 13, the server device 16 updates the manufacturing control table according to the received data.

Various sensors S provided in the vicinity of the manufacturing apparatus 11 measure physical quantities for a period during or before and after the manufacturing apparatus 11 is operating, and output measurement result data indicating the measurement results to the control computer 13. ..

In step S103, the control computer 13 acquires the measurement result data output from the sensor S. In step S104, the control computer 13 causes the display device 130 to display the control screen including the measurement result represented by the acquired measurement result data on the display device 130 in real time. At this time, the control computer 13 causes the display device 130 to display the content indicated by the acquired measurement result data in a form that is easy to visually grasp. Specifically, for example, the control computer 13 may display a screen including an image of a temperature meter and an image of a humidity meter on the display device 130 as illustrated in FIG. 4, or, for example, in a factory. The display device 130 may display a layout diagram schematically showing the layout of the installed devices. The display device 130 corresponding to the manufacturing device 11 displays a screen showing the measurement contents related to the manufacturing device 11 as exemplified in FIGS. 2 to 5. Further, when an error is detected in the manufacturing apparatus 11 or the sensor S, the control computer 13 may display the fact and the content of the error on the display device 130. By visually recognizing the screen displayed on the display device 130, the manager of the manufacturing apparatus 11 grasps the environment, the operating status, the presence or absence of an error, and the like of the manufacturing apparatus 11.

In step S105, the control computer 13 transmits a capture condition data and a shooting condition data acquisition request to the server device 16. The acquisition request includes a device ID that identifies the manufacturing device 11. In the example of FIG. 16, the processing of step S105 is performed after steps S101 to S104, but the order of processing is not limited to that shown in the drawing.

In step S106, when the server device 16 receives the acquisition request, the server device 16 reads the capture condition data and the shooting condition data corresponding to the device ID included in the received acquisition request from the manufacturing control table, and reads the read data to the control computer 13. Send.

The control computer 13 receives the capture condition data and the shooting condition data from the server device 16. In step S107, the control computer 13 captures the screen displayed on the display device 130 at the timing indicated by the capture condition data received from the server device 16 and generates the capture data (acquires the image data). In step S108, the control computer 13 adds time information and a control ID to the captured data representing the captured screen, and sequentially transmits the captured data to the server device 15.

In step S109, the server device 15 receives the capture data transmitted from the control computer 13 and accumulates the received capture data in the image database 153. As a result, the captured data captured at a predetermined timing is sequentially accumulated in the image database 153. Specifically, the data representing the captured image of the screen illustrated in FIGS. 2 to 5 is stored in the image database 153.

On the other hand, in step S110, each of the photographing devices 12 photographs the manufacturing apparatus 11 at a predetermined timing (for example, every 1 second), and assigns the photographing time information and the photographing ID to the photographing data representing the photographed image. Then, it is sequentially transmitted to the server device 15. The photographing device 12 records, for example, a change in the processing status of the product in the manufacturing device 11 as a group of still images. The server device 15 receives the shooting data transmitted from the shooting device 12. In step S111, the server device 15 accumulates the received shooting data in the image database 153. As a result, the image database 153 sequentially accumulates the photographed data taken at the predetermined timing.

Further, in step S112, the control computer 13 manufactures a product, such as a product ID and a process ID of a product that is an object of operation of the manufacturing apparatus 11, and data indicating a time when the manufacturing operation of the product is started or finished. The manufacturing control data related to the above is acquired, and the acquired manufacturing control data is transmitted to the server device 16. The manufacturing control data may be input by the manager operating the control computer 13, or may be generated by the control computer 13 according to the information output from the manufacturing apparatus 11. The timing at which the manufacturing control data is transmitted to the server device 16 may be, for example, a periodic timing for each predetermined unit time, or, for example, the timing at which an operation for transmission is performed by the administrator. It may be.

The manufacturing control data transmitted from the control computer 13 is received by the server device 16. In step S113, the server device 16 registers the received manufacturing control data in the manufacturing control table and updates the manufacturing control table. As a result, the manufacturing control data related to the manufacturing of the product by the manufacturing apparatus 11 is sequentially accumulated in the manufacturing control table.

FIG. 17 is a sequence chart showing an example of a manufacturing control data browsing operation. The manufacturing management data stored in the server device 16 and the image data stored in the server device 15 are used when the administrator or the like wants to confirm the state of manufacturing of the product performed in the past. For example, when the user of the terminal 14 operates the terminal 14 to log in to the administrator website provided by the server device 16, the Web page request data of the image viewing screen is transmitted from the terminal 14 to the server device 16 in step S120. To. In step S121, the server device 16 generates Web page data according to the Web page request data and transmits the Web page data to the terminal 14. In step S122, the terminal 14 displays a screen for designating search conditions (hereinafter referred to as “condition designation screen”) according to the Web page data received from the server device 16.

On the condition specification screen, the user operates the "search" button after inputting search conditions such as "product ID" and "period". In response to this operation, the terminal 14 transmits the search condition data according to the operated content to the server device 16 in step S123. In step S124, the server device 16 receives the search condition data, reads the manufacturing control data group corresponding to the received search condition from the manufacturing control table, and transmits the read manufacturing control data group to the terminal 14. In step S125, the terminal 14 receives the manufacturing control data group and displays the content represented by the received data group on the display device connected to the own device. As a result, a list of manufacturing control data corresponding to the search condition specified by the user is displayed on the display device of the terminal 14.

FIG. 18 is a diagram showing an example of a screen displayed on the display device. This screen displays a list of information represented by manufacturing control data related to the manufacture of the product. The displayed manufacturing control data is not limited to that illustrated in FIG. Other information may be included in the displayed manufacturing control data. Further, for example, the displayed manufacturing control data may not include the [Product delivery date] field. Further, the displayed list may be displayed sorted by product type or device ID, or may be displayed in another layout.

When the user selects any manufacturing control data from the displayed list, in step S126 of FIG. 17, the terminal 14 sends an image acquisition request including the device ID and time information included in the selected manufacturing control data to the server. It is transmitted to the device 16. In step S127, when the server device 16 receives the image acquisition request from the terminal 14, the control ID and the shooting ID corresponding to the device ID included in the received image acquisition request are read from the correspondence table, and the read control ID, An image acquisition request including a shooting ID, time information received from the terminal 14, and information indicating the terminal 14 is transmitted to the server device 15. In step S128, when the server device 15 receives the image acquisition request from the server device 16, the server device 15 reads and receives the group of captured data corresponding to the device ID and the time information included in the received image acquisition request from the image database 153. A group of shooting data corresponding to the shooting ID and time information included in the image acquisition request is read from the image database 153. In step S129, the server device 15 transmits the read capture data group and the shooting data group to the terminal 14 as a response. In step S129, the server device 15 may transmit the image data group to the server device 16, and the server device 16 may relay the transmission of the image data to the terminal 14.

In step S130, when the terminal 14 receives the capture data group and the shooting data group from the server device 15, the image represented by the received capture data group and the image represented by the received shooting data group are displayed together with the contents represented by the manufacturing management data. Display on the device in sequence. As a result, the images represented by the shooting data and the captured data corresponding to the manufacturing control data selected by the user are displayed on the display device in chronological order. As a result, the administrator can confirm the change in the processing status by the photographed manufacturing apparatus 11 and the change in various measured values related to manufacturing in chronological order.

FIG. 19 is a diagram showing an example of a screen displayed on the display device. This screen includes a list display area A31, a captured image display area A32, and a captured image display area A33. The terminal 14 displays the list of FIG. 18 in the list display area A31, and displays the image represented by the shooting data group acquired from the server device 15 in the shooting image display area A32. Further, the terminal 14 displays the image represented by the captured data group acquired from the server device 15 in the captured image display area A33. At this time, the terminal 14 displays and reproduces the image represented by the captured data and the image represented by the captured data in time synchronization.

In this embodiment, the terminal 14 adds the image represented by the received image data (shooting data or captured data) to the image data at a switching speed according to the information output from the operator such as the touch display 405. Display in chronological order according to time information. More specifically, for example, the terminal 14 may switch and display a plurality of still images every 0.5 seconds, for example. Further, in the screen illustrated in FIG. 19, the user can change the switching speed of the still image by using the touch display 405. Specifically, for example, the terminal 14 displays the tabs A34 and A35 as shown in FIG. 19, and the user changes the switching speed by moving the positions of the tabs A34 and A35 using the touch display 405. May be good. When the operation is performed by the user, the touch display 405 outputs information according to the operated content, and the terminal 14 changes the switching speed of the displayed image according to the information output from the touch display 405. At this time, when the switching speed of one image data (captured data or captured data) is changed by the user, the terminal 14 may also change the switching speed of the other image data.

From the screen displayed on the display device of the terminal 14, the administrator can confirm the change in the processing state by the manufacturing device 11 and the change in the measurement result accompanying the change on one screen.

By the way, as a method of recording information related to the manufacture of a product or the like, there are a method of monitoring and recording by a person and a method of recording a measured value by a sensor or the like. However, it may be difficult for the user to judge the situation at that time even by looking at the list of recorded numerical values. In addition, the storage format of the measured values differs depending on the type of sensor and the like, and it may be difficult to reproduce the data collectively.

There are a wide variety of sensor and control data for devices, and each sensor and data is created by various manufacturers and recorded as various types of data. Since the data format differs depending on the sensor manufacturer and the like, if it is intended to record each data, it is necessary to prepare an interface corresponding to each, and the work is complicated. Further, when trying to display a plurality of types of measurement result data at once, complicated work such as unifying the data format becomes necessary. Therefore, it takes a lot of time, money, and labor to comprehensively check the various recorded data.

On the other hand, in this embodiment, the control screen displayed by the control computer 13 in the manufacturing process of the product is captured and sequentially recorded as an image, and managed in association with the manufacturing management data related to manufacturing. Since the screen is captured, all of the various data related to manufacturing can be integrated into a single data format without depending on the respective data formats. Therefore, it is possible to reduce the labor and cost involved in recording the data, and it is easy for the user to comprehensively check various data related to manufacturing. In particular, in this embodiment, since the control screen is saved as an image in a highly versatile data format, not only a dedicated device but also various computers can be used to confirm the past manufacturing status. As described above, in this embodiment, by capturing the screen in which the measurement result data of a plurality of different data formats are displayed together, even if there is a difference in the data formats of the measurement result data, they are used. It is possible to record all the measurement results of. Further, the recording system 1 can be applied to a production line of a product produced through a series of production steps by accumulating captured images and captured images of a plurality of production devices 11 included in the production line.

Further, since the recording system 1 according to this embodiment is introduced by installing the photographing device 12 at the site and installing a program for capturing the screen on the control computer 13, it is necessary to prepare a special data interface. It can be easily introduced into existing production lines.

Further, in this embodiment, the operating state of the manufacturing apparatus 11 and the operation by the administrator are photographed by the photographing device 12 and recorded as an image. Since this captured image is reproduced in synchronization with the captured image in time, the user can easily grasp the situation at that time. In addition, for example, when an error occurs, a captured image of the screen displaying the error and the content of the error is recorded, so that the image is displayed and played back so that the user can visually grasp the situation at that time. Easy to do.

Further, according to this embodiment, for example, even when the sensor is replaced with a different type, it is not necessary to prepare an interface corresponding to the newly installed sensor, and the recording system 1 is changed. Captured images and captured images can be recorded as before without adding.

[Modification example]
The above-described embodiment is a specific example, and can be variously modified within the scope of the technical idea of the present invention. Examples of these modifications are shown below. In addition, two or more of the above-described embodiment and the modified examples illustrated below may be combined.

(1) The recording system 1 may be provided with a photographing device that photographs the operator OP and uploads the captured data to the server device 15.

FIG. 20 is a diagram showing the overall configuration of the recording system 1B according to the modified example. The configuration of the recording system 1B differs from the configuration of the recording system 1 according to the above-described embodiment in that a photographing device 17 for photographing the operator OP is provided. The photographing device 17 is provided at a position where the operator OP is photographed, performs photographing at a predetermined timing, and outputs the photographing data. The timing at which the photographing device 17 outputs the photographing data may be the timing at which the photographing device 12 outputs the photographing data and / or the timing synchronized with the timing at which the control computer outputs the captured data.

The shooting data is uploaded to the server device 15 and stored in the image database 153. In this modification, when the administrator browses the manufacturing control data using the terminal 14, the image represented by the shooting data taken by the shooting device 17 is displayed together with the manufacturing management data, the shooting data, and the captured image. Displayed on the device. On the screen displayed on the display device, the administrator can confirm the change in the manufacturing status by the manufacturing apparatus 11 and the change in the measurement result accompanying the change, as well as the change in the work status by the operator OP.

(2) In the above-mentioned recording system 1, when the administrator browses the manufacturing control data using the terminal 14, a function for searching the image data to be browsed may be provided. For example, the terminal 14 may display a screen for designating a range of measured values of the sensor S (for example, a temperature range and a humidity range) in step S122 of FIG. 17 described above. In this case, the administrator specifies the range of the measured values of the sensor S using the displayed screen. The terminal 14 transmits an image acquisition request including data indicating a range specified by the administrator as a search condition to the server device 16. The server device 16 transmits an image acquisition request corresponding to the image acquisition request received from the terminal 14 to the server device 15. When the server device 15 receives the image acquisition request, the server device 15 searches the image data according to the search conditions included in the received image acquisition request.

Image recognition may be used in the search process performed by the server device 15. Specifically, for example, when the captured data of the meter image representing the measurement result of the sensor S is used as the captured image, the meter image (or the feature of the meter image) corresponding to the range of the measured value of the sensor S is represented. The collation data is stored in a predetermined storage area in advance, and the server device 15 performs pattern matching processing of the image data using the collation data, so that the image data stored in the image database 153 can be selected from the image data. The collated image data may be read out and transmitted to the terminal 14. According to this aspect, the image data corresponding to the condition that the administrator wants to view is searched and displayed on the display device of the terminal 14. Also in this embodiment, as in the above-described embodiment, it is not necessary to create an interface corresponding to the output data from various sensors.

(3) In the above-described embodiment, the photographing device 12 and the control computer 13 are separate devices, but a device having the functions of the photographing device 12 and the functions of the control computer 13 may be used. Further, in the above-described embodiment, two server devices, a server device 15 and a server device 16, are used, but the number of server devices is not limited to two. For example, a single server device having the functions of the server device 15 and the functions of the server device 16 may be used. Further, the function of the server device 15 and the function of the server device 16 may be shared and provided by three or more server devices.

(4) The recording system according to the present invention can be used in various forms. For example, the system according to the present invention may be used as a system for recording information regarding the operation of an apparatus for sheet metal processing in a factory for sheet metal processing, or as a system for recording various information in a factory for packing food. It may also be used, for example, to record information about production lines for various products such as integrated circuits. It may also be used to record information about the construction process of the building's construction equipment. Further, the product according to the present invention is not limited to the product related to the manufacturing industry, but also includes the product related to the service industry and the intermediate product such as parts.

(5) In the above-described embodiment, the image data acquisition means 133 acquires the image data in which the screen displayed on the display device 130 is captured, but the image data is not limited to the captured data. The image data acquired by the image data acquisition means 133 may be, for example, image data generated by an imaging device that captures a screen displayed on the display device 130.

Further, the image data acquired by the image data acquisition means 133 is not limited to the image data representing the displayed screen. For example, when the manufacturing device 11 is provided with a meter showing the measurement result of the physical quantity related to the manufacturing of the manufacturing device 11, a photographing device for photographing the meter is provided, and image data representing the photographed image is uploaded to the server device 15. May be done.

FIG. 21 is a diagram showing an outline of the photographing apparatus 18 according to this modified example. In the figure, the meter 19 is provided in the manufacturing apparatus 11 and is a meter showing the measurement result of physical quantities (temperature, humidity, etc.) related to the manufacturing of the manufacturing apparatus 11. The photographing device 18 photographs the meter 19, and uploads image data indicating the photographing result to the server device 15. In this case, when the manager browses the manufacturing control data using the terminal 14, the image represented by the image data generated by the photographing device 18 is displayed on the display device together with the manufacturing control data. On the screen displayed on the display device, the administrator can easily confirm the change in the manufacturing status by the manufacturing device 11 and the change in the measurement result accompanying the change on one screen.

(6) In the above-described embodiment, the image data uploaded to the server device 15 and the manufacturing management data uploaded to the server device 16 are associated with each other by the device ID, the photographing ID, the control ID, and the correspondence table. It was. The method of associating the image data with the manufacturing control data is not limited to the above. The image data and the manufacturing control data may be linked by other types of information. Further, a database that directly associates image data with manufacturing control data may be used.

(7) In the above-described embodiment, the image database 153 stores the captured data captured by the photographing device 12 and the captured data captured by the control computer 13. The shooting data does not have to be stored in the image database 153. In this case, the captured data transmitted from the control computer 13 is stored in the image database 153.

(8) In the above-described embodiment, the photographing device 12, the control computer 13, the terminal 14, the server device 15, and the server device 16 are connected to the communication network 200, but the configuration of the recording system 1 is not limited to this. For example, a device in which a part or all of the devices related to the recording system 1 are integrally configured and operates standalone may be used.

(9) In the above-described embodiment, the capture data is assigned the control ID and the time information and stored in the image database 153, but other data may be added. Further, although the shooting data is added with the shooting ID and the time information and stored in the image database 153, other data may be added. Further, the data included in the manufacturing control data is not limited to that shown in the above-described embodiment. Other data may be included in the manufacturing control data.

(10) In the above-described embodiment, the start and end of recording may be instructed by the operator OP who operates the control computer 13. In this case, the instruction acquisition means 135 of the control computer 13 acquires the start instruction data and the end instruction data according to the operation of the operator OP. Further, as another example, at least one of the start and end of recording to the control computer 13 may be instructed without requiring a user operation, triggered by the occurrence of a predetermined event or the like. For example, the manufacturing control table is provided with a [scheduled operation time] field for storing data indicating start timing and end timing according to each of the manufacturing contents, and the control computer 13 receives the data from the server device 16. , A configuration may be adopted in which the recording of the captured image is started at the start timing indicated by the data and the capture is terminated at the end timing indicated by the data. In this case, the instruction acquisition means 135 of the control computer 13 acquires the start instruction data and the end instruction data when the timing indicated by the data received from the server device 16 arrives. Further, the start timing and end timing of recording do not need to be directly specified by the operator OP or the server device 16. For example, a configuration may be adopted in which the recording is automatically ended after a predetermined time has elapsed from the timing when the operator OP performs the recording start operation on the control computer 13.

(11) In the above-described embodiment, the photographing device 12 and the control computer 13 immediately transmit the image data to the server device 15 after generating the image data. Instead of this, the image data generated by the photographing device 12 and / or the control computer 13 is stored, and for example, every predetermined time elapses, at the end of work, the photographing device 12 and / or the control computer 13 determines the communication speed. When connected to a fast network, the image data stored in the server device 15 may be transmitted.

(12) In the above-described embodiment, the control computer 13, the terminal 14, the server device 15, and the server device 16 are realized by the computer executing the processing according to the program. Instead, at least one of the control computer 13, the terminal 14, the server device 15, and the server device 16 may be configured as a dedicated device including, for example, an ASIC (Application Specific Integrated Circuit).

(13) In the above-described embodiment, a program for causing the computer exemplified by the PC 10 to execute the processing of the control computer 13, a program for causing the computer exemplified by the computer 20 to execute the processing of the server device 15, and the computer 30. The program for causing the computer exemplified in the above example to execute the processing of the server device 16 and the program for causing the computer exemplified in the computer 40 to execute the processing of the terminal 14 are recorded on a recording medium for continuously recording data. It may be distributed by being downloaded to a computer via a data communication network such as the Internet.

(14) The structure of the various data illustrated in the above-described embodiment may be changed in various ways. For example, the manufacturing control table stored in the server device 16 may be configured to include an operator field. Further, for example, the manufacturing control table may be configured not to have a process type field.

1 ... Recording system, 10, 20 ... Computer, 11 ... Manufacturing equipment, 12 ... Imaging equipment, 13 ... Control computer, 14 ... Terminal, 16 ... Server equipment, 101, 201 ... Memory, 102, 202 ... Processor, 103 ... Clock , 104, 203 ... Communication IF, 105 ... Operating device, 131 ... Measurement result acquisition means, 132 ... Measurement result display instruction means, 133 ... Image data acquisition means, 134 ... Transmission means, 135 ... Instruction acquisition means, 136 ... Condition data Acquisition means, 141 ... Display instruction means, 151 ... Image data acquisition means, 152 ... Memory control means, 153 ... Image database, 154 ... Transmission means, 162 ... Manufacturing management data acquisition means, 163 ... Memory control means, 164 ... Display instruction Means, 165 ... Shooting data acquisition means, 166 ... Conditional data transmission means, 200 ... Communication network.

Claims (8)

The first image data representing an image taken by the photographing apparatus of the manufacturing apparatus for manufacturing the product, and
A data acquisition means for acquiring a second image data representing an image displayed by the first display device as a result of measuring the physical quantity related to the manufacturing by the measuring device, and a data acquisition means.
A storage control means for associating the first image data and the second image data generated at the same time acquired by the data acquisition means and storing them in a storage device.
A system including a display instruction means for simultaneously displaying an image represented by each of the first image data and the second image data stored in association with the storage device on the second display device. The data acquisition means acquires manufacturing control data indicating the manufacturing control information, and obtains manufacturing control data.
The storage control means stores the first image data and the second image data acquired by the data acquisition means in the storage device in association with the manufacturing control data acquired by the data acquisition means.
The display instruction means includes the first image data and the second image data together with an image represented by each of the first image data and the second image data stored in association with the storage device. The system according to claim 1, wherein the management information indicated by the manufacturing control data stored in the storage device is displayed on the second display device in association with the above. The data acquisition means acquires a third image data representing an image taken by the photographing device of an operator who operates the manufacturing apparatus, and obtains a third image data.
The storage control means stores the first image data, the second image data, and the third image data generated at the same time acquired by the data acquisition means in the storage device in association with each other.
The display instruction means transmits an image represented by each of the first image data, the second image data, and the third image data stored in association with the storage device to the second display device. The system according to claim 1 or 2, which is displayed at the same time. An image displayed by the display device as the first image data representing an image taken by the photographing device of the manufacturing device for manufacturing the product from the first terminal device and the result of measuring the physical quantity related to the manufacturing by the measuring device. A receiving means for receiving the second image data representing
A storage control means for storing the first image data and the second image data generated at the same time received by the receiving means in a storage device in association with each other.
A server device including a first image data stored in association with the storage device and a transmission means for transmitting the second image data to a second terminal device. The first image data representing an image taken by the photographing device of the manufacturing device that manufactures the product from the server device, and the image displayed by the display device as the result of measuring the physical quantity related to the manufacturing by the measuring device. A receiving means for receiving the image data of 2 and
A terminal device including a display instruction means for simultaneously displaying an image represented by each of the first image data and the second image data received by the receiving means on a display device. On the computer
An image displayed by the display device as the first image data representing an image taken by the photographing device of the manufacturing device for manufacturing the product from the first terminal device and the result of measuring the physical quantity related to the manufacturing by the measuring device. The process of receiving the second image data representing
A process of associating the first image data and the second image data generated at the same time as being received and storing them in a storage device.
A program for executing a process of transmitting the first image data and the second image data stored in association with the storage device to a second terminal device. On the computer
The first image data representing an image taken by the photographing device of the manufacturing device that manufactures the product from the server device, and the image displayed by the display device as the result of measuring the physical quantity related to the manufacturing by the measuring device. The process of receiving the image data of 2 and
A program for executing a process of simultaneously displaying an image represented by each of the received first image data and the second image data on a display device. The system displays the first image data representing an image taken by the photographing device of the manufacturing device that manufactures the product, and the image displayed by the first display device as the result of measuring the physical quantity related to the manufacturing by the measuring device. The step of acquiring the second image data to be represented, and
A step of associating the first image data and the second image data generated at the same time acquired by the system and storing them in a storage device.
A method in which the system includes a step of simultaneously displaying an image represented by each of the first image data and the second image data stored in association with the storage device on a second display device.

Images