JP5891191B2 - Operation result acquisition system and operation result acquisition method - Google Patents

Description

  The present invention relates to an operation result acquisition system and an operation result acquisition method suitable for acquiring an operation result of a production facility in a production site.

  Patent Document 1 discloses a high-speed and high-accuracy image for recognizing necessary information such as the position of an object in a visual recognition device that requires high-speed and high-precision positioning such as an electronic component mounting machine or a semiconductor assembly. Discloses a technique relating to a method and an apparatus for performing pattern matching. In the technique described in Patent Document 1, matching processing is performed with low cost, high speed, and high accuracy by calculation with a small number of points arranged only on partial feature shapes that match a recognition target pattern on a template.

JP 2002-8028 A

Conventionally, the collection of production results at a production site is performed by introducing devices such as terminals, wireless communication devices, and buttons pressed by workers directly connected to the computer system.
However, a production facility in a production site cannot be connected to a host computer if it is a facility that has been installed for a long time.
In addition, since the relocation within the production site is frequently performed, the production equipment cannot be fixed, and it is necessary to perform wiring work or the like every time the relocation is performed.

  In view of the above circumstances, it is necessary to devise a large-scale wiring work and a relocation of production equipment frequently performed at the production site. However, for example, in production sites that handle precision equipment such as semiconductors and computers, production facilities are placed in a clean room that is managed to reduce the number of dust in the room. There is a risk of being destroyed.

  Therefore, it is conceivable to connect the production equipment in the production site and the host computer by wireless communication, but the production site handling precision equipment is in an environment where wireless communication cannot be used to avoid the influence of electromagnetic waves.

  From the above situation, there has been a demand for a method for collecting production results of production facilities in an environment where data cannot be directly transmitted to and received from a host computer.

In order to solve the above-described problem, an operation result acquisition system according to the present disclosure shoots an operator at a specific place in a production site and outputs image data, and an image output from the imaging device And an operation result acquisition device for analyzing data.
The operation result acquisition device includes a pattern master table in which a correspondence between a preset pattern and operation result information of a production facility in a production site is registered, an operation result table in which operation result information and date / time information are registered, a pattern A recognition processing unit and a recording unit are provided.
The pattern recognition processing unit compares the pattern presented to the imaging device by the worker and the pattern registered in the pattern master table, which is reflected in the image data input from the imaging device, and the operation result information represented by the pattern Determine. The recording unit records the determined operation result information together with the date and time information in the operation result table.

  According to at least one embodiment of the present invention, it is possible to provide a method of acquiring an operation record of a production facility that cannot be connected to a host computer.

It is explanatory drawing which shows the example of installation of the production site where the operation performance acquisition system which concerns on one embodiment of this invention is applied, and an imaging device. It is a schematic block diagram which shows the example of whole structure of the operation performance acquisition system containing the imaging device which concerns on one embodiment of this invention. It is a block diagram which shows the internal structural example of the operation performance acquisition terminal which concerns on one embodiment of this invention. It is explanatory drawing which shows the example of the pose which an operator performs used with the operation performance acquisition system which concerns on one embodiment of this invention. It is explanatory drawing which shows the example of the record of the pattern master table which concerns on one embodiment of this invention. It is explanatory drawing which shows the example of the record of the operation performance table which concerns on one embodiment of this invention. It is a block diagram which shows the structural example of the software function of the operation performance acquisition terminal which concerns on one embodiment of this invention. It is a flowchart which shows the pose recognition process by the operation performance acquisition apparatus which concerns on one embodiment of this invention. It is a flowchart which shows the example of the operation performance acquisition process in the operation performance acquisition apparatus which concerns on one embodiment of this invention. It is a schematic block diagram which shows the structural example of the operation performance acquisition system which concerns on the modification of one embodiment of this invention. It is a flowchart which shows the example of the maintenance process by the operation performance acquisition apparatus which concerns on the modification of one embodiment of this invention.

  Hereinafter, an example of an embodiment for carrying out the present invention will be described with reference to the accompanying drawings. In addition, in each figure, the same code | symbol is attached | subjected to the common component and the overlapping description is abbreviate | omitted.

[Operation result acquisition system]
FIG. 1 is an explanatory diagram illustrating an example of installation of a production site and an imaging apparatus to which an operation performance acquisition system according to an embodiment of the present invention is applied.
The production site 100 includes an assembly line having production facilities 101A, 101B, and 101C, and a worker 102 works alongside the assembly line. The production site 100 is, for example, a production factory for parts and devices that require high precision, and the production facilities 101A to 101C are installed in a clean room, for example.

  An imaging device 103 (an example of an imaging unit) for image recognition is installed outside the production site 100 in order to acquire operation results (operation results such as operation and stop) of the production facilities 101A to 101C. A window 100 a is provided on the side wall of the production site 100 so that the imaging device 103 can photograph the inside of the production site 100. The imaging device 103 monitors a specific location (specific space 104) around the production facilities 101A to 101C in the production site 100 through the window 100a, and captures and generates image data generated by the operation result acquisition device 111 (see FIG. 2). ). For example, a digital video camera can be applied to the imaging device 103.

  In the present embodiment, the imaging device 103 takes an image of the worker 102 presenting a pattern toward the imaging device 103. The pattern presented by the worker included in the image data output by the imaging device 103 is recognized, and operation result information is acquired based on the pattern. In the present embodiment, a pose taken by the worker is used as a pattern that the worker 102 presents to the imaging device 103.

FIG. 2 is a schematic block diagram showing an example of the overall configuration of an operation performance acquisition system according to an embodiment of the present invention.
The operation result acquisition system 110 illustrated in FIG. 2 includes an imaging device 103, an operation result acquisition device 111, and an indicator lamp 115 (an example of a notification unit).

  The operation result acquisition apparatus 111 includes an operation result acquisition terminal 112, a pattern master table 113, and an operation result table 114. The operation result acquisition terminal 112 is connected to the imaging apparatus 103 via an interface and a communication line (not shown).

The operation result acquisition terminal 112 has the following functions.
The first function is to acquire image data that captures the worker 102 on the specific space 104 in the production site 100 from the imaging device 103.
Second, a special pose performed by the worker 102 in the production site 100 (example of pattern indicating operation result information: see FIG. 4) is checked against the pattern master information in the pattern master table 113, and based on the matched pattern. This is a function for discriminating the type of operation results (for example, operation start, production stop, etc.).
The third function is to send a signal corresponding to the result of the verification to the indicator lamp 115 and turn on the indicator lamp 115 to notify the worker 102.
The fourth function is to record the collected operation result information and date / time information in the operation result table 114.

  The indicator lamp 115 includes, for example, a red display portion 115r, a yellow display portion 115y, and a green display portion 115g. The pattern master table 113 and the operation result table 114 will be described later.

[Operation result acquisition terminal]
FIG. 3 is a block diagram showing an internal configuration example of the operation result acquisition terminal 112 according to the embodiment of the present invention.
For the operation result acquisition terminal 112, for example, a personal computer can be used as a host computer.

  The operation result acquisition terminal 112 has a CPU (Central Processing Unit) 121 which is an example of a control unit. Further, the operation result acquisition terminal 112 includes a ROM (Read Only Memory) 122 for storing a program executed by the CPU 121 and a RAM (Random Access Memory) 123 used as a work area of the CPU 121. . These are connected to the system bus 128. As the ROM 122, for example, an electrically erasable programmable ROM is used. The CPU 121 controls each block, that is, controls the entire apparatus.

The CPU 121 is connected to an HDD (Hard Disk Drive) 125 and a decoder 124 via a system bus 128.
The decoder 124 acquires image data from the imaging device 103 through an interface (I / F in the figure) 124a and a communication line, and decodes the encoded image data. The compressed image data may be decompressed by the decoder 124.
The HDD 125 records the image data output from the decoder 124.

Further, the CPU 121 is connected to the operation unit 126 and the display unit 127 via the system bus 128.
The operation unit 126 includes a plurality of keys, receives input of various instructions, data such as letters and numbers, and the like, and outputs input signals to the CPU 121.
The display unit 127 includes a display device such as a liquid crystal display device (LCD) or an organic ELD (Electro Luminescence Display), and displays information about acquired image data, an instruction menu for an operator, and the like.
Note that the display unit 127 and the operation unit 126 may be configured by a touch panel in which a touch sensor having an operation function and a display panel having a display function are stacked.

  Further, the CPU 121 is connected to the pattern master table 113 and the operation result table 114 via the system bus 128. The HDD 125 may be used as a recording device that records the contents of the pattern master table 113 and the operation record table 114.

FIG. 4 is an explanatory diagram illustrating an example of a pose performed by a worker, which is used in the operation result acquisition system 110.
A plurality of special poses performed by the worker 102 in the specific space 104 in the production site 100 are set according to the operating conditions of the production facilities 101A to 101C, and a pattern code and a pattern name are assigned to each set pose. Here, the pose includes not only the posture of the worker or a shape formed by using a part of the body, but also concepts such as gestures and hand gestures.

In FIG. 4, the pattern code 01 is a “recognition start” pose. The “recognition start” pose is a posture in which an operator faces the imaging device 103 and widens his legs to the width of his shoulders and widens his arms to the left and right.
The pattern code 02 is a “confirm” pose. The “confirmation” pose is a state in which the worker raises his right hand, directs the palm of the hand toward the imaging device 103, makes a fist, and projects the thumb.
The pattern code 03 is an “operation start” pause. The “operation start” pose is a state in which the worker raises his right hand to make a fist, shows the vicinity of the proximal interphalangeal joint (second joint from the fingertip) to the imaging device 103, and pushes the thumb.
The pattern code 04 is a “stop” pose. The “stop” pose is a state in which the worker raises his right hand, directs the palm toward the imaging apparatus 103, extends five fingers, and closes the gap between the four fingers excluding the thumb.
The pattern code 05 is a “ cancel ” pose. The “ cancel ” pose is a state in which the worker faces the imaging device 103 and greatly crosses his arms.

FIG. 5 is an explanatory diagram showing an example of records in the pattern master table 113.
As shown in FIG. 5, the pattern master table 113 has fields of “pattern code” and “pattern name”. A special pose performed by the worker 102 is registered in the pattern master table 113 in association with a pattern code and a pattern name for each pose type.
In the present embodiment, the pattern name for the pattern code 01 is “recognition start”, similarly, the pattern code 02 is “confirmation”, the pattern code 03 is “operation start”, the pattern code 04 is “production stop”, and the pattern code 05 is “cancel”.

FIG. 6 is an explanatory diagram illustrating an example of a record in the operation result table 114.
As shown in FIG. 6, the operation result table 114 has fields of “operation result acquisition date and time” and “pattern code”. In the operation result acquisition date / time field, the date and time when the operation result acquisition terminal 112 confirms the pattern code by analyzing the pose of the worker is recorded.

FIG. 7 is a block diagram illustrating a configuration example of software functions of the operation result acquisition terminal 112.
The operation result acquisition terminal 112 includes, as software functions, an image acquisition unit 131, a pose recognition processing unit 132 (an example of a pattern recognition processing unit), a notification unit 133 (an example of a notification unit), and a recording unit 134 (of the recording unit). An example).

  The image acquisition unit 131 acquires the image data transmitted from the imaging device 103 through the interface 124a (see FIG. 3). The image acquisition unit 131 inputs the image data processed by the decoder 124 after acquisition to the pose recognition processing unit 132.

  The pose recognition processing unit 132 compares the pose image included in the image data with the pattern master information in the pattern master table 113, and determines the type of operation results (for example, operation start, production stop, etc.) based on the matched pattern. .

  The notification unit 133 transmits a signal based on the pattern matching result by the pose recognition processing unit 132 to the indicator lamp 115, and turns on the display unit of the designated color. It may be blinking instead of lighting. Thereby, the pattern matching result by the operation result acquisition terminal 112 is transmitted to the worker 102.

For example, if the pattern matching the pose taken by the worker 102 toward the imaging apparatus 103 is not in the pattern master table 113 or the pose recognition processing unit 132 cannot recognize the pose, a recognition failure notification is issued and the red color is issued. The display unit 115r is turned on. Thereby, the worker 102 can know that the operation result acquisition apparatus 111 has determined that there is no pose pattern or that the pose has not been recognized.
If there is a pattern matching the pose taken by the worker in the pattern master table 113, a recognition notice is issued and the yellow display portion 115y is turned on. Thereby, the worker 102 can confirm that the operation result acquisition apparatus 111 recognizes the pose.
Furthermore, after recognizing an arbitrary pose taken by the worker in the pose recognition processing unit 132 (yellow display portion 115y is lit), the pose recognition processing unit 132 further recognizes that the worker has taken a confirmation pose. Issues a normal processing notification and turns on the green display portion 115g. Thereby, the worker 102 can confirm that the operation result acquisition processing has been normally performed by the operation result acquisition device 111.

  The recording unit 134 records the collection time of the collected operation result information and the operation result information in the operation result table 114.

[Operation result acquisition processing]
Next, the flow of operation result acquisition processing by the operation result acquisition device 111 will be described. In this description, first, the flow of the pose recognition process by the operation result acquisition apparatus 111 will be described.

FIG. 8 is a flowchart showing the flow of the pose recognition process performed by the operation result acquisition apparatus 111.
First, the imaging device 103 captures an image of a worker 102 posing in a specific space within the production site 100, and generates image data. The CPU 121 of the operation result acquisition terminal 112 acquires image data showing the worker 102 from the imaging device 103 (step S1).

  Subsequently, the CPU 121 collates the pose of the worker 102 shown in the acquired image data with the pattern master information in the pattern master table 113 (step S2).

  The CPU 121 determines the type of pose performed by the worker 102 based on the collation result (step S3), and ends the pose recognition process.

FIG. 9 is a flowchart illustrating an example of operation result acquisition processing in the operation result acquisition device 111.
For example, when the operation result acquisition device 111 (the CPU 121 of the operation result acquisition terminal 112) detects that the worker 102 has entered the specific space 104 of the production site 100 based on the image data output from the imaging device 103, or Operation result acquisition processing is started at predetermined time intervals.

  When the operation result acquisition terminal 112 starts the operation result acquisition process, the operation result acquisition terminal 112 first performs the pose recognition process shown in FIG. 8 (step S11). Whether the pose recognition processing unit 132 (see FIG. 7) includes image data corresponding to the recognition start pose (pattern code 01) registered in the pattern master table 113 in the image data acquired from the image acquisition unit 131. It is determined whether or not (step S12).

  When the pose in the acquired image data is not a pose registered in the pattern master table 113, or when the pose cannot be recognized (hereinafter collectively referred to as “when the pose cannot be recognized”), Proceed to S13. Then, a notification of unrecognition is issued to the notification unit 133 to light the red display unit 115r (second notification example), and the process returns to step S11 (step S13).

When the pose in the acquired image data is a pose representing the start of recognition registered in the pattern master table 113 (hereinafter referred to as “when pose recognition is possible”), step S 14. Proceed to Then, the notification unit 133 issues a recognition enable notification to light the yellow display unit 115y (first notification example) (step S14). The worker 102 takes a confirmation pose toward the image pickup apparatus 103 while watching the lighting of the yellow display portion 115y.

  Subsequently, the pose recognition processing unit 132 performs the pose recognition process shown in FIG. 8 (step S15). The pose recognition processing unit 132 determines whether the image data acquired from the image acquisition unit 131 includes image data corresponding to the pose registered in the pattern master table 113 (step S16).

Here, when the pose recognition processing unit 132 cannot recognize the pose, the pose recognition processing unit 132 issues a recognition failure notification to the notification unit 133 to turn on the red display unit 115r, and returns to the process of step S15 (step S17).
On the other hand, when the pose recognition is possible, the pose recognition processing unit 132 issues a recognition enable notification to the notification unit 133 and turns on the yellow display unit 115y (step S18).

  In response to the instruction from the pose recognition processing unit 132, the recording unit 134 temporarily writes the pattern code and the operation result acquisition date and time in the operation result table 114 based on the pose recognized in step S15 (temporary writing) (step). S19). Temporary writing is performed by writing a pattern code and an operation result acquisition date and time in the RAM 123 as an example.

  The pose recognition processing unit 132 performs the pose recognition process shown in FIG. 8 (step S20). The pose recognition processing unit 132 determines whether the image data acquired from the image acquisition unit 131 includes image data corresponding to the confirmation pose (pattern code 02) registered in the pattern master table 113 ( Step S21).

If the confirmation pose is not recognized, the pose recognition processing unit 132 proceeds to the determination process in step S24.
On the other hand, when the confirmation pose is recognized, the pose recognition processing unit 132 issues a normal processing notification to the notification unit 133 and turns on the green display unit 115g (third notification example) (step S22).

  In response to the instruction from the pose recognition processing unit 132, the recording unit 134 determines the pattern code and the operation result acquisition date and time temporarily written in the operation result table 114 in step S19 (step S23). As a result, the operation result is stored in the operation result table 114.

  If the confirmation pose is not recognized in the determination process of step S21, the pose recognition processing unit 132 includes image data corresponding to the cancel pose (pattern code 05) registered in the pattern master table 113 in the image data. It is determined whether it has been (step S24).

  When the pose recognition processing unit 132 recognizes the cancel pose, the pose recognition processing unit 132 issues a recognition enable notification to the notification unit 133 and turns on the yellow display unit 115y (step S25).

  In response to the instruction from the pose recognition processing unit 132, the recording unit 134 deletes the pattern code and the operation result acquisition date and time temporarily written in the operation result table 114 in step S19 (step S26). Return to processing.

For example, when the “production stop” (pattern code 04) pose is recognized in the first pose recognition process (step S15), the yellow display portion 115y is turned on.
After that, the worker 102 who has confirmed it takes a “confirmation” pose, and when the “confirmation” pose is recognized in the second pose recognition process (step S20), the operation result acquisition apparatus 111 has stopped production. to decide. Further, the green display portion 115g is turned on to indicate that the operation performance acquisition process has been normally performed.
Thereafter, when the production facility starts to operate again, the pose recognition processing unit 132 recognizes the “operation start” (pattern code 03) and “confirm” poses of the worker 102 in the same manner. Determine the start of operation.

  When the pose recognition is impossible in the determination process of step S24, the pose recognition processing unit 132 issues a recognition failure notification to the notification unit 133 to turn on the red display unit 115r, and returns to the process of step 20 (step S27).

According to the embodiment of the present invention described above, a pattern (pose) presented by the worker 102 is photographed by the imaging device 103 by the imaging device 103. Then, the operation result acquisition device 111 recognizes the pattern presented by the worker 102 included in the image data output from the imaging device 103, and acquires operation result information based on the recognized pattern.
As a result, when the operation result acquisition system 110 is introduced into the production site 100, the operation results of the existing production facilities 101A to 101C are acquired by the operation result acquisition device 111, which is a host computer, without performing new wiring work. Can do.
In addition, frequent rearrangement of production facilities can be handled by changing the installation location of the imaging device 103 or the position of a specific space.
In particular, when a production facility for which an operation result is desired to be obtained is in a clean room, it is possible to obtain the operation result of the production facility without impairing the environment in the clean room.

  In the example of FIG. 9, the process of taking the pose indicating the operation performance after the worker 102 first takes the recognition start pose has been described. However, the process may be such that the recognition start pose is not taken first.

  The green display portion 115g is for notifying the worker 102 whether or not the type of pose taken by the worker 102 is recognized by the operation result acquisition apparatus 111 and the operation result acquisition process is normally performed. Therefore, it may be appropriately provided as necessary.

[Maintenance processing]
Next, an example in which the pattern master table 113 provided in the operation result acquisition apparatus 111 is maintained using the pose recognition function of the operation result acquisition apparatus 111 will be described.

FIG. 10 is a schematic block diagram illustrating a configuration example of an operation result acquisition system according to a modification of the embodiment of the present invention.
An operation result acquisition system 110A illustrated in FIG. 10 includes an operation result acquisition device 111A and an imaging device 103. The operation result acquisition apparatus 111 </ b> A is different from the operation result acquisition apparatus 111 in that it includes a maintenance table 116.

  The maintenance table 116 is a table that records information related to pose recognition of the operation result acquisition apparatus 111A. Information recorded in the maintenance table 116 is used for maintenance of the pattern master table 113.

FIG. 11 is a flowchart illustrating an example of a maintenance process performed by the operation result acquisition apparatus according to the modification of the embodiment of the present invention.
As shown in FIG. 11, when the pose in the image data acquired in the determination process of steps S12, S16, and S24 (see FIG. 9) is not a pose registered in the pattern master table 113, or when the pose cannot be recognized, The recording unit 134 records information that the pose recognition is impossible in the maintenance table 116 (step S31). The date and time when it is determined that the pose cannot be recognized may also be recorded.

  If the pose in the image data acquired in the determination process in step S24 (see FIG. 9) is a cancel pose, the recording unit 134 records information indicating the cancel pose in the maintenance table 116 (step S32). The date and time when it is determined to be a cancel pause may also be recorded.

  Then, the notification unit 133 creates maintenance information from the information that the pose recognition is impossible and the information that the pose is canceled, and displays the maintenance information on the display unit 127 (step S33).

For example, a pose determined to be pose-recognizable is considered to be a pose that is difficult for the operation result acquisition apparatus 111 to recognize. In addition, the fact that the cancel pose has been recognized can be considered that the operation result acquisition apparatus 111 has erroneously recognized the pose of the worker 102. That is, it can be said that the poses corresponding to these are poses in which it is difficult to correctly determine the pattern code.
Therefore, for each pose, the number of times the pose recognition is impossible and the cancel pose is determined is displayed. Alternatively, a pose in which the number of times these are determined exceeds the set number may be displayed as a pose requiring maintenance.

  The worker 102 or the person in charge of the production site 100 confirms the displayed maintenance information, considers a pose change, and maintains the pattern master table 113 (step S34).

  For example, when the number of times the pose recognition is impossible and the cancel pose is determined exceeds the set number, the worker 102 may not be able to correctly create the target pose. In that case, it is possible to take measures such as giving advice so that the worker 102 can correctly perform the desired pose. It is also a suggestion to change to a pose that is easy to recognize. In that case, a process of registering the pattern code and pattern name in the pattern master table 113 by associating the pose after the change is performed.

  Thus, by creating maintenance information using information indicating that the pose recognition is not possible and information indicating that the pose is a cancel pose, the pose can be reviewed and the pattern master table 113 can be maintained. As a result, the operation result acquisition apparatus 111 reduces the erroneous recognition of the pose taken by the worker 102, and the operation result acquisition apparatus 111 can acquire the accurate operation results of the production facilities 101A to 101C.

  In the above-described embodiment, for example, a digital video camera is applied as the imaging device 103, but a digital still camera can also be used.

  In the above-described embodiment, the example in which the worker 102 takes a special pose in front of the imaging device 103 has been described. However, the worker 102 raises a color plate corresponding to the pattern code toward the imaging device 103. You may do it. The pose recognition processing unit 132 (identification information processing unit) identifies the pattern code by analyzing the color of the color plate instead of the pose. In this case, since the color of the color plate is associated with the pattern code, erroneous recognition is reduced as compared with the case where the pose taken by the worker 102 is recognized. In addition, since the pattern matching process is not performed, the processing load of the pose recognition processing unit 132 (CPU 121) is reduced. The pattern representing the operation results may be information such as characters or figures displayed on the board.

  In the above-described embodiment, the example in which the indicator lamp 115 is used as a means for notifying the worker 102 of the pose recognition status has been described. However, by voice notification using a speaker or the like, or by screen display on the display unit 127. Notification may be used. When the pose recognition status is displayed on the screen of the display unit 127, the pose recognition status can be easily and reliably notified using characters, figures, pictures, and the like. In addition, when performing the notification by the screen display to the display part 127, a window is provided in the side wall of the production site 100, and the operator 102 can confirm the screen of the display part 127 through a window.

  In the above-described embodiment, the operation results of the production facilities 101A to 101C in the production site 100 are managed together. However, when the production facilities 101A to 101C can be individually controlled, the operation results of the production facilities 101A to 101C are You may make it acquire separately. For example, the numbers 1 to 3 are assigned to the production facilities 101 </ b> A to 101 </ b> C, and the production facility is designated by the number of fingers that the worker 102 shows toward the imaging device 103. Thereafter, the worker 102 transmits the operation result information regarding the designated production facility to the operation result acquisition apparatus 111 using a pause as in the above-described embodiment. As another method for designating production equipment, for example, a board on which numbers or symbols are described may be presented to the imaging apparatus 103.

Furthermore, the present invention is not limited to the above-described embodiments, but includes other modifications and application examples without departing from the gist of the present invention described in the claims.
For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described. A part of the configuration of an embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of an embodiment. Is also possible. Further, it is possible to add, replace, or delete other configurations for a part of the configuration of each embodiment.

  Each of the above-described configurations, functions, processing units, processing means, and the like may be realized by hardware by designing a part or all of them with, for example, an integrated circuit. Further, each of the above-described configurations, functions, and the like may be realized by software for interpreting and executing a program that realizes each function by the processor. Information such as programs, tables, and files for realizing each function can be held in a recording device such as a memory, a hard disk, or an SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, or an optical disk. .

  In addition, the control lines and information lines are those that are considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown. Actually, it may be considered that almost all the components are connected to each other.

  Further, in this specification, the processing steps describing time-series processing are not limited to processing performed in time series according to the described order, but are not necessarily performed in time series, either in parallel or individually. The processing (for example, parallel processing or object processing) is also included.

  DESCRIPTION OF SYMBOLS 100 ... Production site, 101A-101C ... Production equipment, 102 ... Worker, 103 ... Imaging device, 104 ... Specific space, 110, 110A ... Operation result acquisition system, 111, 111A ... Operation result acquisition device, 112 ... Operation result acquisition Terminal 113 113 Pattern master table 114 Operation result table 115 Indicator lamp 116 Maintenance table 121 CPU 124 Decoder 125 HDD 130 131 Image acquisition unit 132 Pause recognition processing unit 133 ... notification part, 134 ... recording part

Claims (9)

An imaging device that shoots a worker at a specific location in the production site and outputs image data;
An operation result acquisition device that analyzes the image data output from the imaging device, and
The operation results acquisition device is
A pattern master table in which the correspondence between the preset pattern and the operation result information of the production equipment in the production site is registered;
An operation result table in which the operation result information and date information when the operation result information is acquired are recorded;
The pattern shown in the image data input from the imaging device, the pattern presented to the imaging device by the worker, and the pattern registered in the pattern master table are collated, based on the result of the collation, A pattern recognition processing unit for determining operation performance information represented by the pattern presented by the worker;
A recording unit that records the operation result information determined by the pattern recognition processing unit in the operation result table together with date and time information at which the operation result information is acquired.
An operation result acquisition system for acquiring operation result information of the production equipment in the production site . The operation result acquisition system according to claim 1, further comprising: a notification unit that performs notification according to a pattern recognition result presented by the worker by the pattern recognition processing unit. The notification unit performs a first notification when the pattern recognition processing unit can recognize the pattern presented by the worker,
The operation result acquisition system according to claim 2, wherein the second notification is performed when the pattern recognition processing unit cannot recognize the pattern presented by the worker, or when the pattern is not registered in the pattern master table. The notification unit performs a first notification when the predetermined pattern presented by the worker is recognized by the pattern recognition processing unit, and temporarily writes the operation result information represented by the recognized pattern in the operation result table. ,
After the first notification, when the pattern recognition processing unit recognizes that the pattern presented by the worker is a pattern representing confirmation, the recording unit temporarily writes in the operation result table The operation result acquisition system according to claim 2, wherein the content is confirmed, and the notification unit performs a third notification indicating that the pattern recognition processing by the pattern recognition processing unit is normally performed. The notification unit performs a first notification when the predetermined pattern presented by the worker is recognized by the pattern recognition processing unit, and temporarily writes the operation result information represented by the recognized pattern in the operation result table. ,
After performing the first notification, when the pattern recognition processing unit recognizes that the pattern presented by the worker is a pattern representing cancellation, the notification unit performs the first notification again, and The operation record acquisition system according to claim 2, wherein the recording unit erases the contents temporarily written in the operation record table. The operation result acquisition system according to claim 3, wherein the pattern presented by the worker toward the imaging apparatus is a pose taken by the worker. The operation result acquisition system according to claim 3, wherein the pattern presented by the worker toward the imaging device is information displayed on a board. The operation result acquisition system according to any one of claims 1 to 7, wherein the production site is a clean room. The imaging device takes a picture of a worker at a specific location in the production site, outputs image data,
The operation result acquisition device receives the image data output from the imaging device,
The operation result acquisition device is reflected in the image data input from the imaging device, the pattern presented by the worker to the imaging device, the preset pattern, and the operation result of the production equipment in the production site The pattern registered in the pattern master table in which the correspondence relationship with the information is registered, and based on the result of the verification, the operation result information represented by the pattern presented by the worker is determined,
The determined operation result information is recorded in the operation result table together with the date and time information when the operation result information is acquired.
An operation result acquisition method for acquiring operation result information of the production equipment in the production site .

Images