JP6676321B2 - Applicability evaluation device and adaptability evaluation method - Google Patents

Description

  The present invention relates to an adaptability evaluation apparatus and an adaptability evaluation method, and to a technique for evaluating the adaptability of processes and workers in a manufacturing factory or the like.

JP 2001-101422 A JP 2015-125578 A

Patent Literature 1 discloses a technique capable of associating the state of a human body and a work object during work with the burden on the human body, monitoring the state of the human body and the work object, and providing data effective for work improvement.
Patent Literature 2 discloses a technique for evaluating a posture of a work posture or the like based on objective evaluation and subjective evaluation.

In the automobile manufacturing process, there are many operations of assembling parts by workers. By continuing this work for a long time, the work load increases, and in many cases, the work efficiency decreases with time.
This work load is usually taken up as a worker's sensory voice. In addition, the impression of the process and the degree of fatigue vary depending on the influences of the workers. In particular, workers are good at work and poor at work for each individual, so there are directions and unsuitability for each process.
However, these feelings of burden and orientation / unsuitability are subjectively felt by the worker himself, and it is difficult to judge these objectively.

In a production line that includes a large number of processes and a large number of operations, instead of such a subjective opinion, the work load and situation of each worker for each process should be objectively controlled in order to manage personnel at each process. And it is required to evaluate quantitatively.
Therefore, an object of the present invention is to provide a system capable of obtaining useful objective information for line management, design and improvement of a production line, and the like.

The adaptability evaluation apparatus according to the present invention is configured such that, at each point in time, the worker performs a simple model with detection points corresponding to a plurality of body parts of the worker executing the process to be measured and lines connecting the detection points. A detection information acquisition unit that acquires information on the physical condition of the subject, and compares the information about the detection points or lines obtained by the detection information acquisition unit with reference information set for the process of the measurement target. An adaptive value calculation unit that calculates an adaptive value for the process, and an output control unit that generates adaptive evaluation information based on the calculation result of the adaptive value calculation unit and performs control to present the evaluation information, and the output control unit includes: Extracting personal data of each part of the body of the worker in the work selected as the processing target, obtaining a difference value by comparing each of the personal data with reference information, and calculating an adaptation value indicating adaptability to the work from the difference value. Calculate and Determines the recommended process or deprecated step by determining the characteristics of the worker individual by a value, performs control for presenting the determination result.
That is, the physical state of the worker is detected by a simple model, and the movement of the worker can be grasped from the position or change (movement vector) of the detection point or line for each body part, for example, a joint. Then, information on the detection point or the line, that is, individual data such as each part of the body (arms, waist, feet) and the like is compared with reference information set in advance to determine matching between the person and the process.
Further, the adaptability of a certain worker and a certain process can be determined as a calculation result of the adaptive value calculation unit. Then, the personal characteristics of the worker can be estimated in relation to the process. By determining the matching between the personal characteristics of the worker and the work content of each step, it is possible to determine a recommended step and a step that is not recommended for a certain worker.
In addition, if the adaptability of a certain worker and a certain process can be determined as a calculation result of the adaptive value calculation unit, personal characteristics of the worker can be estimated in relation to the process, and this is presented.

In the above-described adaptability evaluation apparatus, it is conceivable that the detection information acquisition unit acquires three-dimensional positions of a plurality of the detection points from an analysis result of image data obtained by imaging the worker.
If the worker is imaged and the captured image is analyzed, the three-dimensional position of the detection point of the worker can be specified.

In the above-described adaptability evaluation device, an operation determining unit that determines a posture or an operation of a worker based on a change in the detection point or a line in the information obtained by the detection information obtaining unit; A load calculation unit that calculates a work load value based on the posture or the motion of the work, and the output control unit presents work load evaluation information in a process to be measured based on a calculation result of the load calculation unit. Control may be performed.
That is, the body state of the worker is detected by a simple model, and the position and change (movement vector) of the detection points and lines of each body part, for example, a joint, are detected in the process work process. Then, the work load value is calculated based on the posture or the motion of the worker. Based on this work load value, work load evaluation information of the process is generated and presented.

In the adaptability evaluation method according to the present invention, at each time point, the information processing apparatus is simply modeled by detection points corresponding to a plurality of body parts of a worker performing the process to be measured and a line connecting the detection points. In the state, acquire information on the physical condition of the worker, compare the acquired information on the detection points or lines with reference information set for the process of the measurement target, and adjust the worker's adaptation value for the process. Is calculated, adaptive evaluation information is generated based on the calculation result, the presentation is controlled , personal data of each part of the worker's body in the work selected as the processing target is extracted, and the personal data is compared with the reference information. and obtains a difference value, and calculates an adaptive value that indicates the adaptability to the work from said difference value, determining the recommended process or deprecated step by determining the characteristics of the worker individuals by the adaptation value An adaptive evaluation method of performing control for presenting the determination result.
This makes it possible to realize an adaptability evaluation device using the information processing device.

  According to the present invention, since the adaptability of each worker is presented as objective adaptation evaluation information for the process in the production line, useful information for management and the like for the production line manager is provided. Obtainable.

It is a block diagram of an adaptability evaluation system of an embodiment of the invention. It is explanatory drawing of the simplified model of the physical condition of the worker of embodiment. It is explanatory drawing of the attitude | position and motion detection by the simple model of embodiment. FIG. 4 is an explanatory diagram of three-dimensional position information and steps of each detection point detected in the embodiment. FIG. 9 is an explanatory diagram of a calculated value for each step obtained in the embodiment. 5 is a flowchart of a process performed by a calculation unit according to the embodiment. It is explanatory drawing of the workload evaluation information of embodiment. It is explanatory drawing of the workload evaluation information of embodiment. It is a flow chart of adaptability judgment processing and recommended process judgment processing of an embodiment. It is an explanatory view of a presentation example of adaptability evaluation information of an embodiment. It is explanatory drawing of the presentation example of the determination information of the recommendation process of embodiment.

<System configuration>
Hereinafter, an embodiment of the adaptability evaluation apparatus will be described. The operation unit 1 shown in FIG. 1 is an embodiment of the adaptability evaluation device of the present invention. FIG. 1 shows an example of an adaptability evaluation system including an operation unit 1.

  As shown in FIG. 1, the adaptability evaluation system includes an arithmetic unit 1, a database unit 2, a storage unit 3, a display unit 4, a communication unit 5, a printing unit 6, an imaging unit 10, a driving unit 11, a sensor 20, and a receiving unit 21. , A detection value generation unit 22.

The imaging unit 10 is a video camera installed on a production line, and captures an image of an operator performing a process operation. Although only one imaging unit 10 is shown in the drawing, it is usually assumed that a plurality of imaging units 10 are arranged so as to be able to image an operator in each step of the manufacturing line.
The one or more imaging units 10 supply the image data of each frame captured as a moving image to the arithmetic unit 1.
The imaging unit 10 performs stereo imaging, and the captured image signal obtained by stereo imaging can also obtain information in the depth direction using the principle of triangulation in image analysis.
The driving unit 11 is a device for displacing the imaging direction of the imaging unit 10 and has, for example, a pan / tilt mechanism and a driving motor thereof.

The sensor 20 is assumed to be, for example, a sensor worn by the worker at various parts of the body, a sensor installed at a work position, and detecting the movement of the worker. Specifically, it is an angular velocity sensor, an acceleration sensor, an infrared sensor, a position sensor, or the like.
The detection signal of each sensor 20 is supplied to the reception unit 21 by wire or wirelessly, and the detection signal received by the reception unit is decoded into a detection value by the detection value generation unit 22 and supplied to the calculation unit 1.

  In the system shown in FIG. 1, the image signal of the worker by the imaging unit 10 and the detection value by the sensor 20 are all information for detecting the posture and movement of the worker. Therefore, at least one of the imaging unit 10 and the sensor 20 may be used. Of course, both may be used to supplement or correct each other's information.

The arithmetic unit 1 is constituted by a computer device, for example. That is, the arithmetic unit 1 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), an interface unit, and the like, and the CPU executes various processes according to programs stored in the ROM. I do. The RAM stores data and the like necessary for the CPU to execute various processes.
Note that the information processing device as the arithmetic unit 1 may be realized by one computer device, or a plurality of computer devices may be realized in cooperation.
The processing unit 1 includes, as processing functions for the present system, an image analysis unit 1a, a camera control unit 1b, a detection information acquisition unit 1c, an operation determination unit 1d, a burden calculation unit 1e, an output control unit 1f, an adaptability determination unit. 1 g is provided. Each of these units is a virtual block of a processing function executed by software.

The image analysis unit 1a performs a process of analyzing each frame data as the captured image data supplied from the imaging unit 20.
In the case of this example, the worker is detected as a simplified model that is simplified mainly based on information on detection points such as joints and lines connecting the detection points.
FIG. 2 shows an example of the simplified model. A detection point P is set for each part of the human body. In the figure, the detection points P0 to P20 are shown as an example. For example, a point that is displaced mainly in accordance with the posture, such as the waist, the head, the neck, and the joints of the limbs, is set as the detection point P.
Each detection point P is connected to a specific other detection point P by a line.
For example, the detection point P1 is connected to each of the detection points P2, P3, and P6 by a line.
The detection point P2 is connected to only the detection point P1 by a line.
The detection point P3 is connected to the detection points P1 and P4 by a line.
As described above, since each of the detection points P1 to P20 defines a detection point connected by a line, a simple model expressing a human body by the point and the line is formed.

  FIG. 3 is an example in which the posture of the worker is represented by a simple model. FIG. 3A is an XY plane, FIG. 3B is a ZY plane, and FIG. 3C is an XZ plane, showing the position of each detection point and the line between each detection point. That is, by detecting the three-dimensional coordinate position for each of the detection points P0 to P20, the posture of the worker at that time can be detected.

The image analysis unit 1a in FIG. 1 detects the positions of the detection points P0 to P20 (the three-dimensional coordinate values of x, y, and z) from the image of the worker in order to detect the posture of the worker using such a simple model. ) Is detected.
In order to accurately detect the worker's body from the captured image data, it is preferable that the colors of the work clothes (uniform) and the hat are registered in advance so that the colors can be clearly distinguished from the colors of the factory equipment and products. It is.
Alternatively, it is also conceivable to determine each detection point P in the human body constituent part by pattern matching.
Further, when the worker wears the sensor 20 on the wrist, ankle, or the like so that the position information thereof can be detected, the three-dimensional position information of the detection point P extracted from the captured image data is obtained by the position information of the sensor 20. Correction may be considered.

The camera control unit 1b controls the driving unit 11 to displace the imaging direction of the imaging unit 10. For example, an operator during a process operation moves a position for the operation. The camera control unit 1b controls the following operation of the imaging unit 10 so that the worker does not go out of the frame from the captured image data due to the movement of the worker.
Specifically, the driving unit 11 is driven according to the movement of the position of the worker recognized by the image analysis unit 1a (change of the position of the worker in each frame).

  At each time point, the detection information acquisition unit 1c sets the detection point P corresponding to a plurality of body parts of the worker performing the process to be measured and the line of the detection point P into a simple model, Get information on physical condition. That is, a detection result of the image analysis unit 1a or a detection value obtained by the sensor 20 is acquired and managed as information of an operator. Specifically, three-dimensional position information of each of the detection points P0 to P20 is acquired at each measurement timing, and is stored as a detection result.

FIG. 4A shows an example of worker information acquired and stored by the detection information acquisition unit 1c.
For example, the image analysis unit 1a detects each of the detection points P0 to P (n) at sample timings t (t0, t1, t2,...) At predetermined frame intervals of the captured image data (n = 20 in the example of FIG. 2). Is detected. The detection information acquisition unit 1c acquires the three-dimensional coordinate values of the detection points P0 to P (n) at each sample timing t, and stores them. The information as shown in FIG. 4A is acquired, for example, for each process and for each worker, and is stored and managed.

For example, in a manufacturing line, there are processes A, B, C,..., And one worker is in charge of one process. It is also assumed that each step has a plurality of operations. For example, assume that the process A includes operations a1 to a5. As a specific example, for example, one process is a process of attaching a tire to a vehicle body, and each operation is an individual operation such as setting, mounting, and checking a tire.
Now, assuming that the process A has five operations a1 to a5 as shown in FIG. 4B, the worker WM1 in charge performs the process A (operations a1 to a5) repeatedly on the vehicle body on the line. Become.
By acquiring and storing the three-dimensional position information of each of the detection points P0 to P20 as shown in FIG. 4A at each sample timing t, the three-dimensional position information of the detection points P0 to P20 in the repeatedly performed process is time-series. Will be collected above.
Although FIG. 4B shows that one step A is completed at each of the sample timings t0 to t99 and t100 to t199, this is merely an example for explanation. This is because, for example, even when the same process is performed by the same operator, the process is not always completed in the same time. Which sample timing t is the information as each of the operations a1 to a5 in the process A can be determined based on the posture determined by each three-dimensional coordinate value, the change in the posture, the change in the motion, and the like.

  The motion determining unit 1d determines the posture or motion of the worker based on a change in the detection point P or the line in the body state obtained by the detection information obtaining unit 1c. The change in the detection point P or the line is represented by a change in the three-dimensional coordinate values of the detection points P0 to P (n) acquired as shown in FIG. 4A. In FIG. 4A, the information of the detection points P is stored, but the information of the line connects the respective detection points P, and thus can be grasped from the respective detection points P. Then, the motion determining unit 1d determines the posture and the motion of the worker based on the time-series change of the information in FIG. 4A.

The load calculation unit 1e calculates a work load value based on the posture or motion of the worker determined by the motion determination unit 1d.
With respect to the posture and the motion of the person, the burden values can be calculated in advance ergonomically. For example, the burden value of the burden of raising both hands, the burden of squatting posture, the posture of bending over, or the lateral movement operation, the twisting movement, and the like can be calculated in advance. Also, the load varies depending on the posture and the duration of the operation, but the value of the load according to the duration can be set in advance. For example, the posture in which both hands are raised is not so burdensome for a moment, but the burden is large when the posture is continuously raised.
These postures and movements, and the load values according to the time, are calculated in advance in accordance with ergonomics, systematically registered in the database unit 2.
The load calculation unit 1e calculates a work load value for the process or each work in the process based on a series of movements and postures of the worker in the process and each work determined by the movement determination unit 1d and the duration thereof. I do. For example, a burden value for the motion or posture determined from the movement amount of the detection point P or the line, the duration thereof, or the like is obtained, and these are added or weighted and added, so that a series of motions (postures) in the work or process are performed. Is calculated. Specifically, load values are individually applied to the determined posture during the work, the angles of the joints of the arms and the like, the amount of movement, and the like, and the work load value of one work or process is calculated using these.
Further, for example, the work load value is calculated until the end of the work, and the peak of fatigue and the degree of influence (fatigue prediction) when the work is extended can also be obtained.

For example, the load calculating unit 1e stores the calculated values regarding the process and the work as shown in FIG.
Note that the calculated value is assumed to be various. For example, the calculated value MA1 for the process A may be a total burden value of the work load in the process A, MA2 may be a burden value on the shoulder of the worker, and MA3 (not shown) may be a burden value on the legs.
Also, the calculated value for each work (for example, the calculated values Ma1-1, Ma2-2,... For the work a1) may be a total burden value, a burden value of each unit, or the like.
The calculation example of the burden value (work load) about a process and work is shown.

Here, Dis is the movement load of each joint in one frame, Kdis is the weight of each joint movement amount with respect to the degree of fatigue, Pos is the posture load, and Kpos is the weight of each joint angle with respect to the degree of fatigue.
Dis is obtained by (Equation 2).

Here, X1, Y1, and Z1 are the coordinates of each joint, and X0, Y0, and Z0 are the coordinates one frame before each joint.
Pos is obtained by, for example, (Equation 3).

Here, U is the weight of the body above each joint, Ku is the weight of the body weight above each joint with respect to the work load, F is the sum of the external forces set for each process, and Kf is the external force above each joint with respect to the work load. The weight, θ is the calculated angle of each joint, and P is a constant indicating the posture of the human being.
The above calculation example of the burden value (work load) is only an example.

The adaptation value calculation unit 1g compares the information on the detection points or lines obtained by the detection information acquisition unit 1c with reference information set for the process to be measured, and calculates the adaptation value of the worker for the process. I do.
For example, in each operation of one process, for example, an ideal posture or operation is used as a reference, and the position or time-series change of each detection point P (P0 to P20) in the reference posture or operation is quantified in advance. And stored in the database unit 2. For example, an image of a process operation of a skilled person may be taken, and the positions and changes of the respective detection points P1 to P20 at each time point may be acquired in the same manner as in FIG. 4A and stored as reference information. Alternatively, by ergonomic analysis, a posture or an operation that places the least burden on a person in the corresponding work is set, and the position or change of each point corresponding to each of the detection points P0 to P20 in that case is used as reference information. You may memorize it.
In any case, by comparing such reference information with the detection information as shown in FIG. 4A, an adaptation value indicating whether or not the detection target worker is suitable for the process is obtained. The adaptation value is information obtained by quantifying whether or not the target worker is suitable for the target process. For example, the adaptability is represented by a numerical value from “0” to “100”.

  In calculating the adaptive value, for example, a difference from the reference information for each of the detection points P0 to P20 at each time point is obtained, and a calculation is performed such that the larger the difference is, the more the value is not suitable for the process. . It is also conceivable to compare the movement trajectory and movement time of each of the detection points P0 to P20 in the time series with the reference information, analyze the smoothness of the movement, the movement efficiency, and the like, and digitize it. In any case, an operation is performed to find a value that is closer to the reference information and more adaptive (for example, adaptive value = 100), and farther from the reference information is less adaptive (for example, adaptive value = 0). .

  The output control unit 1f is a control for presenting work load evaluation information, adaptability evaluation information, information on the result of determination of personal characteristics, and the like in the process to be measured, based on the calculation results of the load calculation unit 1e and the adaptability determination unit 1g. I do. That is, work load evaluation information is generated, and the work load evaluation information is stored in the storage unit 3, displayed on the display unit 4, transmitted to an external device by the communication unit 5, and printed out by the printing unit 6. Perform control processing.

The database unit 2 stores, for example, the load value for each posture and motion, the reference information for determining the adaptability, and the like, as described above, and the arithmetic unit 1 calculates the work load value and the adaptive value. It can be referred to sequentially.
The storage unit 3 stores detection information as shown in FIG. 4A and information of calculated values as shown in FIG. Also, a program for causing the arithmetic unit 1 to execute the above functions is stored.
The display unit 4 is a display device connected to the calculation unit 1 and displays various user interface images and images indicating work load evaluation information.
The communication unit 5 performs communication with an external device by wire or wirelessly, and performs communication via a communication path such as a LAN (Local Area Network). The arithmetic unit 1 can provide, for example, work load evaluation information to another information processing device or the like through the communication unit 5.
The printing unit 6 is a printer or the like connected to the arithmetic unit 1, and performs a printing operation in accordance with an instruction from the arithmetic unit 1.

<Processing procedure>
The processing procedure of the calculation unit 1 will be described with reference to FIG. The arithmetic unit 1 executes the following processing by using the functions (1a to 1g) shown in FIG.
FIG. 6 shows a process for measuring the workload and determining the suitability of one worker or process. The calculation unit 1 performs such processing for each step. Of course, a plurality of computer devices may perform the processing in parallel.

  The arithmetic unit 1 reads basic information in step S101. For example, a process number, information on work in a process, information on an operator, various parameter settings in measurement, and the like are read in accordance with an operation by an operator or automatic setting.

In step S102, the arithmetic unit 1 starts imaging and / or sensing. That is, the capture of the captured image data from the imaging unit 10 is started. The acquisition of the detection value of the sensor 20 is also started.
In step S103, the calculation unit 1 performs worker recognition. That is, the worker is recognized by image analysis of the captured image data that has started capturing. For example, a person wearing work clothes of a specific color is recognized as a worker, and the body position of the worker is grasped.
In step S104, the arithmetic unit 1 starts worker tracking. That is, the tracking control for controlling the drive unit 11 is started so that the worker recognized on the image does not go out of the frame.

In step S105, the arithmetic unit 1 waits for the start of measurement. That is, the operator enters an actual process operation and waits for a trigger to start measurement. The trigger may be an instruction from an operator, a specific time, or a synchronization signal from a production line management system.
In response to the measurement start trigger, the calculation unit 1 proceeds to step S106.

In step S106, the calculation unit 1 acquires measurement data. That is, the function of the detection information acquisition unit 1c acquires the analysis result of the image analysis unit 1a and the information from the sensor 20, and stores and manages the information as one sample timing t (x) in FIG. 4A, for example.
In step S107, the calculation unit 1 performs posture data modeling. That is, by the function of the motion determining unit 1d, the posture and motion of the worker are determined from the simple model of the worker represented by the three-dimensional coordinate values of each detection point P acquired in step S106.
In step S108, the calculation unit 1 quantifies the workload. That is, the calculation unit 1 calculates various workloads by the function of the additional calculation unit 1e, and stores the calculated values.
The above processing of steps S106 to S108 is repeated until it is determined in step S109 that measurement has been completed.
During this time, the calculated value in step S108 may be stored as data as shown in FIG. 5 at each time point, or the data as shown in FIG. 5 is updated as an integrated value of the calculated value at each sample timing t. You may do so.

After the measurement is completed, the calculation unit 1 generates burden evaluation information in step S110. In step S111, the arithmetic unit 1 performs an adaptability determination. Further, the arithmetic unit 1 makes a recommended process determination in step S112. Then, in step S113, the load evaluation information, the adaptability evaluation information, and the like are displayed on the display unit 4.
For example, when the above-described measurement is performed in a span of one day for each process of the manufacturing line, burden evaluation information on the burden on the worker per day is generated and displayed. In addition, the adaptability judgment for evaluating the adaptability of the worker to each process and the recommended process judgment are performed, and as the information of the judgment result, the adaptability evaluation information and the recommended / non-recommended information are generated and displayed. Will be done.

Note that at the stage of step S113, the arithmetic unit 1 stores the load evaluation information, the adaptability evaluation information, and the recommended / non-recommended information in the storage unit 3, prints out the data with the printing unit 6, and prints out the external data with the communication unit 5. It may be transmitted to the device.
The calculations in steps S111 and S112 are performed when a line manager or the like performs a simulation request operation, and after the calculation, adaptive evaluation information and recommended / non-recommended information are displayed and output. Good. That is, the adaptability determination and the recommended process determination can be performed at any time as long as there is past measurement information, and may be performed at any time.
Further, a processing example in which step S112 is not performed may be considered.

<Presentation of workload evaluation information>
A specific example of the workload evaluation information created in step S110 and displayed in step S113 will be described.

FIG. 7A is an example in which the work load calculated for each process is quantified and shown. For example, for each process, the work load value at each sample timing t is integrated, the value of the load given to the worker by one day's work is obtained, and presented so that the processes can be compared for each process.
For one process, the physical condition of the worker at each sample timing t can be acquired in step S106, for example, as shown in FIG. 4A, and the burden value is calculated for each unit period by the processes in steps S107 and S108. If the burden values are integrated and held until the end of the measurement, the calculated values (for example, MA1, MA2,...) Held in each step as shown in FIG. Value. For example, it is a burden value of a process in one-day work. Therefore, by collecting the integrated values thus obtained for each process and using the collected values as burden evaluation information, the display can be performed as shown in FIG. 7A.

FIG. 7B is an example in which the work load calculated for each work in a certain process is quantified and shown. For example, for each operation in one process, the work load value at each sample timing t is integrated, the value of the load given to the worker in one day's work is obtained, and presented so that the operations can be compared.
It is possible to see the degree of burden of each operation in one process.
For each work in the process, if an operation pattern or the like of the work is registered in advance, it is possible to determine which work is being executed during the period of each sample timing t by image analysis. Therefore, the calculation of the burden value in step S108 can be performed separately for each task, and if the calculated values for each task are accumulated, the held calculated value can be calculated in the process from the start to the end of the measurement. It becomes the burden value of. For example, the calculated values Ma1-1, Ma2-1,..., Ma5-1) in FIG. 5 are the burden values of the operations a1 to a5 in the process A from the start to the end of the measurement. For example, it is a burden value of each work in one day's work. Therefore, the display as shown in FIG. 7B can be performed by collecting the integrated values thus obtained for each process and using the collected values as burden evaluation information.

FIG. 7C is an example of obtaining and presenting a momentum load and a posture load for each part of the body with respect to a certain process or work. From such information, it is possible to know where the load is applied to the worker in the process or the work.
The load value pertaining to each part of the body itself can be processed, for example, from the database unit 2 by, for example, determining the posture or movement. For example, when a certain posture is determined in step S107, the burden value of the right hand, the burden value of the left hand, the burden value of the waist, the burden value of the right foot, the burden value of the left foot, and the like in that posture are acquired from the database unit 2. In step S108, the burden value of each unit may be accumulated during the period from the start to the end of the measurement. Then, the burden value of each part of the body is obtained at the end of the measurement. By collecting such integrated values and using them as burden evaluation information, a display as shown in FIG. 7C can be performed.

FIG. 8A is an example in which a burden value is displayed for each of the detection points P0 to P20 for a certain process or operation. As in the case of FIG. 7C, by integrating the burden values for each of the detection points P0 to P20 set corresponding to the posture and the movement, for example, the burden values of the respective detection points P0 to P20 during one working day Can be calculated. The display as shown in FIG. 8A can be performed by collecting such integrated values and using them as burden evaluation information.
Such information allows the manager, line technician, and the like to know in more detail where the load is applied to the worker in the process or the work.

FIG. 8B is an example of presenting information that can be compared for each worker for a certain process (or work). By associating the detection information as shown in FIG. 4A with the worker code, for example, for one process, the burden value and the process required time can be obtained for each worker. The required time can be measured based on the posture / motion determined at each sample timing t. For example, the start and end of each operation and the start and end timings of the process can be determined based on the posture and the motion, and thus the determination can be made based on the number of sample timings between them.
Therefore, load evaluation information is generated so that the load values of the same process or work can be compared for each worker, and displayed as shown in the figure. As a result, the administrator can determine the proficiency and the direction / unsuitability of each worker with respect to each process or work.

  FIGS. 7 and 8 show examples of the burden evaluation information. Various other information presentations are also conceivable. In any case, since the posture and movement of each worker in the process and the work are determined and the burden value is calculated, various burden evaluation information can be generated and displayed based on the information. it can. For example, it is also possible to present a burden value for each time zone, to present a predicted burden value when the work is extended, and the like.

<Adaptability judgment and recommended process judgment>
Next, processing examples of the adaptability determination and the recommended process determination in steps S111 and S112 in FIG. 6 will be described. FIG. 9A is an example of the adaptability determination process.
The calculation unit 1 performs the process of FIG. 9A for each worker in a certain process that is a measurement target in FIG.
First, in step S201, the calculation unit 1 selects a target work. For example, in the case of the process regarding the process A, the operation a1 in the process A is selected as a process target.

  In step S202, the calculation unit 1 extracts individual data of each body part of the worker in the work selected as the processing target. For example, when the operation a1 is selected, as shown in FIG. 4B, assuming that the information at the sample timings t0 to t15, t100 to t115,. The three-dimensional coordinate values of P0 to P (n) are extracted.

In step S203, the calculation unit 1 compares the extracted individual data with each corresponding data of the reference information set for the work a1.
Therefore, the arithmetic unit 1 acquires the reference information on the work a1 in the process A from the database unit 2. For example, the three-dimensional coordinate values of the detection points P <b> 0 to P (n) serving as references as the work a <b> 1 are registered in the database unit 2. Such reference information and individual data of each part of the body of the target worker are compared to obtain a difference value.
Then, in step S204, the calculation unit 1 performs calculation using the difference value, and calculates an adaptation value indicating the adaptability of the worker to the work (for example, work a1).
The fact that the difference value is small means that the difference between the posture and the movement of the worker in comparison with the reference information is small, and that there is little useless movement during the work. Conversely, a large difference value means that there are many useless movements.
For example, an adaptive value is obtained by performing a predetermined calculation as integration of a difference value at each sample timing, selection / weighting of information of a main detection point P, and time of displacement of each detection point P. The adaptation value is a value indicating whether the posture or operation of the target worker is similar or deviated from the reference posture or operation.
Further, according to the information as shown in FIG. 4A, the time required for one work and one operation can be determined. Therefore, it is also effective to determine an adaptive value using a coefficient corresponding to the required time.

  In step S205, it is determined whether there is any unprocessed work for the target process, and if there is any unprocessed work, the process returns to step S201. That is, in the example of the process A, the processes of steps S202 to S204 are performed similarly for the works a2, a3, a4, and a5, and the adaptation value of the worker for each work is obtained.

After calculating the adaptation value for each work, the calculation unit 1 proceeds from step S205 to S206, and calculates (for example, adds) the adaptation value for each process using the adaptation value for each work.
Then, using these adaptation values, adaptation evaluation information as information to be presented in step S207 is generated. For example, information that displays the adaptation value and the adaptability determined from the value of the adaptation value is generated.
Then, the arithmetic unit 1 displays the adaptability evaluation information on the display unit 4 at step S113 in FIG. 6 or at any time based on the operation of the operator or the like.

FIG. 10A shows a presentation example of adaptability evaluation information. It is an example showing the applicability evaluation of process A for a certain worker. In this case, ◎ (optimum), （(suitable), Δ (normal), and × (unsuitable) are used as evaluation symbols indicating the rank of adaptability.
Then, the overall applicability and points for the process A are presented. The point is the above-mentioned adaptive value or a value obtained by normalizing the adaptive value by a certain value. The calculation unit 1 determines the ranks of ◎, △, Δ, and × in step S207 according to the adaptive value calculated in step S206. Also, for each of the operations a1 to a5 in the process A, the ranks of ◎, △, Δ, and × are determined according to the adaptive value calculated in step S204. Then, they are collectively generated as adaptability evaluation information and displayed as shown in the figure.
By such a display, it is possible to confirm in detail whether a certain worker is adaptable to a certain process, that is, whether or not the process is suitable or not.

FIG. 10B is an example in which the adaptability evaluation information for a large number of workers is presented as a list. For each worker, the adaptability in relation to the process and the work in the process (a1 to a5 in process A) is indicated by an evaluation symbol.
The form of the list presentation is various, for example, a specific process such as only the process A is targeted, and the adaptability evaluation information of a plurality of workers is presented in a list. It is also conceivable to present a list of adaptability evaluation information for a plurality of performed steps.

  Next, FIG. 9B shows a processing example of the recommended process determination performed as step S112 in FIG. In the present embodiment, not only the adaptability of the worker is indicated, but also each worker can indicate which process is suitable or not.

The calculation unit 1 determines the personal characteristics of the worker currently being processed in the series of processes in FIG. 6 in step S301 in FIG. 9B.
The personal characteristics include, for example, the following information in addition to known information that can be registered in advance, such as age, gender, years of experience, right-handed, left-handed, and the like.
・ We are good / weak at heavy weight work ・ We are good / weak at precision work ・ We are good at work using right hand mainly (or use left hand mainly) ・ We are weak at work from left to right (or right to left) Good at doing / moving while moving, good at doing upside down (for example, work on the bottom of the car body), good at doing / unsatisfactory, good at moving the body up and down. Good / Not good

Although the above is an example, various personal characteristics can be determined according to the contents of the process.
For example, since an adaptation value is obtained for each work in a process, a tendency of work contents that are adaptable to a worker or work contents that are not adaptable appears. The work that is determined to have a high adaptation value for a certain worker is a work that is determined to have a small difference in posture and movement from the reference information, that is, to have a small amount of useless movement. Therefore, the work can be presumed to be a good work.
In addition, particularly, since the required time for each work is reflected in the adaptation value, the work that is good at work and the work that is not good at work become clearer. Needless to say, the required time of each work may be obtained from the information in FIG. 4A independently of the adaptation value, and the good work / unsatisfactory work may be determined based on the time. Further, by obtaining the speed deviation of each worker for each work, the tendency of each worker in his or her specialty becomes clear.
By these calculations, it is possible to determine the work that the subject worker is good at and the work that he is not good at.

  The database unit 2 stores, as work characteristic information, work characteristics such as “heavy work”, “precision work”, “right hand tendency”, “left hand tendency”, “upper work”, “vertical movement”, and “twist” for each process and each work. Register. When a task that is good for a certain worker is determined, the task characteristics of the task are collected from the database unit 2. As the number of determinations as a good work increases, the tendency of the good work can be understood, and the above-mentioned individual characteristics can be more clearly determined.

In step S302, the arithmetic unit 1 acquires information on the adaptation tendency for each process from, for example, the database unit 2. For example, required characteristics (“weight”, “precision”, etc.) are registered for each process, and the information is confirmed.
In step S303, the arithmetic unit 1 compares the individual characteristics determined for the worker with the characteristics required for each process, selects a recommended process or a non-recommended process for the worker, and displays them. Generate recommended / deprecated information for Also, information on personal characteristics may be generated for display.
Then, the arithmetic unit 1 displays the recommended / non-recommended information and the personal characteristic information on the display unit 4 at step S113 in FIG. 6 or at an arbitrary time based on the operation of the operator or the like.

FIG. 11A shows a presentation example of recommended / non-recommended information and personal characteristic information about a certain worker. For example, steps A and C are shown as recommended steps, and step E is shown as a non-recommended step.
It also shows the personal characteristics of the worker. Although the figure shows an example in which only the information determined for the heavy work and the precision work is shown, it is conceivable that each of the above-mentioned various personal characteristics is shown.

FIG. 11B is an example in which recommended / non-recommended information about a large number of workers is presented as a list. Recommended and non-recommended processes are shown for each worker.
The form of the list presentation is various, and for example, only a recommended step or only a non-recommended step may be shown.
Further, for a specific process such as only the process A, a list of workers (or non-recommended workers) for which the process is recommended may be displayed.

<Summary>
The computing unit 1 serving as the adaptability evaluation apparatus of the above embodiment connects the detection points P corresponding to a plurality of body parts of the worker executing the process to be measured at each sample timing t. In a state where the model is simply modeled by the line, the detection information acquisition unit 1c that acquires information on the physical condition of the worker, and compares the information about the detection point P or the line with reference information set for the process to be measured. An adaptation value calculation unit 1g that calculates an adaptation value of the worker for the process, and an output control unit 1f that controls the generation and presentation of adaptation evaluation information based on the calculation result.
That is, the physical state of the worker is detected by a simple model, and the movement of the worker can be grasped from the position or change (movement vector) of the detection point or line for each body part, for example, a joint. Then, by comparing information about the detection points or lines, that is, individual data such as each part of the body (arms, hips, and feet) with reference information set in advance, the matching between the person and the process is determined (FIG. 6). 9A and 10). Thereby, the adaptability of each worker is presented as objective adaptation evaluation information to the process in the manufacturing line. By this, an objective index for evaluating who is suitable or not suitable for which process can be obtained. For example, for a production line manager, etc., personnel management, improvement of production efficiency, etc. This is very useful information.

In addition, the output control unit 1f determines a recommended process or a non-recommended process for the target worker using the calculation result of the adaptive value calculation unit 1g, and performs control to present the determination result (FIG. 10B, FIG. 11). As a result, objective information for determining a recommended process for a worker and a process not recommended can be obtained, which is also effective information for management.
Further, the output control unit 1f determines individual characteristics of the target worker using the calculation result of the adaptive value calculation unit 1g, and performs control to present the determination result (FIGS. 10B and 11A).
Therefore, objective information as a personal characteristic of the worker can be obtained.

The detection information acquisition unit 1c acquires the three-dimensional positions of the plurality of detection points P0 to P (n) from the analysis result of the image data of the worker. That is, an operator captures an image of a worker, and converts the data into a plurality of points simulating mainly a joint of a person to be imaged and data connecting the points to a simplified line. The calculation unit 1 is a system for specifying a human motion from the detection result of such a point or line movement vector.
In this case, it is possible to eliminate the need for the worker to wear the sensor or the like on the body, and it is possible to prevent the sensor from causing discomfort or deterioration in workability.

Further, an operation determining unit 1d that determines the posture or the motion of the worker based on a change in the detection point P or the line, and a load calculating unit 1e that calculates a work load value based on the determined posture or the motion of the worker, is further provided. The output control unit 1f controls to present the work load evaluation information in the process to be measured based on the calculation result of the load calculation unit 1e (see FIGS. 6 to 8).
That is, the posture and the movement in the process work process are detected, and the work burden value is calculated. Based on the work load value, work load evaluation information of the process is generated and displayed.
As a result, the work load value can be obtained as an objective numerical value, and as the work load evaluation information, information that can accurately recognize the load of the worker in the process can be obtained. Since it is not subjective information, fair judgment can be made, and very significant information can be obtained for management of production line design, maintenance, staffing, etc., and line improvement.
Further, when detecting the movement of a person, if the entire body is detected and recognized, the amount of information is large, there is a malfunction, and the processing load on the arithmetic unit 1 increases. On the other hand, in the present embodiment, since the load is calculated using the detection point P and the line and the angle and the moving amount are used, the processing is simplified, and a relatively small-scale arithmetic system is used. Feasibility can be obtained.

In addition, as shown in FIGS. 7A and 7B, in a target period set to, for example, 8 hours, work load values for a plurality of processes or a plurality of works in a process are presented, for example, in a list or the like, so that the process can be classified by process. Objective information that clarifies the difference in the work load of each work can be shown. Therefore, useful information can be provided for a production line design engineer or a factory manager. For example, it is useful for making improvements such as equalizing the load of each process based on such information at the initial stage of manufacturing line design or operation start.
It is also useful information for improving daily operation lines. For example, the work load evaluation information is checked every day, and it can be used for improvement of work in the process and rational allocation of personnel from the next day.
In the embodiment, the load evaluation information is displayed after the measurement is completed. However, for example, the load value of each process or operation may be displayed in real time during the measurement. Then, a worker with a large load can be found during the work, and measures such as rearrangement of personnel can be performed accordingly.
Further, it becomes possible to cope with a case where the burden value of the work is increased according to mixed production or quality status. For example, there are cases where the production load changes during the day, the quality changes depending on the situation and environment of the day, and some modifications are made, etc., and the work load changes, so it is possible to respond to such cases is there.

In addition, the output control unit 1f performs control to display a burden value for each worker or a process required time for one process as work load evaluation information (see FIG. 8B).
Even in the same process, the work load value and the time required for one cycle of the process are different due to different postures and movements among the workers. Therefore, these are presented so that they can be compared for each worker. This is objective information that can determine the proficiency, adaptability, and unsuitability of the process for each worker. Therefore, useful information can be presented to the site manager and the factory manager.

  DESCRIPTION OF SYMBOLS 1 ... Calculation part, 1a ... Image analysis part, 1b ... Camera control part, 1c ... Detection information acquisition part, 1d ... Operation determination part, 1e ... Load calculation part, 1f ... Output control part, 1g ... Adaptive value calculation part, 2 ... Database section, 3 ... Storage section, 4 ... Display section, 5 ... Communication section, 6 ... Printing section, 10 ... Imaging section, 20 ... Sensor

Claims (4)

At each time point, detection information for acquiring information on the physical state of the worker in a state in which the detection points corresponding to a plurality of body parts of the worker performing the process to be measured and a line connecting the detection points are simply modeled. An acquisition unit;
Information about the detection point or the line obtained by the detection information acquisition unit, by comparing the reference information set for the process of the measurement target, an adaptive value calculation unit that calculates an adaptation value for the process of the worker; ,
An adaptive control unit that generates adaptive evaluation information based on the calculation result of the adaptive value calculation unit and controls the presentation.
The output control unit extracts personal data of each part of the body of the worker in the work selected as the processing target , compares the personal data with the reference information to determine a difference value, and determines the adaptability to the work from the difference value. An adaptive evaluation apparatus that calculates an adaptive value indicating the following, determines a recommended process or a non-recommended process by determining a characteristic of an individual worker based on the adaptive value, and performs control to present a determination result. The adaptability evaluation device according to claim 1, wherein the detection information acquisition unit acquires three-dimensional positions of a plurality of the detection points from an analysis result of image data obtained by imaging the worker. An operation determination unit that determines the posture or operation of the worker based on a change in the detection point or line in the information obtained by the detection information acquisition unit,
A load calculating unit that calculates a work load value based on the posture or the motion of the worker determined by the motion determining unit,
The adaptive evaluation device according to claim 1, wherein the output control unit performs control for presenting work load evaluation information in a process to be measured based on a calculation result of the load calculation unit. As the adaptability evaluation method executed by the information processing device,
At each time point, in a state in which the detection points corresponding to a plurality of body parts of the worker executing the process to be measured and a line connecting the detection points are simply modeled, information on the body state of the worker is obtained,
The obtained information about the detection point or line is compared with reference information set for the process to be measured, and an adaptation value for the process of the worker is calculated,
Generates adaptive evaluation information based on the calculation result and performs control to present it.
Extract personal data of each part of the worker's body in the work selected as the processing target, compare each of the personal data with reference information to obtain a difference value, and calculate an adaptation value indicating adaptability to the work from the difference value And an adaptive evaluation method for determining a recommended step or an unrecommended step by determining a characteristic of an individual worker based on the adaptation value, and performing control for presenting the determination result.

Images