WO2023181805A1 - Système d'analyse de travail et procédé d'analyse de travail - Google Patents

Système d'analyse de travail et procédé d'analyse de travail Download PDF

Info

Publication number
WO2023181805A1
WO2023181805A1 PCT/JP2023/007348 JP2023007348W WO2023181805A1 WO 2023181805 A1 WO2023181805 A1 WO 2023181805A1 JP 2023007348 W JP2023007348 W JP 2023007348W WO 2023181805 A1 WO2023181805 A1 WO 2023181805A1
Authority
WO
WIPO (PCT)
Prior art keywords
work
analysis result
period
worker
analysis
Prior art date
Application number
PCT/JP2023/007348
Other languages
English (en)
Japanese (ja)
Inventor
達矢 石橋
Original Assignee
パナソニックＩｐマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニックＩｐマネジメント株式会社 filed Critical パナソニックＩｐマネジメント株式会社
Publication of WO2023181805A1 publication Critical patent/WO2023181805A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063—Operations research, analysis or management
    • G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/04—Manufacturing

Definitions

  • the present disclosure relates to a work analysis device and a work analysis method in which a processor executes a process of outputting analysis result information regarding a worker's work situation based on a video shot of the worker's work situation.
  • the present disclosure provides a work analysis device and a work analysis method that allow a user to efficiently check the analysis results over a long period of time even when the analysis results of a worker's work situation extend over a long period of time.
  • the main purpose is to
  • a work analysis device of the present disclosure is a work analysis device in which a processor executes a process of outputting analysis result information regarding a worker's work situation based on a video shot of the worker's work situation, the processor , based on the video, the target object handled by the worker is recognized, and the actions that constitute the worker's work are recognized, and the analysis result information includes the recognition result of the target object and the recognition result of the action. and the first analysis result display information that visualizes the analysis result information for the first period, and the first analysis result for the second period included in the first period. It is configured to output second analysis result display information in which the analysis result information is visualized by enlarging the time axis from the display information.
  • the work analysis method of the present disclosure is a work analysis method in which a processor executes a process of outputting analysis result information regarding a worker's work situation based on a video shot of the worker's work situation, the method comprising: Based on the video, the target object handled by the worker is recognized, and the actions that constitute the worker's work are recognized, and the analysis result information including the recognition result of the target object and the recognition result of the action is obtained. and first analysis result display information that visualizes the analysis result information for a first period, and first analysis result display information for a second period included in the first period.
  • the configuration is such that second analysis result display information that visualizes the analysis result information by further expanding the time axis is output.
  • the user can check the work status of the worker over a long period of time from a bird's-eye view. Furthermore, by viewing the second analysis result display information, the user can check the work status of the worker in detail. Thereby, even if the analysis results of the worker's work situation extend over a long period of time, the user can efficiently check the analysis results over a long period of time.
  • a first invention made to solve the above problem is a work analysis device in which a processor executes a process of outputting analysis result information regarding a worker's work situation based on a video shot of the worker's work situation. Based on the video, the processor recognizes a target object handled by a worker, recognizes actions that constitute the worker's work, and generates a recognition result of the target object and a recognition result of the action. and first analysis result display information that visualizes the analysis result information targeting a first period, and a second period included in the first period. and second analysis result display information in which the analysis result information is visualized by enlarging the time axis from the first analysis result display information.
  • the user can check the work status of the worker over a long period of time from a bird's-eye view. Furthermore, by viewing the second analysis result display information, the user can check the work status of the worker in detail. Thereby, even if the analysis results of the worker's work situation extend over a long period of time, the user can efficiently check the analysis results over a long period of time.
  • the processor outputs the video in a state where it is associated with at least one of the first and second analysis result display information so as to be playable.
  • the user can easily understand the work status of the worker by viewing the video while comparing the first analysis result display information with the video.
  • the video included in the second period may be played back by associating the video with the second analysis result display information that presents the detailed work status of the worker.
  • a timeline cursor indicating the current playback position may be displayed on the second analysis result display information.
  • the first period is the entire target period extracted from the entire period in which the worker's work was performed, and the second period is a part of the target period. A certain configuration is assumed.
  • the users can check the worker's work status from a bird's-eye view for the entire target period, as well as check the worker's work status in detail for a part of the target period.
  • the first period and the second period may be arbitrarily designated by a user's operation.
  • the processor sets the selected specified period to the second period in response to a user's operation to select one of the plurality of specified periods included in the first period. and outputs the second analysis result display information.
  • the analysis result information for each specified period can be easily confirmed using the second analysis result display information.
  • the prescribed period is a work cycle consisting of a predetermined series of actions, and depending on the user's operation to select a work cycle, a second analysis is performed with the selected work cycle as the second period.
  • Result display information may also be output.
  • the processor controls the specified second period in response to a user's operation to arbitrarily specify the second period on the time axis in the first analysis result display information.
  • the second analysis result display information targeted at is output.
  • the user can appropriately specify the second period of the second analysis result display information on the time axis of the first analysis result display information that covers a wide first period.
  • the second period may be designated by a slider bar that visualizes the time axis in the first analysis result display information.
  • the processor outputs at least one of the first and second analysis result display information including information regarding the abnormality detection result when detecting an abnormality regarding the worker's work situation. do.
  • the user can easily check any abnormality regarding the worker's work status.
  • abnormalities regarding excess or deficiency of actions in a work cycle consisting of a predetermined series of actions, the order of actions, and the time length of the work cycle may be detected.
  • the processor outputs the second analysis result display information including information regarding the abnormality detection result, and the second analysis result display information is used as display information regarding the abnormality detection result.
  • a configuration including at least one of highlighting a display column of the target object, displaying a mark indicating an action related to the abnormality, and displaying characters representing details of the abnormality.
  • the user can more easily confirm abnormalities related to the worker's work status.
  • the abnormality detection results are displayed for each action, allowing the user to confirm the abnormality situation in detail.
  • the processor outputs the first analysis result display information including information regarding the abnormality detection result, and the first analysis result display information is used as display information regarding the abnormality detection result.
  • the configuration includes a display of statistical information aggregated over a specified period included in the first period.
  • the user can more easily confirm abnormalities related to the worker's work status.
  • the first analysis result display information having a long time axis statistical information aggregated over a specified period is displayed, so that the user can easily check the abnormal situation.
  • the number of abnormality detections may be totaled for each of a plurality of work cycles included in the first period, and the number of abnormality detections for each work cycle may be presented.
  • a ninth invention is a work analysis method in which a processor executes a process of outputting analysis result information regarding a worker's work situation based on a video shot of a worker's work situation, the method comprising: based on the information, recognizing the target object handled by the worker and recognizing the actions that constitute the worker's work, and acquiring the analysis result information including the recognition result of the target object and the recognition result of the action; first analysis result display information that visualizes the analysis result information targeting a first period; and time from the first analysis result display information targeting a second period included in the first period. It is configured to output second analysis result display information that visualizes the analysis result information by enlarging the axis.
  • the user can efficiently confirm the analysis results over a long period of time.
  • FIG. 1 is an overall configuration diagram of a work analysis system according to this embodiment.
  • This system analyzes the work status of workers in factories and other places, and presents the analysis results to the user.
  • This system includes a camera 1, a recorder 2, a server 3 (work analysis device), and an administrator terminal 4.
  • the camera 1 photographs the worker working at his or her post.
  • the recorder 2 records the video output from the camera 1.
  • the server 3 acquires the video from the recorder 2, performs a work analysis to analyze the work situation of the worker based on the video, and outputs the analysis result.
  • the server 3 is installed in a facility (such as a factory) and performs work analysis on that facility. Further, the server 3 may be configured as a cloud computer and perform work analysis on a plurality of facilities.
  • the administrator terminal 4 is used by a system administrator or a work administrator (user), and is composed of a PC, a tablet terminal, or the like. At the administrator terminal 4, a system administrator performs various setting operations related to processing performed by the server 3. In addition, the manager terminal 4 displays the analysis results output from the server 3 for the work manager to view.
  • FIG. 2 is a block diagram showing a schematic configuration of the server 3. As shown in FIG.
  • the server 3 includes a video input section 11, a screen output section 12, a storage section 13, and a processor 14.
  • the video recorded by the recorder 2 is input to the video input unit 11.
  • the screen output unit 12 outputs the analysis result display screen generated by the processor 14, and the analysis result display screen (see FIG. 6) is displayed on the administrator terminal 4.
  • the storage unit 13 stores programs and the like executed by the processor 14. Furthermore, the storage unit 13 stores the video for analysis acquired from the recorder 2. The storage unit 13 also stores an object behavior recognition model (object behavior estimation model) used by the processor 14, an analysis result video generated by the processor 14, and analysis result information.
  • object behavior recognition model object behavior estimation model
  • the processor 14 performs various processes by executing programs stored in the storage unit 13. In this embodiment, the processor 14 performs analysis processing P1, analysis result visualization processing P2, and the like.
  • the processor 14 analyzes the work situation of the worker based on a video of the worker performing the work, and generates analysis result information.
  • the processor 14 visualizes the analysis result information obtained in the analysis process P1 and presents it to the user.
  • an analysis result display screen (see FIG. 6) is generated.
  • FIG. 3 is a block diagram showing the contents of the analysis process P1.
  • the processor 14 performs analysis processing P1.
  • the analysis process P1 includes a video acquisition process P11, an object behavior recognition process P12, an analysis result video generation process P13, a work cycle detection process P14, an abnormality detection process P15, and an output process P16.
  • the processor 14 acquires a video to be analyzed from the storage unit 13.
  • object behavior recognition processing P12 the processor 14 performs object recognition to recognize the type of object (person, part, and work tool) from the video to be analyzed, and also performs behavior recognition (behavior estimation) to recognize the type of person's behavior. )I do.
  • action recognition a person's actions are recognized based on the person's movement and the type of object the person has come into contact with.
  • the action ID given to the action, the type of object (target object) related to the action, and the start time and end time of the action are acquired as recognition result information.
  • an object behavior recognition model constructed by machine learning such as deep learning can be used.
  • the processor 14 In analysis result video generation processing P13, the processor 14 generates an analysis result video to which recognition result information is added. Specifically, a rectangular frame surrounding the object (person, part, work tool) recognized in the object action recognition process P12, a character representing the type of the recognized object, and a character representing the type of the recognized action. is superimposed on the original video to be analyzed to generate an analysis result video.
  • the processor 14 detects a work cycle (regular period) consisting of a predetermined series of actions from among the worker actions recognized in the object action recognition process P12.
  • a work cycle regular period
  • the cycle ID assigned to the work cycle and the start time and end time of the work cycle are acquired as work cycle detection result information.
  • the processor 14 compares the worker's work procedure and the normal work procedure to detect a work error (work abnormality). Specifically, the processor 14 detects a work error by comparing the actions performed by the worker with the actions included in the regular work procedure regarding the target work cycle.
  • Work errors include, for example, excessive action, insufficient action, and a change in the order of actions.
  • the state of excessive action is a state in which an action is performed redundantly at a timing that should not have been performed.
  • a state in which an action is insufficient is a state in which an action that should originally be performed is not performed.
  • the processor 14 compares the worker's working time regarding one work cycle with the standard time to detect an abnormality in the work cycle.
  • the work cycle is determined to be abnormal if the work cycle time is longer than the standard time by more than a predetermined limit, for example, when the line is temporarily stopped due to some kind of trouble. Further, for example, when the time of the work cycle is shorter than the standard time by more than a predetermined limit, as in the case where the work cycle is canceled midway, it is determined that the work cycle is abnormal.
  • the processor 14 outputs the information related to the worker's behavior (type of behavior, start time, end time, etc.) acquired in the object behavior recognition process P12, and the information related to the work cycle (start time, etc.) acquired in the work cycle detection process P14. time, end time, etc.), and information on the detection results of the abnormality detection process P15 (work abnormalities (work mistakes), work cycle abnormalities) as analysis result information.
  • Analysis result information is stored in the storage unit 13.
  • FIG. 4 is an explanatory diagram showing the status of the work cycle detection process P14.
  • a work cycle detection process P14 is performed to detect a work cycle consisting of a predetermined series of actions. Specifically, the processor 14 detects a trigger action that defines the start timing of a work cycle from among the recognized actions, sets the timing at which the trigger action is detected as the start timing of the work cycle, and sets the next trigger action. The timing at which the action immediately before the action is detected is the end timing of the work cycle.
  • FIG. 4 is an example of actions included in one work cycle.
  • the worker takes action to grasp the main body with his/her hands.
  • the worker takes action to grasp the driver with his/her hand.
  • the operator takes action to take out the screws from the parts box.
  • the operator takes action to tighten the screw.
  • the worker takes action to carry the main body.
  • the worker takes action to grasp the main body with his/her hands.
  • the action of the worker grasping the main body with his or her hand becomes a trigger action that defines the start timing of the work cycle, and the timing at which the trigger action is started is This is the start time of the work cycle. Further, the timing at which the action immediately before the next triggered action ends is the end timing of the work cycle.
  • action information including the action ID assigned to the action, the type of object (target object) related to the action, and the start time and end time of the action is obtained as recognition result information. be done.
  • work cycle detection result information work cycle information including a cycle ID assigned to the work cycle, and the start time and end time of the work cycle is acquired.
  • FIG. 5 is a block diagram showing the contents of the analysis result visualization process P2.
  • the processor 14 performs analysis result visualization processing P2.
  • the analysis result visualization process P2 includes a video acquisition process P21, an analysis result acquisition process P22, and a screen generation process P23.
  • the processor 14 acquires the analysis result video from the storage unit 13.
  • the rectangular frame surrounding the recognized object (person, part, work tool), characters representing the type of recognized object, and characters representing the type of recognized action are the objects of analysis. This is superimposed on the original video.
  • analysis result acquisition processing P22 the processor 14 acquires analysis result information from the storage unit 13.
  • Analysis result information includes information on worker behavior (type of behavior, start time, end time, etc.), information on work cycles (start time and end time, etc.), and information on abnormality detection results (work abnormality (work error)). ), work cycle abnormalities).
  • the processor 14 In the screen generation process P23, the processor 14 generates an analysis result display screen (see FIG. 6) that visualizes the analysis result information.
  • This analysis result display screen is output from the screen output unit 12 to the administrator terminal 4, and the analysis result display screen is displayed on the administrator terminal 4.
  • analysis result information is visualized and displayed on the analysis result display screen, and an analysis result video is also displayed.
  • FIG. 6 is an explanatory diagram showing an analysis result display screen.
  • FIG. 7 is an explanatory diagram showing the process selection section 102, target period specification section 103, work video display section 104, playback operation section 105, and work cycle selection section 106 of the analysis result display screen.
  • FIG. 8 is an explanatory diagram showing the detailed analysis result display section 107 of the analysis result display screen.
  • 9 and 10 are explanatory diagrams showing the main parts of the detailed analysis result display section 107 when a work error (abnormality) occurs.
  • FIG. 11 is an explanatory diagram showing another example of the detailed analysis result display section 107.
  • FIG. 12 is an explanatory diagram showing the overall analysis result display section 108 of the analysis result display screen.
  • FIG. 13 is an explanatory diagram showing another example of the overall analysis result display section 108.
  • an analysis result display screen 101 is displayed on the administrator terminal 4.
  • the analysis result display screen 101 includes a process selection section 102, a target period specification section 103, a work video display section 104, a playback operation section 105, a work cycle selection section 106, and a detailed analysis result display section 107 (second (a display section for displaying analysis result display information) and an overall analysis result display section 108 (a display section for first analysis result display information).
  • the process selection section 102 is provided with buttons 111 for each process (picking, pressing, welding, assembly, inspection).
  • buttons 111 for each process (picking, pressing, welding, assembly, inspection).
  • the user can input a date and time (start time and end time) in characters as information regarding the target period (first period) for which the analysis results are to be displayed.
  • the target period designation unit 103 allows the user to designate any period included in the period during which video is stored in the recorder 2, that is, the period during which work analysis results based on the video can be obtained.
  • the analysis result video 121 is displayed on the work video display section 104.
  • a rectangular frame 122 surrounding a recognized object (person, part, work tool), and characters 123 representing the type of the recognized object are displayed on a video of a worker performing a task.
  • characters 124 representing the type of recognized action are displayed in a superimposed manner.
  • a rectangular frame 122 and characters 123 representing a person, a rectangular frame 122 and characters 123 representing a driver, and characters 124 representing a screw tightening action are displayed.
  • the playback operation unit 105 is provided with a button 131 for both playback and pause, and a double speed button 132.
  • the work cycle selection section 106 is provided with buttons 141 for each work cycle (1 to 6), a previous skip button 142, and a next skip button 143.
  • buttons 141 for each work cycle (1 to 6)
  • a previous skip button 142 When the user selects a work cycle by operating the button 141, analysis results regarding the selected work cycle are displayed on the work video display section 104 and the detailed analysis result display section 107.
  • the previous skip button 142 When the user operates the previous skip button 142, the process advances to the beginning of the next work cycle.
  • the skip back button 143 the process returns to the beginning of the currently displayed work cycle.
  • the detailed analysis result display section 107 is provided with a first action list display section 201.
  • the first behavior list display section 201 visualizes and presents to the user short-term analysis results regarding the behavior status related to each object.
  • action display columns 202 are arranged vertically for each object related to the worker's actions. In this example, actions are displayed for each part (main body, part #1, part #2, and part #3) and work tools (driver, tweezers, and marker) as objects related to worker actions.
  • a column 202 is provided.
  • An action bar 203 is drawn in the action display column 202.
  • the action bar 203 is an image representing the period in which the action was performed. That is, in the action display field 202, the horizontal direction is a time axis representing time, and the action bar 203 is drawn in a range corresponding to the period in which the action was performed. As a result, the implementation status of actions for each type of object is expressed in chronological order.
  • the display form of the action bar 203 differs depending on the action type, specifically, the action of grasping a part or work tool in the hand, the action of tightening a screw with a screwdriver, etc.
  • the shaded pattern (drawing pattern) drawn on the action bar 203 differs depending on the action type.
  • the filling color of the action bar 203 may vary depending on the action type.
  • the analysis results for the entire period of the selected work cycle are displayed. Further, when an arbitrary period is specified in the overall analysis result display section 108, the analysis results for the specified period are displayed on the first action list display section 201.
  • a timeline cursor 204 indicating the current playback position (playback time) of the analysis result video 121 displayed on the work video display section 104 is displayed.
  • the timeline cursor 204 moves in the horizontal direction (time axis direction) as the playback time of the analysis result video 121 on the work video display section 104 advances.
  • the detailed analysis result display section 107 is provided with a time display section 205.
  • the time display section 205 displays the start time, end time, and time length of the range (display period) of the analysis results displayed on the first action list display section 201 .
  • the displayed time length is Represents the working time of the selected work cycle.
  • an alert mark 206 is displayed when a work error (abnormality) is detected.
  • the alert mark 206 is displayed at a position corresponding to the implementation timing of the action related to the work error in the action display field 202 regarding the object related to the detected work error. For example, if an action is insufficient, an alert mark 206 is displayed at the position where the action should be performed. Furthermore, if the action is redundant, an alert mark 206 is displayed at the position where the redundant action was performed.
  • the action bar 203 related to the work error may be highlighted by changing its display form.
  • the frame line of the action bar 203 may be drawn as a dotted line, or the transparency of the action bar 203 may be changed.
  • FIGS. 9(A-1) and (A-2) are examples of actions related to component #3.
  • the part handling work consists of the action of grasping the part by hand.
  • the action of grasping the part with the hand is performed one more time; This is detected as a work error (abnormality) and an alert mark 206 is displayed.
  • FIGS. 9(B-1) and (B-2) are examples of actions related to the driver.
  • the screw tightening work consists of the action of grasping the screwdriver by hand, the action of taking out the screw from the parts box, and the action of tightening the screw.
  • the action of taking out the screw from the parts box and the action of tightening the screw are Repeated 3 times.
  • the worker's work procedure shown in Figure 9 (B-2) compared to the regular work procedure shown in Figure 9 (B-1), there is one less action to take out the screw from the parts box, which is a work error. (Abnormality) is detected, and an alert mark 206 is displayed.
  • Figures 10 (A-1) and (A-2) are examples of actions related to markers.
  • the marking work consists of the action of grasping the marker with the hand, the action of opening the cap, the action of placing a mark, and the action of closing the cap.
  • the worker's work procedure shown in Figure 10 (A-2) there is a lack of action to close the cap compared to the normal work procedure shown in Figure 10 (A-1), and this is due to a work error (abnormality). ) is detected and an alert mark 206 is displayed.
  • an abnormality content display section 211 may be displayed.
  • the abnormality content display section 211 displays characters representing the content of the detected work error.
  • there is one excess action related to #3, one less screw tightening action related to the driver, and forgetting to close the cap as an action related to the marker. is displayed.
  • the overall analysis result display section 108 is provided with a second action list display section 301.
  • the second action list display section 301 visualizes and presents to the user long-term analysis results regarding the state of actions related to each object.
  • action display columns 302 are arranged vertically for each object related to the worker's actions.
  • an action bar 303 is drawn, similar to the first action list display section 201.
  • the analysis results for the period (target period) specified by the target period designation section 103 are displayed.
  • the overall analysis result display section 108 is provided with a slider bar 304.
  • the user can specify an arbitrary period for the analysis results to be displayed on the detailed analysis result display section 107 by operating the left and right sliders 305.
  • the slider 305 on the left side defines the start time
  • the slider 305 on the right side defines the end time.
  • the analysis results for the specified period are displayed in the detailed analysis result display section 107 in an enlarged state in the time axis direction.
  • the left and right sliders 305 move to correspond to the period (start time and end time) of the selected work cycle, and
  • the analysis result of the selected work cycle is displayed in the detailed analysis result display section 107.
  • a number mark 306 is displayed when a work error (abnormality) is detected.
  • the number of times mark 306 represents the number of times a work error (abnormality) is detected in one work cycle.
  • the number of times mark 306 is displayed in the display area of the work cycle in which the work error was detected. In this example, one work error is detected in the #1 work cycle, and three work mistakes are detected in the #4 work cycle.
  • an abnormality in a work cycle when an abnormality in a work cycle is detected, the work cycle in which the abnormality was detected is highlighted. Specifically, rectangular image 307 is displayed during the corresponding work cycle. The rectangular image 307 is highlighted with, for example, a filled color or a hatched pattern. In this example, an abnormality in work cycle #4 has been detected.
  • an abnormality in the work cycle specifically refers to a case where the time of the work cycle is longer than the standard time by more than a predetermined limit, or a case where the time of the work cycle is shorter than the standard time by more than a predetermined limit.
  • the period specified by the slider bar 304 that is, the period in which the analysis results were displayed in the detailed analysis result display section 107, is highlighted.
  • Ru Specifically, rectangular image 311 is displayed during the corresponding period.
  • the rectangular image 311 is highlighted with, for example, a filled color or a hatched pattern.
  • the rectangular image 311 is displayed in a different display form from the rectangular image 307 so that it can be distinguished from the rectangular image 307 that highlights the work cycle in which an abnormality has been detected. In this example, the #5 work cycle is selected, and the rectangular image 311 is displayed in the #5 work cycle.
  • the user can arbitrarily specify the period (target period, first period) of the analysis results to be displayed on the overall analysis result display section 108 using the target period specifying section 103. Further, the user can use the slider bar 304 to arbitrarily specify the period (a part of the target period, the second period) of the analysis results to be displayed on the detailed analysis result display section 107. Further, the user can use the work cycle selection unit 106 to display analysis results regarding one work cycle on the detailed analysis result display unit 107.
  • the first period targeted by the overall analysis result display section 108 is the entire target period extracted from the entire period in which the worker's work was performed, and the second period targeted by the detailed analysis result display section 107 is The period is part of the period of interest.
  • the detailed analysis result display section 107 and the overall analysis result display section 108 have different time axis scales, and some of the analysis results displayed on the overall analysis result display section 108 are enlarged in the time axis direction. It is displayed on the detailed analysis result display section 107.
  • the user first uses the work cycle selection unit 106 to display the analysis results for one work cycle on the detailed analysis result display unit 107 to view them, and if necessary, selects the slider bar 304.
  • analysis results in various ranges can be viewed.
  • the user can use the slider bar 304 to display only the analysis results of an arbitrary range of interest within one work cycle on the detailed analysis result display section 107.
  • the user can use the slider bar 304 to display analysis results in a range spanning two or more work cycles on the detailed analysis result display section 107.
  • the work analysis device and work analysis method according to the present disclosure have the effect that even when the analysis results of the work situation of a worker extend over a long period of time, the user can efficiently check the analysis results over a long period of time.
  • the present invention is useful as a work analysis device and a work analysis method in which a processor executes a process of outputting analysis result information regarding a worker's work situation based on a video shot of the worker's work situation.

Abstract

Le problème à résoudre dans le cadre de la présente invention consiste à permettre à un utilisateur de vérifier, même lorsqu'un résultat d'analyse d'une situation de travail d'un travailleur s'étend sur une longue durée, ce résultat d'analyse s'étendant sur la longue durée de manière efficace. Dans la solution selon l'invention, un objet cible manipulé par un travailleur est reconnu, et une action qui constitue le travail par le travailleur est reconnue sur la base d'une vidéo acquise par capture d'une scène du travail par le travailleur, des informations de résultat d'analyse comprenant le résultat de reconnaissance concernant l'objet cible et le résultat de reconnaissance concernant l'action sont obtenues, et une partie d'affichage (une partie d'affichage de résultat d'analyse globale (108)) de premières informations d'affichage de résultat d'analyse dans lesquelles les informations de résultat d'analyse sur une première période sont visualisées, et une partie d'affichage (une partie d'affichage de résultat d'analyse détaillée (107)) de secondes informations d'affichage de résultat d'analyse dans lesquelles les informations de résultat d'analyse sur une seconde période comprise dans la première période sont visualisées tandis que l'axe temporel est étendu plus que celui des premières informations d'affichage de résultat d'analyse, sont délivrées en sortie.
PCT/JP2023/007348 2022-03-22 2023-02-28 Système d'analyse de travail et procédé d'analyse de travail WO2023181805A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022045888A JP2023140047A (ja) 2022-03-22 2022-03-22 作業分析装置および作業分析方法
JP2022-045888 2022-03-22

Publications (1)

Publication Number Publication Date
WO2023181805A1 true WO2023181805A1 (fr) 2023-09-28

Family

ID=88100575

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/007348 WO2023181805A1 (fr) 2022-03-22 2023-02-28 Système d'analyse de travail et procédé d'analyse de travail

Country Status (2)

Country Link
JP (1) JP2023140047A (fr)
WO (1) WO2023181805A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021071778A (ja) * 2019-10-29 2021-05-06 オムロン株式会社 技能評価装置、技能評価方法及び技能評価プログラム
JP2021076920A (ja) * 2019-11-05 2021-05-20 オムロン株式会社 要素作業分割装置、要素作業分割方法、要素作業分割プログラム及び要素作業分割システム
JP2021077070A (ja) * 2019-11-08 2021-05-20 オムロン株式会社 動作分析装置、動作分析方法及び動作分析プログラム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021071778A (ja) * 2019-10-29 2021-05-06 オムロン株式会社 技能評価装置、技能評価方法及び技能評価プログラム
JP2021076920A (ja) * 2019-11-05 2021-05-20 オムロン株式会社 要素作業分割装置、要素作業分割方法、要素作業分割プログラム及び要素作業分割システム
JP2021077070A (ja) * 2019-11-08 2021-05-20 オムロン株式会社 動作分析装置、動作分析方法及び動作分析プログラム

Also Published As

Publication number Publication date
JP2023140047A (ja) 2023-10-04

Similar Documents

Publication Publication Date Title
CN107924173B (zh) 监视装置、监视系统及计算机可读存储介质
US20040138783A1 (en) Operation state analyzer for robot
US10019346B2 (en) Generating software test script from video
US20230044842A1 (en) Work analyzing device and work analyzing method
US20180107192A1 (en) Information processing device
WO2019058775A1 (fr) Dispositif de détection d'anomalie et procédé de détection d'anomalie
JP2017010277A (ja) 作業分析システム及び作業分析方法
JP7393720B2 (ja) 技能評価装置、技能評価方法及び技能評価プログラム
JP2014033429A (ja) 画像処理プログラムおよび画像処理装置
JP6928880B2 (ja) 動作分析装置、動作分析方法、動作分析プログラム及び動作分析システム
WO2023181805A1 (fr) Système d'analyse de travail et procédé d'analyse de travail
US20160110611A1 (en) Numerical control device
WO2023181804A1 (fr) Dispositif et procédé d'analyse d'opérations
JP7456111B2 (ja) 生産可視化システム
WO2022044637A1 (fr) Dispositif de traitement des images, procédé de traitement des images et programme
JP2022164831A (ja) 作業稼働率測定装置及び作業稼働率測定方法
JP6948294B2 (ja) 作業異常検知支援装置、作業異常検知支援方法、および作業異常検知支援プログラム
EP3301529A1 (fr) Procédé et appareil pour l'affichage d'informations de surveillance
JP2009110239A (ja) 作業動作分析システム及び作業動作分析方法
KR20190097116A (ko) 철강 플랜트의 분석 지원 장치
JPWO2023067642A5 (fr)
JP2007164800A (ja) データ表示装置
WO2020157790A1 (fr) Dispositif de reproduction d'état de dispositif, procédé de reproduction d'état de dispositif et programme de reproduction d'état de dispositif
JP6875878B2 (ja) 情報処理装置、プログラム、及び制御方法
JP2001005522A (ja) データ表示装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23774404

Country of ref document: EP

Kind code of ref document: A1