WO2019064917A1

WO2019064917A1 - Robot simulator

Info

Publication number: WO2019064917A1
Application number: PCT/JP2018/028994
Authority: WO
Inventors: 小菅　昌克; ナットタンドアン; 常田　晴弘; 吉田　昌弘
Original assignee: 日本電産株式会社
Priority date: 2017-09-26
Filing date: 2018-08-02
Publication date: 2019-04-04
Also published as: JP7151713B2; JPWO2019064917A1

Abstract

[Problem] To assist the examination of individual operation elements with respect to the result of execution of a series of operations performed by a robot. [Solution] According to one embodiment, the present invention comprises: a program execution unit that executes a robot program including tasks, which are information pertaining to operation elements of a robot; a condition information acquisition unit that generates a control signal for the robot on the basis of the result of execution by the program execution unit, and acquires from the robot condition information, which is information indicating a condition that corresponds to the passage of time with respect to the robot operating due to the control signal; and a display control unit that displays, on a display device, a first timing chart indicating the condition of the robot on the basis of the condition information obtained by the condition information acquisition unit, the first timing chart being displayed so that it will become possible to distinguish between periods that correspond to the operation elements of the tasks on a time axis.

Description

Robot simulator

The present invention relates to a robot simulator.

It is known to teach (teaching) the motion of a robot and to simulate the motion taught to the robot by a three-dimensional model of the robot. For example, Patent Document 1 describes simulating the operation of a robot in which a grinding tool is attached to an arm.

Patent No. 4961447 gazette

By the way, when a plurality of work elements are included in a series of work performed by a robot to be taught, there is a demand to check each of the plurality of work elements in the execution result of the robot of the series of works. Here, “work element” means the minimum unit of work performed by the robot in a series of work such as “take” or “place” an object. By focusing on the state of the robot for each work element, it is possible to improve the teaching of a series of work by the robot and / or the arrangement of the robot and the work target.

Then, this invention aims at supporting examination of every operation element with respect to the execution result of a series of operation | work by a robot.

In an exemplary first invention of the present application, there is provided a program execution unit that executes a robot program including a task that is information related to work elements of the robot, and a control signal to the robot based on an execution result by the program execution unit. Based on the state information acquired by the state information acquiring unit acquiring from the robot state information which is information indicating a state according to the elapsed time of the robot operated by the control signal, and based on the state information acquired by the state information acquiring unit And a display control unit for displaying on the display device a first timing chart indicating a state of the robot such that a period corresponding to a work element of the task can be identified on a time axis. is there.

According to the present invention, it is possible to support examination of each work element with respect to the execution result of a series of work by a robot.

FIG. 1 is a view showing the overall configuration of a robot simulator according to the first embodiment. FIG. 2 is a diagram showing a hardware configuration of each device included in the robot simulator of the first embodiment. FIG. 3 is a view showing a three-dimensional CAD window according to an example of the first embodiment. FIG. 4 is a view showing a teaching window according to an example of the first embodiment. FIG. 5 is a diagram for conceptually explaining a job. FIG. 6 is a diagram for conceptually explaining a task. FIG. 7 is a view showing transition of a window for teaching according to an example of the first embodiment. FIG. 8 is a diagram showing an example of the task list. FIG. 9 is a view showing an example of a timing chart displayed by the robot simulator according to the first embodiment. FIG. 10 is a view showing a three-dimensional CAD window according to an example of the first embodiment. FIG. 11 is a functional block diagram of the robot simulator according to the first embodiment. FIG. 12 is an example of a sequence chart showing processing of the robot simulator according to the first embodiment. FIG. 13 is a view showing the overall configuration of a robot simulator according to the second embodiment. FIG. 14 is a diagram showing a hardware configuration of each device included in the robot simulator of the second embodiment. FIG. 15 is a view showing an example of a timing chart displayed by the robot simulator according to the second embodiment. FIG. 16 is a functional block diagram of a robot simulator according to the second embodiment. FIG. 17 is a view showing an example of a timing chart displayed by the robot simulator according to the third embodiment. FIG. 18 is a view showing an example of a timing chart displayed by the robot simulator according to the third embodiment.

Hereinafter, an embodiment of a robot simulator of the present invention will be described.
In the following description, "work element" means the minimum unit of work performed by the robot in a series of work such as "take" or "place" an object.
"Object" means an object that is the target of the robot's work, and is not limited to the object that the robot grips (for example, the workpiece that is the processing object), but an object related to the robot's work (for example, the robot Also includes a shelf) on which an object to be gripped is placed.

(1) First Embodiment The robot simulator according to the first embodiment simulates the operation of an actual robot without connecting it to the actual robot, and displays the state of the robot on a timing chart.

(1-1) Configuration of Robot Simulator According to Present Embodiment Hereinafter, the configuration of the robot simulator 1 according to the present embodiment will be described with reference to FIG. 1 and FIG. FIG. 1 is a view showing the overall configuration of a robot simulator 1 of the present embodiment. FIG. 2 is a diagram showing a hardware configuration of each device included in the robot simulator 1 of the present embodiment.

As shown in FIG. 1, the robot simulator 1 includes an information processing device 2 and a robot control device 3. The information processing device 2 and the robot control device 3 are communicably connected by, for example, a communication network cable EC.
The information processing apparatus 2 is an apparatus for teaching an operation to a robot installed in a factory line. The information processing device 2 is provided to perform off-line teaching by the operator, and is disposed, for example, at a position away from the factory where the robot is installed (for example, a work place of the operator).

The robot control device 3 executes a robot program transmitted from the information processing device 2. In this embodiment, the robot control device 3 is not connected to the robot, but when connected to the robot, it is possible to send a control signal according to the execution result of the robot program to the robot to operate the robot. Therefore, preferably, the robot control device 3 is disposed in the vicinity of the actual robot.

As shown in FIG. 2, the information processing device 2 includes a control unit 21, a storage 22, an input device 23, a display device 24, and a communication interface unit 25.
The control unit 21 includes a central processing unit (CPU), a read only memory (ROM), and a random access memory (RAM). The ROM stores a three-dimensional CAD application program and teaching software. The CPU executes three-dimensional CAD application software (hereinafter referred to as “CAD software” as appropriate) on the ROM and teaching software in the RAM. The teaching software and the CAD software execute processing in cooperation via an API (Application Program Interface).
The control unit 21 continuously displays images in frame units in order to perform moving image reproduction by CAD software.

The storage 22 is a large-capacity storage device such as a hard disk drive (HDD) or a solid state drive (SSD), and is configured to be sequentially accessible by the CPU of the control unit 21. As described later, the storage 22 stores a task database 221, a hierarchical list database 222, a three-dimensional model database 223, and an execution log database 224.
The storage 22 stores data of a three-dimensional model that is referred to when executing CAD software. In the example of the present embodiment, the storage 22 stores data of a three-dimensional model of a robot and an object (for example, a pen, a cap, a product, a pen tray, a cap tray, a product tray described later).
The storage 22 stores execution log data acquired from the robot control device 3. The execution log data includes robot program execution results and robot state data to be described later.
The robot state data is used to create a timing chart to be described later. The robot state data may also be used to reproduce the motion of the robot in a virtual space by animation (animation) by three-dimensional CAD.

The input device 23 is a device for receiving an operation input by an operator, and includes a pointing device.
The display device 24 is a device for displaying execution results of teaching software and CAD software, and includes a display drive circuit and a display panel.
The communication interface unit 25 includes a communication circuit for performing network communication with the robot control device 3.

The robot control device 3 includes a control unit 31, a storage 32, and a communication interface unit 33.
The control unit 31 includes a CPU, a ROM, a RAM, and a control circuit. The control unit 31 executes a robot program received from the information processing device 2 and outputs execution log data. As described above, the execution log data includes the execution result of the robot program and robot state data of the robot that executes the work described in the robot program.
The storage 32 includes data of a model of a robot manipulator (a robot body including the arm 51 and the hand 52). The control unit 31 is a physical quantity (for example, an angular displacement of the joint angle of the arm 51, an angular velocity, a position of the hand 52, etc.) according to the passage of time during execution of the job of each unit constituting the manipulator based on the execution result of the robot program. Etc.). The data of the physical quantity is included in the robot state data.

The storage 32 is a mass storage device such as an HDD or an SSD, and is configured to be sequentially accessible by the CPU of the control unit 31. The storage 32 stores a robot program and execution log data in addition to data of a model of a robot manipulator.
The communication interface unit 33 includes a communication circuit for performing network communication with the information processing device 2.

(1-2) User Interface in Off-Line Teaching Before executing a simulation of a robot, the operator performs off-line teaching on the robot using the information processing apparatus 2 to create a robot program. In creating a robot program, in a preferred example of the present embodiment, CAD software and teaching software are executed by the information processing apparatus 2.
The execution result of CAD software is displayed in a CAD window, and the execution result of teaching software is displayed in a teaching window. The operator causes both the CAD window and the teaching window to be displayed on the information processing apparatus 2 or causes the information processing apparatus 2 to display the CAD window and the teaching window while switching between the CAD window and the teaching window. I do.

FIG. 3 shows a CAD window W1 according to an example of the present embodiment. In FIG. 3, an image in a state where the robot R, the pen tray 11, the cap tray 12, the jig 13, and the product tray 14 are arranged in a virtual space on the table T (hereinafter referred to as “CAD as appropriate” The image is displayed.
In the example shown in FIG. 3, it is assumed that the robot R performs a series of operations for assembling a product (a finished product with the cap fitted on the pen) by fitting the cap on the pen. A pen group P composed of a plurality of pens is disposed on the pen tray 11, and a cap group C composed of a plurality of caps is disposed on the cap tray 12. The jig 13 is a member for the robot R to temporarily arrange a pen and fit a cap. The product tray 14 is a member for placing a product.

In the example illustrated in FIG. 3, each pen included in the pen group P, each cap included in the cap group C, the pen tray 11, the cap tray 12, the jig 13, and the product tray 14 are work targets of the robot R. It is an example of an object. Further, a product in which a cap is fitted to a pen is also an example of an object.

(1-2-1) Hierarchical List FIG. 4 shows a teaching window W2 according to an example of the present embodiment. Displayed in the teaching window W2 is a robot R included in the CAD image of FIG. 3 and a hierarchical list showing hierarchical relationships of objects.

The teaching software can create hierarchical lists in conjunction with CAD software. A tree structured data format is prepared by the teaching software as a hierarchical list. The operator drags the robot R and the object in the CAD image to a desired node of the data format of the tree structure while selecting the robot R and the object in the CAD image with the CAD window and the teaching window displayed. . The hierarchical list can be completed by sequentially performing this operation on all objects required to teach the robot R. As the name of each node displayed in the hierarchical list, the name of the original three-dimensional model may be applied as it is, but the name may be changed later.

In the following description, to include the robot R in the CAD image and the object in any node of the hierarchical list is referred to as “registering the robot R or the object in the hierarchical list”. Although FIG. 3 exemplifies a CAD image when there is one robot, when two or more robots exist, the two or more robots can be registered in the hierarchical list.

In the hierarchical list shown in FIG. 4, three nodes related to the hand are provided under the nodes of the robot R (Robot_R). The reason for providing a plurality of nodes for the hand is to consider the working state assumed for the hand. That is, nodes 61 to 63 mean the following contents.

-Node 61 (Pen): a hand corresponding to an operation of holding a pen-Node 62 (Cap): a hand corresponding to an operation of holding a cap-Node 63 (Pen_with_Cap): for an operation of holding a pen on which a cap is fitted Corresponding hand

Perform right-click operation on any of the nodes 61 to 63 and select "hand sequence operation" to perform settings related to the hand sequence such as actuation method (single solenoid or double solenoid), sensor type, etc. be able to.
The hand sequence is set for each object held by the hand 52 because it depends on the object held by the hand 52 of the robot R. If a task to be described later is created when the hand sequence is not set, a program based on the task can not be executed, so a warning display may be output to the display device 24.

The components of the object include jig (JIG), pen tray (PenTray), cap tray (CapTray), product tray (ProductTray), pens (Pen1, Pen2, ..., Pen12), caps (Cap1, Cap2, ... ,, Cap12) and products (PenProduct1, PenProduct2, ..., PenProduct12) are included.
Below the nodes of the jig (JIG), for example, the following nodes are provided corresponding to the operation for the jig.

Node 64 (PenProduct): jig in a state of holding product (PenProduct) Node 65 (PenJ): jig in a state of holding pen (Pen) Node 66 (CapJ): holding a cap (Cap) Jig of state

Below the nodes of the pen tray (PenTray), nodes corresponding to the pens Pen1, Pen2, ..., Pen12 are provided. Below the nodes of the cap tray (CapTray), nodes corresponding to the caps Cap1, Cap2, ..., Cap12 are provided. Below the nodes of the product tray (ProductTray), nodes corresponding to the products PenProduct 1, PenProduct 2,..., PenProduct 12 are provided.

Robot R in the hierarchical list (Robot_R in FIG. 4), and objects (jig (JIG), pen tray (PenTray), cap tray (CapTray), product tray (ProductTray), pens Pen1, Pen2, ..., Pen12 , Caps Cap1, Cap2, ..., Cap12, and products PenProduct1, PenProduct2, ..., PenProduct12) are in a state associated with the data of the corresponding three-dimensional model. Therefore, even if there is a change in the robot R and the three-dimensional model of the object in the hierarchical list after the hierarchical list is created, it is not necessary to register again in the hierarchical list.

(1-2-2) Jobs and Tasks Next, jobs and tasks will be described with reference to FIG. 5 and FIG.
FIG. 5 is a diagram for conceptually explaining a job. FIG. 6 is a diagram for conceptually explaining a task.

A job is a series of tasks performed by the robot R. A task is information on a work element which is a minimum unit of work performed by the robot R in a series of work. Accordingly, as shown in FIG. 5, the period corresponding to the job (JOB), a plurality of tasks _T _1, T 2, _..., and duration of a plurality of work elements corresponding to _{_{T n-1,} T n,} the robot The movement between R's work elements (that is, “movement between tasks”) is included. As shown in FIG. 5, in the present embodiment, a plurality of tasks are defined for the job performed by the robot R.

Each task includes a plurality of motions (meaning “movement of robot R”) M ₁ to M _n . The tasks may include hand sequences (HS) in addition to motion. The hand sequence is a series of processes for gripping an object by the hand 52 of the robot R. Between adjacent motions, a waiting time WT due to an interlock or the like described later may be set.

In FIG. 6, a line with an arrow conceptually shows the trajectory of the hand 52 of the robot R. The trajectory includes approach points AP1 and AP2 which are passing points before reaching the target point TP of the work element, the target point TP, and departure points DP1 and DP2 which are passing points after reaching the target point TP. Including. The target point TP indicates the position of the target object of the work element.

In the example shown in FIG. 6, the motion of the robot R before reaching the approach point AP1 corresponds to the movement between work elements (that is, the movement between the previous work element and the work elements shown in FIG. 6). The movement of the robot R after the departure point DP2 corresponds to the movement between work elements (that is, the movement between the work element shown in FIG. 6 and the next work element). The motion of the robot R from the approach point AP1 to the departure point DP2 corresponds to one work element and one task, and the movement of the robot R between adjacent points in the work element corresponds to one motion.
That is, the task may include, in addition to the information on the work element, information on at least one of the target point TP, the approach point AP, and the departure point DP.

In FIG. 6, the case where interlock is set in approach point AP1, AP2 is illustrated. The interlock operates the robot R at the target point TP, the approach point AP, and / or the departure point DP until a predetermined signal is input in order to avoid interference with other robots etc. It is processing to make it wait.
The task may include information on the interlock setting including the point of setting the interlock and the timeout value of the waiting time due to the interlock.

(1-2-3) Creation of Task Next, a method of creating a task using a hierarchical list will be described with reference to FIG. 4 and FIG. FIG. 7 is a view showing transition of a window for teaching according to an example of the present embodiment.
In order to create a task in the hierarchical list shown in FIG. 4, first, the operator points to one of the nodes 61 to 63 of the hand of the hand of the robot R (Robot_R) included in the robot area RA. Select with and right-click, and select "Create task". That is, the selection of the node is selected from among the gripping targets of the hand of the robot R in the work element corresponding to the task based on the operation input of the operator.

When “task creation” is selected, a teaching window W3 for task creation in FIG. 7 is displayed. The teaching window W3 is a screen for performing detailed setting of tasks, and displays items of task name (Name), type of work element (Function), and target of work element (Target). Here, by left-clicking a node corresponding to any one of the target object areas PA in the hierarchical list with the pointing device, the target (Target) item of the teaching window W3 is left-clicked. The selected object is input. In the column of the type of work element (Function), any work from a pull-down menu consisting of candidates of a plurality of types of work elements set in advance (for example, Pick up, Place, etc.) It is configured to be able to select an element.

Then, an object to be a work object is selected with the pointing device from the object area PA of the hierarchical list, and left-click operation is selected in the item of Target (Target) in the teaching window W3. The target object is input.
When data is input for each item of the type of work element (Function) and the target (Target), the name (Name) of the task is automatically determined and displayed based on the data.

For example, to create a task corresponding to the work element “take pen 1 from pen tray” in a state in which the hand of robot R is not gripping anything, the operator points at node 61 in robot area RA and the pointing device Right click on and select "Create task". Next, by performing a left click operation with the pointing device on the node 67 corresponding to the pen tray (PenTray) from the object area PA of the hierarchical list, the pen tray is displayed in the item of the target (Target) of the teaching window W3. (PenTray) is input. In the column of the type of work element (Function), "Pick up" is selected from candidates for a plurality of types of work elements. Then, by performing a left click operation with the pointing device on the node 68 corresponding to the pen Pen 1 to be worked out from the object area PA of the hierarchical list, the teaching window W3 shown in FIG. 7 is displayed. .

As a result of the above operation, a task with the name "Pickup_Pen1_From_PenTray" is created as information related to the work element "take pen 1 from pen tray".
In the present embodiment, the operator intuitively performs the task by designating the target of the work element (here, “Pen Pen1”) and the start point (for example, “Pen tray”) or the end point of the work element on the hierarchical list. Can be created. Also, the name of the task is the work content of the work element (for example, "Pickup"), the work target (for example, "Pen Pen 1"), the target (for example, "pen tray") which is the start point of the work element, or the end point The contents of the task can be immediately understood from the name of the task because it is automatically created so as to include the object.

When a task is created, information on an approach point AP, a target point TP, and a departure point DP included in the task may be automatically created. Alternatively, the operator may operate the button b1 (“detail setting”) of the teaching window W3 to set one or more approach points and / or departure points. When the approach point AP, the target point TP, and the departure point DP are automatically created, the center of gravity of the object is set as the target point TP, and a predetermined coordinate is set in the local coordinate system of the object based on the center of gravity of the object. The approach point AP and the departure point DP may be set on the axis (for example, on the Z axis).

Referring to FIG. 7, by operating button b1 (“detail setting”) of the teaching window W3, the operator can perform “motion parameter setting” and “interlock setting” in addition to “approach point, departure point setting”. You can choose one of these.
Motion parameters are parameters relating to the motion of the hand 52 of the robot R between adjacent approach points AP included in the task, between the approach point AP and the target point TP, and between the target point TP and the departure point DP. It is. For example, such parameters include moving speed, acceleration, acceleration time, deceleration time, posture of the robot R, and the like. By selecting “motion parameter setting”, the motion parameter can be changed from the default value.
By selecting “interlock setting”, it is possible to change from the default value the timeout value of the interlock waiting time and the setting of the operation when the waiting time exceeds the timeout value and it is judged as an error.

A button b2 ("Create") is provided in the teaching window W3 of FIG. By operating the button b2 ("Create"), the task set by the teaching window W3 is registered in a task list described later.

(1-2-4) Creation of a Program Based on a Task For example, a program for executing a work element corresponding to a task shown in FIG. 6 consists of the following functions, each function corresponding to a robot R It is described by a program for executing motion.
Note that the following move (AP1) may be separately defined as movement between work elements.

Move (AP1): movement to approach point AP1 interlock (IL1): waiting by interlock (IL1) at approach point AP1 move (AP2): movement to approach point AP2 interlock (IL2): approach point AP2 Interlock (IL2) waits by • move (TP) ... move to the target point TP • handSequence () ... hand sequence process • move (DP1) ... move to the departure point DP1 • move (DP2) ... to the departure point DP2 In the case of performing operation check for each task in the functions of interlock (IL1) and interlock (IL2), a program is created but the timeout value of the waiting time due to interlock is invalid.

(1-2-5) Task List The task list is information on a list of a plurality of tasks corresponding to each of a plurality of work elements included in a job performed by the robot R. The tasks created for the specific job by the teaching window W3 are sequentially registered in the task list corresponding to the job. In order to manage jobs, it is preferable that the order of the plurality of tasks included in the task list indicates the execution order of the plurality of work elements respectively corresponding to the plurality of tasks.

The teaching window W4 in FIG. 8 displays an example of a task list corresponding to a job (“Pen Assembly”) which is a series of operations “attach a cap to a pen and assemble a product”. An example of this task list includes tasks corresponding to the following six work elements (i) to (vi). In this case, the teaching window W3 for creating a task shows a case where a task having a name shown in parentheses is created.
(i) Take the pen from the pen tray (Pickup_Pen1_From_PenTray)
(ii) Set the taken pen on the jig (Place_to_PenJ_in_PenProduct)
(iii) Remove the cap from the cap tray (Pickup_Cap1_From_CapTray)
(iv) Put the cap on the pen on the jig (Place_to_CapJ_in_PenJ)
(v) Take a pen with a cap (Pickup_PenProduct_From_JIG)
(vi) Place a pen with a cap on the product tray (Place_to_PenProduct1_in_ProductTray)

The operator can set the selected tasks in an arbitrary order in the task list by performing the drag operation while selecting any task with the pointing device in the task list.

As shown in FIG. 8, when right-clicking while selecting any task in the task list with the pointing device, one of “Edit task”, “Add task”, and “Delete task” can be selected. . Here, when “Edit task” is selected, it is possible to return to the teaching window W3 of the selected task to change the information on the task. When "Add task" is selected, the created task is read and inserted in the order immediately after the selected task, or the instruction window W3 is returned to create a task and inserted. can do. When "delete task" is selected, the selected task can be deleted from the task list.

In FIG. 8, when the right-click operation is performed on an arbitrary position in the teaching window W4 and “program output” is selected, two types of robots, a simulation program and a real machine program, corresponding to the job. Output the program The actual program is different from the other in that the timeout value of the standby time due to the interlock is valid, but the simulation program is that the standby time due to the interlock is invalidated.

(1-2-6) Job Simulation When the button b3 is operated in the teaching window W4 of FIG. 8, simulation of a job of the robot R corresponding to the task list is executed.
When executing job simulation, first, a robot program corresponding to the job is created. That is, as described above, the program based on each task included in the task list is represented as a collection of functions in which programs for causing the robot R to execute a plurality of motions are described. Note that motion parameters (moving speed, acceleration, acceleration time, deceleration time, etc.) for the movement of the robot R between work elements corresponding to consecutive tasks may be predetermined as default values, or the operator It may be settable.
When combining programs based on each task, branch processing may be incorporated such as switching a program to be executed depending on input signals or conditions, processing for repeating a specific program, or the like.

In the present embodiment, a robot program is created in the information processing device 2, and the robot program is executed in the robot control device 3. In the present embodiment, the simulation program is executed.
In the present embodiment, the robot controller 3 is not connected to a real robot, so the controller 31 of the robot controller 3 controls the manipulator based on the data of the model of the manipulator of the robot R recorded in the storage 32. Physical quantities (for example, angular displacement of joint angles of the arm 51, angular velocity, etc.) according to the passage of time of the respective parts constituting the computer are calculated as robot state data.

The execution log data including the job execution result and the robot state data is transmitted from the robot control device 3 to the information processing device 2. The information processing device 2 creates and displays a timing chart based on the robot state data. In the present embodiment, since the job simulation is performed in a state where the robot R of the actual machine is not connected to the robot control device 3, the timing chart created by the information processing device 2 is also referred to as an "offline timing chart". The offline timing chart is an example of a second timing chart.

FIG. 9 shows an example of a timing chart displayed on the display device 24 of the information processing device 2.
The timing chart illustrated in FIG. 9 shows a timing chart corresponding to the task named “Pickup_Pen1_From_PenTray” in the job (“Pen Assembly”) illustrated in the teaching window W4 in FIG. ing.
The timing chart of FIG. 9 includes a part A which displays a graph and a part B which displays a task execution status, and the time from the job start time is displayed at the top. ing. In the example shown in FIG. 9, cursors CU1 to CU3 are provided. Each pointing device can move each cursor left and right. The cursor CU1 indicates the time from the start time of the job, and the cursors CU2 and CU3 indicate times when the time indicated by the cursor CU1 is 0.

A portion (A) of FIG. 9 displays a waveform (graph) in which changes in reference time (for example, 1 ms) of the following robot state data of the robot R are plotted. The position of the robot R is, for example, the position of the tip flange of the manipulator.
· Command value ("posX") of the position of the X coordinate (world coordinate system) of the robot R
· Command value of position of Y coordinate (world coordinate system) of robot R ("posY")
· Command value ("posZ") of the position of Z coordinate (world coordinate system) of robot R
· Command value of angular velocity of joint angle of arm 51 (“Angular Velocity”)

The graph displayed in part A of FIG. 9 is only data of a part of a plurality of types of robot state data. The operator can select the type of robot state data to be displayed from among the plurality of types of robot state data.

In part B of FIG. 9, the task name (“Task Function”) and the motion state (“Motion status”) are displayed. The task name ("Task Function") is "Pickup_Pen1_From_PenTray" as described above, and the period (start time and end time) of the task included in the job is known from FIG.
The motion status ("Motion status") corresponds to the motion included in the task. That is, in the motion state ("Motion status"), the period (start time and end time) of the following three types of motion (here, including the hand sequence) can be known. The start time and the end time of each motion match the execution start time and the execution end time of the function corresponding to each motion. The start time of each task matches the start time of the first motion among the plurality of motions included in each task, and the end time of each task is the end time of the last motion among the plurality of motions included in each task Match with

-Move (PTP) ... arc movement. It is mainly used for moving between approach points AP and for moving between departure points DP.
・ Move (Line) ... linear movement. It is mainly used for the movement from the approach point AP to the target point TP and for the movement from the target point TP to the departure point DP.
・ HandSequence () ... Hand sequence processing

If an error occurs when calculating robot state data of the robot R, the cause of the error may be displayed in the column of the status of the teaching window W4 of FIG. The cause of the error includes, for example, overspeeding, reaching of the target point, reaching of the singular point and the like.

Preferably, in the present embodiment, the information processing apparatus 2 causes the robot R and the three-dimensional model of the object to operate in the virtual space based on the robot state data, and the motion of the robot R corresponding to the task as a simulation output. Display the animation (animation) of. Thereby, the operator can confirm the result of simulation of the job in the CAD window.

FIG. 10 shows an example of a CAD window W5 for reproducing a moving image of a result of simulation of a job. In the example shown in the CAD window W5, buttons b4 to b8 are provided as operation objects by the operator.
The button b4 is an operation button for causing the robot R and the object to operate in the virtual space so that the same change in robot state data as in the timing chart shown in FIG. 9 (that is, at normal speed). The button b5 is an operation button for operating the robot R and the object in the virtual space so that the robot state data changes at twice the normal speed. The button b6 is an operation button for operating the robot R and the object in the virtual space so that the robot state data changes at a speed lower than the normal speed. The button b7 is an operation button for temporarily stopping the robot R operating in the virtual space and the object. The button b8 is an operation button for operating the robot R and the object in the virtual space by changing the robot state data (that is, performing reverse reproduction) so that the progress of time is in the reverse direction.

(1-3) Function of Robot Simulator 1 Next, the function of the robot simulator 1 of the present embodiment will be described with reference to FIG. FIG. 11 is a functional block diagram of the robot simulator 1 according to the embodiment.
As shown in FIG. 11, the robot simulator 1 includes a display control unit 101, a task creation unit 102, a program creation unit 103, a program execution unit 104, a state information calculation unit 105, a simulation unit 107, and an interlock setting unit 108. Prepare.
The robot simulator 1 further includes a task database 221, a hierarchical list database 222, a three-dimensional model database 223, and an execution log database 224.

In the following description, when the processing of the control unit 21 of the information processing device 2 is referred to, the CPU included in the control unit 21 executes the teaching software and / or the CAD software to perform the processing.

The display control unit 101 controls the display device 24 to display the execution results of the teaching software and the CAD software. In order to realize the function of the display control unit 101, the control unit 21 of the information processing device 2 generates image data including the output of teaching software and CAD software, buffers it, and transmits it to the display device 24. The display device 24 drives the display drive circuit to display an image on the display panel.

The task creation unit 102 has a function of creating a task that is information related to work elements of the robot with respect to the object based on the operation input of the operator.
In order to realize the function of the task creating unit 102, when the control unit 21 of the information processing device 2 receives an operation input of the operator from the input device 23, the control unit 21 of FIG. The task is created as a file including information of the target of the work element (Target) and recorded in the storage 22. The control unit 21 determines the task name in accordance with a predetermined rule, based on the type (Function) of the work element and the target (Target) of the work element. The storage 22 stores a task database 221 including tasks created by the task creating unit 102.
The control unit 21 of the information processing device 2 sequentially creates tasks corresponding to a plurality of work elements included in a job performed by the robot, and thereby creates a plurality of tasks associated with the job as a task list. In the task database 221, each task is recorded in a state associated with a specific job.
The display control unit 101 refers to the task database 221 of the storage 22 and displays a task list, which is a list of a plurality of tasks, on the display device 24. By displaying the task list, it is possible to manage the job performed by the robot in an easy-to-understand manner when teaching the robot. In the present embodiment, the names of the tasks in the displayed task list are configured such that the work contents of the work elements of the robot can be recognized, so that a series of work contents can be intuitively understood by the operator intuitively. It has become.

The display control unit 101 displays hierarchical data in which the components of the robot and the components of the object are hierarchically described on the display device 24.
The control unit 21 of the information processing device 2 creates a hierarchical list by linking teaching software and CAD software. That is, the control unit 21 receives an operation input for dragging a robot and an object in a CAD image to a desired node of the data format of the tree structure in a state where the robot and the object are selected by the pointing device of the input device 23. Create a list The control unit 21 records the created hierarchical list in the hierarchical list database 222 of the storage 22. In the hierarchical list, each node corresponding to the component of the robot and the component of the object in the data of the tree structure is associated with the corresponding data of the three-dimensional model recorded in the three-dimensional model database 223 It has become.

Preferably, the task creating unit 102 has a function of creating a task based on an operation input of an operator specifying a component of a robot of hierarchical data and a component of an object. In order to realize the function, the control unit 21 of the information processing device 2 displays a node indicating a hand of a robot corresponding to an operation of gripping a specific target and a node corresponding to the target from the hierarchical list. Create a task based on the operation input of the selected operator. By using the hierarchical list, the operator can create tasks intuitively according to the contents of work elements.

The program creation unit 103 has a function of creating a program for causing the robot 5 to execute a work element corresponding to the task based on the task created by the task creation unit 102.
In order to realize the function of the program creation unit 103, the control unit 21 of the information processing device 2 selects the type of work element included in the task, the target of the work element, the approach point, the departure point, the motion parameter, and the interlock. Based on the settings, a function is created in which a program for causing the robot to execute the work element corresponding to the task is written. For example, the program creation unit 103 automatically creates a program by referring to the information included in the task and rewriting the coordinate position etc. in the format of a predetermined program according to the type of the work element stored in the storage 22. Do.

The program execution unit 104 has a function of executing a robot program including a task that is information on work elements of the robot.
In order to realize the function of the program execution unit 104, the control unit 21 of the information processing device 2 controls the robot program (program for simulation) created based on at least one task via the communication interface unit 25 Send to 3
As described above, one job includes a plurality of work elements described by the task and movement between the work elements. One task includes a plurality of motions and an optional hand sequence, and a program for executing a work element corresponding to the task is defined by a plurality of functions. Movement between work elements of the robot is defined by a function described by a program including predetermined default motion parameters.
When receiving the robot program, the control unit 31 of the robot control device 3 executes a robot program for one job by sequentially executing a plurality of functions corresponding to each motion and hand sequence.

The state information calculation unit 105 has a function of calculating robot state data (example of state information) which is information indicating the state of the robot according to the passage of time based on the execution result by the program execution unit 104. Then, the display control unit 101 is a timing chart showing the state of the robot so that the period corresponding to the task element of the task can be identified on the time axis based on the robot state data obtained by the state information calculation unit 105. (Ie, the off-line timing chart) is displayed on the display device 24.

In order to realize the function of the state information calculation unit 105, as described above, the control unit 31 of the robot control device 3 causes the information processing device 2 to sequentially execute the program created based on each task. Execute the received robot program. Then, the control unit 31 calculates robot state data in the entire job as the execution result of the robot program, and sequentially records the data in the storage 32.
The robot state data is data of physical quantities (for example, arm joint angle, arm speed and acceleration, hand position, etc.) indicating the state of the robot according to the elapsed time calculated based on the model of the manipulator 50. .
When the execution of the robot program for the entire job is completed, the control unit 31 reads robot state data from the storage 32 for each predetermined reference time (for example, 1 ms) along the time axis of the progress of the job. The control unit 31 transmits execution log data including the read robot state data and the execution result of the robot program to the information processing apparatus 2 via the communication interface unit 33.

When acquiring the execution log data including the robot state data from the robot control device 3, the control unit 21 of the information processing device 2 records the execution log data in the execution log database 224.
The control unit 21 generates an image including an off-line timing chart of a predetermined format based on the acquired robot state data for each reference time, and displays the image on the display device 24. The said timing chart is comprised so that the period corresponded to a specific work element can be identified about a series of operation | movement of a robot.

The robot state data may include information of a plurality of types of robots. In that case, the display control unit 101 displays the off-line timing chart on the display device 24 based on the information of a part of the robot state data selected from the plurality of types by the operation input of the operator. It is also good. As a result, the operator can display robot status data of the type he / she wishes to check on the off-line timing chart. Although the method of selecting the type of robot state data is not limited, for example, it is preferable that the display screen of the timing chart is configured to include a menu that allows the type of robot state data to be selected by an operation by the operator.

The storage 22 (an example of a storage unit) stores a three-dimensional model database 223 including a three-dimensional model of a robot in a virtual space and information of a three-dimensional model of an object.
The simulation unit 107 has a function of operating a three-dimensional model in a virtual space and displaying it on the display device 24 based on the robot state data obtained by the state information calculation unit 105.
In order to realize the function of the simulation unit 107, the control unit 21 of the information processing device 2 reads the execution log data recorded in the execution log database 224, and based on the robot state data included in the execution log data, in the virtual space. The robot and the three-dimensional model of the object are operated and displayed on the display device 24. By this, the operator can visually confirm the operation of the robot of each task, so the setting value of each task (for example, approach point, departure point, motion parameter, etc.) and the arrangement of the object (for example, FIG. It becomes easy to re-examine the arrangement of the cap tray 12 and the like 3).

The simulation unit 107 makes the operation of the three-dimensional model faster or slower than the speed based on the robot state data, or the progress of time in the opposite direction. It may be displayed on Thereby, the operator can reproduce the simulation result at the operator's desired speed or by reverse reproduction.
In this case, as illustrated in FIG. 10, the control unit 21 of the information processing device 2 makes the robot and the object three-dimensional by setting the speed higher or lower than the normal speed according to the operation by the operator on the button of the CAD window. The model is reproduced as a moving image, or the three-dimensional model is reproduced in reverse and displayed on the display device 24. For example, since robot status data for each 1 ms reference time is recorded in the execution log database 224, the control unit 21 creates a reproduction frame according to the operation of the operator.

The interlock setting unit 108 has a function of setting a time-out value of the waiting time for waiting the operation of the robot at at least one of the target point, the approach point and the departure point set to the task based on the operation input of the operator. Prepare.
In order to realize the function of the interlock setting unit 108, the control unit 21 of the information processing device 2 performs the operation input of the operator received by the input device 23 (for example, the operation input in the teaching window W3 of FIG. 7). The storage 22 is accessed, and the timeout value of the interlock waiting time set at the specific approach point or departure point included in the task included in the task database 221 is rewritten.
The interlock setting unit 108 allows the operator to easily set the timeout value of the standby time by the interlock for each work element when performing the off-line teaching of the robot.

The simulation unit 107 may operate the three-dimensional model in the virtual space by invalidating the standby time due to the interlock. That is, when the simulation program is executed, the three-dimensional model is operated without waiting for the interlock. As a result, the operator can check the execution result of the program paying attention to the movement of the robot without stopping the robot in the virtual space.

(1-4) Job Simulation Execution Process Next, with reference to FIG. 12, a job simulation execution process by the robot simulator 1 will be described with reference to a sequence chart. FIG. 12 is an example of a sequence chart showing job execution processing of the robot simulator according to the present embodiment.

When an operation input to the button b3 by the operator in the teaching window W4 in FIG. 8 (simulation execution instruction) is received (step S10: YES), the program creation unit 103 creates a robot program for causing the robot R to execute a job. (Step S12). The robot program includes a plurality of functions in which programs for causing the robot R to execute the work elements corresponding to the tasks in the task list corresponding to the job are described.

The created robot program is transmitted from the information processing device 2 to the robot control device 3 (step S14) and executed by the robot control device 3. That is, the program execution unit 104 executes the robot program in task units (step S16). The state information calculation unit 105 calculates robot state data which is information indicating the state of the robot R according to the passage of time based on the execution result by the program execution unit 104, and stores execution log data including the robot state data. Record in 32 (step S18). The processes of steps S16 and S18 are performed until all tasks included in the task list are completed.
When the processing for all the tasks is completed (step S20: YES), the robot control device 3 transmits the execution log data to the information processing device 2 (step S22). The execution log data includes robot state data for each predetermined reference time (for example, 1 ms) along the time axis of the progress of the job, and the execution result of the robot program. The information processing device 2 records the received execution log data in the execution log database 224.
Next, the display control unit 101 sets a timing chart (offline, based on robot status data (that is, robot status data obtained by the status information calculation unit 105) included in the execution log data received in step S22 (offline) The timing chart is displayed on the display unit 24 (step S24). The simulation unit 107 operates the three-dimensional model in the virtual space based on the robot state data and displays it on the display device 24 (step S26).

As described above, the robot simulator 1 according to the present embodiment calculates robot state data based on the execution result of the robot program corresponding to the job, and based on the robot state data, determines the task element on the time axis. An offline timing chart is displayed so that the corresponding period can be identified. Therefore, when displaying the result of simulation about a series of tasks of the robot, the period corresponding to the specific task can be identified, and the consideration for each task can be supported.

(2) Second Embodiment Next, a second embodiment of the present invention will be described.

(2-1) Configuration of Robot Simulator According to this Embodiment Hereinafter, the configuration of the robot simulator 1A according to this embodiment will be described with reference to FIGS. 13 and 14. FIG. FIG. 13 is a view showing the overall configuration of a robot simulator 1A of the present embodiment. FIG. 14 is a diagram showing a hardware configuration of each device included in the robot simulator 1A of the present embodiment.
In addition, about the component similar to the robot simulator 1 of 1st Embodiment, the same code | symbol is attached | subjected and duplication description is abbreviate | omitted.

As shown in FIG. 13, the robot simulator 1A includes an information processing device 2 and a robot control device 3A. The information processing device 2 and the robot control device 3A are communicably connected by, for example, a communication network cable EC.
The robot control device 3A is common to the robot control device 3 of the first embodiment in that it executes the robot program transmitted from the information processing device 2, but the robot control in that it is connected to the robot R and the cable WC. Different from device 3. Preferably, the robot control device 3A is disposed in the vicinity of the actual robot.

As shown in FIG. 14, the robot control device 3A includes a control unit 31A, a storage 32, and a communication interface unit 33.
The control unit 31A of the robot control device 3A executes a robot program to generate a control signal for the robot R. The control signal for the robot R is a signal (for example, a pulse signal) indicating a command value for the robot R. The command value for the robot R is, for example, a target value such as the position, velocity, or acceleration of the robot R.
The control unit 31A acquires robot state data, which is data indicating the state of the robot R, from the robot R. The present embodiment differs from the first embodiment in that the robot state data acquired by the control unit 31A is acquired from the robot R instead of the operation value. The robot state data of this embodiment includes input / output signals to / from the robot R. The control unit 31 </ b> A sequentially records robot state data acquired from the robot R in the storage 32.
The control unit 31A reads robot state data for each predetermined reference time (for example, 1 ms) along the time axis of the progress of the job from the storage 32, and executes the read robot state data and the execution result of the robot program. Log data is transmitted to the information processing device 2.

As shown in FIG. 14, the robot R includes a manipulator 50 as a robot body, a control device 55, a sensor group 56, and an input / output unit 57.
The manipulator 50 is a main body of the robot R, and includes an arm 51 and a hand 52, and a plurality of motors for controlling the positions and angles of the arm 51 and the hand 52.
The control device 55 includes a servo mechanism that controls a motor provided in the manipulator 50 so as to follow a command value received from the robot control device 3A.
The sensor group 56 may include a plurality of sensors that detect the position, velocity, and acceleration of the manipulator 50, and the angle, angular velocity, and the like of each joint.

The robot state data transmitted from the controller 55 to the robot controller 3A may be a physical quantity of the manipulator 50 detected by any of the sensors of the sensor group 56, or a physical quantity that can be estimated from a control current value or the like for the motor. It may be For example, when the angular velocity sensor of the joint angle of the arm 51 is provided, the data of the angular velocity of the joint angle of the arm 51 may be a detection value of the angular velocity sensor, or a servo for controlling the motor of the manipulator 50 It may be a control current value in the mechanism.

The input / output unit 57 is an input / output interface with a system outside the robot R. For example, examples of the input signal include an interlock signal from an external system, and a signal for correcting the position of the object when the robot R is disposed in a line as described later. .

(2-2) Timing Chart of this Embodiment In this embodiment, the robot R of the actual machine is connected to the robot control device 3A, and based on the robot state data acquired from the robot R, a timing chart is created in the information processing device 2 Be done. In the following description, the timing chart created in the present embodiment is also referred to as an “online timing chart” as appropriate. The on-line timing chart is an example of a first timing chart.

FIG. 15 shows an example of a timing chart of the present embodiment. The timing chart of FIG. 15 includes a part C that is a part that displays input / output signals, in addition to a part A that is a part that displays a graph and a part B that is a part that displays the task execution status. That is, the robot state data included in the online timing chart may include the state of input / output signals in the robot. It is preferable that the input / output signals displayed on the online timing chart can be selected from the input / output signals provided to the robot R by the operation input of the operator.

In part A, a waveform (graph) in which changes at each reference time (for example, 1 ms) of the following robot state data acquired from the robot R are plotted is displayed.
・ Acquisition value of position of robot R's X coordinate (world coordinate system) ("posX")
・ Acquisition value of position of Y coordinate (world coordinate system) of robot R ("posY")
· Acquisition value of position of robot R's Z coordinate (world coordinate system) ("posZ")
・ Acquired value of angular velocity of joint angle of arm 51 (“Angular Velocity”)

In Part B, as in the off-line timing chart of the first embodiment, the start time and the end time of each motion coincide with the execution start time and the execution end time of the function corresponding to each motion. The start time of each task matches the start time of the first motion among the plurality of motions included in each task, and the end time of each task is the end time of the last motion among the plurality of motions included in each task Match with

In part C of FIG. 15, the state (ON (H level) or OFF (L level)) of the I / O (input / output signal) is displayed. The numbers in [] are predetermined I / O numbers, and the characters following [] indicate the contents of I / O. In addition, the input-output signal contained in C part may show indeterminate.
In the example shown in FIG. 15, I / O of the following contents is shown.

[09] Pen Set: A camera is provided in the working environment of the actual robot R, and is turned on when the camera recognizes the pen tray. When the pen tray is fixed and arranged, it is always on. However, when the pen tray is carried in a line, the camera switches from OFF to ON when it recognizes the pen in the pen tray.
[10] Vision lock on: Indicates a correction timing for correcting the command value for the robot R based on the position of the pen tray recognized by the camera installed in the working environment of the robot R of the actual machine. It turns ON when the correction timing is reached. The correction timing is preset for the task.
[16] Hand 1 grasp ... Turns on when the hand holds the pen. The timing of ON differs depending on the hand sequence.
・ [17] Hand1 release ... It turns ON when the hand releases the pen. When the robot R of the actual machine is turned on during the picking up operation, it can be understood that the user has failed to grasp the object and drops it.

As shown in FIG. 15, in the online timing chart, as in the off-line timing chart of the first embodiment, the period (start time and end time) of each task included in the job of robot R and each task are included. Period of motion (start time and end time) to be known.
In the example of the online timing chart of FIG. 15, the time t3 which is the correction timing of the command value for the robot R is later than the time t2 which is the start time of the motion corresponding to the command value. I understand that

(2-3) Function of Robot Simulator 1A Next, the function of the robot simulator 1A of the present embodiment will be described with reference to FIG. FIG. 16 is a functional block diagram of a robot simulator 1A according to the embodiment.
As shown in FIG. 16, the robot simulator 1A includes a display control unit 101, a task creation unit 102, a program creation unit 103, a program execution unit 104, a state information acquisition unit 106, a simulation unit 107, and an interlock setting unit 108. Prepare. That is, the robot simulator 1A according to the present embodiment differs from the robot simulator 1 according to the first embodiment in that the state information acquisition unit 106 is provided instead of the state information calculation unit 105.

In order to realize the program execution unit 104 of the present embodiment, the control unit 21 of the information processing device 2 recognizes, for example, an operation input to the button b3 of the teaching window W3 (FIG. 8). And transmit the robot program to the robot control apparatus 3A. The control unit 31A of the robot control device 3A executes the received program for a real machine.

The state information acquisition unit 106 generates a control signal for the robot based on the execution result by the program execution unit 104, and robot state data, which is information indicating a state according to the passage of time of the robot operating according to the control signal, It has a function to acquire from a robot.
In the present embodiment, the display control unit 101 determines the state of the robot so that the period corresponding to the task element of the task can be identified on the time axis based on the robot state data obtained by the state information acquisition unit 106. The timing chart (ie, the on-line timing chart) shown is displayed on the display unit 24.

In order to realize the function of the state information acquisition unit 106, as described above, the control unit 31A of the robot control device 3A sequentially executes the program created based on each task, from the information processing device 2 Execute the received robot program. Then, the control unit 31A generates a control signal including a command value for the robot R every time the function included in the robot program is executed, and transmits the control signal to the robot R.
The control device 55 of the robot R controls the motor provided in the manipulator 50 so as to follow the command value received from the robot control device 3A, and transmits robot state data to the robot control device 3A. The robot state data is a physical quantity of the manipulator 50 detected by any of the sensors of the sensor group 56 or an estimated value (for example, a control current value or the like) of the physical quantity of the manipulator 50. The control unit 31A of the robot control device 3A sequentially records the robot state data acquired from the robot R in the storage 32.
The control unit 31A reads robot state data accumulated in the storage 32 every predetermined reference time (for example, 1 ms), and transmits execution log data including robot state data read every predetermined reference time to the information processing apparatus 2 Do.
The control unit 21 of the information processing device 2 records the received execution log data in the execution log database 224. Furthermore, as in the first embodiment, the control unit 21 generates an image including a timing chart (on-line timing chart) of a predetermined format based on robot state data included in the execution log data, and displays the display device 24. Display on The timing chart can make it possible to identify a period corresponding to a specific work element in a series of work of the robot.

As in the first embodiment, in the robot state data, the robot may include plural types of information. In that case, the display control unit 101 displays an online timing chart on the display device 24 based on the information of a part of the robot state data selected from the plurality of types by the operation input of the operator. It is also good.

In the present embodiment, the simulation unit 107 may have a function of operating the three-dimensional model in the virtual space and displaying it on the display device 24 based on the robot state data obtained by the state information acquisition unit 106. At this time, the simulation unit 107 causes the motion of the three-dimensional model to be faster or slower than the speed based on the robot state data, or to make the progress of time reverse. It may be displayed on the display device 24.
In the present embodiment, the control unit 21 of the information processing device 2 causes the display device 24 to operate the three-dimensional model of the robot and the object in the virtual space based on the robot state data for each reference time acquired from the robot R. indicate. By this, the operator can visually confirm the operation of the robot of each task, so the setting value of each task (for example, approach point, departure point, motion parameter, etc.) and the arrangement of the object (for example, FIG. It becomes easy to re-examine the arrangement of the cap tray 12 and the like 3).

In the present embodiment, the process of displaying the online timing chart and reproducing the moving image of the three-dimensional model is substantially in common with the process of the flowchart shown in FIG. 12, but in step S18, robot state data is acquired from the robot R Differs in that they are recorded.

As described above, the robot simulator 1A of this embodiment transmits a command value to the robot based on the execution result of the robot program corresponding to the job, and acquires robot state data from the robot. Then, based on the acquired robot state data, the robot simulator 1A displays the online timing chart so that the period corresponding to the task element of the task can be identified on the time axis. Therefore, when displaying the result of a series of tasks of a real robot, it is possible to identify a period corresponding to a specific task, and to support consideration for each task.

(3) Third Embodiment Next, the third embodiment will be described.
The robot simulator of the present embodiment has the functions of the robot simulator 1 of the first embodiment and the functions of the robot simulator 1A of the second embodiment, and both the off-line timing chart and the on-line timing chart are displayed on the display device 24. indicate. That is, in the present embodiment, the display control unit 101 displays the offline timing chart (example of the second timing chart) and the online timing chart (example of the first timing chart) as the state of the robot in a period equivalent to the task element of the task. Are displayed on the display device 24 so that they can be compared. With this display, it is possible to compare and examine robot state data in the case where the same job is connected to the robot and in the case where the robot is not connected to each other for each work element included in the job.

In the execution log database 224 of the information processing apparatus 2 according to the present embodiment, robot state data (computed robot state data and robots obtained by executing robot programs created for the same job) The acquired robot state data is recorded. Then, the control unit 21 of the information processing device 2 displays the off-line timing chart based on the calculated robot state data and the on-line timing chart based on the robot state data acquired from the robot on the display 24 that can be compared. .

The display mode that makes it possible to compare the offline timing chart and the online timing chart is not limited. For example, the offline timing chart is displayed on the upper side of the display screen, and the online timing chart is displayed on the lower side of the display screen. May be
Preferably, the display control unit 101 displays the off-line timing chart and the on-line timing chart in a switchable manner, or superimposes the off-line timing chart and the on-line timing chart on a common time axis and displays them on the display device 24. . With this display mode, it becomes easy to compare the off-line timing chart and the on-line timing chart.

FIG. 17 shows an example in which the off-line timing chart and the on-line timing chart are superimposed and displayed on a common time axis. In the example shown in FIG. 17, the off-line timing chart shown in FIG. 9 is displayed superimposed on the on-line timing chart shown in FIG. 15 on a common time axis.

FIG. 18 shows an example in which the off-line timing chart and the on-line timing chart are displayed switchably. In the example shown in FIG. 18, at the top, a tab named “Result # 1 (robot not connected)” corresponding to the offline timing chart and a name “Result # 2 (robot connected) corresponding to the online timing chart And tabs are provided switchably. FIG. 18 shows the case where the tab named “Result # 1 (robot not connected)” is selected, and has the same display content as the off-line timing chart of FIG.

(4) Modification Hereinafter, the modification of each embodiment mentioned above is described.

(4-1) Modified Example 1
The display control unit 101 may display an off-line timing chart or an on-line timing chart on the display device 24 so that the states of robots in different work elements can be compared. Thereby, it is possible to compare the state of the robot among different work elements among the plurality of work elements included in the robot's job.
In order to realize the present modification, for example, the control unit 21 of the information processing device 2 controls the information processing device 2 based on the operation input of the operator who selects two tasks among the plurality of tasks included in the job. The unit 21 creates a timing chart in which the periods of the two selected tasks are configured in parallel. Preferably, the timing chart is created such that the start times of the selected two task periods coincide.

(4-2) Modification 2
The simulation unit 107 operates the three-dimensional model based on robot state data in a partial period designated based on the operator's operation input among the periods displayed in the off-line timing chart or the on-line timing chart. It may be displayed on the display device 24. As a result, it is possible to confirm the operation of the robot in the period that the operator wants to focus on during the entire period of the job.
In order to realize the present modified example, the offline timing chart or the online timing chart is provided with a button b4 (an operation button for operating the robot and the object at a normal speed) as illustrated in FIG. The control unit 21 of the information processing device 2 reproduces the moving image corresponding to the off-line timing chart or the on-line timing chart based on the operation input of the button b4. At this time, by operating the cursors CU1 to CU3 provided on the timing chart, it is possible to designate a period to be a reproduction target of a moving image as a part of the periods displayed on the timing chart.

(4-3) Modification 3
In the second embodiment, the display control unit 101 may display the on-line timing chart on the display device 24 so that the states of the robots in different execution results can be compared even with the same work element. Thereby, it is possible to grasp the variation of the state of the robot when trying the same task a plurality of times. In order to realize the present modification, the control unit 21 of the information processing device 2 plots and plots a plurality of robot state data acquired by executing the robot program a plurality of times such that the start times of jobs coincide with each other. Create a timing chart.

As mentioned above, although several embodiment of the robot simulator of this invention was explained in full detail, this invention is not limited to said each embodiment. Further, various modifications and changes can be made to the embodiment described above without departing from the spirit of the present invention. For example, the technical matters referred to for each embodiment may be combined as appropriate between different embodiments as long as no technical contradiction arises.

In the first and second embodiments described above, the information processing device 2 may provide useful information based on robot state data acquired from the robot control device 3.
For example, by providing information obtained by statistically processing the movement distance and the number of movements between work elements in a job, it is possible to support consideration of the location, direction, etc. of supply and / or discharge of an object in a line.
Also, the time ratio between the operation time of the robot in the job and the waiting time may be calculated and presented. As a result, it is possible to support consideration of improvement of the work order in the job or slowing down of unnecessary high speed operation.

The robot simulator according to the embodiment described above does not have to have all the functions described in the functional block diagram of FIG. 11 or FIG. 16, and may have at least a part of the functions.
In the embodiment described above, the robot simulator is illustrated as including the two devices of the information processing device and the robot control device, but the invention is not limited thereto, and may be configured as an integrated device.
In the embodiment described above, the case where the input device of the information processing apparatus includes the pointing device has been described, but the present invention is not limited thereto, and another device may be used. For example, a display panel provided with a touch input function may be used to receive touch input by an operator.
In the embodiment described above, an example in which the task list included in the job is created based on the hierarchical list has been described, but it is not limited thereto. As long as multiple work elements included in the job are identified, it is not necessary to define the tasks included in the job based on the hierarchical list.

Based on the above description, a program for causing a computer to implement at least a part of the functions described in the functional block diagrams of FIG. 11 and FIG. 16, and a computer readable storage medium (nonvolatile It is understood by those skilled in the art that the storage medium of the above is also disclosed.

1, 1A: robot simulator, 2: information processing device, 21: control unit, 22: storage, 23: input device, 24: display device, 25: communication interface unit, 3, 3A: robot control device, 31, 31A: Control unit 32: Storage 33: Communication interface unit 11: Pen tray P: pen group 12: cap tray C: cap group 13: jig 15: product tray A1 to A12: product EC Communication network cable, WC: cable, R: robot, 50: manipulator, 51: arm, 52: hand, 55: control device, 56: sensor group, 57: input / output unit, 61 to 68, node: 101, display control Unit 102: task creation unit 103: program creation unit 104: program execution unit 105: state information calculation unit 106: state Information acquisition unit 107: simulation unit 108: interlock setting unit 221: task database 222: hierarchical list database 223: three-dimensional model database 224: execution log database RA: robot area PA: target object Area, W1 to W6: Window, b1 to b8: button, AP: approach point, TP: target point, DP: departure point, T: table

Claims

A program execution unit that executes a robot program including a task that is information on work elements of the robot;
A state in which a control signal for the robot is generated based on an execution result by the program execution unit, and state information which is information indicating a state according to the elapsed time of the robot operated by the control signal is acquired from the robot Information acquisition unit,
Based on the state information obtained by the state information obtaining unit, a first timing chart indicating the state of the robot is displayed on a display device such that a period corresponding to a task element of the task can be identified on the time axis. A display control unit to be displayed,
, A robot simulator.
A storage unit storing information of a three-dimensional model of the robot in a virtual space;
A simulation unit that operates the three-dimensional model and displays it on the display device based on the state information obtained by the state information obtaining unit;
The robot simulator according to claim 1, further comprising:
The system further includes a state information calculation unit that calculates state information that is information indicating the state of the robot according to the passage of time based on the execution result by the program execution unit.
The display control unit is configured to indicate a state of the robot such that a period corresponding to a work element of the task can be identified on a time axis based on the state information obtained by the state information calculation unit. Display a timing chart on the display device,
A robot simulator according to claim 1 or 2.
The display control unit displays the first timing chart and the second timing chart on the display device so that the state of the robot in a period corresponding to the work element of the task can be compared.
The robot simulator according to claim 3.
The display control unit displays the first timing chart and the second timing chart in a switchable manner, or displays the first timing chart and the second timing chart so as to overlap on a common time axis. Do,
The robot simulator according to claim 4.
The display control unit may compare the states of the robot in different work elements, or may compare the states of the robot in different execution results even with the same work element. Displaying the first timing chart on the display device;
A robot simulator according to claim 1.
The state information includes information of a plurality of types of robots.
The display control unit displays the first timing chart on the display device based on information of a part of the plurality of types selected from the plurality of types in the state information. A robot simulator according to claim 1 or 6.
The robot simulator according to any one of claims 1 to 6, wherein the state information includes the state of an input / output signal of the robot.
The simulation unit operates the three-dimensional model based on the state information in a partial period designated based on an operator's operation input among the periods displayed in the first timing chart. The robot simulator according to claim 2, displayed on a display device.
The simulation unit performs the display such that the operation of the three-dimensional model is faster or slower than the speed based on the state information, or the time progression is in the reverse direction. The robot simulator according to claim 2, displayed on a device.