US20240019874A1 - Flight path specification device and computer readable storage medium - Google Patents

Flight path specification device and computer readable storage medium Download PDF

Info

Publication number
US20240019874A1
US20240019874A1 US18/252,190 US202118252190A US2024019874A1 US 20240019874 A1 US20240019874 A1 US 20240019874A1 US 202118252190 A US202118252190 A US 202118252190A US 2024019874 A1 US2024019874 A1 US 2024019874A1
Authority
US
United States
Prior art keywords
flight path
industrial machine
unmanned aircraft
unit
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US18/252,190
Other languages
English (en)
Inventor
Takashi Miyoshi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fanuc Corp
Original Assignee
Fanuc Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fanuc Corp filed Critical Fanuc Corp
Assigned to FANUC CORPORATION reassignment FANUC CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MIYOSHI, TAKASHI
Publication of US20240019874A1 publication Critical patent/US20240019874A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/18Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form
    • G05B19/406Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form characterised by monitoring or safety
    • G05B19/4061Avoiding collision or forbidden zones
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/18Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form
    • G05B19/4097Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form characterised by using design data to control NC machines, e.g. CAD/CAM

Definitions

  • the present invention relates to a flight path specification device and a computer readable storage medium.
  • An object of the present invention is to provide a flight path specification device and a computer readable storage medium that can reliably prevent interference between an unmanned aircraft and an industrial machine.
  • a flight path specification device includes: a space information generation unit configured to, based on model data on a structure of an industrial machine and an operating state of the industrial machine, generate non-interference space information indicating a non-interference space in which the industrial machine and an unmanned aircraft do not interfere with each other; a command accepting unit configured to accept an operation command for the unmanned aircraft; and a path information generation unit configured to, based on the non-interference space information and the operation command, generate flight path information that specifies a flight path for the unmanned aircraft.
  • a computer readable storage medium stores an instruction for causing a computer to execute: based on model data on a structure of an industrial machine and an operating state of the industrial machine, generating non-interference space information indicating a non-interference space in which the industrial machine and an unmanned aircraft do not interfere with each other; accepting an operation command for the unmanned aircraft; and based on the non-interference space information and the operation command, generating flight path information that specifies a flight path of the unmanned aircraft.
  • FIG. 1 is a diagram illustrating an example of an overall unmanned aircraft control system.
  • FIG. 2 is a diagram illustrating an example of a hardware configuration of a flight path specification device.
  • FIG. 3 is a diagram illustrating an example of a hardware configuration of an unmanned aircraft.
  • FIG. 4 is a diagram illustrating an example of a hardware configuration of an industrial machine.
  • FIG. 5 is a diagram illustrating an example of functions of the flight path specification device.
  • FIG. 6 is a diagram illustrating an example of a three-dimensional model of an industrial machine.
  • FIG. 7 is a diagram illustrating an example of a non-interference space.
  • FIG. 8 is a diagram illustrating of an example of information stored in a command information storage unit.
  • FIG. 9 is a diagram illustrating an example of a flight path.
  • FIG. 10 is a diagram illustrating an example of a non-interference space.
  • FIG. 11 is a diagram illustrating an example of a non-interference space.
  • FIG. 12 is a diagram illustrating an example of functions of an unmanned aircraft.
  • FIG. 13 is a diagram illustrating an example of functions of a numerical controller.
  • FIG. 14 is a flowchart illustrating an example of a process performed in the flight path specification device.
  • FIG. 1 is a diagram illustrating an example of an overall unmanned aircraft control system.
  • An unmanned aircraft control system 1 has a flight path specification device 2 , an unmanned aircraft 3 , and an industrial machine 4 .
  • the flight path specification device 2 is a device that specifies a flight path of the unmanned aircraft 3 .
  • the flight path specification device 2 is implemented in a personal computer (PC) or a server.
  • the flight path is a path along which the unmanned aircraft 3 flies near the industrial machine 4 and inside the industrial machine 4 .
  • the unmanned aircraft 3 is a small unmanned aircraft of a multi-copter type.
  • the unmanned aircraft 3 is called a drone.
  • the unmanned aircraft 3 flies near the industrial machine 4 and inside the industrial machine 4 along a flight path specified by the flight path specification device 2 . This enables the unmanned aircraft control system 1 to perform inspection on the industrial machine 4 or an operation applied to the industrial machine 4 .
  • the industrial machine 4 is a device that is installed inside a factory and performs various operations.
  • the industrial machine 4 is a machine tool, for example.
  • FIG. 2 is a diagram illustrating an example of the hardware configuration of the flight path specification device 2 .
  • the flight path specification device 2 has a central processing unit (CPU) 20 , a bus 21 , a read only memory (ROM) 22 , a random access memory (RAM) 23 , and a nonvolatile memory 24 .
  • CPU central processing unit
  • ROM read only memory
  • RAM random access memory
  • nonvolatile memory 24 nonvolatile memory
  • the CPU 20 is a processor that controls the overall flight path specification device 2 in accordance with a system program.
  • the CPU 20 reads the system program or the like stored in the ROM 22 via the bus 21 .
  • the bus 21 is a communication path that connects respective pieces of hardware within the flight path specification device 2 to each other.
  • the respective pieces of hardware within the flight path specification device 2 exchange data via the bus 21 .
  • the ROM 22 is a storage device that stores a system program or the like used for controlling the overall flight path specification device 2 .
  • the system program includes a flight path specification program that specifies a flight path of the unmanned aircraft 3 .
  • the RAM 23 is a storage device that temporarily stores various data.
  • the RAM 23 temporarily stores data or the like on an operation command for the unmanned aircraft 3 that is input externally.
  • the RAM 23 functions as a working area where the CPU 20 processes various data.
  • the nonvolatile memory 24 is a storage device that retains data even in a state where the flight path specification device 2 is powered off and the flight path specification device 2 is no longer supplied with power.
  • the nonvolatile memory 24 includes a solid state drive (SSD), for example.
  • the flight path specification device 2 further has a first interface, a display device 26 , a second interface 27 , an input device 28 , and a communication device 29 .
  • the first interface 25 connects the bus 21 and the display device 26 to each other.
  • the first interface 25 transmits various data processed by the CPU 20 to the display device 26 .
  • the display device 26 receives various data via the first interface 25 and displays the various data.
  • the display device 26 is a display such as a liquid crystal display (LCD).
  • the second interface 27 connects the bus 21 and the input device 28 to each other. For example, the second interface 27 transmits data, which is input from the input device 28 , to the CPU 20 via the bus 21 .
  • the input device 28 is a device for inputting various data.
  • the input device 28 receives input of data and transmits the input data to the nonvolatile memory 24 via the second interface 27 .
  • the input device 28 is a keyboard and a mouse, for example.
  • the input device 28 and the display device 26 may be configured as a single device such as a touch panel, for example.
  • the communication device 29 is a device that performs wireless communication with the unmanned aircraft 3 .
  • the communication device 29 performs communication by using a wireless LAN or Bluetooth, for example.
  • the communication device 29 is a device that communicates with the industrial machine 4 by wire or wirelessly.
  • the communication device 29 communicates with the industrial machine 4 by using the Internet line, for example.
  • FIG. 3 is a diagram illustrating an example of the hardware configuration of the unmanned aircraft 3 .
  • the unmanned aircraft 3 has a battery 30 , a processor 31 , a bus 32 , a memory 33 , a motor control circuit 34 , a motor 35 , a sensor 36 , and a communication device 37 .
  • the battery 30 supplies power to each part of the unmanned aircraft 3 .
  • the battery 30 is a lithium-ion battery, for example.
  • the processor 31 controls the overall unmanned aircraft 3 in accordance with a control program.
  • the processor 31 functions as a flight controller, for example.
  • the processor 31 is a CPU, for example.
  • the bus 32 is a communication path that connects respective pieces of hardware within the unmanned aircraft 3 to each other.
  • the respective pieces of hardware within the unmanned aircraft 3 exchange data via the bus 32 .
  • the memory 33 is a storage device that stores various programs, data, and the like.
  • the memory 33 stores a control program used for controlling the overall unmanned aircraft 3 .
  • the memory 33 is at least any one of a ROM, a RAM, and an SSD.
  • the motor control circuit 34 is a circuit for controlling the motor 35 .
  • the motor control circuit 34 drives and controls the motor 35 in response to receiving a control command from the processor 31 .
  • the motor 35 is controlled by the motor control circuit 34 .
  • the motor 35 rotates a propeller fixed to a rotary shaft. Note that, although FIG. 3 depicts a single motor 35 , the unmanned aircraft 3 has four motors 35 , for example, and the motor control circuit 34 controls rotation of each of the motors 35 to fly the unmanned aircraft 3 .
  • the sensor 36 is a device that detects various state of the industrial machine 4 .
  • the sensor 36 is an image sensor, for example.
  • the sensor 36 captures a display image on the display device 26 of the industrial machine 4 to detect the operating state of the industrial machine 4 .
  • the sensor 36 includes a ranging sensor, for example.
  • the sensor 36 measures the distance to a mark provided on a predetermined location on the industrial machine 4 .
  • the ranging sensor may be a ranging sensor using infrared rays, radio waves, or ultrasonic waves, for example.
  • the sensor 36 may include an electronic compass, for example. The electronic compass senses the earth magnetism and acquires the direction in which the unmanned aircraft 3 is directed. Further, the sensor 36 may include an acceleration sensor, an angular velocity sensor, or the like.
  • the communication device 37 communicates with the flight path specification device 2 through wireless communication. As described above, the communication device 37 performs communication by using a wireless LAN or Bluetooth, for example.
  • FIG. 4 is a diagram illustrating an example of the hardware configuration of the industrial machine 4 .
  • the industrial machine 4 has a numerical controller 5 , a communication device 6 , a servo amplifier 7 , a servo motor 8 , and an auxiliary device 9 .
  • the numerical controller 5 is a device that controls the overall industrial machine 4 .
  • the numerical controller 5 includes a CPU 50 , a bus 51 , a ROM 52 , a RAM 53 , and a nonvolatile memory 54 .
  • the CPU 50 is a processor that controls the overall numerical controller 5 in accordance with a system program.
  • the CPU 50 reads a system program or the like stored in the ROM 52 via the bus 51 . Further, the CPU 50 controls the servo motor 8 and a spindle motor (not illustrated) in accordance with a machining program to machine a workpiece.
  • the bus 51 is a communication path that connects respective pieces of hardware within the numerical controller 5 to each other.
  • the respective pieces of hardware within the numerical controller 5 exchange data via the bus 51 .
  • the ROM 52 is a storage device that stores a system program or the like used for controlling the overall numerical controller 5 .
  • the RAM 53 is a storage device that temporarily stores various data.
  • the RAM 53 functions as a working area where the CPU 50 processes various data.
  • the nonvolatile memory 54 is a storage device that retains data even in a state where the industrial machine 4 is powered off and the numerical controller 5 is no longer supplied with power.
  • the nonvolatile memory 54 includes a solid state drive (SSD), for example.
  • the numerical controller 5 further includes an interface 55 , an axis control circuit 56 , a programmable logic controller (PLC) 57 , and an I/O unit 58 .
  • PLC programmable logic controller
  • the interface 55 is a communication path that connects the bus 51 and the communication device 6 to each other. For example, the interface 55 transmits, to the CPU 50 , various data received by the communication device 6 .
  • the communication device 6 communicates with the flight path specification device 2 . As described above, the communication device 6 communicates with the flight path specification device 2 by using the Internet line, for example.
  • the axis control circuit 56 is a circuit that controls the servo motor 8 .
  • the axis control circuit 56 outputs a command for driving the servo motor 8 to the servo amplifier in response to receiving a control command from the CPU 50 .
  • the axis control circuit 56 transmits a torque command that controls the torque of the servo motor 8 to the servo amplifier 7 .
  • the servo amplifier 7 supplies power to the servo motor 8 in response to receiving a command from the axis control circuit 56 .
  • the servo motor 8 is driven in response to receiving power supply from the servo amplifier 7 .
  • the servo motor 8 is coupled to a ball screw that drives a tool post, a spindle head, or a table, for example.
  • the structure of a machine tool such as a tool post, a spindle head, or a table is then moved in an X-axis direction, a Y-axis direction, or a Z-axis direction, for example.
  • the PLC 57 is a device that executes a ladder program to control the auxiliary device 9 .
  • the PLC 57 controls the auxiliary device 9 via the I/O unit 58 .
  • the I/O unit 58 is an interface that connects the PLC 57 and the auxiliary device 9 to each other.
  • the I/O unit 58 transmits a command received from the PLC 57 to the auxiliary device 9 .
  • the auxiliary device 9 is installed to the industrial machine 4 and performs auxiliary operations when the industrial machine 4 performs machining on a workpiece.
  • the auxiliary device 9 may be a device installed around the industrial machine 4 .
  • the auxiliary device 9 may be, for example, a tool changer, a cutting fluid ejection device, or an open/close door driving device.
  • FIG. 5 is a block diagram illustrating an example of the function of each unit of the flight path specification device 2 .
  • the flight path specification device 2 includes a model acquisition unit 201 , a model data storage unit 202 , an operating state acquisition unit 203 , a space information generation unit 204 , a command accepting unit 205 , a command information storage unit 206 , a path information generation unit 207 , a path information output unit 208 , a control information generation unit 209 , and a control information output unit 210 .
  • the model acquisition unit 201 , the operating state acquisition unit 203 , the space information generation unit 204 , the command accepting unit 205 , the path information generation unit 207 , the path information output unit 208 , the control information generation unit 209 , and the control information output unit 210 are realized by the CPU 20 performing arithmetic processing using a system program stored in the ROM 22 and various data, for example. Further, the model data storage unit 202 and the command information storage unit 206 are realized by data input from the input device or the like or a calculation result of arithmetic processing by the CPU 20 being stored in the RAM 23 or the nonvolatile memory 24 , for example.
  • the model acquisition unit 201 acquires model data indicating a three-dimensional model of a structure of the industrial machine 4 from the numerical controller 5 .
  • the structure of the industrial machine 4 may be, for example, a spindle, a spindle head, a table, a splash guard, an open/close door, and various covers. Further, the structure of the industrial machine 4 includes a tool, a workpiece, a jig, or the like.
  • the model data is three-dimensional computer aided design (CAD) data, for example.
  • the model acquisition unit 201 may acquire model data indicating a three-dimensional model from a management server or the like that manage a plurality of industrial machines 4 .
  • FIG. 6 is a diagram illustrating an example of a three-dimensional model of structures of the industrial machine 4 .
  • the three-dimensional model is a model used for simulating interference among each structure, a tool, and a workpiece in the industrial machine 4 , for example.
  • FIG. 6 illustrates a three-dimensional model of an open/close door 401 , a turret 402 , a spindle 403 , a tool 404 , a table 405 , a splash guard 406 , a telescopic cover 407 , a workpiece 408 , a jig 409 , and the like.
  • the model data storage unit 202 stores model data on the industrial machine 4 acquired by the model acquisition unit 201 .
  • model data storage unit 202 stores model data indicating a three-dimensional model of the unmanned aircraft 3 .
  • This model data is a three-dimensional CAD data, for example.
  • the model data indicating the three-dimensional model of the unmanned aircraft 3 is acquired from an external server or the like by the communication device 29 , for example.
  • the three-dimensional model of the unmanned aircraft 3 may be simplified. For example, a cylindrical shape model may be used as the model of the unmanned aircraft 3 .
  • the operating state acquisition unit 203 acquires information indicating the operating state of the industrial machine 4 from the numerical controller 5 .
  • the information indicating the operating state may be, for example, information indicating an open/closed state of a door, information indicating an ON/OFF state of a cutting fluid, information about the tool 404 attached to the spindle 403 , or information indicating a position of each structure.
  • the operating state acquisition unit 203 may acquire the operating state of the industrial machine 4 from a machining program executed by the numerical controller 5 .
  • the space information generation unit 204 generates non-interference space information indicating a non-interference space in which the industrial machine 4 and the unmanned aircraft 3 do not interfere with each other based on model data of a structure of the industrial machine 4 , model data of the unmanned aircraft 3 , and the operating state of the industrial machine 4 .
  • the non-interference space is a space in which the unmanned aircraft 3 can fly without colliding with the industrial machine 4 near the industrial machine 4 or inside the industrial machine 4 .
  • FIG. 7 is a diagram illustrating an example of the non-interference space.
  • the non-interference space is defined by a plurality of surfaces separated by a predetermined distance from outer surfaces of each structure of the industrial machine 4 , the tool 404 , and the workpiece 408 .
  • the space between the structure depicted by the two-dot chain line and the surface depicted by the solid line is the interference spaces, and the remaining space is the non-interference space.
  • the distance from a structure or the like to a position to define the non-interference space is determined by taking into consideration a factor such as a degree of accuracy at which the unmanned aircraft 3 can be controlled, for example.
  • the non-interference space may be defined so as not to include a space where a cutting fluid may be scattered. For example, when a cutting fluid is being ejected from a nozzle or the like, a pre-defined space may be excluded from the non-interference space.
  • the command accepting unit 205 accepts an operation command for an operation to be performed by the unmanned aircraft 3 .
  • the operation command is a command for an inspection operation to inspect the industrial machine 4 or a command for a transport operation to transport the workpiece 408 .
  • the inspection operation is, for example, an operation to capture an image of a monitor or the like displaying the temperature of a cutting fluid or an operation to capture an image of an edge of the tool 404 .
  • the transport operation for the workpiece 408 is, for example, an operation in which the unmanned aircraft 3 installs the workpiece 408 on the table 405 by using a workpiece holder that attracts the workpiece 408 by electromagnetic force.
  • the command information storage unit 206 stores information in which an operation command to the unmanned aircraft 3 and a coordinate value of an operation position of an operation performed by the unmanned aircraft 3 are associated with each other, for example.
  • the operation command is a command that specifies an operation to be performed by the unmanned aircraft 3 .
  • the operation position is a flight position when the unmanned aircraft 3 performs an operation in accordance with an operation command.
  • FIG. 8 is a diagram illustrating an example of information stored in the command information storage unit 206 .
  • the command information storage unit 206 stores operation commands and operation positions in association with each other.
  • the command information storage unit 206 stores “Image capturing of thermometer”, which is an operation command, and a coordinate value (X1, Y1, Z1), which represents an operation position, in association with each other.
  • the command information storage unit 206 stores “Image capturing of tool edge”, which is an operation command, and a coordinate value (X2, Y2, Z2), which represents an operation position, in association with each other. Further, the command information storage unit 206 stores “Installation of workpiece”, which is an operation command, and a coordinate value (X3, Y3, Z3), which represents an operation position, in association with each other.
  • the path information generation unit 207 generates flight path information that specifies a flight path of the unmanned aircraft 3 .
  • the path information generation unit 207 specifies an operation position at which the unmanned aircraft 3 performs an operation based on an operation command accepted by the command accepting unit 205 and information stored in the command information storage unit 206 . Further, the path information generation unit 207 specifies a flight path to an operation position in the non-interference space based on non-interference space information generated by the space information generation unit 204 and an operation position. Accordingly, flight path information is generated.
  • the path information generation unit 207 when the command accepting unit 205 accepts an operation command indicating “Image capturing of tool edge”, the path information generation unit 207 generates flight path information that specifies a flight path from the current location of the unmanned aircraft 3 to an operation position based on the non-interference space information and the coordinate value (X2, Y2, Z2).
  • the path information generation unit 207 generates flight path information by using a search algorithm to search for the shortest path to the operation position indicated by the coordinate value (X2, Y2, Z2) in the non-interference space, for example.
  • FIG. 9 is a diagram illustrating a flight path when “Image capturing of tool edge” is instructed as an operation command.
  • the flight path FP is the shortest path for the unmanned aircraft 3 to reach the operation position indicated by the coordinate value (X2, Y2, Z2).
  • the path information generation unit 207 cancels the generation of flight path information.
  • a case where no flight path information can be generated is a case where, in the non-interference space, no flight path FP can be specified along which the unmanned aircraft 3 reaches an operation position without colliding with any structure of the industrial machine 4 or the like.
  • the path information output unit 208 outputs flight path information generated by the path information generation unit 207 .
  • the path information output unit 208 transmits flight path information to the unmanned aircraft 3 by using a communication device, for example.
  • the control information generation unit 209 generates control information on the industrial machine 4 . As described above, when the path information generation unit 207 cancels generation of flight path information, the control information generation unit 209 generates control information used for moving a structure of the industrial machine 4 .
  • control information generation unit 209 when the unmanned aircraft 3 is unable to approach the tool 404 because a large workpiece 408 is installed on the table 405 , the control information generation unit 209 generates control information used for moving the table 405 of the industrial machine 4 along the Y-axis direction.
  • the control information output unit 210 outputs control information generated by the control information generation unit 209 .
  • the control information output unit 210 transmits control information to the numerical controller 5 by using a communication device, for example.
  • the numerical controller 5 ensures the flight path FP of the unmanned aircraft 3 by moving the table 405 , for example, as illustrated in FIG. 11 . That is, the flight path specification device 2 indirectly controls the motion of a structure of the industrial machine 4 by using the control information generation unit 209 and the control information output unit 210 .
  • the operating state acquisition unit 203 may again acquire information indicating the operating state of the industrial machine 4 .
  • the space information generation unit 204 can generate non-interference space information again, and the path information generation unit 207 can generate flight path information.
  • control information generation unit 209 may generate control information used for prohibiting the operation of the industrial machine 4 . Further, when flight path information is output by the path information output unit 208 , the control information generation unit 209 may generate control information used for prohibiting motion of a structure.
  • FIG. 12 is a block diagram illustrating an example of the function of each unit of the unmanned aircraft 3 .
  • the unmanned aircraft 3 has a communication unit 301 , a flight position specification unit 302 , and a flight control unit 303 .
  • the communication unit 301 communicates with the flight path specification device 2 .
  • the communication unit 301 acquires flight path information from the flight path specification device 2 , for example.
  • the flight position specification unit 302 specifies the flight position of the unmanned aircraft 3 .
  • the flight position specification unit 302 uses the sensor 36 to detect marks provided inside a factory and provided on the industrial machine 4 and thereby specifies the flight position and the orientation of the unmanned aircraft 3 .
  • the flight position specification unit 302 may specify the flight position of the unmanned aircraft 3 by using GPS.
  • the unmanned aircraft 3 may be detected by a sensor installed inside a factory or installed to the industrial machine 4 , and the flight position specification unit 302 may calculate the position and the orientation of the unmanned aircraft 3 based on detection information received from the sensor. Alternatively, these methods may be combined to specify the position of the unmanned aircraft 3 .
  • the flight control unit 303 performs flight control on the unmanned aircraft 3 based on flight path information acquired by the communication unit 301 and position information on the unmanned aircraft 3 specified by the flight position specification unit 302 .
  • the flight control unit 303 performs flight control by controlling the rotation speed of each motor.
  • the flight control unit 303 causes the unmanned aircraft 3 to fly along the flight path FP indicated by flight path information. Further, the flight control unit 303 may perform feedback control by using information indicating the flight position of the unmanned aircraft 3 specified by the flight position specification unit 302 .
  • FIG. 13 is a block diagram illustrating an example of the function of each unit of the numerical controller 5 .
  • the numerical controller 5 includes a communication unit 510 , a storage unit 511 , and a control unit 512 .
  • the communication unit 510 communicates with the flight path specification device 2 .
  • the communication unit 510 receives control information output from the control information output unit 210 of the flight path specification device 2 . Further, the communication unit 510 transmits information indicating the operating state of the industrial machine 4 to the flight path specification device 2 .
  • the storage unit 511 stores a system program used for controlling the overall numerical controller 5 , a machining program, or information about tool offset, for example. Further, the storage unit 511 stores model data indicating the three-dimensional model of structures of the industrial machine 4 . The model data stored in the storage unit 511 is transmitted to the flight path specification device 2 by the communication unit 510 .
  • the control unit 512 controls the overall industrial machine 4 .
  • the control unit 512 performs machining on the workpiece 408 in accordance with a machining program, for example. Further, the control unit 512 moves a structure of the industrial machine 4 based on control information received by the communication unit 510 .
  • the control unit 512 performs control to move the spindle head in the Z-axis direction, for example. Further, the control unit 512 performs control to move the table 405 in the X-axis direction and the Y-axis direction. Further, the control unit 512 controls ejection and stop of the ejection of a cutting fluid or opening and closing of the open/close door 401 .
  • FIG. 14 is a flowchart illustrating an example of a process performed in the flight path specification device 2 .
  • the model acquisition unit 201 acquires, from the industrial machine 4 , model data indicating a three-dimensional model of the industrial machine 4 (step S 1 ).
  • the model data storage unit 202 stores the model data acquired by the model acquisition unit 201 (step S 2 ).
  • the operating state acquisition unit 203 acquires information indicating the operating state of the industrial machine 4 from the numerical controller 5 (step S 3 ).
  • the space information generation unit 204 generates non-interference space information indicating a non-interference space based on the model data on structures of the industrial machine 4 , the model data on the unmanned aircraft 3 , and the operating state of the industrial machine 4 (step S 4 ).
  • the command accepting unit 205 accepts an operation command for an operation to be performed by the unmanned aircraft 3 (step S 5 ).
  • the path information generation unit 207 generates flight path information that specifies the flight path FP of the unmanned aircraft 3 (step S 6 ).
  • the path information output unit 208 outputs the flight path information (step S 8 ), and the process ends.
  • control information generation unit 209 If the generation of the flight path information is cancelled by the path information generation unit 207 (step S 7 , Yes), the control information generation unit 209 generates control information on the industrial machine 4 (step S 9 ).
  • control information output unit 210 outputs the control information generated by the control information generation unit 209 (step S 10 ), and the process ends.
  • the operating state acquisition unit 203 may again acquire, from the industrial machine 4 , information indicating the latest operating state of the industrial machine 4 . That is, the flight path specification device 2 may return to the process of step S 3 after performing the process of step S 10 .
  • the flight path specification device 2 includes: the space information generation unit 204 that, based on model data on a structure of the industrial machine 4 and an operating state of the industrial machine 4 , generates non-interference space information indicating a non-interference space in which the industrial machine 4 and the unmanned aircraft 3 do not interfere with each other; the command accepting unit 205 that accepts an operation command for the unmanned aircraft 3 ; and the path information generation unit 207 that, based on the non-interference space information and the operation command, generates flight path information that specifies a flight path FP for the unmanned aircraft 3 .
  • the space information generation unit 204 that, based on model data on a structure of the industrial machine 4 and an operating state of the industrial machine 4 , generates non-interference space information indicating a non-interference space in which the industrial machine 4 and the unmanned aircraft 3 do not interfere with each other
  • the command accepting unit 205 that accepts an operation command for the unmanned aircraft 3
  • the path information generation unit 207 that, based on the non-inter
  • the flight path specification device 2 further includes the model acquisition unit 201 that acquires the model data from the industrial machine 4 .
  • the model acquisition unit 201 that acquires the model data from the industrial machine 4 .
  • the flight path specification device 2 further includes the path information output unit 208 that outputs the flight path information to the unmanned aircraft 3 .
  • the operator is not required to perform an operation of inputting flight path information generated by the flight path specification device 2 to the unmanned aircraft 3 via a storage medium or the like. As a result, the workload of the operator can be reduced.
  • the flight path specification device 2 includes the control information generation unit 209 that generates control information on the industrial machine 4 .
  • the control information generation unit 209 that generates control information on the industrial machine 4 .
  • control information generated by the control information generation unit 209 includes control information used for prohibiting the operation of the industrial machine 4 .
  • control information generated by the control information generation unit 209 includes control information used for prohibiting motion of the structure.
  • flight path specification device 2 is implemented in a PC, a server, or the like in the embodiment described above, the flight path specification device 2 may be implemented in the numerical controller 5 of the industrial machine 4 .
  • the industrial machine 4 may be an industrial robot such as a manipulator.
  • the space information generation unit 204 generates non-interference space information indicating a non-interference space based on model data on structures of the industrial machine 4 , model data on the unmanned aircraft 3 , and the operating state of the industrial machine 4 .
  • the space information generation unit 204 may generate non-interference space information indicating a non-interference space based on model data on structures of the industrial machine 4 and the operating state of the industrial machine 4 .
  • the operating state acquisition unit 203 may acquire a machining program from the numerical controller 5 .
  • the space information generation unit 204 may analyze the motion of a structure of the industrial machine 4 , a scattering condition of the cutting fluid, or the like to generate non-interference space information on the industrial machine 4 which is in operation. This enables the unmanned aircraft 3 to perform a predetermined operation without causing collision between the unmanned aircraft 3 and the industrial machine 4 even when the industrial machine 4 is in operation.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Manufacturing & Machinery (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Numerical Control (AREA)
US18/252,190 2020-11-20 2021-11-16 Flight path specification device and computer readable storage medium Pending US20240019874A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2020193371 2020-11-20
JP2020-193371 2020-11-20
PCT/JP2021/042131 WO2022107774A1 (ja) 2020-11-20 2021-11-16 飛行経路特定装置、およびコンピュータ読取可能な記憶媒体

Publications (1)

Publication Number Publication Date
US20240019874A1 true US20240019874A1 (en) 2024-01-18

Family

ID=81708002

Family Applications (1)

Application Number Title Priority Date Filing Date
US18/252,190 Pending US20240019874A1 (en) 2020-11-20 2021-11-16 Flight path specification device and computer readable storage medium

Country Status (5)

Country Link
US (1) US20240019874A1 (ja)
JP (1) JP7525640B2 (ja)
CN (1) CN116438498A (ja)
DE (1) DE112021004743T5 (ja)
WO (1) WO2022107774A1 (ja)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115586794A (zh) * 2022-10-10 2023-01-10 福建省电力有限公司泉州电力技能研究院 一种变电站无人机抗电磁干扰巡视方法及终端

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5035768B2 (ja) * 2006-04-18 2012-09-26 独立行政法人産業技術総合研究所 人間ロボット共存作業用安全装置
JP6997578B2 (ja) 2016-10-12 2022-01-17 株式会社ゼンリン 制御システム
JP7173746B2 (ja) 2018-03-30 2022-11-16 日立造船株式会社 飛行体、情報記録方法、飛行体の制御方法、および制御プログラム
JP6816077B2 (ja) * 2018-09-14 2021-01-20 ファナック株式会社 誘導情報提示装置、誘導情報提示サーバ、誘導情報提示システム、誘導情報提示方法及びプログラム
JP2020119122A (ja) * 2019-01-22 2020-08-06 三菱電機株式会社 ワーク搬送装置
JP7272825B2 (ja) 2019-03-06 2023-05-12 ファナック株式会社 ロボットシステム
JP6918044B2 (ja) 2019-03-28 2021-08-11 Kddi株式会社 ロボット制御装置及びロボット制御方法

Also Published As

Publication number Publication date
WO2022107774A1 (ja) 2022-05-27
CN116438498A (zh) 2023-07-14
JP7525640B2 (ja) 2024-07-30
JPWO2022107774A1 (ja) 2022-05-27
DE112021004743T5 (de) 2023-08-10

Similar Documents

Publication Publication Date Title
US10286551B2 (en) Robot system that controls robot including multiple mechanical units, the mechanical units, and robot control device
US11396099B2 (en) Safe operation of machinery using potential occupancy envelopes
EP2047955B1 (en) Robot operating range setting device
EP4116033A1 (en) Machine tool, machine tool control method, and machine tool control program
EP3385494A1 (en) Apparatus and method for controlling boom of mine vehicle
US20240019874A1 (en) Flight path specification device and computer readable storage medium
US20220234209A1 (en) Safe operation of machinery using potential occupancy envelopes
CN107229253B (zh) 容易实施干扰检测后的对策的数值控制装置
JP6709315B1 (ja) 工作機械
JP7488365B2 (ja) 搬送システム制御装置、およびコンピュータ読み取り可能な記憶媒体
US20230409053A1 (en) Flight command generation device and computer-readable storage medium
CN117177846A (zh) 设定安全参数的装置、示教装置以及方法
US20190391565A1 (en) Numerical controller
US20230185272A1 (en) Program analyzer and control system
Rizia et al. Autonomous aerial flight path inspection using advanced manufacturing techniques
WO2022264338A1 (ja) 制御装置、干渉チェック装置、及び制御システム
WO2022107760A1 (ja) 数値制御装置、及び記憶媒体
WO2023136138A1 (ja) 工作機械、工作機械の制御方法、および工作機械の制御プログラム
WO2022050292A1 (ja) 表示装置
WO2022107758A1 (ja) 無人飛行機制御装置、及び記憶媒体
Ferreira et al. Autonomous Navigation System for a Differential Drive Mobile Robot
WO2022215476A1 (ja) 情報処理装置および情報処理プログラム
CN118103782A (zh) 加工面推定装置以及计算机可读取的存储介质

Legal Events

Date Code Title Description
AS Assignment

Owner name: FANUC CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MIYOSHI, TAKASHI;REEL/FRAME:063572/0013

Effective date: 20230329

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION