WO2019000854A1

WO2019000854A1 - Wave compensation salvage robot system

Info

Publication number: WO2019000854A1
Application number: PCT/CN2017/116476
Authority: WO
Inventors: 卢道华; 陈文君; 王佳; 韩彬
Original assignee: 江苏科技大学; 江苏科技大学海洋装备研究院
Priority date: 2017-03-28
Filing date: 2017-12-15
Publication date: 2019-01-03
Also published as: CN107186752B; CN107186752A

Abstract

A wave compensation salvage robot system, installed on a ship and comprising: a mechanical arm mechanism (1), an inertial navigation sensor (2), a motion controller (3), a computer and a visual detector (4). Compared with an ordinary robot, the wave compensation salvage robot has a larger working space, is convenient to move, and can be conveniently stored in a cabin and an anti-corrosion shell by means of a transverse guide rail and a longitudinal guide rail. In this way, the service life of the robot system is prolonged, and the robot system can be maintained more conveniently. The wave compensation salvage robot system adopts a tandem-mode mechanism, and thus forward position kinematics is obtained more easily, and the accuracy is higher compared with a traditional parallel wave compensation platform. The wave compensation salvage robot system can effectively replace a traditional wave compensation device which is single in function, the whole compensation system is simpler in structure, more convenient in operation and higher in working efficiency; and operation can be conducted on a deck for workpiece salvage in the ship marching process.

Description

Wave compensation salvage robot system

Technical field

The invention relates to the field of salvage of marine vessels, in particular to a wave compensation salvage robot system.

Background technique

China is a large maritime country with a vast sea area under its jurisdiction. The potential for the exploitation and utilization of marine resources is great. With the accelerated development of the marine industry and the promotion of the development of the marine economy, offshore platforms or ships are increasingly engaged in offshore operations due to wind and waves. Affected, ships working at sea will have irregular swings when salvaging, and the difficulty of salvage will increase, which may even lead to the interruption of salvage of the ship and the safety of the workers. Then the impact of the ship's roll, pitch and roll on the salvage caused by the waves will be a key and difficult problem to solve.

At present, most of the marine fishing devices are manually operated crane cable fishing devices. The existing fishing device installs the crane on the deck of the ship and carries out the salvage operation at sea by manually lifting the cable. During the salvage process, the ship will continue to do the swinging motion due to the influence of wind and waves. The personnel will continue to compensate for the lifting and lowering of the cable, and the accuracy and efficiency of the target will be low. At the same time, the target of the sea will continue to change relative to the position. Due to the artificial observation of the operation cable, there will be a certain delay, which will seriously affect the accuracy of the workpiece position and quickly and effectively salvage the workpiece.

A wave compensating robot as described in Chinese Patent No. 201610617770.X, having an arm, a wrist mechanism, an end effector driver and an end effector, the front end of the arm is connected to the rear end of the wrist mechanism, and the front end of the wrist mechanism is rigidly connected to the end actuator driver. End The actuator driver is connected to the end actuator, and the wrist mechanism in the initial position is parallel to the ship deck, and the front end of the wrist mechanism is directed to the front of the bow. The feature is that the rear end of the wrist mechanism includes the first and second drives, and the front end includes a front end. The differential mechanism and the two support arms are in the middle of the support frame, the support frame is fixed to the front end of the arm, the middle position of the support frame is fixedly coupled to the drive frame, and the first and second drives are oppositely arranged on the left and right sides of the drive frame. And the drive frame is connected in common, the central axes of the first and second drivers are horizontally arranged; the front side of the support frame is fixed to two support arms arranged one left and one right, and the two support arms are differential mechanisms; The differential mechanism is composed of four bevel gears, one yaw axis and two pitching active shafts, and the yaw axis is vertically arranged vertically. The center lines of the first and second pitching active shafts are collinear, perpendicular to the center line of the yaw axis and one left One right is symmetrically arranged on both sides of the yaw axis, one end of the first and second pitching active shafts are rotatably connected to the differential mechanism supporting block, and the other end is supported on the same side of the supporting arm a coaxial gap of the middle portion of the yaw axis passes through a central hole of the differential support block, and a third bevel gear is coaxially connected through the bearing on the upper portion of the yaw axis, and the first bevel gear is coaxially fixedly connected to the lower portion of the yaw axis; a second bevel gear and a first pulley fixed to each other by a coaxial fixing sleeve on a pitching main shaft, and a fourth bevel gear and a third pulley fixed to each other by a coaxial fixing sleeve on the second pitching driving shaft The first bevel gear meshes with the second bevel gear and the fourth bevel gear, and the third bevel gear is meshed with the second bevel gear and the fourth bevel gear; the output shaft of the first drive is coaxially fixedly connected to the fourth a pulley, the output shaft of the second driver is coaxially fixedly connected to the second pulley, the first pulley is connected to the second pulley through the first toothed belt, and the third pulley is connected to the fourth pulley through the second toothed belt; The bevel gear is secured to the end effector drive by a connector.

The above patent uses a pulley-type transmission structure, resulting in a complicated transmission mechanism and a working space. The gap is small, the maintenance is troublesome and the service life is low, and the transmission performance of the wheeled type is poor;

In view of the above salvage problem, the present invention designs a wave compensation salvage robot system.

Summary of the invention

The technical problem to be solved by the present invention is to provide a wave compensation salvage robot system, which has the functions of wave compensation and automatic identification, and can perform real-time compensation for the roll, pitch and roll of the ship caused by wind waves to ensure that the end effector does not follow The sea wind and waves affect the serious shaking and can automatically capture the exact position of the moving objects on the sea to complete the efficient, accurate and reliable completion of the salvage mission.

In order to solve the above technical problem, the technical solution of the present invention is: a wave compensation salvage robot system installed on a ship; the innovations are: including a robot arm mechanism, an inertial navigation sensor, a motion controller, Computer and visual detectors;

The mechanical arm mechanism comprises a base, a longitudinal rail, a transverse rail and a mechanical arm; the longitudinal rail and the transverse rail are perpendicular to each other and disposed on a same horizontal plane, and the base can be along a mutually perpendicular transverse rail by a motion controller Reciprocating movement with the longitudinal rail; the mechanical arm is fixedly coupled to the base by a bolt set, the mechanical arm follows the base to move along the transverse rail or the longitudinal rail; the mechanical arm is driven by the servo motor;

The inertial navigation sensor is located on the side of the robot arm and is fixedly connected to the base to measure data transformation caused by wind and waves in real time and send the tested data to the computer;

The computer performs data exchange with an inertial navigation sensor, a motion controller, and a visual detector, respectively; the computer processes and processes data output by the inertial sensor and models, predicts, and outputs data; the computer transmits to the motion controller Instruction The computer processes the transmission data of the visual detector;

One end of the motion controller exchanges data with a computer, and the other end of the motion controller is connected with a servo motor of the robot arm and controls the mechanical arm to perform a compensation motion;

The vision processor includes a first camera and a second camera; the first camera and the second camera are respectively mounted on the robot arm mechanism.

The working method of the system is:

S1: First, the vision processor collects an image of the workpiece to be salvaged, and compares the obtained image of the workpiece to be salvaged according to the template image of the calibration, and searches for a feature graphic matching the template, and the feature graphic is extracted by the computer to reflect the actuator and The pose deviation information of the workpiece is transformed according to the mapping relationship between the coordinate system of the first camera and the second camera and the coordinate system of the robot arm, and the coordinates of the workpiece in the coordinate system of the robot arm are obtained, and the motion of the robot arm is obtained by the characteristic error of the image. The position increment is transmitted to the servo motor of the robot arm to determine the rotation speed and steering of the servo motor, and the path of the robot arm path is calculated according to the coordinates of the workpiece with the fishing;

S1: according to the coordinate data collected by the first camera and the second camera, the inertial navigation sensor and the mechanical arm are moved to the working position by the driving motor through the lateral rail and the longitudinal rail;

S2: using the inertial navigation sensor to detect the change of the ship due to wind and waves in real time to detect the roll, pitch and roll motion parameters of the ship, and input the data into the computer, and provide a prediction algorithm to the computer;

S3: The data transmitted by the inertial navigation sensor is subjected to filtering preprocessing and data normalization processing in a computer, and a model is established. The computer predicts the wave condition according to the established model and the data detected by the inertial sensor; the computer according to the predicted wave condition Determining the target point of the wave The position coordinates under the action of the wave are compared with the actual target point coordinates to calculate the compensation data;

S4: The computer transmits the compensation data to the motion controller, and the motion controller gives a control signal according to the displacement and speed change rate of the ship, and transmits the control signal to the robot arm servo driver, and the servo driver according to the control signal The size determines the speed and steering of the servo motor, and the servo motor drives the robot arm to complete the wave compensation function;

S5: The inertial navigation sensor continuously feeds back the detected parameters such as the actual displacement and speed of the ship to the computer, and the computer processes and feeds back to the motion controller. The motion controller calculates the next cycle according to the magnitude of the change rate of the displacement and the speed. Control the size of the signal and pass it to the robotic servo drive for the next cycle of control;

S6: The servo motor drives the robot arm according to the wave compensation data and the visual processing data, and the salvage task of the workpiece to be salvaged.

The inertial navigation sensor can detect roll, pitch, sway, sway, sway, heave, and sway, sway, and heave velocity data in real time and send it to a computer for processing.

The model is established in the S3 by calculating the autocorrelation function acf and the partial correlation function pacf by the computer after the zero-average and smoothing processing of the data transmitted by the inertial sensor, and determining the AR model according to the function curve, according to the determined AR model. The computer recognizes the model parameters for continuous prediction of the ship.

The advantages of the invention are:

1) Compared with the ordinary robot, the robot in the device of the invention has a larger working space through the lateral rail and the longitudinal rail, is convenient to move, and is convenient to be stored in the cabin and the corrosion-resistant casing. This increases its service life and makes it easier to maintain.

2) The mechanism of the invention is a series-connected mechanism, and it is easier to obtain a positive position solution and a higher precision than a conventional parallel wave compensation platform.

3) The device and the control method of the invention can effectively replace the traditional wave compensation device with single function, so that the structure of the whole compensation system is simpler, the operation is more convenient, and the work efficiency is higher. During the course of the ship's travel, it is also possible to work on the deck to salvage the items.

DRAWINGS

The present invention will be further described in detail below in conjunction with the drawings and specific embodiments.

1 is a schematic view showing the overall structure of a wave compensation robot system of the present invention.

2 is a structural diagram of a visual processor of the present invention.

Figure 3 is a flow chart of the control system of the present invention.

Figure 4 is a diagram showing the control structure of the present invention.

Detailed ways

The following examples are intended to provide a fuller understanding of the invention, and are not intended to limit the invention.

A wave compensating salvage robot system as shown in FIGS. 1 to 4, the wave compensating salvage robot system being mounted on a ship; comprising a robot arm mechanism 1, an inertial sensor 2, a motion controller 3, a computer and a visual detector 4 .

The robot arm mechanism includes a base 11, a longitudinal rail, a lateral rail and a mechanical arm 12; the longitudinal rail and the transverse rail are perpendicular to each other and disposed on the same horizontal plane, and the base 11 is horizontally perpendicular to each other by a motion controller The rail and the longitudinal rail reciprocate; the robot arm 12 is fixedly coupled to the base 11 by a bolt set, and the robot arm 12 follows the base 11 to move along the transverse rail or the longitudinal rail; the robot arm 12 is driven by a servo motor.

The inertial sensor 2 is located on the side of the robot arm 12 and is fixedly attached to the base 11, and measures data conversion due to wind and waves in real time and transmits the tested data to the computer.

The computer exchanges data with the inertial navigation sensor 2, the motion controller 3, and the visual detector 4, respectively; the computer processes and processes the data output by the inertial sensor 2 and models, predicts, and outputs data; The processor 3 sends an instruction; the computer processes the transmission data of the visual detector 4.

One end of the motion controller 3 exchanges data with a computer, and the other end of the motion controller 3 is connected to the servo motor of the robot arm 12 and controls the robot arm 12 to perform a compensation motion.

The vision processor 4 includes a first camera 41 and a second camera 42; the first camera 41 and the second camera 42 are mounted on the robot arm mechanism 1, respectively.

The working method of the compensation salvage robot system is:

Step 1: The vision processor 4 collects the workpiece image, and performs calibration on the workpiece through computer calculation to determine the mapping relationship between the workpiece feature model and the position coordinates of the workpiece in the vision processor 4 and the robot arm 12. Specifically, the calibration plate is first provided, and the calibration plate has the same characteristic pattern as the workpiece to be salvaged, that is, the size of the calibration plate is the same as the workpiece to be salvaged, and the image capturing search range of the salvage workpiece is determined. After that, the position of the calibration plate in the arm mechanism 1 is determined by the installation positioning. Next, the starter arm 12 drives the first camera 41 and the second camera 42 to collect the calibration plate information, and creates a feature template according to the acquired image. The template contains parameters such as the position and shape of the feature graphic. Finally, according to the characteristic pattern on the calibration plate, the coordinate parameters of the robot arm 12 and the corresponding feature patterns in the coordinate system of the first camera 41 and the second camera 42 determine the coordinate system of the binocular camera and the coordinate system of the robot arm. The mapping relationship between.

Step 2: Determine the position of the workpiece characteristic pattern by the wave compensation system and the calculation to determine that the robot arm and the workpiece are in a relatively static state. The inertial sensor 2 is mounted on the base 11 of the robot. The so-called inertial sensor 2 can provide three-dimensional motion parameters such as acceleration and angular velocity of the carrier, and obtain important information such as the position and posture of the carrier based on the above parameters. The attitude reference system uses the acceleration sensor, the gyroscope and the electronic compass to measure the motion parameters and azimuth of the carrier. By processing and calculating the measured values, real-time tracking and monitoring of the position and motion state of the carrier is realized. The inertial measurement unit utilizes an acceleration sensor and a gyroscope to measure the acceleration and angular velocity of the carrier to obtain the motion and state of the carrier under the inertial reference frame.

The inertial navigation sensor 2 detects the roll, pitch and roll motion parameters of the ship, and transmits the data to the motion controller 3. The motion controller 3 processes the digital signal according to the displacement and speed change rate of the ship. The analog signal is obtained by the D/A converter, and the analog signal is transmitted to the mechanical arm servo driver in the form of a pulse. The servo driver determines the rotation speed and steering of the servo motor according to the magnitude of the pulse signal, and the servo motor drives the mechanical arm to complete the wave compensation function; At the same time, the detection system continuously feeds back the measured parameters such as the actual displacement and speed of the ship to the motion controller, and the motion controller calculates the size of the next cycle control signal according to the magnitude of the change rate of the displacement and the velocity, and Passed to the robotic servo drive for the next cycle of control.

At the same time, the first camera 41 and the second camera 42 collect an image of the workpiece, and find a feature image matching the feature template in the obtained workpiece image, and obtain a workpiece image by acquiring images of the camera, and the image is a two-dimensional image. , the calibration template image obtained before the comparison is performed, and the collected workpiece feature image is searched for, and the feature image is calculated. The computer extracts the pose deviation information reflecting the actuator and the workpiece. The information is called the image feature error. The robot motion position increment is obtained by the characteristic error of the image, and is transmitted to the robot controller, and the robot controller transmits the signal to the robot controller. The servo arm servo drive determines the rotation speed and steering of the servo motor according to the size of the control signal, and the servo motor drives the robot arm 12 to complete the motion increment to achieve the relative static state of the robot arm 12 and the workpiece. Specifically, the positions of the feature images of the workpieces in the coordinate systems of the first camera 41 and the second camera 42 are respectively calculated; according to the previously obtained coordinate systems of the first camera 41 and the second camera 42 and the coordinate system of the robot arm The mapping relationship performs coordinate transformation, and the position of the feature image of the workpiece is converted from the coordinates in the coordinate system of the first camera 41 and the second camera 42 to the coordinates in the coordinate system of the robot arm 12.

Step 3: In a state where the robot arm 12 and the workpiece are relatively stationary, the image captured by the camera is processed by a computer to obtain a feature pattern of the workpiece matched with the feature template. Specifically, an image of the workpiece is acquired by the first camera 41 and the second camera 42 to obtain two images of the workpiece, which is a two-dimensional image, that is, a planar image. Then, through the feature template previously obtained by the computer, the feature image is searched on the acquired workpiece image, and the feature graphic of the workpiece matching the feature model in the image is obtained.

Step 4: The camera captures the image and determines the position of the workpiece by using the calibration parameter by the computer. Specifically, the computer calculates the position of the two feature patterns of the workpiece in the coordinate system of the first camera 41 and the second camera 42 respectively according to the previously obtained The mapping relationship between the coordinate system of the first camera 41 and the second camera 42 and the robot arm coordinate system is converted, and the positions of the two feature patterns of the workpiece are converted from the coordinates in the coordinate system of the first camera 41 and the second camera 42 to Coordinates within the robot arm coordinate system to determine the workpiece The coordinate position in the robot arm coordinate system.

Step 5: The workpiece and the robot arm are in a relatively static position. According to the robot arm path planning algorithm, the most reasonable path planning is calculated. Specifically, the robot arm generates the most reasonable planning path according to the positional (X, Y, Z) coordinate parameter of the workpiece to be grasped according to a preset algorithm of the robot arm, and the setting algorithm may be various suitable types in the field. Algorithm.

Step 6: Complete the salvage task accurately and efficiently according to the planning path. Specifically, the robot arm 12 calculates the motion compensation data of each servo motor of the robot arm 12 according to the generated planning path, and thereby automatically and accurately transmits the actuator to the workpiece position to perform the grabbing. After the capture operation is completed, the controller records the information data of the compensation and capture process and saves it.

It should be understood by those skilled in the art that the present invention is not limited by the foregoing embodiments, and that the present invention is only described in the foregoing description and the description of the present invention, without departing from the spirit and scope of the invention. Various changes and modifications are intended to be included within the scope of the invention as claimed. The scope of the invention is defined by the appended claims and their equivalents.

Claims

A wave compensation salvage robot system installed on a ship; characterized by comprising: a mechanical arm mechanism, an inertial navigation sensor, a motion controller, a computer and a visual detector;

The mechanical arm mechanism comprises a base, a longitudinal rail, a transverse rail and a mechanical arm; the longitudinal rail and the transverse rail are perpendicular to each other and disposed on a same horizontal plane, and the base can be along a mutually perpendicular transverse rail by a motion controller Reciprocating movement with the longitudinal rail; the mechanical arm is fixedly coupled to the base by a bolt set, the mechanical arm follows the base to move along the transverse rail or the longitudinal rail; the mechanical arm is driven by the servo motor;

The inertial navigation sensor is located on the side of the robot arm and is fixedly connected to the base to measure data transformation caused by wind and waves in real time and send the tested data to the computer;

The computer performs data exchange with an inertial navigation sensor, a motion controller, and a visual detector, respectively; the computer processes and processes data output by the inertial sensor and models, predicts, and outputs data; the computer transmits to the motion controller An instruction to process the transmission data of the visual detector;

One end of the motion controller exchanges data with a computer, and the other end of the motion controller is connected with a servo motor of the robot arm and controls the mechanical arm to perform a compensation motion;

The vision processor includes a first camera and a second camera; the first camera and the second camera are respectively mounted on the robot arm mechanism.
A wave compensating salvage robot system according to claim 1, wherein the working method of the system is:

S1: First, the visual processor collects an image of the workpiece to be salvaged, and the obtained workpiece to be salvaged The image is compared according to the calibrated template graphic, and the feature graphic matching the template is searched for, and the feature graphic is extracted by the computer to reflect the posture deviation information of the actuator and the workpiece, according to the coordinate system and the mechanical system of the first camera and the second camera. The mapping relationship of the arm coordinate system is transformed to obtain the coordinates of the workpiece in the coordinate system of the robot arm. The movement position increment of the arm is obtained by the characteristic error of the image, and is transmitted to the servo motor of the arm to determine the rotation speed of the servo motor. And steering, calculating the path of the robot arm path according to the coordinates of the salvage workpiece;

S1: according to the coordinate data collected by the first camera and the second camera, the inertial navigation sensor and the mechanical arm are moved to the working position by the driving motor through the lateral rail and the longitudinal rail;

S2: using the inertial navigation sensor to detect the change of the ship due to wind and waves in real time to detect the roll, pitch and roll motion parameters of the ship, and input the data into the computer, and provide a prediction algorithm to the computer;

S3: The data transmitted by the inertial navigation sensor is subjected to filtering preprocessing and data normalization processing in a computer, and a model is established. The computer predicts the wave condition according to the established model and the data detected by the inertial sensor; the computer according to the predicted wave condition Determining the position coordinates of the target point under the action of the wave, and comparing with the actual target point coordinates to calculate the compensation data;

S4: The computer transmits the compensation data to the motion controller, and the motion controller gives a control signal according to the displacement and speed change rate of the ship, and transmits the control signal to the robot arm servo driver, and the servo driver according to the control signal The size determines the speed and steering of the servo motor, and the servo motor drives the robot arm to complete the wave compensation function;

S5: The inertial sensor continuously feeds back the detected parameters such as the actual displacement and speed of the ship. To the computer, the computer processes and feeds back to the motion controller. The motion controller calculates the size of the next cycle control signal according to the magnitude of the rate of change of the displacement and the velocity, and transmits it to the robot arm servo driver for the next cycle. control;

S6: The servo motor drives the robot arm according to the wave compensation data and the visual processing data, and the salvage task of the workpiece to be salvaged.
A wave compensating salvage robot system according to claim 1, wherein said inertial navigation sensor can detect roll, pitch, sway, sway, sway, heave, and sway and cross in real time. Swing and swaying speed data is sent to the computer for processing.
A wave compensating salvage robot system according to claim 2, wherein the model is established in the S3 by calculating the autocorrelation function acf and the computer by zero-average and smoothing processing of the data transmitted by the inertial sensor. The partial correlation function pacf, based on the AR model determined by the function curve, continuously predicts the ship by computer recognition of the model parameters according to the determined AR model.