CN215160705U - Autonomous mobile forklift - Google Patents
Autonomous mobile forklift Download PDFInfo
- Publication number
- CN215160705U CN215160705U CN202121278507.5U CN202121278507U CN215160705U CN 215160705 U CN215160705 U CN 215160705U CN 202121278507 U CN202121278507 U CN 202121278507U CN 215160705 U CN215160705 U CN 215160705U
- Authority
- CN
- China
- Prior art keywords
- target object
- autonomous mobile
- image
- forklift
- mobile forklift
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
- Forklifts And Lifting Vehicles (AREA)
Abstract
The utility model provides an autonomic mobile fork truck. Wherein, autonomic removal fork truck includes: a vehicle body including a vehicle body and a fork tooth portion provided on one side of the vehicle body; the image acquisition unit is arranged on the vehicle main body and is used for acquiring a first image of a target object; the controller is electrically connected with the image acquisition unit and is used for acquiring the first image acquired by the image acquisition unit; determining target information related to the pose of the target object according to the first image; adjusting the pose of the autonomous mobile forklift according to the target information so that the fork tooth parts are aligned with the butt joint part at the bottom of the target object; and after the pose of the autonomous mobile forklift is adjusted, controlling the autonomous mobile forklift to move towards the target object in the adjusted posture so as to enable the fork tooth part to be in butt joint with the butt joint part at the bottom of the target object. The utility model provides a technical scheme, autonomic mobile fork truck can realize with the accurate butt joint of target object, and simple structure, and is with low costs.
Description
Technical Field
The utility model relates to an automatic handling technical field especially relates to an autonomic mobile fork truck.
Background
Currently, an Automated Guided Vehicle (AGV) is widely used in the field of automatic transport due to its characteristics of high automation degree and high intelligence level. The automatic moving forklift is used as an AGV and has a fork tooth characteristic, the automatic moving forklift is mainly used for carrying empty goods shelves in a factory site or goods shelves with objects, a certain height gap is usually reserved between the bottom of each goods shelf and the ground, so that goods shelves can be conveniently entered and lifted by a fork, and the butt joint problem of the fork tooth and the goods shelves is involved before the fork tooth enters the bottom of each goods shelf. If the butt joint is not accurate, the fork tines may collide with the goods shelf, or the fork tines may be askew after entering the bottom of the goods shelf, so that the goods shelf may be deflected or toppled in the process of being carried. Therefore, how to improve the accuracy of the butt joint of the autonomous mobile forklift and the goods shelf is particularly important.
SUMMERY OF THE UTILITY MODEL
The present application provides an autonomous mobile forklift that addresses the above problems, or at least partially addresses the above problems.
An embodiment in the present application provides an autonomous mobile forklift. This autonomic mobile fork truck includes:
the vehicle body comprises a vehicle main body and fork tooth parts arranged on one side of the vehicle main body;
the image acquisition unit is arranged on the vehicle main body and is used for acquiring a first image of a target object;
the controller is electrically connected with the image acquisition unit and is used for acquiring the first image through the image acquisition equipment; determining target information related to the pose of the target object according to the first image; adjusting the pose of the autonomous mobile forklift according to the target information so that the fork tooth parts are aligned with the butt joint part at the bottom of the target object; and after the pose of the autonomous mobile forklift is adjusted, controlling the autonomous mobile forklift to move towards the target object in the adjusted posture so as to enable the fork tooth part to be in butt joint with the butt joint part at the bottom of the target object.
Optionally, the forktooth portion is disposed at a first side of the vehicle body; the image acquisition device is arranged on the first side surface of the vehicle main body.
Optionally, the top of the vehicle body is provided with the image acquisition unit fixedly facing the side where the fork tooth parts are located; or the top of the vehicle main body is provided with a rotating mechanism, one end of the rotating mechanism is connected with the top of the vehicle main body, and the other end of the rotating mechanism is provided with the image acquisition unit; the controller is also electrically connected with the rotating mechanism and used for controlling the rotating mechanism to rotate along a set direction so as to enable the image acquisition unit to face the side where the fork tooth part is located.
Optionally, the autonomous mobile forklift further comprises: a sensor disposed on the tine portion; the controller is electrically connected with the sensor and is used for acquiring first detection data which are detected by the sensor and related to the target object; determining target information related to the pose of the target object according to the first image and the first detection data.
Optionally, the sensor is disposed at a distal end of the tine portion away from the vehicle body.
Optionally, the sensor is a ranging sensor.
In the technical scheme provided by the embodiment of the application, the autonomous mobile forklift comprises a forklift body, an image acquisition unit and a controller; the vehicle body comprises a vehicle main body and a fork tooth part, and the image acquisition unit is arranged on the vehicle main body and used for acquiring first image data of a target object; the controller is connected with the image acquisition unit and used for acquiring the first image through the image acquisition equipment; determining target information related to the pose of the target object according to the first image; adjusting the pose of the autonomous mobile forklift according to the target information so that the fork tooth parts are aligned with the butt joint part at the bottom of the target object; and after the pose of the autonomous mobile forklift is adjusted, controlling the autonomous mobile forklift to move towards the target object in the adjusted posture so as to enable the fork tooth part to be in butt joint with the butt joint part at the bottom of the target object. The automatic moving forklift in the scheme can realize accurate butt joint with a target object, and is simple in structure and low in cost.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required to be utilized in the description of the embodiments or the prior art are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained according to the drawings without creative efforts for those skilled in the art.
Fig. 1 is a schematic flowchart of a docking method of an autonomous mobile forklift according to an embodiment of the present application;
fig. 2a is a schematic diagram of a process of docking an autonomous mobile forklift with a target object according to an embodiment of the present application;
fig. 2b is a schematic diagram of a process of docking an autonomous mobile forklift with a target object according to another embodiment of the present application;
fig. 3a is a schematic diagram of a process of docking an autonomous mobile forklift with a target object according to another embodiment of the present application;
fig. 3b is a schematic diagram illustrating a process of docking an autonomous mobile forklift with a target object according to another embodiment of the present application;
fig. 4 is a schematic diagram illustrating a principle of adjusting the pose of an autonomous mobile forklift according to an embodiment of the present application;
fig. 5 is a schematic flow chart of a docking method of an autonomous mobile forklift according to another embodiment of the present application;
fig. 6 is a schematic view illustrating the autonomous mobile forklift moving to a preset docking position in the docking portion of the bottom of the target object according to an embodiment of the present application;
fig. 7 is a bottom view of the autonomous mobile forklift according to an embodiment of the present application, with the tines of the autonomous mobile forklift entering the bottom of the target object.
Detailed Description
At present, the method for carrying the goods shelf by adopting the AGV has become a mainstream trend, but in the process of butting the AGV and the goods shelf, the butting precision between the AGV and the goods shelf directly influences the success rate of butting; moreover, the movable goods shelf has high randomness, so that the AGV is required to judge the placing posture of the goods shelf and correct the position and the posture of the AGV so as to carry out accurate butt joint.
Typically, the AGV is required to move to a designated location to dock with the rack before the AGV completes docking with the rack. According to different types of AGVs, the docking modes comprise a plurality of modes, for example, an AGV with a manipulator acquires objects from a shelf; or, the submerged AGV is submerged at the bottom of the goods shelf and lifts the goods shelf to carry the goods shelf; or the AGV with the connecting structure drags the goods shelf with the goods shelf through the connecting structure; further alternatively, an AGV having a fork arm structure (i.e., an autonomous mobile forklift) is configured to insert a fork into a butt portion of a rack bottom and lift the rack for transportation; the abutting part of the bottom of the shelf refers to a certain height space formed between the bottom of the shelf and a plane (such as the ground) on which the shelf is placed. Aiming at the butt joint mode that the fork teeth are inserted into the butt joint part at the bottom of the goods shelf of the autonomous mobile forklift and the goods shelf is jacked, in order to realize the accurate butt joint of the autonomous mobile forklift and the goods shelf, the fork teeth are required to be ensured to be positioned in the middle of the butt joint part when entering the butt joint part at the bottom of the goods shelf. If the fork tines are displaced from the middle of the butt portion of the pallet bottom portion in the position of the pallet bottom portion, the autonomous mobile forklift may be inclined or toppled due to unstable center of gravity when lifting and carrying the pallet. Based on the problems, the application scheme provides a docking method of an autonomous mobile forklift and the autonomous mobile forklift.
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
In some of the flows described in the specification, claims, and above-described figures of the present application, a number of operations are included that occur in a particular order, which operations may be performed out of order or in parallel as they occur herein. The sequence numbers of the operations, e.g., 101, 102, etc., are used merely to distinguish between the various operations, and do not represent any order of execution per se. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different. In the present application, the term "or/and" is only one kind of association relationship describing the associated object, and means that three relationships may exist, for example: a or/and B, which means that A can exist independently, A and B can exist simultaneously, and B can exist independently; the "/" character in this application generally indicates that the objects associated with each other are in an "or" relationship. In addition, the embodiments described below are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Fig. 1 shows a flow chart of a docking method of an autonomous mobile forklift truck according to an embodiment of the present application, which can be applied to the autonomous mobile forklift truck 1 shown in fig. 2a, fig. 2b, fig. 3a, fig. 3b, and fig. 6, and is implemented by a controller in the autonomous mobile forklift truck 1. The controller may be a Central Processing Unit (CPU), a single chip, etc., and is not limited herein. The autonomous mobile forklift 1 may include a vehicle body and an image pickup unit 20 provided on the vehicle body. The image capturing unit may be used to capture image data, and the vehicle body may include a vehicle body 11 and a fork 12 disposed on one side of the vehicle body. Wherein the tine portions 12 may be used to interface with a target object (e.g., a shelf) for the handling of objects. Further, the autonomous mobile forklift may also include a memory, a travel component, and the like; the memory may be a RAM (Random Access memory), a Flash (Flash memory), etc., and may be used to store received data (such as image data and radar data), data required by the processing procedure, data generated by the processing procedure, etc. For the specific structural functions of the autonomous mobile forklift 1, reference is made to the following related contents, which are not described in detail herein. As shown in fig. 1, the method may include the steps of:
101. acquiring a first image of a target object acquired by the image acquisition unit;
102. determining target information related to a pose of the target object based on the first image;
103. adjusting the pose of the autonomous mobile forklift according to the target information so that the fork tooth parts are aligned with the butt joint part at the bottom of the target object;
104. and after the pose adjustment of the autonomous mobile forklift is completed, controlling the autonomous mobile forklift to move towards the target object in the adjusted posture so as to enable the fork tooth part to be in butt joint with the butt joint part of the target object.
In the above 101, the target object may be a shelf for carrying an object, such as the shelf 2 shown in fig. 2a, 2b, 3a, 3b and 6. Referring to fig. 2a, the pallet has a bearing plane 21 and a support leg 22, and the support leg 22 supports the bearing plane, so that the bottom of the bearing plane and a working plane (such as the ground) form a certain height gap, which can be called a docking space (or docking portion), and the fork of the autonomous mobile forklift can enter the docking portion to dock with the pallet, so as to lift the pallet by the fork for convenient transportation. Before the fork teeth of the autonomous mobile forklift enter the butt joint part, the autonomous mobile forklift automatically moves towards the goods shelf waiting for butt joint according to a preset route on a working plane, but because various factors influencing the moving accuracy exist in the moving process, when the autonomous mobile forklift moves to the goods shelf, the fork teeth of the autonomous mobile forklift cannot be in standard butt joint with the goods shelf, so that the fork teeth of the autonomous mobile forklift cannot be located at the middle position of the butt joint part at the bottom of the goods shelf when entering the bottom of the goods shelf easily. In view of the above problem, referring to fig. 2a, 2b, 3a or 3b, in the present embodiment, when the autonomous mobile forklift 1 is moving toward a target object (e.g., the rack 2) waiting for docking, the controller may control the image capturing unit 20 provided on the body 11 of the autonomous mobile forklift 1 to capture an image toward the rack 2, and recognize the image captured by the image capturing unit 20 to determine whether the captured image contains the target object, and when it is determined that the captured image contains the target object, the captured image may be determined as the first image of the rack 2. Based on this, that is, in an achievable technical solution, the step 101 "acquiring the first image of the target object acquired by the image acquisition unit" may specifically include:
acquiring an acquired image of the image acquisition unit;
performing image recognition on the acquired image to determine whether the acquired image contains the target object;
and when the acquired image contains the target object, determining the acquired image as the first image.
In specific implementation, the image acquired by the image acquisition unit can be identified and analyzed by adopting the existing image identification technology, and when the acquired image is determined to contain the target object according to the identification result, the acquired image is taken as the first image of the target object, so that the target information related to the pose of the goods shelf 2 is determined based on the first image, the butt joint of the self-moving forklift and the target object is controlled according to the target information, and the following related contents can be referred to for how to butt joint.
In a specific implementation, the image capturing unit 20 may be disposed on a first side or a top of the vehicle body 11. The first side may refer to a side connected to the prong portion 12, and the prong portion 12 may be a double prong arm structure as shown in fig. 2a and 2b, or may be a single prong arm structure as shown in fig. 3a and 3b, which is not limited in this embodiment.
In the direction of travel of the autonomous mobile forklift, as indicated by the lateral arrows shown in fig. 2a, 2b, 3a or 3b, the various orientations around the vehicle body 11 can be distinguished: front side, back side, left side, right side; accordingly, for convenience of description, the side of the vehicle body 11 may include, in the above orientation; front side, back side, left side and right side. Based on this, the first side may specifically refer to a front side of the vehicle body, i.e., the tine part and the image pickup unit may be provided to the front side of the vehicle body 11. In addition, or the image capturing unit may be disposed at other positions of the vehicle main body 11, such as the top of the vehicle main body 11, which is not limited in this embodiment.
In a practical implementation, the image capturing unit 20 may be fixedly disposed at a preset position on a first side or a top of the vehicle body, and may be disposed at a preset pitch angle and a preset yaw angle. Specifically, for the convenience of subsequent calculation, the image capturing unit 20 may be fixedly disposed at an intersection line position of the first side surface of the vehicle body 11 and a second perpendicular surface passing through the central axis of the tine portion 12; alternatively, the image pickup unit 20 may be fixedly disposed at an intersection of the top of the vehicle body 11 and a second vertical plane passing through the center axis of the crotch portion 12. For example, referring to fig. 2a, the intersection line of the front side surface of the main body 11 and the second vertical plane S passing through the center axis of the crotch portion 12 is l1At the intersection line l1An image acquisition unit 20 is arranged at the position A, and the image acquisition unit at the position A is arrangedThe pickup orientation of 20 is the front side direction of the vehicle body 11. When the image capturing unit 20 is fixedly installed, the installation height of the image capturing unit 20 is fixed. After the installation parameters of the image capturing unit 20 are fixed, it is simple to subsequently determine target information such as the pose of the target object, whether the fork teeth of the autonomous moving forklift move to the preset docking position in the docking portion at the bottom of the target object, and the like based on the image related to the target object captured by the image capturing unit 20. A method of determining the target information related to the pose of the target object and whether the tine portions of the autonomous moving forklift move to the preset docking position in the docking portion at the bottom of the target object will be described in detail later, and details thereof will not be described herein.
In another realizable technical scheme, a rotating mechanism is arranged at the top of the vehicle main body 11, one end of the rotating mechanism is connected with the top of the vehicle main body, and an image acquisition unit 20 is arranged at the other end of the rotating mechanism; the rotating mechanism can rotate in a set direction (e.g., clockwise or counterclockwise) to rotate the image capturing unit 20 toward the side of the tine portion.
It should be noted that: the image capturing unit 20 may be a camera capable of outputting image information and depth information, such as an RGBD (depth camera), but may also be other types of cameras, such as a fisheye camera, a general camera for capturing video or image data, and the like, which is not limited herein.
In 102, the target information may be pose information of the target object, such as a position and a posture of the target object; or may be the position of the target object and the orientation of the insertion end face. The insertion end face refers to an end face corresponding to an entry port of a channel for the fork tooth part to enter, which is arranged on the butt joint part at the bottom of the target object. For example, referring to fig. 2a, the abutting portion of the bottom of the target object 2 refers to a certain height gap formed between the bottom of the target object 2 and a working plane (e.g., a ground), and the entrance port of the channel for the fork tines 12 provided in the abutting portion of the bottom of the target object 2 may be a certain height plane formed between the rear edge of the bottom of the target object 2 and the ground, in which case the inserted end surface of the target object refers to the rear side surface of the target object 2. Of course, the entrance port of the channel may also be a certain height plane formed between the other edge of the bottom of the target object and the ground, and accordingly, the insertion end surface may also refer to the other side surface of the target object 2, for example, the entrance port may also be a certain height plane formed between the front edge of the target object 2 and the ground, and at this time, the insertion end surface refers to the front side surface of the target object 2, which is not specifically limited in this embodiment. It can be seen that the entry port of the channel is coplanar with the plane of the insertion end face of its corresponding target object. It should be noted that: the above-mentioned side dividing manner of the target object is the same as the side dividing manner of the vehicle main body of the autonomous mobile forklift, and details are not described here.
In particular, the first image may be identified and analyzed by using an image identification technology to determine target information related to the pose of the target object. The image recognition technology may be a machine learning model, a wavelet moment algorithm, etc., which is not specifically limited in this embodiment; when the machine learning model is used for identifying and analyzing the first image, a related machine learning model, such as a neural network model, needs to be trained in advance based on a large number of training samples, namely when the trained neural network model is used for identifying and analyzing the first image, the first image can be used as the input of the trained neural network model, the neural network model is executed, and the first image is analyzed and calculated through the neural network model, so that a corresponding identification result can be obtained; then, according to the recognition result, the target information related to the pose of the target object can be determined.
However, considering that only the first image is relied upon to determine the target information relating to the pose of the target object, there may be a problem of low accuracy. In order to improve the accuracy of the target information, the first image may be further combined with detection data detected by other sensors (e.g., ranging sensors) to obtain target information related to the pose of the target object. That is, in one implementation, the autonomous mobile forklift may further include a sensor; the sensor may be arranged on the vehicle body, in particular on the tine part, for detecting data information relating to the target object. Accordingly, the step 102 "determining target information related to the pose of the target object according to the first image" may specifically include:
1021. acquiring first detection data about the target object detected by the sensor;
1022. and determining target information related to the pose of the target object according to the first image and the first detection data.
At 1021, the sensor may be a distance measuring sensor, and the distance measuring sensor may be a radar, specifically, the radar may be a laser radar, a millimeter wave radar, an ultrasonic radar, or the like; alternatively, the distance measuring sensor may also be another type of sensor capable of measuring distance, such as an ultrasonic sensor, an infrared sensor, and the like, which is not limited in this embodiment. Of course, the sensor may be a distance measuring sensor or an image capturing unit, and in the case that the sensor provided on the tine part is the image capturing unit, the sensor may be combined with the image capturing unit provided on the vehicle main body to form a binocular camera. In the specific arrangement of the sensor provided on the tine part, the sensor may be provided at a distal end of the tine part (hereinafter, referred to as a tine distal end) away from the vehicle body, and the tine distal end may refer to a tine end of the tine, i.e., an end not connected to the vehicle body. The detection direction of the sensor arranged at the far end of the fork tooth can be the front side direction, the sensor can be connected with a controller of the self-moving forklift, and during the process that the self-moving forklift moves towards the target object waiting for butt joint, the controller can obtain first detection data related to the target object, which is detected by the sensor arranged at the far end of the fork tooth part, while obtaining a first image of the target object through the image acquisition unit 20.
For example, referring to fig. 2a and 2b, the tine part 12 of the autonomous mobile forklift 1 is of a double-tine arm structure, i.e. the tine part 12 includes a tine 121 and a tine 122. In this case, a sensor for detecting the forward direction may be provided at the distal end of each of the tines 121 and 122. Specifically, as shown in fig. 2a and 2B, sensors 30 for detecting the forward direction may be respectively disposed at a central position B of the distal end of the fork 121 and a central position C of the distal end of the fork 122, and the first detection data acquired by the controller is obtained by detecting both the radar 30 disposed at the distal end of the fork 121 and the sensor 30 disposed at the distal end of the fork 122. For another example, referring to fig. 3a and 3b, the fork part 12 of the autonomous mobile forklift 1 is a single-fork arm structure, that is, only one fork 12 is included, and a sensor 30 may be provided at a central position D of the distal end of the fork 12 in a manner of providing a sensor at the distal end of the fork as shown in fig. 2a and 2b, and the first detection data acquired by the controller is acquired by the sensor 30 at the tooth end of the fork 12. It should be noted that, when the fork tooth portion 12 is of a double-fork arm structure, a sensor may be provided on only one of the fork teeth, and this embodiment is not limited thereto. However, in consideration of the limitation of the detection range of the sensor, in order to acquire the first detection data related to the target object more comprehensively, the embodiment is preferred to be provided with the sensor at the distal ends of the two fork teeth.
In the above 1022, after the first detection data is acquired in step 1021, the first detection data and the first image may be integrated to determine the pose-related target information of the target object, so as to improve the accuracy of the target information. Specifically, the method comprises the following steps: for example, taking the sensor arranged at the far end of the fork tooth part as a radar and the first detection data as radar data as an example, the first image can be identified and analyzed by using an image identification technology, and initial contour information of the target object can be obtained according to an identification result; then, optimizing the recognition result of the first image by using the acquired radar data (namely, optimizing the initial contour information of the target object by using the radar data) so as to further accurately determine the contour information of the target object; and finally, determining target information related to the pose of the target object based on the contour information of the target object. For another example, the sensor disposed at the distal end of the fork tooth portion is an image acquisition unit, and the image acquisition unit is a camera, and at this time, the camera on the distal end of the fork tooth portion and the camera disposed on the vehicle body may be combined into a binocular camera. In this case, after determining the target information related to the pose of the target object from the first images acquired by the distal-end cameras of the tine portions and the cameras on the vehicle body, respectively, the target information related to the pose of the target object can be determined by averaging.
In step 103, as can be seen from the content in step 102, the abutting portion of the bottom of the target object may be provided with a channel for the fork tine portion to enter. After the target information related to the pose of the target object is determined, the position information of a first vertical plane passing through a central shaft of the channel can be further determined according to the first image, and the pose of the autonomous mobile forklift is adjusted according to the target information and the position information of the first vertical plane. Accordingly, the butt joint part at the bottom of the target object can be provided with a channel for the fork tooth part to enter; accordingly, one possible solution of step 103 "adjusting the pose of the autonomous mobile forklift to align the tine parts with the butt joint part of the bottom of the target object according to the target information" is:
1031. determining position information about a first vertical plane from the first image; wherein the first vertical plane refers to a vertical plane passing through a central axis of the channel;
1032. and adjusting the position and posture of the autonomous mobile forklift according to the target information and the position information related to the first vertical plane, so that a second vertical plane passing through the central axis of the fork tooth part and the first vertical plane are positioned on the same plane.
1031, analyzing and determining the position information of the central axis of the inlet port of the channel for the fork tooth part to enter, which is arranged on the butt joint part at the bottom of the target object, according to the first image; positional information about the first vertical plane is then determined from positional information about a central axis of the access port. That is, in particular implementations, the position information about the first vertical plane may include: the first vertical plane is positioned at the intersection line of the first vertical plane and the plane of the inlet port of the channel. Since the entrance port of the channel and the plane where the insertion end face of the corresponding target object is located are the same plane, the position information of the first vertical plane necessarily includes: the position of the intersection line of the first vertical plane and the plane of the insertion end face of the target object. For example, if the insertion end face of the target object is the rear side face of the target object, the position information of the first vertical face includes the position of the intersection line of the first vertical face and the rear side face of the target object.
In specific implementation, in order to facilitate subsequent analysis and calculation according to the target object and the position information related to the first vertical surface and adjust the pose of the autonomous mobile forklift according to the analysis and calculation result, a point on an intersection line of the first vertical surface and the insertion end surface of the target object may be used as the position of the first vertical surface. For example, see FIG. 4, O1The point O may be a point on the intersection of the first vertical plane and the rear side of the target object 21As the position of the first vertical plane.
1032, set the determined target information related to the pose of the target object as the pose information of the target object, where the pose information includes the position and the pose of the target object. When the pose of the autonomous mobile forklift is adjusted according to the target information and the position information related to the first vertical surface, specifically, a lateral deviation distance and a deviation angle of a second vertical surface passing through a central axis of the fork tooth part relative to the first vertical surface can be calculated and analyzed according to the position information of the first vertical surface; and then adjusting the pose of the autonomous mobile forklift according to the pose of the target object and the lateral deviation distance and the deviation angle of the second vertical plane relative to the first vertical plane.
A specific example is given below to describe the process of adjusting the attitude of the autonomous mobile forklift. Specifically, the method comprises the following steps:
calculating the lateral offset distance and offset angle of the second vertical plane relative to the first vertical plane
See FIG. 4 and following the example in step 1031 above, at point O1As the position of the first vertical plane. If the point a is located on an intersection line of the front side surface of the body of the autonomous mobile forklift 1 and a second vertical surface passing through the center axis of the tine part, the point a can be set as the position of the second vertical surface. The image acquisition unit is fixedly arranged at the position of the point A, namely the point A is also arrangedIt can be regarded as the origin of the camera coordinate system. Due to the fact that the point A and the point O are followed1When calculating the lateral offset distance and offset direction of the second vertical plane with respect to the first vertical plane, it is necessary to connect points A and O1The above-mentioned fixed arrangement of the image capturing unit at the position of point a may be beneficial to reduce the amount of calculation for subsequent coordinate transformations, when transforming to the same coordinate system (e.g. world coordinate system). Suppose that, in the world coordinate system, the coordinates of the point A are (x)1，y1，z1) Point of, O1Has the coordinates of (x)2，y2，z2) Then point A and point O1The projection coordinates on a horizontal coordinate plane (such as the xoy plane shown in FIG. 4) are (x) respectively2，y2)、(x1，y1) Based on the projection coordinates (x) of point A on the xoy plane1，y1) And point O1Projection coordinates (x) on xoy plane2，y2) That is, point A is determined relative to point O1The lateral offset distance and the offset angle. Specifically, referring to FIG. 4, point A is shown relative to point O1The lateral offset distance Dist of (d) is: dist ═ x1-x2I, offset angle α is arctan (x)1-x2)/(y1-y2) I.e. the lateral offset distance Dist of the second vertical plane with respect to the first vertical plane is: dist ═ x1-x2I, offset angle α is arctan (x)1-x2)/(y1-y2)。
Adjusting the pose of an autonomous mobile forklift
As shown in fig. 4, the autonomous mobile forklift may be controlled to adjust the posture of the autonomous mobile forklift based on the posture of the target object, so that the adjusted posture of the autonomous mobile forklift is consistent with the posture of the target object. As shown in fig. 4, after the autonomous mobile forklift 1 is controlled to adjust its own posture based on the posture of the target object 2, the adjusted posture of the autonomous mobile forklift 1 is the posture of the autonomous mobile forklift 1' indicated by a broken line segment in fig. 4. After controlling the autonomous moving forklift 1 to adjust the posture of itself, the autonomous moving forklift may be further controlled to adjust the position of itself based on the lateral deviation distance and the deviation angle of the second vertical plane with respect to the first vertical plane calculated in the above example. Specifically, when the lateral offset distance and/or the offset angle of the second vertical plane with respect to the first vertical plane is not zero, the controller may control the autonomous mobile forklift to move in a direction that may shorten the lateral offset distance and/or the offset angle until the lateral offset distance and the offset angle of the second vertical plane with respect to the first vertical plane are both zero. When the transverse deviation distance and the deviation angle of the adjusted second vertical plane relative to the first vertical plane are both zero, the second vertical plane and the first vertical plane are positioned on the same plane, and the pose adjustment of the autonomous mobile forklift is completed. After the pose of the autonomous mobile forklift is adjusted, the second vertical surface passing through the central shaft of the fork tooth part and the first vertical surface passing through the central shaft of the channel provided by the butt joint part and allowing the fork tooth part to enter are kept on the same plane, so that the autonomous mobile forklift is controlled to move towards the target object in the adjusted posture, the fork tooth part is butted with the butt joint part at the bottom of the target object, and the butting accuracy can be ensured.
In the process of controlling the autonomous mobile forklift to continuously move towards the target object in the adjusted posture, the image acquisition device on the forklift body needs to be controlled to continuously acquire images, whether the fork tooth part moves to the preset butt joint position in the butt joint part at the bottom of the target object is judged based on the images continuously acquired by the image acquisition device, so that when the fork tooth part is determined to move to the preset butt joint position in the butt joint part, the autonomous mobile forklift is controlled to stop moving, and the fork tooth part is controlled to lift so as to lift the target object to be conveniently carried. Based on this, in an achievable technical solution, the "controlling the autonomous mobile forklift to move towards the target object with the adjusted posture" in the step 104 may specifically include:
s11, acquiring a plurality of second images acquired by the image acquisition unit in the process that the autonomous mobile forklift moves towards the target object in the adjusted posture;
and S12, determining whether the forking part moves to a preset butting position in the butting part at the bottom of the target object according to the plurality of second images.
In S11, while the autonomous mobile forklift continues to move toward the target object in the adjusted posture, the image capturing unit disposed on the autonomous mobile forklift body may be controlled to continue to capture images toward the target object, so as to capture a plurality of second images and send the second images to the controller, so that the controller may determine whether the fork tines move to the preset docking position in the docking portion of the bottom of the target object according to the plurality of second images.
In S12, it is considered that, in the process of the autonomous mobile forklift moving toward the target object in the adjusted posture, as the autonomous mobile forklift gradually moves closer to the target object, the image capturing unit gradually fails to capture a complete image of the target object, and the resolution of the captured image gradually decreases. Based on this, after receiving the plurality of second images sent by the image acquisition unit, the controller may determine, by performing recognition analysis on the plurality of second images, that the tine portions are moved to the preset docking position in the docking portion at the bottom of the target object when it is determined that the received second images do not include the target object and the resolution of the second images is smaller than a preset threshold. On the contrary, the forking tooth part does not move to the preset butt joint position in the butt joint part at the bottom of the target object. The preset threshold may be flexibly set according to actual conditions, and is not specifically limited herein.
However, in practical applications, it is considered that, after the autonomous mobile forklift is controlled to move toward the target object in the adjusted posture thereof so that the tine portions enter the bottom of the target object, the posture of the autonomous mobile forklift may slightly change from the original adjusted posture due to various factors, so that the tine portions present an obstacle in the traveling direction thereof during the movement of the bottom of the target object. For example, referring to fig. 7 showing a bottom view of a pallet 2 having a "chuan" shaped bottom, the posture of the autonomous forklift is inclined to the left with respect to the adjusted posture, and the fork 121 is obstructed by a long leg in the middle of the bottom of the pallet 2l1If the posture of the autonomous mobile forklift is not modified at this time, the fork 121 and the middle long leg l at the bottom of the shelf may be caused to move continuously during the control of the autonomous mobile forklift1A collision occurs, causing damage to the tines 121 or the shelf 2, etc. In view of the above, after the tine portions enter the bottom of the target object, it is possible to determine whether or not there is an obstacle in the advancing direction of the tine portions by using detection data on the abutting portions of the bottom of the target object detected by the sensors provided on the tine portions, and in the case where it is determined that there is an obstacle, it is possible to further correct the attitude of the autonomous mobile forklift based on the detection data on the abutting portions of the bottom of the target object detected by the sensors. Based on this, that is, in another achievable solution, the "controlling the autonomous mobile forklift to move toward the target object in the adjusted posture so that the fork tooth part is butted against the butting part at the bottom of the target object" in the step 104 may specifically include:
s21, determining whether there is an obstacle in the traveling direction of the tine part according to the adjusted posture and second detection data on the abutting part detected by the sensor after the tine part enters the bottom of the target object;
s22, if an obstacle exists, correcting the posture of the autonomous mobile forklift according to the second detection data;
and S23, controlling the autonomous mobile forklift to move continuously in the corrected posture so as to enable the fork tooth part to move to a preset butt joint position in the butt joint part.
For the above steps S21 and S22, for example: continuing with the example described above and with reference to fig. 7, assuming that the sensors provided at the center position C of the tine 121 and at the center position D of the tine 122 are radars, it is determined from the second detection data detected by the radars on the tine 122 that there is an obstacle in the direction of travel of the tine 122 (i.e., the middle long leg l of the bottom of the rack 2 shown in the figure)1) From this second detection data, the vertical plane l through the central axis of the fork tines 122 can then be calculated and analyzed2Relative to the middle long leg1The posture of the autonomous mobile forklift 1 is adjusted based on the offset angle θ until the offset angle θ becomes 90 °, and the posture of the autonomous mobile forklift after the adjustment is the posture of the autonomous mobile forklift shown by the broken line in fig. 7.
Here, after the posture of the autonomous forklift is corrected, there may be a second vertical plane passing through the center axis of the tine part and a first vertical plane passing through the center axis of the abutting part of the bottom part of the pallet 2 (for example, the middle long leg l shown in fig. 7 may be present1As the first vertical plane) is no longer on the same plane. To avoid this, after the posture correction of the autonomous mobile forklift is completed, it is still possible to determine the vertical plane passing through the center axis of the fork 121 and the middle long leg l based on the detection data detected by the radar on the tine 1211A first distance d therebetween1Likewise, a vertical plane passing through the central axis of the tines 122 and the central long leg l may be obtained1A second distance d between2(not shown), the controller may then rely on the first distance d1And a second distance d2Correcting the position of the autonomous moving forklift such that the first distance d1Is equal to the second distance d2。
In the above S23, in the implementation process of controlling the autonomous mobile forklift to continue to travel in the modified posture so as to move the tine portion to the preset docking position in the docking portion of the bottom of the target object, it is considered that when the tine portion moves to the preset docking position in the docking portion of the bottom of the target object, the tine portion generally exceeds the bottom of the target object, and at this time, the sensor provided at the tine end of the tine fails to detect the data information related to the docking portion of the bottom of the target object. Based on this, in the process of controlling the autonomous mobile forklift to continue to travel in the corrected posture, the controller may determine whether the tine portions are moved to the preset docking position of the docking portion at the bottom of the rack 2 according to the acquired detection data detected by the sensor. Specifically, in the process of controlling the autonomous mobile forklift to continue to move in the corrected posture, when the sensor arranged at the tooth end of the fork tooth part is determined to be incapable of detecting data information related to the butt joint part at the bottom of the target object, the fork tooth part is determined to move to the preset butt joint position in the butt joint part at the bottom of the target object; on the contrary, if the sensor arranged on the tooth end of the fork tooth part can still detect the data information related to the butt joint part of the bottom of the target object, the situation that the fork tooth part does not move to the preset butt joint position in the butt joint part of the bottom of the target object is indicated.
Further, after the fork tooth parts of the autonomous mobile forklift move to the preset butt joint positions in the butt joint parts at the bottoms of the target objects, the controller can control the autonomous mobile forklift to stop moving and control the fork tooth parts to lift the target objects so as to lift the target objects and facilitate carrying. How to control the fork tooth part to lift up is the same as the prior art, and detailed description thereof is omitted here.
According to the technical scheme provided by the embodiment, the image acquisition unit is arranged on the body of the autonomous mobile forklift, and when the autonomous mobile forklift moves towards a target object (such as a goods shelf) to be docked, after a first image of the target object acquired by the image acquisition unit is acquired, target information related to the pose of the target object can be determined based on the first image; according to the target information, the pose of the autonomous mobile forklift can be adjusted, so that the fork tooth parts are aligned with the butt joint part at the bottom of the target object; and after the pose adjustment of the autonomous mobile forklift is completed, the autonomous mobile forklift can be controlled to move towards the target object in the adjusted posture, so that the fork tooth part is in butt joint with the butt joint part at the bottom of the target object. According to the scheme, the fork tooth part of the autonomous mobile forklift is aligned with the butt joint part of the bottom of the target object in the process of controlling the autonomous mobile forklift to move towards the target object in the adjusted posture, so that the fork tooth part can enter the butt joint part of the bottom of the target object and can be located in the middle of the butt joint part when entering the butt joint part of the bottom of the target object. Therefore, the scheme can enable the autonomous mobile forklift to be accurately butted with a target object (such as a goods shelf), so that the phenomenon that the target object is inclined or toppled in the process of being carried due to position deviation generated in the butting process is avoided.
The above embodiments mainly explain how to accurately dock the autonomous mobile forklift with the target object from the perspective of combining the image data acquired by the image acquisition unit and the detection data detected by other sensors. In addition to this, in the case where the other sensor is a radar, it is of course also possible to achieve accurate docking of the autonomous mobile forklift with the target object based only on the acquired radar data. The following embodiment is a technical solution corresponding to the implementation of accurate docking of an autonomous mobile forklift and a target object from the perspective of only based on acquired radar data. Specifically, fig. 5 shows a flowchart of a docking method of an autonomous mobile forklift according to another embodiment of the present application, where the method may be applied to the autonomous mobile forklift and implemented by a controller in the autonomous mobile forklift. The controller may be a Central Processing Unit (CPU), a single chip, etc., and is not limited herein. Referring to fig. 2a, the autonomous mobile forklift may specifically include a vehicle body 11 and a radar 20 disposed on the vehicle body. The radar may be used to detect radar data associated with a target object, and the vehicle body may include a vehicle body 11 and a tine 12 disposed on one side of the vehicle body. Wherein the tine portions may be used to interface with a target object (e.g., a shelf) for the handling of objects. For the specific structural functions of the autonomous mobile forklift, reference may be made to the above or below related contents, and detailed description thereof is omitted here. As shown in fig. 5, the method includes the steps of:
201. acquiring first radar data detected by a radar and related to a target object;
202. determining target information related to a pose of the target object based on the first radar data;
203. adjusting the pose of the autonomous mobile forklift according to the target information so that the fork tooth parts are aligned with the butt joint part at the bottom of the target object;
204. and after the pose of the autonomous mobile forklift is adjusted, controlling the autonomous mobile forklift to move towards the target object in the adjusted posture so as to enable the fork tooth part to be in butt joint with the butt joint part at the bottom of the target object.
In 201 and 202, the radar may be a laser radar, a millimeter wave radar, an ultrasonic radar, etc., and this embodiment does not limit this. The radar may be located at a distal end of the tine portion (hereinafter referred to as the tine distal end) remote from the vehicle body, and the tine distal end may refer to a tine end of the tine, i.e., an end not connected to the vehicle body. The detection orientation of the radar provided at the distal end of the tines may be in the direction of the front side of the vehicle body, the radar being connectable to a controller of the autonomous mobile forklift. The front side of the main body is determined according to the traveling direction of the autonomous moving forklift, which can be referred to the above related contents, and is not described in detail here. In addition, for specific settings of the radar and how to obtain the first radar data of the target object by the radar, reference may be made to corresponding parts in the foregoing embodiments, which are not described herein again.
In 203, the abutting portion of the bottom of the target object is provided with a channel for the fork tooth portion to enter; accordingly, the step 203 "adjusting the pose of the autonomous mobile forklift to align the fork tine parts with the butt joint part of the bottom of the target object according to the target information" may specifically include:
2031. determining position information about a first vertical plane based on the first radar data; wherein the first vertical plane refers to a vertical plane passing through a central axis of the channel;
2032. and adjusting the position and posture of the autonomous mobile forklift according to the target information and the position information related to the first vertical plane, so that a second vertical plane passing through the central axis of the fork tooth part and the first vertical plane are positioned on the same plane.
In 204, the controlling the autonomous mobile forklift to move toward the target object in the adjusted posture may specifically include:
2041. acquiring second radar data acquired by the radar in the process that the autonomous mobile forklift moves towards the target object in the adjusted posture;
2042. determining, from the second radar data, whether the tine portion is moved to a preset docking position in the docking portion of the target object bottom.
In practice, it is considered that when the tine portion of the autonomous mobile forklift moves to the preset docking position in the docking portion of the bottom of the target object, the tooth end of the tine portion generally goes beyond the bottom of the target object, such as the example shown in fig. 6, the tooth end of the tine 12 goes beyond the bottom of the target object 2. In this case, the radar 30 provided at the tine end of the tine 12 does not acquire radar data related to the target object, that is, when it is determined that the radar 30 provided at the tine end of the tine 12 cannot acquire radar data related to the target object while the autonomous mobile forklift moves toward the target object in the adjusted posture, it is determined that the autonomous mobile forklift moves to the preset docking position in the docking portion of the bottom of the target object. On this basis, i.e. when determining from the second radar data whether the tine portion is moved to the preset docking position in the docking portion of the target object bottom, it may specifically be: under the condition that the second radar data are determined to be irrelevant to the target object, the forktooth part can be considered to move to a preset butt joint position in the butt joint part at the bottom of the target object; on the contrary, the forking tooth part does not move to the preset butt joint position in the butt joint part at the bottom of the target object.
According to the technical scheme provided by the embodiment, after first radar data related to a target object is acquired through a radar, target information related to the pose of the target object can be determined based on the first radar data, and the pose of the autonomous mobile forklift is adjusted according to the target information, so that the fork tooth portions are aligned to the butt joint portion of the bottom of the target object; and then, after the pose adjustment of the autonomous mobile forklift is completed, controlling the autonomous mobile forklift to move towards the target object in the adjusted posture so that the fork tooth part is butted with the butting part at the bottom of the target object. The scheme can ensure that the fork tooth parts of the autonomous mobile forklift are aligned with the butt joint part of the bottom of the target object in the process of moving the autonomous mobile forklift to the target object for butt joint, so that the fork tooth parts can enter the butt joint part of the bottom of the target object and can be positioned in the middle of the butt joint part when entering the butt joint part of the bottom of the target object. Therefore, the scheme can enable the autonomous mobile forklift to be accurately butted with a target object (such as a goods shelf).
Here, it should be noted that: the content of each step in the method provided by this embodiment, which is not described in detail in the foregoing embodiments, may refer to the corresponding content in each embodiment, and is not described herein again. In addition, the method provided in this embodiment may further include, in addition to the above steps, other parts or all of the steps in the above embodiments, and specific reference may be made to corresponding contents in the above embodiments, which is not described herein again.
Based on the above, the present application further provides an autonomous mobile forklift 1 as shown in fig. 2a, 2b, 3a, 3b and 6, the autonomous mobile forklift 1 including: a vehicle body 10, an image pickup unit 20, and a controller (not shown in the drawings); wherein the content of the first and second substances,
the vehicle body 10 includes a vehicle body 11 and a fork 12 provided on one side of the vehicle body.
An image acquisition unit 20, disposed on the vehicle body, for acquiring a first image of a target object;
the controller is electrically connected with the image acquisition unit 20 and is used for acquiring the first image through the image acquisition unit; determining target information related to the pose of the target object according to the first image; adjusting the pose of the autonomous mobile forklift according to the target information so that the fork tooth parts are aligned with the butt joint part at the bottom of the target object; and after the pose of the autonomous mobile forklift is adjusted, controlling the autonomous mobile forklift to move towards the target object in the adjusted posture so as to enable the fork tooth part to be in butt joint with the butt joint part at the bottom of the target object.
In practical implementation, the fork tine portion 12 is used for carrying an object, and may be a double fork tine arm structure shown in fig. 2a and 2b, or a single fork tine arm structure shown in fig. 3a and 3b, which is not limited in this embodiment. The serration 12 may be disposed on a first side surface of the vehicle body 11, specifically, which side surface of the vehicle body 11 is determined according to actual conditions.
In practical applications, along the direction of travel of the autonomous mobile forklift 1, as indicated by the lateral arrows shown in fig. 2a, 2b, 3a, 3b and 6, the directions around the vehicle body 10 can be distinguished as follows: front side, back side, left side, right side; accordingly, for convenience of description, the side of the vehicle body 11 is included in the above orientation; front side, back side, left side and right side. The tine part 12 may be provided on a front side surface of the vehicle body, i.e., the first side surface may refer to a front side surface of the vehicle body 11, and a rear side surface of the vehicle body is a side surface facing away from the tine part 12.
Referring to fig. 2a, 2b, 3a and 3b, the image capturing unit 20 may also be disposed on a first side (i.e., a front side) of the vehicle body 11; of course, the image capturing unit may alternatively be disposed at other positions of the vehicle body 11, such as the top of the vehicle body 11, specifically: if the image acquisition unit fixedly faces to the side where the fork tooth parts are located (namely the front side of the vehicle body) is arranged at the top of the vehicle body; or the top of the vehicle main body is provided with a rotating mechanism, one end of the rotating mechanism is connected with the top of the vehicle main body, and the other end of the rotating mechanism is provided with the image acquisition unit; correspondingly, the controller is also electrically connected with the rotating mechanism and is used for controlling the rotating mechanism to rotate along a set direction so as to enable the image acquisition unit to face the side where the fork tooth parts are located. The specific setting position of the image capturing unit is not specifically limited in this embodiment, and the specific setting of the image capturing unit can refer to the above related contents, which are not described in detail herein. Further, the prior art can be referred to with respect to the specific structure of the rotating mechanism.
In a specific implementation, the image capturing unit 20 may be a camera capable of outputting image information and depth information, such as an RGBD (depth camera), and may also be a general camera for capturing video or image data, which is not limited herein. The controller may be a Central Processing Unit (CPU) with data Processing and computing capabilities, a single chip, etc., and may be flexibly disposed at any position of the vehicle body 10, such as inside the vehicle body 10, according to the actual situation, which is not limited herein.
In the technical scheme provided by the embodiment, the autonomous mobile forklift comprises a forklift body, an image acquisition unit and a controller; the vehicle body comprises a vehicle main body and a fork tooth part arranged on the vehicle main body, and the image acquisition unit is arranged on the vehicle main body and is used for acquiring first image data of a target object; the controller is connected with the image acquisition unit and used for acquiring the first image through the image acquisition equipment; determining target information related to the pose of the target object according to the first image; adjusting the pose of the autonomous mobile forklift according to the target information so that the fork tooth parts are aligned with the butt joint part at the bottom of the target object; and after the pose of the autonomous mobile forklift is adjusted, controlling the autonomous mobile forklift to move towards the target object in the adjusted posture so as to enable the fork tooth part to be in butt joint with the butt joint part at the bottom of the target object. The automatic moving forklift in the scheme can realize accurate butt joint with a target object, and is simple in structure and low in cost.
Further, the autonomous mobile forklift that this embodiment provided still includes: a radar 30; the radar 30 is provided on the tine portion 12;
the controller, which can be electrically connected with the radar 30, is used for acquiring radar data detected by the radar and related to the target object; target information related to the pose of the target object is determined from the first image and the radar data.
In a specific implementation, the radar 30 may be a laser radar, a millimeter wave radar, an ultrasonic radar, and the like, which is not limited in this embodiment. The radar 30 may be disposed at a distal end of the tine portion (hereinafter referred to as a tine distal end) away from the vehicle body, and the tine distal end may refer to a tine end of the tine, i.e., an end not connected to the vehicle body. The detection orientation of the radar located at the distal end of the tines may be in the direction of the front side of the vehicle body. The controller may be electrically connected to the radar 30, and configured to acquire a first image of the target object through the image acquisition unit 20 while acquiring radar data of the target object detected by the radar during movement of the self-moving forklift towards the target object waiting for docking, and determine target information related to the pose of the target object according to the first image and the radar data.
Here, it should be noted that: for the content that is not described in detail in the structural functions of the autonomous mobile forklift provided in this embodiment, reference may be made to the corresponding content in the above embodiments, which is not described herein again. In addition, the autonomous mobile forklift provided in this embodiment may further include other functional structures besides the above structural functions, such as a memory, an audio component, a traveling component, and the like, and is not limited herein.
In addition, embodiments of the present application also provide a computer-readable storage medium storing a computer program, where the computer program, when executed by a computer, can implement the steps or functions in the autonomous mobile forklift docking method provided in each of the above embodiments.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.
Claims (6)
1. An autonomous mobile forklift, comprising:
the vehicle body comprises a vehicle main body and fork tooth parts arranged on one side of the vehicle main body;
the image acquisition unit is arranged on the vehicle main body and is used for acquiring a first image of a target object;
the controller is electrically connected with the image acquisition unit and is used for acquiring the first image acquired by the image acquisition unit; determining target information related to the pose of the target object according to the first image; adjusting the pose of the autonomous mobile forklift according to the target information so that the fork tooth parts are aligned with the butt joint part at the bottom of the target object; and after the pose of the autonomous mobile forklift is adjusted, controlling the autonomous mobile forklift to move towards the target object in the adjusted posture so as to enable the fork tooth part to be in butt joint with the butt joint part at the bottom of the target object.
2. The autonomous mobile forklift of claim 1,
the fork tooth part is arranged on the first side surface of the vehicle main body;
the image acquisition unit is arranged on the first side surface of the vehicle main body.
3. The autonomous mobile forklift of claim 1,
the top of the vehicle body is provided with the image acquisition unit which is fixedly arranged towards the side where the fork tooth parts are arranged; or
The top of the vehicle main body is provided with a rotating mechanism, one end of the rotating mechanism is connected with the top of the vehicle main body, and the other end of the rotating mechanism is provided with the image acquisition unit; the controller is also electrically connected with the rotating mechanism and used for controlling the rotating mechanism to rotate along a set direction so as to enable the image acquisition unit to face the side where the fork tooth part is located.
4. The autonomous mobile forklift of any one of claims 1 to 3, further comprising:
a sensor disposed on the tine portion;
the controller is electrically connected with the sensor and is used for acquiring first detection data which are detected by the sensor and related to the target object; determining target information related to the pose of the target object according to the first image and the first detection data.
5. The autonomous mobile forklift of claim 4,
the sensor is arranged at the far end of the fork tooth part far away from the vehicle main body.
6. The autonomous mobile forklift of claim 4, wherein the sensor is a range sensor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202121278507.5U CN215160705U (en) | 2021-06-08 | 2021-06-08 | Autonomous mobile forklift |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202121278507.5U CN215160705U (en) | 2021-06-08 | 2021-06-08 | Autonomous mobile forklift |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN215160705U true CN215160705U (en) | 2021-12-14 |
Family
ID=79388388
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202121278507.5U Active CN215160705U (en) | 2021-06-08 | 2021-06-08 | Autonomous mobile forklift |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN215160705U (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022257550A1 (en) * | 2021-06-08 | 2022-12-15 | 灵动科技（北京）有限公司 | Docking method for self-moving forklift, and self-moving forklift |
-
2021
- 2021-06-08 CN CN202121278507.5U patent/CN215160705U/en active Active
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022257550A1 (en) * | 2021-06-08 | 2022-12-15 | 灵动科技（北京）有限公司 | Docking method for self-moving forklift, and self-moving forklift |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11772267B2 (en) | Robotic system control method and controller | |
| US9828223B2 (en) | Fork-lift truck and method for operating a fork-lift truck | |
| US10850961B2 (en) | Forklift | |
| CN110796063B (en) | Method, device, equipment, storage medium and vehicle for detecting parking space | |
| JP6507894B2 (en) | Travel control method at unloading in unmanned forklift and travel control device at unloading | |
| KR102276259B1 (en) | Calibration and operation of vision-based manipulation systems | |
| US20230286750A1 (en) | Method and device for storing goods, robot, warehousing system and storage medium | |
| CN107229903B (en) | Robot obstacle avoidance method and device and storage device | |
| US11554501B2 (en) | Robot system and control method | |
| EP3943880A1 (en) | Item detection device, item detection method, and industrial vehicle | |
| CN215160705U (en) | Autonomous mobile forklift | |
| CN111694358B (en) | Method and device for controlling transfer robot, and storage medium | |
| WO2022257550A1 (en) | Docking method for self-moving forklift, and self-moving forklift | |
| US20130073090A1 (en) | Robot system | |
| CN114170521A (en) | Forklift pallet butt joint identification positioning method | |
| JP5370122B2 (en) | Moving object position estimation device and moving object position estimation method | |
| WO2023036212A1 (en) | Shelf locating method, shelf docking method and apparatus, device, and medium | |
| CN111017814A (en) | AGV forklift and AGV forklift fork tooth position adjusting method and system | |
| Iinuma et al. | Pallet detection and estimation for fork insertion with rgb-d camera | |
| CN110850868A (en) | Deviation rectifying method, device and equipment for AGV (automatic guided vehicle) butt joint of cows and storage medium | |
| CN115289966A (en) | Goods shelf detecting and positioning system and method based on TOF camera | |
| JP7436170B2 (en) | robot system | |
| CN116081524A (en) | Fork truck tray butt joint detection method and detection system | |
| JP2021076532A (en) | Measuring device | |
| CN114419164B (en) | Pose calibration data generation method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |