WO2021004483A1 - 一种导航方法、移动载体及导航系统 - Google Patents

一种导航方法、移动载体及导航系统 Download PDF

Info

Publication number
WO2021004483A1
WO2021004483A1 PCT/CN2020/100879 CN2020100879W WO2021004483A1 WO 2021004483 A1 WO2021004483 A1 WO 2021004483A1 CN 2020100879 W CN2020100879 W CN 2020100879W WO 2021004483 A1 WO2021004483 A1 WO 2021004483A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
shelf
mobile carrier
leg
coordinate system
Prior art date
Application number
PCT/CN2020/100879
Other languages
English (en)
French (fr)
Inventor
林翰
Original Assignee
深圳市海柔创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市海柔创新科技有限公司 filed Critical 深圳市海柔创新科技有限公司
Priority to EP20837065.0A priority Critical patent/EP3998451A4/en
Publication of WO2021004483A1 publication Critical patent/WO2021004483A1/zh
Priority to US17/570,732 priority patent/US20220128998A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/0088Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/20Instruments for performing navigational calculations
    • G01C21/206Instruments for performing navigational calculations specially adapted for indoor navigation
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/3407Route searching; Route guidance specially adapted for specific applications
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/89Lidar systems specially adapted for specific applications for mapping or imaging
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/93Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means

Definitions

  • the invention relates to the field of intelligent storage, in particular to a navigation method, a mobile carrier and a navigation system.
  • the existing mobile carriers can use visual technology to implement navigation in the warehouse to complete the warehouse tasks assigned by the administrator.
  • two-dimensional code navigation is generally used. That is, a two-dimensional code is posted on the ground according to certain rules, and the mobile carrier obtains the information of the two-dimensional code posted on the ground during the movement, and converts the information into navigation data of the mobile carrier.
  • the two-dimensional code navigation method is prone to errors in the process of tagging on the ground, which causes the mobile carrier to work unreliably.
  • the embodiments of the present invention provide a navigation method, a mobile carrier and a navigation system, which work reliably.
  • an embodiment of the present invention provides a navigation method applied to a mobile carrier, the mobile carrier can travel in a preset space, and the preset space includes an aisle formed by at least two rows of shelves placed opposite each other ,
  • the method includes:
  • an embodiment of the present invention provides a mobile carrier, including:
  • At least one processor At least one processor
  • a memory connected in communication with the at least one processor
  • the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the navigation method provided in any embodiment.
  • an embodiment of the present invention provides a navigation system, including:
  • the second aspect of the present invention corresponds to the mobile carrier provided in the embodiment and communicates with the server.
  • the mobile carrier can travel in a preset space, and the preset space includes an aisle formed by at least two rows of shelves placed opposite each other.
  • the method includes: calculating the offset position information of the mobile carrier in the lane relative to the rack in the non-traveling direction, and navigating the mobile carrier according to the offset position information. Therefore, navigating the mobile carrier based on the offset position information in the non-traveling direction, on the one hand, prevents the mobile carrier from colliding with the shelf, and on the other hand, can reliably navigate the mobile carrier in the lane.
  • Figure 1 is a schematic structural diagram of a mobile carrier provided by an embodiment of the present invention.
  • FIG 2 is a schematic diagram of the structure of the mobile chassis in Figure 1;
  • Figure 3a is a schematic structural diagram of a navigation system provided by an embodiment of the present invention.
  • Figure 3b is a schematic diagram of a mobile carrier traveling in a warehouse according to an embodiment of the present invention.
  • Figure 3c is a side view of a shelf provided by an embodiment of the present invention.
  • Fig. 4a is a schematic flowchart of a navigation method provided by an embodiment of the present invention.
  • Figure 4b is a schematic diagram of the flow of S41 in Figure 4a;
  • FIG. 5 is the establishment of a three-dimensional space coordinate system of a photographing device using the edge of the laminate as the characteristic information provided by an embodiment of the present invention
  • Fig. 6a is a schematic diagram of leg feature information of a shelf leg provided by an embodiment of the present invention.
  • Figure 6b is a schematic diagram of the movement of the mobile carrier in the tunnel provided by the embodiment of the present invention.
  • FIG. 6c is a schematic flowchart of a navigation method according to another embodiment of the present invention.
  • Figure 7a is a schematic structural diagram of a navigation device provided by an embodiment of the present invention.
  • Figure 7b is a schematic diagram of the structure of the computing module in Figure 7a;
  • Figure 7c is a schematic structural diagram of a navigation device according to another embodiment of the present invention.
  • Figure 7d is a schematic structural diagram of a navigation device provided by still another embodiment of the present invention.
  • Fig. 8 is a block diagram of a circuit principle of a mobile carrier provided by an embodiment of the present invention.
  • the navigation method provided by the present invention can be applied to any suitable industry field or technical field, such as the field of smart storage, smart logistics, smart sorting, etc.
  • the mobile carrier provided by the present invention can be applied to any suitable industry field or technical field, such as the field of smart storage, smart logistics, smart sorting, and the like.
  • the mobile carrier can be constructed into different structures to realize the corresponding business functions.
  • the mobile carrier when the mobile carrier is applied to the field of smart storage, the mobile carrier can be configured with a robotic arm to grab goods.
  • FIG. 1 is a schematic structural diagram of a mobile carrier provided by an embodiment of the present invention.
  • the mobile carrier 100 includes a mobile chassis 10, a storage rack 20, a conveying device 30, and a lifting assembly 40. Among them, the storage rack 20, the conveying device 30 and the lifting assembly 40 are all installed on the mobile chassis 10.
  • the mobile chassis 10 is used to carry the mobile carrier 100 to move according to a planned path.
  • the storage rack 20 is used to store goods.
  • the storage rack 20 may include a plurality of storage units, and each storage unit may place one or more goods.
  • the handling device 30 can move along the vertical direction of the planned path, so that the position of the handling device 30 is horizontally opposite to any storage unit.
  • the handling device 30 is used to transport goods between the preset position of the fixed shelf and any storage unit.
  • the lifting assembly 40 is used for driving the conveying device 30 to move relative to the storage shelf 20 in a vertical direction, and the lifting assembly 40 includes a lifting transmission mechanism and a lifting driving mechanism.
  • the lifting drive mechanism is used to provide a driving force for the conveying device 30 to move in a vertical direction relative to the storage shelf 20, and the lifting transmission mechanism is used to transmit the second drive force to the conveying device 30.
  • FIG. 2 is a schematic structural diagram of the mobile chassis in FIG. 1.
  • the mobile chassis 10 includes a bracket assembly 11, a driven wheel 12, a driving wheel assembly 13 and a guide device 14. Among them, the driven wheel 12, the driving wheel assembly 13 and the guiding device 14 are all installed in the bracket assembly 11.
  • the bracket assembly 11 is formed by welding steel beams, steel plates and skins.
  • the bracket assembly 11 includes a base 110 and a vertical bracket 111, and the vertical bracket 111 is installed on the base 110.
  • the base 110 includes a base body 112, an axle seat 113 and a shock absorber bracket 114.
  • the axle seat 113 is installed on the base body 112, and the shock absorber bracket 114 is also installed on the base body 112.
  • the base body 112 is a horizontally arranged rectangular plate with a symmetry axis S1.
  • the base body 112 includes a first surface 1120 and a second surface 1121 that are arranged oppositely.
  • the base body 112 is provided with a driven wheel installation groove 1122, a driving wheel installation port 1123, and a guide device installation port 1124.
  • the driven wheel installation groove 1122 is provided on the first surface 1120 of the base body 112, and the driven wheel installation groove 1122 is used for installing the driven wheel 12.
  • the driving wheel installation opening 1123 is formed through the first surface 1120 and the second surface 1121 of the base body 112, and the driving wheel installation opening 1123 is used for placing the driving wheel assembly 13.
  • the guiding device installation opening 1124 is provided through the first surface 1120 and the second surface 1121 of the base body 112, and the guiding device installation opening 1124 is used for installing the guiding device 14.
  • the guiding device 14 may be a lidar, a camera, or other suitable sensors.
  • the lidar or camera is used to scan the legs of the shelf to obtain the shelf image.
  • the difference from the above-mentioned embodiments is that the guiding device 14 can be arranged at any suitable position of the bracket assembly 11 so as to photograph the shelf or shelf legs.
  • Both the axle seat 113 and the shock absorber bracket 114 are installed on the second surface 1121 of the base body 112, and the axle seat 113 and the shock absorber bracket 114 are used to install the driving wheel assembly 13 together.
  • the ground clearance and the height of the center of mass of the mobile chassis 10 can be controlled.
  • the grip of the mobile chassis 10 is improved, and the stability of the mobile chassis 10 is improved.
  • FIG. 3a is a schematic structural diagram of a navigation system provided by an embodiment of the present invention.
  • the mobile carrier 100 can form a navigation system with the server 200, and communicate with the server 200 to achieve navigation and thus succeed.
  • the mobile carrier 100 receives a dispatch instruction from the server 200, where the dispatch instruction includes a pick-up location, a destination location, a planned route, and goods information.
  • the mobile carrier 100 moves to the pickup location in the warehouse along the planned path according to the scheduling instruction, and after obtaining the corresponding goods, transports the goods to the destination location.
  • the mobile carrier sends its own location information to the server 200 so that the server 200 can determine the current occupancy of the channel in the warehouse according to the location information sent by each mobile carrier 100.
  • the mobile carrier 100 receives the occupancy status of the channel in the warehouse sent by the server 200, and requests the server 200 to adjust the planned route according to the occupancy status of the channel in the warehouse.
  • the server 200 herein may be a physical server or a logical server virtualized by multiple physical servers.
  • the server 200 may also be a server group composed of multiple servers that can be interconnected and communicated, and each functional module may be distributed on each server in the server group.
  • FIG. 3b is a schematic diagram of a mobile carrier traveling in a warehouse according to an embodiment of the present invention.
  • the warehouse 300 includes an aisle 31, a public area 32, and an operating table area 33.
  • the aisle 31 is formed by at least two rows of shelves 311 placed opposite each other.
  • the shelves on the same side are arranged side by side.
  • the number of shelves on the same side can be multiple.
  • the warehouse 300 can include multiple rows of shelves.
  • An aisle 31 is formed between two adjacent shelves. Therefore, multiple rows of shelves can form multiple aisles 31, and the mobile carrier 100 can pick up the goods on the shelves 311 in the aisle 31.
  • a reference travel direction 31a is preset in the lane 31.
  • the mobile carrier 100 travels along the travel direction 31a, the mobile carrier 100 does not touch the shelf. Under the premise, the goods are effectively picked and placed on the shelf.
  • the mobile carrier 100 deviates from the traveling direction 31a and travels along 31b or 31c in the lane 31, the mobile carrier 100 is prone to accidents of touching the shelf.
  • FIG. 3c is a side view of a shelf provided by an embodiment of the present invention.
  • Each shelf 311 includes a layer board 3111 and two shelf legs 3112 spaced apart by a predetermined distance.
  • the layer board 3111 is installed on On the two shelf legs 3112, the two shelf legs 3112 provide support for the layer board 3111 to support the layer board 3111, and the cargo box for loading goods can be placed on the layer board 3111.
  • the shelf legs 3112 can be constructed by brackets of any suitable shape.
  • the shelf legs in each shelf are in a right-angled top view.
  • the top view of the shelf legs in each shelf may also be in a suitable shape such as an arc or a circle.
  • the public area 32 is an area shared by all mobile carriers during navigation.
  • the mobile carrier A1 needs to go to the first container of the first row of shelves to pick up the goods, and the mobile carrier A2 needs to place the first row of shelves in the second container.
  • the goods are transported to the console area 33, so the mobile carrier A1 and the mobile carrier A2 need to pass through the public area 32.
  • the identifier includes any suitable form of identifier, such as a two-dimensional code, an electronic label, a barcode, or a graphic object.
  • the console area 33 is the area where each mobile carrier handles containers or goods.
  • the mobile carrier places the transported containers or goods at a preset position in the console area 33, or the administrator gives the corresponding items in the console area 33
  • the mobile carrier is equipped with an empty container so that the mobile carrier can place the empty container on the corresponding shelf position.
  • the camera of the mobile carrier starts to read the identifier in the console area 33, thereby Realize the positioning of its own position, and suspend the operation or implement other control logic according to the positioning position.
  • the marker is installed in a preset position of the console area 33, such as a protective net or a protective net of the next console that suspends operation. Fence.
  • the mobile carrier can pass through the public area 32 from the console area 33, and then reach the corresponding lane 31 from the public area 32.
  • the mobile carrier can also start from the lane 31, pass through the public area 32, and then arrive at the console area 33 from the public area 32.
  • a ground coordinate system XOY is configured on the floor of the warehouse 300, and each shelf corresponds to a unique coordinate (x, y, ⁇ ), where x is the abscissa, y is the ordinate, and ⁇ is the orientation of the robot. The angle between and the direction of travel.
  • the mobile carrier 100 may also use other indoor positioning technologies to complete positioning. Please refer to Figure 3b.
  • the non-data identification is deployed in a grid on the ground of the warehouse 300.
  • the mobile carrier 100 is equipped with a positioning antenna.
  • the positioning antenna is UWB (Ultra Wideband).
  • the pulse repeats and sends data frames uninterruptedly.
  • Each positioning base station 34 receives UWB pulses.
  • the positioning base station 34 uses a highly sensitive short pulse detector to measure the time when the data frame of the positioning tag reaches the receiver antenna.
  • the server 200 refers to the calibration sent by the positioning antenna According to the data, the time difference between the positioning antennas reaching different positioning base stations is determined, and the three-point positioning technology and optimization algorithm are used to calculate the position of the positioning antenna, that is, the position of the mobile carrier 100.
  • the positioning base station 34 may adopt a TDOA (Time difference of Arrival) algorithm to realize positioning.
  • TDOA Time difference of Arrival
  • the mobile carrier 100 may also use other positioning methods to complete positioning and navigation, which is not limited to the methods provided in the embodiments of the present invention.
  • the embodiment of the present invention provides a navigation method, which is applied to a mobile carrier, the mobile carrier is provided with a sensor, and the sensor is installed at a suitable position of the mobile carrier to collect sensor data.
  • the sensor herein can be any suitable type of sensor, such as various types of motion sensors, image sensors, or wireless sensors, etc., where the motion sensors can include, for example, an inertial measurement unit (IMU), a gyroscope, and a magnetic field. Meter, accelerometer or speedometer etc.
  • the image sensor can be configured as a camera of any shape for capturing images.
  • the wireless sensor is set on the mobile carrier, communicates with an external wireless base station or wireless system, and realizes the positioning of the mobile carrier based on wireless technology.
  • the mobile carrier can travel in a preset space, where the preset space is the activity space range of the mobile carrier.
  • the definition of the preset space may be different.
  • the preset space is a warehouse.
  • the preset space is the sum of the various indoor spaces separated by walls.
  • the preset space includes an aisle formed by at least two rows of shelves placed oppositely.
  • Fig. 4a is a schematic flowchart of a navigation method provided by an embodiment of the present invention. As shown in Fig. 4a, the navigation method S400 includes:
  • the non-traveling direction is the direction in which the mobile carrier moves away from the traveling direction.
  • the mobile carrier continues to travel along the non-traveling direction in the aisle, the mobile carrier is prone to misalignment of the shelf, resulting in failure to pick and place goods. Or, it is easy to touch the shelf and cause a safety accident.
  • the offset position information is the amount of offset between the mobile carrier relative to the shelf, where the offset position information includes an offset angle and/or an offset distance, where the offset angle is the non-traveling
  • the direction is relative to the corner of the shelf
  • the offset distance is the distance between the mobile carrier and the shelf in the non-traveling direction.
  • the mobile carrier of this embodiment calculates the offset position relative to the shelf in the non-travel direction in the aisle in real time Information, and implement navigation based on the offset position information. For example, the mobile carrier travels to the preset direction of travel according to the offset position information. For example, when the offset angle of the mobile carrier relative to the shelf is 8 degrees, then move The carrier rotates 8 degrees clockwise. Further, when the shift distance of the moving carrier to the left relative to the shelf is 10 cm, the moving carrier moves to the right by 10 cm. Therefore, the moving carrier returns to the traveling direction again, and the direction is directly toward the traveling direction.
  • the mobile carrier obtains the current position information, and performs fusion processing on the offset position information and the current position information to obtain the fused position information.
  • the mobile carrier will integrate the location information with the acquired target location information for navigation.
  • the current position information can be scanned by the mobile carrier to scan the QR code on the shelf or on the ground, and the current position information can be parsed from the coordinate information encapsulated by the two-dimensional code, or the mobile carrier can be combined with the internal sensor according to the preset motion equation such as speed, etc. Movement information, the current position information is calculated, or the mobile carrier receives the current position information sent by an external sensor, where the internal sensor includes, for example, a gyroscope or an odometer.
  • the received current position estimation information can be derived from the UWB positioning information sent by the UWB device received by the mobile carrier.
  • the method provided in this embodiment can navigate the mobile carrier according to the offset position information in the non-traveling direction. On the one hand, it prevents the mobile carrier from colliding with the shelf, and on the other hand, it can reliably navigate the mobile carrier in the lane.
  • FIG. 4b is a schematic diagram of the flow of S41 in FIG. 4a.
  • S41 includes:
  • the shelf may include multiple feature information, where the feature information is used to identify different parts of each shelf.
  • the feature information is used to identify different parts of each shelf.
  • one feature information can be used to identify the shelf of the shelf, and the other feature information can be used to identify the shelf. Shelf legs.
  • the characteristic information can be collected by different types of sensors, such as suitable sensors such as cameras or lidars, that is, suitable sensors such as cameras or lidars can be used to collect corresponding characteristic information, for example, considering the shelf layer The position of the board is relatively high, and there are many types of objects on the laminate. If the laser radar is used for collection, because the laser image collected by the laser radar has more clutter and the image processing is more complicated, therefore, considering the efficiency, you can choose The camera collects the characteristic information of the laminate. For another example, considering that the shelf legs of the shelf are located relatively low, and there are fewer objects under the shelf legs, compared to the way that the camera collects the characteristic information of the shelf legs, it is more effective to use the lidar to collect the characteristic information of the shelf legs. effectiveness. It is understandable that there is no restriction on obtaining the characteristic information of the shelf here, and this is only an auxiliary description.
  • the mobile carrier can calculate the offset position information in the lane relative to the shelf in the non-traveling direction based on the characteristic information.
  • the selection of the reference object can be pre-defined, and the characteristic information is obtained by the sensor and sent by the sensor to the mobile carrier.
  • the sensor can be installed on the mobile carrier or not.
  • the sensor transmits the characteristic information to the mobile carrier through wireless communication or wired communication.
  • the sensor is configured with a coordinate system.
  • the photographing device is configured with a world coordinate system, a camera coordinate system, an image coordinate system, and a pixel coordinate system.
  • the world coordinate of the photographing device coincides with the camera coordinate system or not.
  • the physical point is converted between the world coordinate system and the camera coordinate system through the conversion matrix between the world coordinate system and the camera coordinate system.
  • the mobile carrier calculates the conversion matrix between the marker and the mobile carrier according to the coordinate information and the camera model, and then According to the conversion matrix, the position information of the mobile carrier in the world coordinate system is obtained.
  • the lidar when the sensor is a lidar, the lidar is configured with a world coordinate system and a polar coordinate system.
  • the world coordinate system and the polar coordinate system of the lidar overlap, or may not overlap.
  • the physical point is converted between the world coordinate system and the polar coordinate system through the conversion matrix between the world coordinate system and the polar coordinate system.
  • the mobile carrier calculates the offset position information in the lane relative to the shelf in the non-traveling direction according to the characteristic information, it can calculate the offset position information according to the coordinate information of the characteristic information in the coordinate system of the sensor For example, since the position of the shelf and the height of the shelf are fixed, when the sensor is a photographing device or lidar, and the characteristic information is the edge characteristic information of the shelf, the mobile carrier can be used in the photographing device or lidar according to the edge characteristic information. The coordinate information of the coordinate system, the offset position information is calculated.
  • the edge feature of the laminate means that the edge of the shelf will have a significant gradient difference in the image captured by the camera (for example, the light shines on the shelf to make the shelf bright, and the background is dark, there will be obvious at the edge of the shelf Boundary line), the Canny algorithm can be used to extract the image feature information of the edge feature from the captured image, and make the image feature information the edge feature information.
  • the mobile carrier can calculate the offset position information according to the coordinate information of the leg characteristic information in the coordinate system of the photographing device or lidar .
  • the working principle of this embodiment is described in detail.
  • the mobile carrier Since the coordinate information of the edge feature information in the sensor's coordinate system is related to the installation position of the sensor in the mobile carrier, when the mobile carrier calculates the offset position information according to the coordinate information of the feature information in the sensor's coordinate system, first, the mobile carrier obtains The posture information of the sensor installed on the mobile carrier, where the posture information includes the installation height and pitch angle of the shooting device installed on the movable carrier. In this embodiment, the posture information is pre-configured. When calculating the offset position information, the mobile carrier can directly access the database to obtain it.
  • the mobile carrier calculates the offset position information based on the posture information and the coordinate information of the edge feature information in the sensor's coordinate system. For example, the mobile carrier calculates the edge feature based on the camera model of the shooting device and the coordinate information of the edge feature information in the coordinate system. The information is in the edge line equation of the camera model, where the camera model includes camera internal parameters.
  • the mobile carrier calculates the offset position information according to the camera model, edge line equation, installation height and pitch angle.
  • the moving carrier can calculate that the shooting device is perpendicular to the shelf in the horizontal direction according to the mathematical deduction of three-dimensional geometry. The relative distance between the edges, and the horizontal angle with the edge of the laminate.
  • the mobile carrier can choose a reference point P in the edge feature information, and let the coordinate information of the reference point P in the coordinate system be (x, y, z). Secondly, the mobile carrier derives the first equation between x and the installation height, pitch angle, and offset position information based on the positional relationship between the edge feature information and the coordinate system, and the relationship between y and the installation height and the pitch angle. The second equation between. Third, the mobile carrier derives a third equation integrating x, y, and z under the same equation based on the equation relationship between the camera model and the edge line equation. Third, the mobile carrier simultaneously establishes the first equation, the second equation, and the third equation to obtain the fourth equation. Finally, the mobile carrier calculates the offset position information according to the fourth equation.
  • FIG. 5 is provided by an embodiment of the present invention using the edge of the laminate as the characteristic information to establish the three-dimensional space coordinate system of the shooting device, and set the shooting device as the origin 0 to establish the three-dimensional space coordinate system.
  • the optical axis direction of the shooting device be the z axis
  • the optical axis intersects the ground at point D, passes through point O to the ground and crosses the ground at point Q, and crosses O in the ODQ plane as the OD perpendicular to the ground crosses the ground at point D E point
  • OE is defined as the y axis
  • the vertical line of the zOy plane passing through the O point is the x axis, and the coordinate system is established.
  • OQ is the installation height h of the camera on the mobile carrier
  • (u, v) represents the coordinate information of the pixel coordinate system
  • f is the focal length
  • focal length is the distance from the origin of the camera coordinate system to the image plane
  • dx and dy are the physical dimensions of each pixel in the abscissa and ordinate directions of the image plane
  • x, y and z are the camera coordinates, respectively
  • the coordinate value of the system, p x , p y are the coordinates of the origin of the image coordinate system in the pixel coordinate system.
  • the moving carrier calculates the angle ⁇ and the vertical distance d between the projection of the camera on the laminate plane and the laminate edge, where the angle ⁇ is the offset angle, and the vertical distance d is the offset distance.
  • P any point on the edge of the layer GF
  • its spatial coordinates in the camera coordinate system of the shooting device are (x, y, z)
  • P' is the pixel point of the P point in the pixel coordinate system
  • the coordinates of P'are (u, v)
  • the distance between point R and RQ is d as a perpendicular line crossing point Q and intersecting the edge GF of the laminate.
  • equation (9) is the first equation, that is, the first equation expresses the relationship between x and the installation height, pitch angle, and offset position information.
  • Equation (4) is the second equation, that is, the second equation expresses the relationship between y and the installation height and pitch angle.
  • Equation (10) is the third equation, that is, the third equation integrates x, y, and z into the same equation.
  • Equation (11) is the fourth equation.
  • equation (11) should hold for any value of z, and thus:
  • the offset angle and offset distance can be calculated. Therefore, the mobile carrier can accurately position in the non-traveling direction, obtain non-traveling position information, and use other positioning methods to obtain the moving carrier's traveling The traveling position information in the direction, combined with the non-traveling position information and the traveling position information, so as to ensure that the mobile carrier will not deviate and collide with the shelf, and reliably and safely approach the target pick-and-place position or leave the aisle.
  • the mobile carrier when the mobile carrier arrives at the place where the goods are picked and placed, the mobile carrier starts to read the QR code on the shelf or other markers used for positioning, and according to the position information of the read markers, the target Cargo boxes are implemented precisely.
  • the feature information described in the above embodiments is different from the edge feature information of the laminate in that the feature information can also be the leg feature information of the shelf legs, and the feature information is the leg feature.
  • the information is taken as an example to elaborate on the working principle of this embodiment.
  • the mobile carrier is provided with a front sensor and a rear sensor.
  • the front sensor can obtain the leg feature information of the shelf leg facing the mobile carrier in the traveling direction
  • the rear sensor can obtain the mobile carrier having passed the shelf leg. The leg feature information.
  • Figure 6a is a schematic diagram of leg feature information of a shelf leg provided by an embodiment of the present invention.
  • the mobile carrier obtains the first leg feature information of the first shelf leg K facing in the direction of travel through the front sensor And the second leg feature information of the second shelf leg L, where the first shelf leg K and the second shelf leg L are located on different rows of shelves and they are opposite.
  • the mobile carrier passes the rear sensor, and the third leg feature information of the third shelf leg M and the fourth leg feature information of the fourth shelf leg N facing away in the direction of travel, where the third shelf leg M and the fourth shelf leg M
  • the shelf legs N are located on different rows of shelves and they are facing each other.
  • the mobile carrier when the mobile carrier calculates the offset position information, it first determines the first leg feature information of the first shelf leg K and the second leg feature information of the second shelf leg L that the mobile carrier faces in the traveling direction Second, the mobile carrier calculates the offset position information according to the respective coordinate information of the first leg feature information and the second leg feature information in the sensor coordinate system, for example, the line segment determined by the first shelf leg and the second shelf leg Is the first line segment, for example, the first line segment is KL.
  • a first straight line EF perpendicular to the first line segment KL is drawn through the midpoint E of the first line segment KL.
  • the line segment determined by the third shelf leg M and the fourth shelf leg N be the second line segment MN, and the second line GH passing through the midpoint G of the second line segment MN is perpendicular to the second line segment MN.
  • Figure 6a in order to visually distinguish between the first straight line EF and the second straight line GH and to facilitate labeling, Figure 6a deliberately marks the first straight line EF and the second straight line GH independently.
  • the straight line EF and the second straight line GH may or may not overlap.
  • the coordinate information of the first leg feature information of the first shelf leg K in the coordinate system is (x k , y k ), the second leg feature information of the second shelf leg L is (x l , y l ), and the third The third leg feature information of the shelf leg M is (x m , y m ), and the fourth leg feature information of the fourth shelf leg N is (x n , y n ).
  • the mobile carrier calculates the offset angle according to the respective coordinate information of the first leg feature information and the second leg feature information in the coordinate system of the sensor, for example, the offset angle is:
  • the mobile carrier may also calculate the offset angle according to the respective coordinate information of the third leg feature information and the fourth leg feature information in the coordinate system of the sensor, for example, the offset angle is:
  • the mobile carrier calculates the offset angle according to the respective coordinate information of the first leg feature information and the third leg feature information in the coordinate system of the sensor, for example, the offset angle is:
  • the mobile carrier calculates the offset angle according to the respective coordinate information of the second leg feature information and the fourth leg feature information in the coordinate system of the sensor, for example, the offset angle is:
  • the moving carrier can also calculate the offset distance. For example, the mobile carrier calculates the first centerline equation of the first straight line in the coordinate system according to the respective coordinate information of the first leg feature information and the second leg feature information in the coordinate system of the sensor. Second, the moving carrier calculates the first distance from the origin of the coordinate system to the first straight line according to the first median line equation, and uses the first distance as the offset distance.
  • the slope of the first line segment KL is The midpoint of the first line segment KL is The equation of the first center line passing through the midpoint of the first line segment KL and perpendicular to the first line segment KL is
  • the origin of the coordinate system is (0,0), and the distance from the origin of the coordinate system to the first centerline equation is Generally, since k kl is much greater than 1, therefore, Approximately equal to 0, therefore,
  • the mobile carrier calculates the offset distance, first determine the third leg feature information of the third shelf leg and the fourth leg feature information of the fourth shelf leg that the mobile carrier faces away in the traveling direction. Secondly, the mobile carrier calculates the offset position information based on the respective coordinate information of the third leg feature information and the fourth leg feature information in the coordinate system of the sensor. For example, the mobile carrier calculates the second centerline equation of the second straight line in the coordinate system based on the third leg feature information and the fourth leg feature information in the coordinate system of the sensor, and calculates the coordinate system according to the second centerline equation The second distance from the origin of the to the second straight line, and the second distance is used as the offset position information.
  • the slope of the second line segment MN The midpoint of the second line segment MN is The equation of a straight line passing through the midpoint of the second line segment MN and perpendicular to the second line segment MN is The origin of the coordinate system is (0,0), and the distance from the origin of the coordinate system to the second centerline equation is Generally, since k mn is much greater than 1, therefore, Approximately equal to 0, therefore,
  • the mobile carrier may also obtain an average value of the second distance and the first distance, and use the average value as the offset position information.
  • the mobile carrier when the mobile carrier is navigating in the lane, not only the methods described in the foregoing embodiments can be used to calculate the offset position information relative to the shelf in the non-traveling direction in the lane, but also the traveling direction of the mobile carrier can be accurately calculated.
  • the current position on the camera so that the current position and the acquired target position can be used for navigation.
  • the mobile carrier can also determine the current coordinates in the direction of travel, that is, the current coordinates are the coordinates corresponding to the current position of the mobile carrier in the direction of travel.
  • the origin of the moving carrier is point O
  • the straight line that passes the origin O and the direction of travel perpendicular to the reference intersects at point S, where the line of the reference travel direction is the midpoint R of the line AB and the line perpendicular to the line AB
  • the midpoint T of the straight line CD make a straight line perpendicular to the straight line CD
  • pass the origin O to make a perpendicular to the straight line AC and intersect at the point U
  • pass the origin O to make a perpendicular to the straight line BD and intersect at the point V.
  • the coordinate information where the point S is located is the current coordinate of the moving carrier in the traveling direction.
  • shelf CC' and shelf DD' are both passed through by the mobile carrier, and shelf AA' and shelf BB' are the next ones that the mobile carrier will pass through.
  • Figure 6b the CU part of the shelf CA or the DV part of the shelf DB The mobile carrier has passed through, and the UA part of the shelf CA or the VB part of the shelf DB has not been passed through by the mobile carrier.
  • the mobile carrier After the mobile carrier has determined the current coordinates in the direction of travel, the mobile carrier will merge the current coordinates with the calculated or received current position estimation information in the lane to obtain the fused position fusion information, and then merge the information with The obtained target position information is used for navigation, where the calculated current position estimation information can be calculated by combining the movement data collected by the internal sensor of the mobile carrier and the preset movement equation.
  • the mobile carrier implements navigation according to the current coordinates and the acquired target position information.
  • the current coordinates of the mobile carrier in the direction of travel there are many ways to determine the current coordinates of the mobile carrier in the direction of travel. For example, in some embodiments, first, determine the entrance coordinates of the mobile carrier in the direction of travel when the mobile carrier enters the entrance of the roadway. For example, please continue to refer to Figure 6b.
  • a schematic diagram of the movement of the mobile carrier in the lane is assumed. It is assumed that the rack CC' and the rack DD' are the racks at the head end of the lane. When the mobile carrier enters the lane, it first needs to pass through the rack CC' and the rack DD'.
  • the straight line RT and the straight line C'D' intersect at a point W, where the coordinates of the point W are the entry coordinates of the moving carrier in the traveling direction.
  • the line segment SW is the moving length of the moving carrier in the direction of travel in the tunnel.
  • the left shelf on the mobile carrier includes shelf C'C, shelf CA and shelf AA'
  • the right shelf on the mobile carrier includes shelf D'D, shelf DB, and shelf BB'.
  • the respective shelf lengths of C'C, shelf CA and shelf AA' are the same and are pre-configured.
  • the respective shelf lengths of shelf D'D, shelf DB and shelf BB' are also the same and are pre-configured. Configured.
  • the shelf CA or the shelf DB is made the current shelf. It is understandable that the "current shelf” can be changed with the current location of the mobile carrier. For example, at time t1, the mobile carrier is currently in the aisle area formed between the shelf CA and the shelf DB, so the shelf CA or the shelf DB Is the current shelf. At time t2, the mobile carrier is currently in the aisle area formed between shelf AA' and shelf BB', so shelf AA' or shelf BB' is the current shelf.
  • the mobile carrier enter the current shelf position in the direction of travel as the starting position, and the position corresponding to the current position in the direction of travel is the final position. Since the current shelf is shelf CA or shelf DB, the mobile carrier starts to enter in the direction of travel The position of the shelf CA or the shelf DB is the point T, that is, the point T is the starting position. Since the current position of the mobile carrier is point O, the position corresponding to the current position point O in the traveling direction is the position of point S, that is, point S is the final position.
  • the moving length of the mobile carrier in the direction of travel in the lane first, obtain the number of shelves that the mobile carrier passes through the same side rack in the lane, for example, the mobile carrier passes through the rack C'C in the lane, or, Pass through shelf D'D, where the number of shelves passing through the same side shelf in the aisle is 1. Second, determine the relative length of the mobile carrier in the direction of travel of the current shelf. The relative length is the absolute value of the difference between the final position and the initial position, that is, the relative length is the length ⁇ x of the line segment ST. Again, multiply the number of shelves by the length of the shelf to obtain the multiplication result.
  • the current coordinates of the moving carrier in the direction of travel are calculated, that is, the x-axis, y-axis, or z-axis values of the entry coordinates are calculated Add the moving length to form a new coordinate value, and use the new coordinate value as the current coordinate of the moving carrier in the direction of travel.
  • x is the current coordinate in the direction of travel
  • x 0 is the entry coordinate of the lane in the direction of travel
  • n is the number of shelves passing by the same side of the shelf
  • c is the length of a shelf in the direction of travel
  • ⁇ x is the mobile carrier The relative length in the direction of travel of the current shelf.
  • the relative length of the mobile carrier in the direction of travel of the current shelf there are many ways to determine the relative length of the mobile carrier in the direction of travel of the current shelf. For example, please continue to refer to Figure 6b. First, calculate the two next to the current shelf and located on the same side.
  • One side shelf for example, the current shelf is shelf CA
  • shelf C'C is adjacent to shelf CA
  • shelf A'A is adjacent to shelf CA. Therefore, shelf C'C is the first side shelf, and shelf A'A It is also the first side shelf.
  • the leg feature information of the respective shelf legs of the two first side shelves calculates the first side line equation determined by the two first side shelves, for example, shelf A'A and shelf C'C are determined
  • the first side straight line is CA
  • the leg feature information of the shelf leg of the first side shelf is (x a , y a )
  • the leg feature information of the shelf leg of the other first side shelf is (x c ,y c ), so:
  • the coordinate information of the first vertical point is determined.
  • the first vertical point is the point that crosses the origin and is perpendicular to the first side line and intersects.
  • point U is The first vertical point.
  • Simultaneous straight line equations (12) and (13) can be used to obtain the coordinate information (x e , y e ) of the point U that crosses the line segment AC as a perpendicular through point O.
  • shelf AA' and shelf CC' both belong to the first side shelf on the same side. Since the mobile carrier moves along the direction of travel, shelf AA' is the shelf facing the mobile carrier in the direction of travel, and shelf CC 'It is the shelf with the mobile carrier facing away in the direction of travel.
  • the mobile carrier calculates the distance between the line segments UC according to the coordinate information U(x e , y e ) and (x c , y c ) of the first vertical point That is, the first lateral distance is the relative length ⁇ x1.
  • the mobile carrier when determining the relative length of the mobile carrier in the traveling direction of the current shelf, the mobile carrier first calculates the two adjacent to the current shelf and on the same side.
  • a second side shelf where the second side shelf and the first side shelf are located on different sides and opposite to each other.
  • the current shelf is shelf DB
  • both shelf D'D and shelf BB' belong to the second side shelf.
  • shelf D'D and shelf BB' are adjacent to shelf DB
  • shelf D'D is directly opposite to shelf C'C
  • shelf BB' is directly opposite to shelf AA'.
  • the leg feature information of the respective shelf legs of the two second side shelves calculate the second side line equation determined by the two second side shelves, for example, the shelf D'D and shelf BB' determined
  • the second side line is DB
  • the leg feature information of the shelf leg of the second side shelf is (x b , y b )
  • the leg feature information of the shelf leg of the other first side shelf is (x d , y d ), so:
  • the slope of line BD is Straight line equation of the second side of line segment BD
  • the coordinate information of the second vertical point is determined according to the second side line equation and the origin coordinates of the coordinate system.
  • the second vertical point is a point that crosses the origin and crosses a straight line perpendicular to the second side, for example, point V is the second vertical point.
  • Simultaneous straight line equations (14) and (15) can obtain the coordinate information (x g , y g ) of the point V that crosses the line segment BD as a perpendicular through point O.
  • shelf DD' and shelf BB' both belong to the second side shelf on the same side. Since the mobile carrier moves along the direction of travel, shelf BB' is the shelf facing the mobile carrier in the direction of travel, and shelf DD 'It is the shelf with the mobile carrier facing away in the direction of travel.
  • the moving carrier calculates the distance between the line segments VD according to the coordinate information V(x g ,y g ) and (x d ,y d ) of the second vertical point That is, the second lateral distance is the relative length ⁇ x2.
  • the mobile carrier may also obtain the average value of the second lateral distance ⁇ x2 and the first lateral distance ⁇ x1, and use the average value as the relative length.
  • the mobile carrier can also calculate the straight line equation of the straight line determined by the SR, and obtain the antiphase angle of the slope of the SR straight line equation to obtain the offset angle.
  • the moving carrier can also calculate the linear equation of the straight line determined by ST, and obtain the inverse angle of the slope of the ST linear equation to obtain the offset angle.
  • the current position can be accurately positioned in the traveling direction, thereby ensuring that the mobile carrier does not It will deviate and collide with the shelf, and reliably and safely approach the target pick-up location or leave the aisle.
  • the mobile carrier enters the roadway from the public area.
  • the positioning method of the mobile carrier in the public area is relatively rough and the positioning error is relatively large.
  • the positioning method of the public area is directly used for the positioning when entering the lane, there will be a risk of hitting the shelves when entering the lane.
  • FIG. 6c is a schematic flowchart of a navigation method according to another embodiment of the present invention.
  • the navigation method S400 further includes:
  • the navigation mobile carrier According to the deflection angle and the relative distance of entering the lane, the navigation mobile carrier enters the entry of the lane.
  • the point W is the center point of the roadway
  • the deflection angle of the roadway is the angle ⁇ between the straight line C'D' and the X axis of the moving carrier coordinate system, which is perpendicular to the straight line C'D' through the origin O.
  • the vertical lines of and intersect at point J, and the relative distance ⁇ d2 of the entry lane is the line segment JW.
  • the user may install identification objects 61 on the sides of the shelves on the two opposite sides at the lane entrance.
  • the shelves CC' and the shelves DD' are located at the lane entrance.
  • the side of the shelf CC' facing the mobile carrier is provided with an identification object 61.
  • the side of the shelf DD' facing the mobile carrier is also provided with an identification object 61, wherein, the identification object 61 is a square, arc or other suitable shape.
  • the identification object 61 may be an object composed of a plurality of edge line segments, wherein for one of the edge line segments, one end is connected to the shelf On one side of the shelf leg, the other end is connected to the other side of the same shelf leg.
  • the two brackets are opposite.
  • the identification object 61 set on the shelf CC' One end of the edge line segment is connected to one side of the shelf CC', and the other end is connected to the other side of the shelf CC'.
  • the marking object 61 set on the shelf DD' one end of the edge line segment is connected to one side of the shelf DD', and the other end is connected to the other side of the shelf DD'.
  • the setting of the identification object 61 on the shelf may not be as in the above-mentioned embodiment.
  • the mathematical model used in the later calculation it can calculate the deflection angle of the entry lane or the entry relative to the lane based on the identification object. distance.
  • a suitable object such as a baffle can also be selected for the identification target.
  • the performance of the baffle includes: rigidity, durability, flatness, good reflective ability, and low cost.
  • the mobile carrier can calculate the edge line equation of the edge line segment of the identification object in the coordinate system. According to the slope of the edge line equation, calculate the relative The deflection angle of the entry lane at the center point of the lane. For example, when the moving carrier scans the image of the baffle plate mounted on the shelf by a sensor such as a laser radar or a photographing device, the linear line segment detection algorithm is used to detect the baffle plate. Analyze the edge line segment of the identified object in the image. Moreover, since the coordinates of the two end points of the edge line segment can be obtained when the sensor collects the data, the coordinate information of each end point can be obtained.
  • the mobile carrier determines the endpoint coordinates of the edge line segment of the identification object on each side closest to the entrance of the roadway, for example, because each side The edge line segment of the identification object is butted with the side of the shelf. Therefore, for the shelf CC', the endpoint of the edge line segment of the identification object closest to the tunnel entrance is C', and the coordinate value of the endpoint C'is (x c , y c ) . For the shelf DD', the end point of the edge line segment of the identification object closest to the lane entrance is D', and the coordinate value of the end point D'is (x d , y d ).
  • the mobile carrier determines the center coordinates of the center point of the roadway according to the coordinates of the two end points, where the line determined by the two end points is the identification line, and the vertical line perpendicular to the identification line through the origin of the coordinate system is the entry vertical line.
  • the straight line determined by the end points C'and D' is the identification straight line C'D'
  • the straight line OJ is the entry vertical line
  • the center coordinate of the roadway center point W is
  • the moving carrier determines the coordinates of the intersection point between the entry vertical line and the marking line, that is, the coordinate value of point J is obtained.
  • the linear equation of the entry vertical line is
  • the mobile carrier calculates the distance between the coordinates of the intersection point and the center coordinates, and uses the distance as the relative distance into the lane. For example, according to the calculation method of the distance between two points, the mobile carrier calculates the distance between the points J(x j ,y j ) and For the two coordinates, the relative distance of the entry lane is calculated as:
  • the mobile carrier can safely and reliably navigate the entrance of the mobile carrier into the tunnel according to the deflection angle of the entrance and the relative distance of the entrance.
  • the method of detecting a straight line is used instead of the traditional method of detecting corners, and then using the vertex coordinates of the straight line to calculate the relative distance of the moving carrier relative to the center of the roadway will be more robust. , Because the detection of a straight line can use a large amount of point cloud data for calculation, which can improve the reliability of calculation.
  • the preset space also includes a public area.
  • the current position information of the mobile carrier is acquired, and the mobile carrier is navigated according to the current position information and the acquired target position information.
  • the current position information can be calculated by mobile carriers such as IMU, odometer or other internal sensors in combination with the preset motion equation, or it can be calculated by the UWB method, or the current position calculated by the preset motion equation can also be calculated.
  • the location information is fused with the current location information sent by UWB, and the obtained location fusion information is used as the final current location information.
  • the mobile carrier can make the mobile carrier closer to the target roadway or console area based on the global positioning information and the acquired target location information.
  • each mobile carrier can also use photographing equipment or lidar to implement emergency obstacle avoidance.
  • Markers such as dimension codes can be used for accurate positioning by the shooting equipment, wherein the markers encapsulate positioning information.
  • the preset space further includes a console area, and the console area is provided with a marker.
  • the mobile carrier enters the console area, it obtains the positioning information of the marker, and controls the mobile carrier according to the positioning information. For example, when the mobile carrier arrives at the console area, the camera starts to read the QR code (or other Marker used for positioning), so as to make accurate and corresponding control logic for the target position according to the positioning information encapsulated by the two-dimensional code.
  • QR code or other Marker used for positioning
  • the embodiments of the present invention provide a navigation device, which is applied to a mobile carrier, and the mobile carrier can travel in a preset space, and the preset space includes a space formed by at least two rows of shelves placed oppositely. Roadway.
  • FIG. 7a is a schematic structural diagram of a navigation device according to an embodiment of the present invention.
  • the navigation device 700 includes a calculation module 71 and a navigation module 72.
  • the calculation module 71 is used to calculate the offset position information of the mobile carrier relative to the rack in the non-traveling direction in the lane;
  • the navigation module 72 is used to navigate the mobile carrier according to the offset position information.
  • the mobile carrier can be navigated based on the offset position information in the non-traveling direction, on the one hand, the mobile carrier can be prevented from colliding with the shelf, and on the other hand, the mobile carrier can be reliably navigated in the lane.
  • FIG. 7b is a schematic structural diagram of the calculation module in FIG. 7a.
  • the calculation module 71 includes: an obtaining unit 711 and a calculation unit 712.
  • the acquiring unit 711 is configured to acquire characteristic information of the shelf
  • the calculation unit 712 is configured to calculate the offset position information of the mobile carrier in the lane relative to the rack in the non-traveling direction according to the characteristic information.
  • the shelf is installed with a laminate
  • the characteristic information is edge characteristic information of the laminate
  • the mobile carrier is equipped with a sensor, and the characteristic information is obtained by the sensor.
  • the calculation unit 712 is configured to calculate the offset position information according to the coordinate information of the characteristic information in the coordinate system of the sensor.
  • the calculation unit 712 is used to obtain the posture information of the sensor installed on the mobile carrier, and calculate the offset position information according to the posture information and the coordinate information of the edge feature information in the coordinate system of the sensor.
  • the sensor includes a shooting device
  • the posture information includes the installation height and pitch angle of the shooting device installed on the mobile carrier.
  • the calculation unit 712 is used to calculate the edge line equation of the edge feature information in the camera model according to the camera model of the shooting device and the coordinate information of the edge feature information in the coordinate system, and calculate the offset according to the camera model, edge line equation, installation height and pitch angle. Move location information.
  • the shooting device be the origin 0
  • the optical axis direction is the z-axis
  • the optical axis intersects the ground at point D, crosses the ground at point O and crosses the ground at point Q, and passes through point O in the ODQ plane
  • OE is defined as the y axis
  • the perpendicular to the zOy plane passing through the O point is the x axis to establish the coordinate system.
  • each shelf includes at least two shelf legs separated by a predetermined distance, and the characteristic information is the leg characteristic information of the shelf legs.
  • the calculation unit 712 is used to determine the first leg feature information of the first shelf leg and the second leg feature information of the second shelf leg that the mobile carrier faces in the travel direction, wherein the first The shelf legs and the second shelf legs are located on different rows of shelves and they are opposite each other, according to the respective coordinate information of the first leg feature information and the second leg feature information in the coordinate system of the sensor , Calculate the offset position information.
  • the line segment determined by the first shelf leg and the second shelf leg is the first line segment
  • the midpoint of the first line segment is the first line segment perpendicular to the first line segment.
  • the calculation unit 712 is configured to calculate the first line of the first straight line in the coordinate system of the sensor according to the respective coordinate information of the first leg feature information and the second leg feature information in the coordinate system of the sensor. Centerline equation; according to the first centerline equation, calculate the first distance from the origin of the coordinate system to the first straight line, and use the first distance as the offset position information.
  • the calculation unit 712 is used to determine the third leg feature information of the third shelf leg and the fourth leg feature information of the fourth shelf leg that the mobile carrier faces back in the direction of travel, wherein The third shelf leg and the fourth shelf leg are located on different rows of shelves and they are opposite; according to the third leg feature information and the fourth leg feature information in the coordinate system of the sensor The respective coordinate information calculates the offset position information.
  • the calculation unit 712 is configured to calculate the position of the second straight line in the coordinate system of the sensor according to the respective coordinate information of the third leg feature information and the fourth leg feature information in the coordinate system of the sensor.
  • the second median line equation of the coordinate system according to the second median line equation, calculate the second distance from the origin of the coordinate system to the second straight line, and use the second distance as the offset position information, or Calculate the average value of the second distance and the first distance, and use the average value as the offset position information.
  • FIG. 7c is a schematic structural diagram of a navigation device provided by another embodiment of the present invention.
  • the navigation device 700 further includes a determining module 73, which is used to determine the moving direction of the mobile carrier The current coordinates on the.
  • the determining module 73 is used to determine the entrance coordinates of the mobile carrier in the direction of travel when the mobile carrier enters the entrance of the tunnel; calculate the moving length of the mobile carrier in the direction of travel in the tunnel; The entry coordinates and the moving length are used to calculate the current coordinates of the moving carrier in the traveling direction.
  • the shelf length of each shelf is preset and the same, so that the position where the mobile carrier starts to enter the current shelf in the direction of travel is the starting position.
  • the position corresponding to the current position above is the final position.
  • the determining module 73 is used to obtain the number of shelves of the mobile carrier passing the same side shelf in the aisle; to determine the relative length of the mobile carrier in the direction of travel of the current shelf, the relative length Is the absolute value of the difference between the final position and the starting position; multiply the number of shelves by the length of the shelves to obtain the multiplication result; add the multiplication result and the relative length to obtain the phase
  • the addition result, and the addition result is used as the moving length.
  • the determining module 73 is used to calculate the two first side shelves adjacent to the current shelf and on the same side; according to the leg characteristics of the respective shelf legs of the two first side shelves Information, calculate the first side line equation determined by the two first side shelves; determine the coordinate information of the first vertical point according to the first side line equation and the origin coordinates of the coordinate system, so The first vertical point is a point that crosses the origin and crosses a straight line perpendicular to the first side edge; calculate the coordinate information of the first vertical point and the leg of the first side shelf facing away from the mobile carrier The first lateral distance between the feature information, and use the first lateral distance as the relative length.
  • the determining module 73 is used to calculate two second side shelves adjacent to the current shelf and located on the same side, wherein the second side shelf and the first side shelf are located at Different sides and opposite; according to the leg feature information of the respective shelf legs of the two second side shelves, calculate the second side line equation determined by the two second side shelves; according to the second The side line equation and the origin coordinates of the coordinate system determine the coordinate information of the second vertical point, the second vertical point is the point that crosses the origin and crosses the second side line perpendicular to the second side; The second lateral distance between the coordinate information of the second vertical point and the leg feature information of the second side shelf facing away from the mobile carrier, and the second lateral distance is taken as the relative length, Alternatively, an average value of the second lateral distance and the first lateral distance is obtained, and the average value is used as the relative length.
  • FIG. 7d is a schematic structural diagram of a navigation device provided by still another embodiment of the present invention.
  • the navigation device 700 further includes an entrance calculation module 74 and an entrance navigation module 75 .
  • the entrance calculation module 74 is used to calculate the entry deflection angle and the entry distance of the mobile carrier relative to the center point of the roadway;
  • the entrance navigation module 75 is used for navigating the entrance of the mobile carrier into the lane according to the deflection angle and the relative distance of the entry.
  • identification objects are installed on the sides of the shelves on two opposite sides at the entrance of the lane; the entrance calculation module 74 is used to calculate the edge line equation of the edge line segment of the identification object in the coordinate system; According to the slope of the edge straight line equation, the deflection angle of the moving carrier relative to the center point of the roadway is calculated.
  • the entrance navigation module 75 is configured to respectively determine the endpoint coordinates of the edge line segment of the identification object on each side that is closest to the entrance of the tunnel; determine the center coordinates of the center point of the tunnel according to the two endpoint coordinates, Wherein, let the straight line determined by the two end points be the identification straight line, and the vertical line perpendicular to the identification straight line passing through the origin of the coordinate system is the entry perpendicular; determine the entry perpendicular and the identification straight line Calculate the distance between the intersection coordinate and the center coordinate, and use the distance as the relative distance into the lane.
  • the senor includes lidar.
  • the navigation module 72 is configured to: adjust the travel of the mobile carrier to a preset travel direction according to the offset position information; and navigate the mobile carrier.
  • the preset space further includes a public area; please refer to FIG. 7d again, the device 700 further includes: a public area navigation module 76 and a console area navigation module 77.
  • the public area navigation module 76 is configured to obtain the current position information of the mobile carrier when the mobile carrier enters the public area; and navigate the mobile carrier according to the current position information and the acquired target position information.
  • the preset space also includes an operating platform area, the operating platform area is provided with a marker, the identifier encapsulating positioning information; the operating platform area navigation module 77 is used when the mobile carrier enters the operating platform area , Acquire the location information of the identifier; control the mobile carrier according to the location information.
  • the above-mentioned navigation device can execute the navigation method provided by the embodiment of the present invention, and has corresponding functional modules and beneficial effects for the execution method.
  • the navigation method provided in the embodiments of the present invention.
  • Fig. 8 is a block diagram of a circuit principle of a mobile carrier provided by an embodiment of the present invention.
  • the mobile carrier 800 includes one or more processors 81 and a memory 82. Among them, one processor 81 is taken as an example in FIG. 8.
  • the processor 81 and the memory 82 may be connected by a bus or in other ways. In FIG. 8, the connection by a bus is taken as an example.
  • the memory 82 can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions corresponding to the navigation method in the embodiment of the present invention.
  • the processor 81 executes various functional applications and data processing of the navigation device by running the non-volatile software programs, instructions, and modules stored in the memory 82, that is, implements the navigation method of the foregoing method embodiments and the foregoing device embodiments. The function of the module.
  • the memory 82 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage devices.
  • the memory 82 may optionally include memories remotely provided with respect to the processor 81, and these remote memories may be connected to the processor 81 via a network. Examples of the aforementioned networks include but are not limited to the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.
  • the program instructions/modules are stored in the memory 82, and when executed by the one or more processors 81, the navigation method in any of the foregoing method embodiments is executed.
  • the mobile carrier 800 of the embodiment of the present invention exists in various forms, and each step described above is executed.
  • the embodiment of the present invention also provides a non-volatile computer storage medium, the computer storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors, such as the one in FIG. 8
  • the device 81 may enable the foregoing one or more processors to execute the navigation method in any of the foregoing method embodiments.
  • the embodiment of the present invention also provides a computer program product, the computer program product includes a computer program stored on a non-volatile computer-readable storage medium, the computer program includes program instructions, when the program instructions are moved When the carrier is executed, the mobile carrier is caused to execute any one of the navigation methods.
  • the device or device embodiments described above are merely illustrative, wherein the unit modules described as separate components may or may not be physically separated, and the components displayed as modular units may or may not be physical units , Which can be located in one place, or can be distributed to multiple network module units. Some or all of the modules may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each implementation manner can be implemented by means of software plus a general hardware platform, and of course, it can also be implemented by hardware.
  • the above technical solution essentially or the part that contributes to the related technology can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk , CD-ROM, etc., including a number of instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute the methods described in each embodiment or some parts of the embodiment.

Abstract

一种智能仓储领域的导航方法、移动载体(100)及导航系统。导航方法应用于移动载体(100),移动载体(100)可在预设空间内行进,预设空间包括由相对摆放的至少两排货架(311)形成的巷道(31),导航方法包括:获取移动载体(100)在巷道(31)内,相对货架(311)在非行进方向的偏移位置信息(S41);根据偏移位置信息,导航移动载体(100)(S42)。一方面,防止移动载体(100)碰撞到货架(311),另一方面,能够在巷道(31)内可靠地导航移动载体(100)。

Description

一种导航方法、移动载体及导航系统
本申请要求于2019年07月11日提交中国专利局、申请号为201910625924.3、申请名称为一种导航方法、移动载体及导航系统的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本发明涉及智能仓储领域,特别是涉及一种导航方法、移动载体及导航系统。
背景技术
现有移动载体可以利用视觉技术在仓库内实施导航,以完成管理员下达的仓储任务。
移动载体在仓库内实施仓储作业时,一般采用二维码导航。即按照一定的规则在地面贴设二维码,移动载体在移动过程中获取地面贴设二维码信息,并将该信息转换为移动载体的导航数据。但是采用二维码导航的方法,在地面的贴码过程中,容易出错,导致移动载体工作不可靠。
发明内容
本发明实施例提供一种导航方法、移动载体及导航系统,其工作可靠。
为了解决上述技术问题,本发明实施例提供以下技术方案:
在第一方面,本发明实施例提供一种导航方法,应用于移动载体,所述移动载体可在预设空间内行进,所述预设空间包括由相对摆放的至少两排货架形成的巷道,所述方法包括:
获取所述移动载体在所述巷道内,相对所述货架在非行进方向的偏移位置信息;
根据所述偏移位置信息,导航所述移动载体。
在第二方面,本发明实施例提供一种移动载体,包括:
至少一个处理器;以及
与所述至少一个处理器通信连接的存储器;
其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行任一实施例提供的导航方法。
在第三方面,本发明实施例提供一种导航系统,包括:
服务器;以及
本发明第二方面对应实施例提供的移动载体,与所述服务器通讯。
相对于传统技术,在本发明各个实施例提供的导航方法、移动载体及导航系统中,移动载体可在预设空间内行进,预设空间包括由相对摆放的至少两排货架形成的巷道,方法包括:计算移动载体在巷道内,相对货架在非行进方向的偏移位置信息,根据偏移位置信息,导航移动载体。因此,根据在非行进方向上的偏移位置信息导航移动载体,一方面,防止移动载体碰撞到货架,另一方面,能够在巷道内可靠地导航移动载体。
附图说明
一个或多个实施例通过与之对应的附图中的图片进行示例性说明,这些示例性说明并不构成对实施例的限定,附图中具有相同参考数字标号的元件表示为类似的元件,除非有特别申明,附图中的图不构成比例限制。
图1是本发明实施例提供的一种移动载体的结构示意图;
图2是图1中移动底盘的结构示意图;
图3a是本发明实施例提供的一种导航系统的结构示意图;
图3b是本发明实施例提供的一种移动载体在仓库内的行进示意图;
图3c是本发明实施例提供的一种货架的侧视图;
图4a是本发明实施例提供的一种导航方法的流程示意图;
图4b是图4a中S41的流程示意图;
图5是本发明实施例提供的以层板边缘为特征信息,建立拍摄设备的三维空间坐标系;
图6a是本发明实施例提供的一种货架腿的腿部特征信息的示意图;
图6b是本发明实施例提供的移动载体在巷道内的行进示意图;
图6c是本发明另一实施例提供的一种导航方法的流程示意图;
图7a是本发明实施例提供的一种导航装置的结构示意图;
图7b是图7a中计算模块的结构示意图;
图7c是本发明另一实施例提供的一种导航装置的结构示意图;
图7d是本发明再另一实施例提供的一种导航装置的结构示意图;
图8是本发明实施例提供一种移动载体的电路原理框图。
具体实施方式
为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本发明,并不用于限定本发明。
除非另有定义,本说明书所使用的所有的技术和科学术语与属于本发明的技术领域的技术人员通常理解的含义相同。在本发明的说明书中所使用的术语只是为了描述具体的实施方式的目的,不是用于限制本发明。本说明书所使用的术语“和/或”包括一个或多个相关的所列项目的任意的和所有的组合。
本发明提供的导航方法可应用于任何合适行业领域或技术领域,诸如智能仓储领域、智能物流领域、智能分拣领域等。
本发明提供的移动载体可应用于任何合适行业领域或技术领域,诸如智能仓储领域、智能物流领域、智能分拣领域等。
当移动载体应用于不同行业领域,移动载体可被构造成不同结构,以实现相应的业务功能。举例而言,当移动载体在应用于智能仓储领域,移动载体可被构造成配置有机械臂,以抓取货物。
本发明实施例提供一种移动载体,请参阅图1,是本发明实施例提供的一种移动载体的结构示意图,移动载体100包括移动底盘10、存储货架20、搬运装置30及升降组件40。其中,存储货架20、搬运装置30以及升降组件40均安装于移动底盘10。
移动底盘10用于携带移动载体100按照规划的路径移动。
存储货架20用于存放货物,在一些实施例中,存储货架20可包括多个存储单元,每个存储单元可放置一个或多个货物。
搬运装置30可沿规划的路径的竖直方向移动,使得搬运装置30的位 置与任意一个存储单元水平相对,搬运装置30用于在固定货架的预设位置和任何一个存储单元之间搬运货物。
升降组件40用于驱动搬运装置30沿竖直方向相对于存储货架20移动,升降组件40包括升降传动机构和升降驱动机构。其中,升降驱动机构用于提供搬运装置30相对于存储货架20沿竖直方向移动的驱动力,升降传动机构用于将第二驱动力传递至搬运装置30。
在一些实施例中,请一并参阅图2,是图1中移动底盘的结构示意图,移动底盘10包括支架总成11、从动轮12、驱动轮组件13以及引导装置14。其中,从动轮12、驱动轮组件13以及引导装置14均安装于支架总成11。
支架总成11由钢梁、钢板以及蒙皮组焊而成,支架总成11包括底座110和立式支架111,立式支架111安装于底座110。
底座110包括底座主体112、轴座113及避震器支架114,轴座113安装于底座主体112,避震器支架114也安装于底座主体112。
底座主体112为一水平设置的矩形板体,具有对称轴线S1,底座主体112包括相对设置的第一表面1120和第二表面1121。
底座主体112设置有从动轮安装槽1122、驱动轮安装口1123及引导装置安装口1124。
从动轮安装槽1122设置于底座主体112的第一表面1120,从动轮安装槽1122用于安装从动轮12。
驱动轮安装口1123贯穿底座主体112的第一表面1120和第二表面1121设置,驱动轮安装口1123用于放置主动轮组件13。
引导装置安装口1124贯穿底座主体112的第一表面1120和第二表面1121设置,引导装置安装口1124用于安装引导装置14。
在本发明实施例中,引导装置14可以为激光雷达、摄像头或者其它合适的传感器。激光雷达或摄像头用于扫描货架的货腿,得到货架图像。
或者,在一些实施例中,与上述实施例不同点在于,引导装置14可以设置在支架总成11任意合适位置,以便拍摄到货架层板或者货架腿。
轴座113和避震器支架114均安装于底座主体112的第二表面1121,轴座113和避震器支架114共同用于安装驱动轮组件13。
值得说明的是,通过设置有用于安装从动轮12的从动轮安装槽1122,以及用于放置驱动轮组件13的驱动轮安装口1123,可实现移动底盘10的离地间隙和质心高度得到控制,使移动底盘10的抓地力得到改善,提高了移动底盘10移动的稳定性。
在一些实施例中,请参阅图3a,是本发明实施例提供的一种导航系统的结构示意图,移动载体100可与服务器200组成导航系统,通过与服务器200互相通讯,以实现导航,从而成功地抓取或存放货物,例如,移动载体100接收服务器200的调度指令,其中,调度指令包括取货位置、目的位置、规划路径及货物信息。移动载体100根据调度指令沿规划路径移动至仓库内的取货位置,获取相应的货物后,将货物运送至目的位置。并且,移动载体将自身位置信息发送至服务器200,以便服务器200根据各个移动载体100发送的位置信息确定当前仓库内航道占用情况。移动载体100接收服务器200发送的仓库内航道占用情况,根据仓库内航道占用情况请求服务器200调整规划路径。
在本发明一些实施例中,此处的服务器200可以是一个物理服务器或者多个物理服务器虚拟而成的一个逻辑服务器。服务器200也可以是多个可互联通信的服务器组成的服务器群,且各个功能模块可分别分布在服务器群中的各个服务器上。
移动载体100在仓库内移动时,可借助各种室内定位方式,辅助定位与导航。请参阅图3b,是本发明实施例提供的一种移动载体在仓库内的行进示意图,仓库300包括巷道31、公共区域32及操作台区域33。
巷道31由相对摆放的至少两排货架311形成的,位于同侧的货架并列排放,位于同侧的货架数量可以为多个,并且,仓库300可以包括多排货架,多排货架中任意相邻两个货架之间皆形成巷道31,因此,多排货架可形成多条巷道31,移动载体100可在巷道31内取放在货架311上的货物。
在巷道31内,为了更好地导航移动载体100取放货物,巷道31内预设基准的行进方向31a,当移动载体100顺沿着行进方向31a行进时,移动载体100在不触碰货架的前提下,有效地在货架上取放货物。当移动载体100偏离行进方向31a而在巷道31内沿着31b或31c行进时,移动载 体100容易出现触碰货架的事故。
在本实施例中,请参阅图3c,是本发明实施例提供的一种货架的侧视图,每个货架311包括层板3111及间隔预设距离的两个货架腿3112,层板3111安装在两个货架腿3112上,两个货架腿3112为层板3111提供支撑力以支撑层板3111,并且,用于装载货物的货箱可放置在层板3111上。
货架腿3112可由任意合适形状的支架构造而成,例如,请参阅图3d,在同侧并排的各个货架中,每个货架中的货架腿俯视图呈直角状。在一些实施例中,每个货架中的货架腿俯视图还可以呈弧状、圆形等等合适形状。
公共区域32为各个移动载体在导航时共同途径的区域,例如,移动载体A1需要前往第一排货架第一个货箱中取货物,移动载体A2需要将第一排货架第二个货箱中的货物运输至操作台区域33,于是,移动载体A1与移动载体A2需要途径公共区域32。
由于众多移动载体频繁出现在公共区域,在本实施例中,为了提高各个移动载体在公共区域32的导航安全性,需要增加各个移动载体之间的预留安全距离,或者,在公共区域32的关键位置或者频繁经过的位置设定标识物,以便各个移动载体根据标识物精确地对各自位置作出定位,以便后续服务器根据各个移动载体的位置灵活地调整各个移动载体的行进方向以及各个移动载体之间的距离。
在本实施例中,标识物包括任意合适形式的标识物,诸如二维码、电子标签、条形码或图形物等等。
操作台区域33为各个移动载体操作货箱或货物的区域,例如,移动载体将运输的货箱或货物放置在操作台区域33的预设位置,或者,管理员在操作台区域33给对应的移动载体配置空货箱,以便移动载体将空货箱放置在对应的货架位置上,例如,当移动载体抵达操作台区域33时,移动载体的摄像头开始读取操作台区域33的标识物,从而实现自身位置的定位,并根据定位位置暂停操作或者实施其它控制逻辑,其中,在一些实施例中,标识物安装在操作台区域33的预设位置,诸如暂停操作的隔壁操作台的防护网或围栏。
在本实施例中,移动载体可以从操作台区域33途径公共区域32,再由公共区域32抵达对应的巷道31内。或者,移动载体还可以从巷道31 内出发,途径公共区域32,再由公共区域32抵达操作台区域33。
在本实施例中,仓库300地面配置有一个地面坐标系XOY,每个货架皆对应着唯一坐标(x,y,θ),其中,x为横坐标,y为纵坐标,θ为机器人的朝向与行进方向之间的夹角。
在一些实施例中,移动载体100还可借助其它室内定位技术完成定位。请参阅图3b,在仓库300地面将无数据标识部署成网格状,仓库300内设置有多个定位基站34,移动载体100设置有定位天线,该定位天线以UWB(Ultra Wideband,超宽带)脉冲重复不间断发送数据帧,各个定位基站34接收UWB脉冲,定位基站34利用高敏度的短脉冲侦测器测量定位标签的数据帧到达接收器天线的时间,服务器200参考定位天线发送过来的校准数据,确定定位天线达到不同定位基站之间的时间差,并利用三点定位技术及优化算法来计算定位天线的位置,亦即移动载体100的位置。其中,定位基站34可采用TDOA(Time difference of Arrival)算法实现定位。
可以理解的是,移动载体100还可借助其它定位方式完成定位与导航,并不局限本发明实施例提供的方式。
本发明实施例提供一种导航方法,应用于移动载体,移动载体设置有传感器,传感器被安装在移动载体合适的位置以采集传感器数据。其中,此处的传感器可采用任何合适类型的传感器,诸如各类运动传感器、图像传感器或无线传感器等等,其中,运动传感器可包括诸如惯性测量单元(Inertial measurement unit,IMU)、陀螺仪、磁场计、加速度计或速度计等等。图像传感器可被构造成任意形状的摄像头,用于拍摄图像。无线传感器设置于移动载体,与外部无线基站或无线系统通讯,基于无线技术实现对移动载体的定位。
移动载体可在预设空间内行进,其中,预设空间为移动载体的活动空间范围,对于不同业务场景,预设空间的界定可不相同,例如,对于仓储业务场景,预设空间为仓库。对于家居业务场景,预设空间为墙壁相隔的各个室内空间总和。在本实施例中,预设空间包括由相对摆放的至少两排货架形成的巷道。
图4a是本发明实施例提供的一种导航方法的流程示意图,如图4a所示,该导航方法S400包括:
S41、获取移动载体在巷道内,相对货架在非行进方向的偏移位置信息;
S42、根据偏移位置信息,导航移动载体。
在本实施例中,非行进方向为移动载体偏离行进方向而移动的方向,当移动载体在巷道内,持续沿着非行进方向而行进时,移动载体容易跑偏货架而导致取放货失败,或者,容易触碰到货架而引发安全事故。
在本实施例中,偏移位置信息为移动载体相对货架之间的偏移量,其中,偏移位置信息包括偏移角和/或偏移距离,其中,偏移角为移动载体在非行进方向上相对于货架的转角,偏移距离为移动载体在非行进方向上相对于货架之间的距离。当移动载体偏离行进方向而在非行进方向移动时,通过根据偏移位置信息,校正移动载体在行进方向上移动,从而提高移动载体在巷道内的导航安全性与可靠性。
在巷道内导航时,区别于传统技术需要根据扫描地面上二维码或者货架二维码实施定位进行导航时,本实施例的移动载体实时计算在巷道内相对货架在非行进方向的偏移位置信息,并且根据偏移位置信息,实施导航,举例而言,移动载体根据偏移位置信息,行进至预设行进方向,例如,当移动载体相对于货架的偏移角为8度,于是,移动载体顺时针转动8度。进一步的,当移动载体相对于货架向左偏移的偏移距离为10厘米,于是,移动载体向右移动10厘米,因此,移动载体重新回归至行进方向,并且朝向是直接向着行进方向的。
再举例而言,移动载体获取当前位置信息,并将偏移位置信息与当前位置信息作融合处理,得到融合位置信息。再次,移动载体将融合位置信息与获取到的目标位置信息实施导航。其中,当前位置信息可以由移动载体扫描货架或地面的二维码,从二维码封装的坐标信息解析出当前位置信息,或者,移动载体根据预设运动方程,结合内传感器发送的诸如速度等运动信息,计算出当前位置信息,或者,移动载体接收外传感器发送的当前位置信息,其中,内传感器包括诸如陀螺仪或里程计等等。接收到的当前位置估算信息可由移动载体接收UWB设备发送的UWB定位信息而来。
本实施例提供的方法可以根据在非行进方向上的偏移位置信息导航移动载体,一方面,防止移动载体碰撞到货架,另一方面,能够在巷道内 可靠地导航移动载体。
计算偏移位置信息的方法比较繁多,诸如通过距离传感器而探测,或者,通过预先构建数学模型并将移动载体当前的环境信息输入该数学模型而得到,或者,通过机器视觉算法而得到等等。
举例而而言,在一些实施例中,请参阅图4b,是图4a中S41的流程示意图,S41包括:
S411、获取货架的特征信息;
S412、根据特征信息,计算移动载体在巷道内,相对货架在非行进方向的偏移位置信息。
在本实施例中,货架可以包括多个特征信息,其中,特征信息用于标识每个货架的不同部位,例如,一个特征信息可用于标识货架的层板,另一个特征信息可用于标识货架的货架腿。
在本实施例中,特征信息可由不同种类传感器而采集到,诸如摄像头或激光雷达等等合适传感器,亦即,可使用摄像头或激光雷达等合适传感器采集对应的特征信息,例如,考虑到货架层板所在位置比较高,并且,层板上的各类物体比较多,若采用激光雷达采集,由于激光雷达采集的激光图像中杂波比较多,图像处理比较复杂,因此,考虑到效率,可以选择摄像头采集层板的特征信息。再例如,考虑到货架的货架腿所在位置比较低,并且,货架腿底下的各类物体比较少,相对于摄像头采集货架腿的特征信息的方式,采用激光雷达采集货架腿的特征信息更为有效率。可以理解的是,此处不对获取货架的特征信息作出任何限制,此处只是作为辅助说明。
在本实施例中,通过预先确定货架上的特征信息,诸如在货架上选择参考物,该参考物的特征信息为货架的特征信息。然后移动载体便可以根据特征信息,计算在巷道内相对货架在非行进方向的偏移位置信息了。
在一些实施例中,如同上述阐述所言,参考物的选择可由预先定义,特征信息由传感器获得并且由传感器发送给移动载体,其中,传感器可以安装在移动载体上,亦可以不用安装在移动载体上,由传感器通过无线通讯或有线通讯将特征信息传输给移动载体。
其中,传感器被配置有坐标系,例如,当传感器为拍摄设备时,拍摄 设备被配置有世界坐标系、相机坐标系、图像坐标系及像素坐标系,在一些实施例中,拍摄设备的世界坐标系与相机坐标系重合,亦可以不重合。当拍摄设备的世界坐标系与相机坐标系不重合时,通过世界坐标系与相机坐标系之间的转换矩阵,将物理点在世界坐标系与相机坐标系之间进行转换。
举例而言,当拍摄设备扫描铺设在地面上的标识物,其中,所述标识物封装有坐标信息,移动载体根据坐标信息及相机模型,计算出标识物与移动载体之间的转换矩阵,后续再根据转换矩阵,得到移动载体在世界坐标系下的位置信息。
再举例而言,当传感器为激光雷达时,激光雷达被配置有世界坐标系、极坐标系,在一些实施例中,激光雷达的世界坐标系与极坐标系重合,亦可以不重合。当激光雷达的世界坐标系与极坐标系不重合时,通过世界坐标系与极坐标系之间的转换矩阵,将物理点在世界坐标系与极坐标系之间进行转换。
可以理解的是,上述各个坐标系之间的内置参数或矩阵都被预先设置。
在一些实施例中,移动载体根据特征信息,计算在巷道内相对货架在非行进方向的偏移位置信息的过程中,其可以根据特征信息在传感器的坐标系的坐标信息,计算偏移位置信息,例如,由于货架的位置和层板的高度是固定的,当传感器为拍摄设备或激光雷达,特征信息为层板的边缘特征信息时,移动载体可以根据边缘特征信息在拍摄设备或激光雷达的坐标系的坐标信息,计算偏移位置信息。其中,层板的边缘特征指货架的边缘在相机拍摄到图像中会有显著的梯度差(例如,灯光照射在货架上使得货架是亮的,而背景是暗的,在货架边缘处会有明显分界线),利用Canny算法可以从拍摄到的图像中提取出边缘特征的图像特征信息,并令该图像特征信息为边缘特征信息。
再例如,当传感器为拍摄设备或激光雷达,特征信息为货架腿的腿部特征信息时,移动载体可以根据腿部特征信息在拍摄设备或激光雷达的坐标系的坐标信息,计算偏移位置信息。
在一些实施例中,以特征信息为边缘特征信息为例,详细阐述本实施例的工作原理。
由于边缘特征信息在传感器的坐标系的坐标信息与传感器在移动载体内的安装位置关联,因此,移动载体根据特征信息在传感器的坐标系的坐标信息计算偏移位置信息时,首先,移动载体获取传感器安装在移动载体的姿态信息,其中,姿态信息包括拍摄设备安装在移动载体上的安装高度及俯仰角。在本实施例中,姿态信息被预先配置好,计算偏移位置信息时,移动载体可以直接访问数据库而获取。
其次,移动载体根据姿态信息及边缘特征信息在传感器的坐标系的坐标信息,计算偏移位置信息,例如,移动载体根据拍摄设备的相机模型及边缘特征信息在坐标系的坐标信息,计算边缘特征信息在相机模型的边缘直线方程,其中,相机模型包括相机内参。
紧接着,移动载体根据相机模型、边缘直线方程、安装高度及俯仰角,计算偏移位置信息。
例如,在本实施例中,当货架层板的高度已知且平行于地面,拍摄设备的姿态被预先配置,则移动载体根据立体几何数学推演可计算出拍摄设备在水平方向上垂直于层板边缘的相对距离,以及水平方向上与层板边缘的夹角。
例如,首先,移动载体在边缘特征信息中任选一个参考点P,并令参考点P在坐标系的坐标信息为(x,y,z)。其次,移动载体根据边缘特征信息与坐标系之间的位置关系,推导出x与安装高度、俯仰角及偏移位置信息之间的第一等式,以及y与安装高度及所述俯仰角之间的第二等式。再次,移动载体根据相机模型与边缘直线方程之间的等式关系,推导出集成x、y及z在同一个等式下的第三等式。再次,移动载体联立第一等式、第二等式及第三等式,得到第四等式。最后,移动载体根据第四等式,计算偏移位置信息。
下面结合图5对推导过程做出详细说明,如下所述:
请参阅图5,是本发明实施例提供的以层板边缘为特征信息,建立拍摄设备的三维空间坐标系,令所述拍摄设备为原点0,建立三维空间坐标系。令拍摄设备的光轴方向为z轴,所述光轴与地面相交于D点,过O点向地面作垂线交地面于Q点,在ODQ平面内过O点作OD垂线交地面于E点,OE定义为y轴,过O点做zOy平面的垂线为x轴,建立所述坐标系。
在本实施例中,OQ为拍摄设备安装在移动载体上的安装高度h,角∠ODQ=θ为拍摄设备安装在移动载体上的俯仰角θ。
令拍摄设备的像素坐标系为uOv,根据拍摄设备的相机模型,有:
Figure PCTCN2020100879-appb-000001
Figure PCTCN2020100879-appb-000002
其中,(u,v)表示像素坐标系的坐标信息,
Figure PCTCN2020100879-appb-000003
其中,f为焦距,焦距为相机坐标系原点到图像平面的距离,dx和dy分别是每个像素在图像平面的横坐标与纵坐标方向上的物理尺寸,x、y及z分别为相机坐标系的坐标值,p x、p y是图像坐标系原点在像素坐标系中的坐标。
首先,移动载体根据相机模型及边缘特征信息在坐标系的坐标信息,计算边缘特征信息在相机模型的边缘直线方程v=mu+n。
其次,移动载体根据安装高度h、俯仰角θ及边缘直线方程v=mu+n,计算出相机在层板平面的投影与层板边缘之间的夹角β与垂直距离d,其中,夹角β为偏移角,垂直距离d为偏移距离。
例如,令P为层板边缘GF上的任一点,其在拍摄设备的相机坐标系中的空间坐标为(x,y,z),P'为该P点在像素坐标系下的像素点,P'坐标为(u,v),令过Q点作垂线相交于层板边缘GF于点R,RQ之间的距离为d。
根据图5,推导出(x,y,z)间的关系:
Figure PCTCN2020100879-appb-000004
合并(3)可得:
Figure PCTCN2020100879-appb-000005
Figure PCTCN2020100879-appb-000006
合并(5)可得:
Figure PCTCN2020100879-appb-000007
Figure PCTCN2020100879-appb-000008
合并(4)(7)可得:
Figure PCTCN2020100879-appb-000009
合并(6)(8)可得:
Figure PCTCN2020100879-appb-000010
将(1)(2)代入直线方程v=mu+n,可得:
Figure PCTCN2020100879-appb-000011
将(4)(9)代入(10)可得:
(f ysin(θ)cos(β)+ncos(θ)cos(β)-mf xsin(β)-p ycos(θ)cos(β)+mp xcos(θ)cos(β))z+mf xhsin(θ)sin(β)+mf xdcos(θ)-f yhcos(β)=0
                                                 (11)
在本实施例中,等式(9)为第一等式,亦即,第一等式表达了x与安装高度、俯仰角及偏移位置信息之间的关系。等式(4)为第二等式,亦即,第二等式表达了y与安装高度及俯仰角之间的关系。等式(10)为第三等式,亦即,第三等式集成x、y及z在同一个等式。等式(11)为第四等式。
由于P点为层板边缘直线上任意一点,等式(11)对任意z值都应当成立,由此可得:
Figure PCTCN2020100879-appb-000012
最终可得:
Figure PCTCN2020100879-appb-000013
因此,通过上述数学推导,便可以计算出偏移角及偏移距离,因此,移动载体能够在非行进方向实施精确地定位,获得非行进位置信息,并借助其它定位方式以获得移动载体在行进方向上的行进位置信息,并且结合 非行进位置信息与行进位置信息,从而保证移动载体不会跑偏而碰撞到货架,并且可靠安全地接近目标取放货位置或离开巷道。
在本实施例中,当移动载体到达取放货物的地点时,移动载体开始读取货架上的二维码或用于定位的其它标识物,根据读取到的标识物的位置信息,对目标货箱实施精确地操作。
在一些实施例中,与上述各个实施例所阐述的特征信息为层板的边缘特征信息的不同点在于,特征信息还可以为货架腿的腿部特征信息,并且,以特征信息为腿部特征信息为例,详细阐述本实施例的工作原理。
在本实施例中,移动载体设置有前置传感器与后置传感器,前置传感器可以获取移动载体在行进方向上面向的货架腿的腿部特征信息,后置传感器可以获取移动载体已途径货架腿的腿部特征信息。
请参阅图6a,是本发明实施例提供的一种货架腿的腿部特征信息的示意图,移动载体通过前置传感器,得到在行进方向上面向的第一货架腿K的第一腿部特征信息以及第二货架腿L的第二腿部特征信息,其中,第一货架腿K与第二货架腿L位于不同排的货架上并且两者正相对。
移动载体通过后置传感器,在行进方向上背向的第三货架腿M的第三腿部特征信息以及第四货架腿N的第四腿部特征信息,其中,第三货架腿M与第四货架腿N位于不同排的货架上并且两者正相对。
在本实施例中,移动载体计算偏移位置信息时,首先确定移动载体在行进方向上面向的第一货架腿K的第一腿部特征信息以及第二货架腿L的第二腿部特征信息,其次,移动载体根据第一腿部特征信息及第二腿部特征信息在传感器的坐标系的各自坐标信息,计算偏移位置信息,例如,令第一货架腿与第二货架腿确定的线段为第一线段,例如,第一线段为KL。过第一线段KL的中点E作垂直于第一线段KL的第一直线EF。令第三货架腿M与第四货架腿N确定的线段为第二线段MN,过第二线段MN的中点G作垂直于第二线段MN的第二直线GH。
在图6a中,为了在视觉上对第一直线EF与第二直线GH作区分并方便标注,图6a特意将第一直线EF与第二直线GH独立标出,可以理解的是,第一直线EF与第二直线GH可以是重合的,亦可以不是重合的。
第一货架腿K的第一腿部特征信息在坐标系的坐标信息为(x k,y k), 第二货架腿L的第二腿部特征信息为(x l,y l),第三货架腿M的第三腿部特征信息为(x m,y m),第四货架腿N的第四腿部特征信息为(x n,y n)。
于是,移动载体根据第一腿部特征信息及第二腿部特征信息在传感器的坐标系的各自坐标信息,计算偏移角,例如,偏移角为:
Figure PCTCN2020100879-appb-000014
或者,在一些实施例中,移动载体还可以根据第三腿部特征信息及第四腿部特征信息在传感器的坐标系的各自坐标信息,计算偏移角,例如,偏移角为:
Figure PCTCN2020100879-appb-000015
或者,在一些实施例中,移动载体根据第一腿部特征信息及第三腿部特征信息在传感器的坐标系的各自坐标信息,计算偏移角,例如,偏移角为:
Figure PCTCN2020100879-appb-000016
或者,在一些实施例中,移动载体根据第二腿部特征信息及第四腿部特征信息在传感器的坐标系的各自坐标信息,计算偏移角,例如,偏移角为:
Figure PCTCN2020100879-appb-000017
或者,从上述四个偏移角中任意选择2个或3个或4个值并求取平均值,将平均值作为偏移角。
在一些实施例中,移动载体还可以计算出偏移距离。例如,移动载体根据第一腿部特征信息及第二腿部特征信息在传感器的坐标系的各自坐标信息,计算第一直线在坐标系的第一中线方程。其次,移动载体根据第一中线方程,计算坐标系的原点到第一直线的第一距离,并将第一距离作为偏移距离。
例如,第一线段KL的斜率为
Figure PCTCN2020100879-appb-000018
第一线段KL的中点为
Figure PCTCN2020100879-appb-000019
Figure PCTCN2020100879-appb-000020
穿过第一线段KL中点垂直于第一线段KL的第一中线方程为
Figure PCTCN2020100879-appb-000021
坐标系原点为(0,0)计算坐标系原点到第一中线方程的距离为
Figure PCTCN2020100879-appb-000022
一般的,由于k kl远大于1,因此,
Figure PCTCN2020100879-appb-000023
约等于0,因此,
Figure PCTCN2020100879-appb-000024
与上述实施例不同点在于,移动载体计算偏移距离时,首先确定移动 载体在行进方向上背向的第三货架腿的第三腿部特征信息以及第四货架腿的第四腿部特征信息,其次,移动载体根据第三腿部特征信息及第四腿部特征信息在传感器的坐标系的各自坐标信息,计算偏移位置信息。例如,移动载体根据第三腿部特征信息及第四腿部特征信息在传感器的坐标系的各自坐标信息,计算第二直线在坐标系的第二中线方程,根据第二中线方程,计算坐标系的原点到第二直线的第二距离,并将第二距离作为偏移位置信息。
例如,第二线段MN的斜率
Figure PCTCN2020100879-appb-000025
第二线段MN的中点为
Figure PCTCN2020100879-appb-000026
Figure PCTCN2020100879-appb-000027
穿过第二线段MN中点垂直于第二线段MN的直线方程为
Figure PCTCN2020100879-appb-000028
坐标系原点为(0,0)计算坐标系原点到第二中线方程的距离为
Figure PCTCN2020100879-appb-000029
一般的,由于k mn远大于1,因此,
Figure PCTCN2020100879-appb-000030
约等于0,因此,
Figure PCTCN2020100879-appb-000031
在一些实施例中,移动载体还可以求取第二距离与第一距离两者的平均值,并将平均值作为偏移位置信息。
一般的,移动载体在巷道内导航时,不仅可以使用前述各个实施例所阐述的方法以计算在巷道内相对货架在非行进方向的偏移位置信息,而且还可以精确地计算移动载体在行进方向上的当前位置,以便后期结合当前位置与获取到的目标位置实施导航。
因此,在一些实施例中,移动载体还可以确定在行进方向上的当前坐标,亦即,所述当前坐标为在行进方向上与移动载体当前位置对应的坐标,例如,请参阅图6b,令移动载体的原点为点O,过原点O作垂直于基准的行进方向所在的直线交于点S,其中,基准的行进方向所在的直线为过直线AB的中点R作垂直于直线AB的直线,或者,为过直线CD的中点T作垂直于直线CD的直线,过原点O作垂直于直线AC并交于点U,过原点O作垂直于直线BD并交于点V。
在本实施例中,点S所在的坐标信息为移动载体在行进方向上的当前坐标。并且,货架CC’及货架DD’都被移动载体穿过,货架AA’及货架BB’是移动载体接下来要穿过的,由图6b也可知,货架CA中CU部分或 货架DB中DV部分已被移动载体穿过,货架CA中UA部分或货架DB中VB部分尚未被移动载体穿过。
当移动载体确定好在行进方向上的当前坐标后,移动载体在巷道内将当前坐标与计算或接收到的当前位置估算信息作融合处理,得到融合后的位置融合信息,再根据位置融合信息与获取到的目标位置信息实施导航,其中,计算的当前位置估算信息可由移动载体的内传感器采集的运动数据结合预设运动方程计算而来。
或者,在一些实施例中,当确定好在行进方向上的当前坐标后,在巷道内,移动载体根据当前坐标与获取到的目标位置信息实施导航。
确定移动载体在行进方向上的当前坐标的方法比较繁多,例如,在一些实施例中,首先,确定移动载体进入巷道入口时,在行进方向上的入口坐标,例如,请继续参阅图6b,是本发明实施例提供的移动载体在巷道内的行进示意图,假设货架CC’及货架DD’是巷道首端的货架,移动载体进入巷道时,首先需要经过货架CC’及货架DD’,行进方向所在的直线RT与直线C’D’交于点W,其中,点W的坐标为移动载体在行进方向上的入口坐标。
其次,计算移动载体在巷道内行进方向上的移动长度,亦即,线段SW为移动载体在巷道内行进方向上的移动长度。其中,计算移动载体在巷道内行进方向上的移动长度的方法繁多,举例而言,在一些实施例中,位于同侧货架的数量为多个,每个货架的货架长度皆被预设并且相同,例如,请继续参阅图6b,位于移动载体的左侧货架包括货架C’C、货架CA及货架AA’,位于移动载体的右侧货架包括货架D’D、货架DB及货架BB’,货架C’C、货架CA及货架AA’的各自货架长度是相同的并且被预先配置好的,同理可得,货架D’D、货架DB及货架BB’的各自货架长度也是相同的并且被预先配置好的。
由于移动载体当前在货架CA与货架DB之间形成的巷道区域内,于是,令货架CA或货架DB为当前货架。可以理解的是,“当前货架”可以随移动载体当前所在的位置而变换,例如,在t1时刻,移动载体当前在货架CA与货架DB之间形成的巷道区域内,于是,货架CA或货架DB为当前货架。在t2时刻,移动载体当前在货架AA’与货架BB’之间形成的巷道区 域内,于是,货架AA’或货架BB’为当前货架。
令移动载体在行进方向上开始进入当前货架的位置为起始位置,在行进方向上与当前位置对应的位置为最终位置,由于当前货架为货架CA或货架DB,移动载体在行进方向上开始进入货架CA或货架DB的位置为点T,亦即,点T为起始位置。由于移动载体的当前位置为点O,在行进方向上与当前位置点O对应的位置为点S的位置,亦即,点S为最终位置。
因此,在计算移动载体在巷道内行进方向上的移动长度时,首先,获取移动载体在巷道内途经过同侧货架的货架数量,例如,移动载体在巷道内途径过货架C’C,或者,途径过货架D’D,其中,在巷道内途经过同侧货架的货架数量为1。其次,确定移动载体在当前货架的行进方向上的相对长度,相对长度为最终位置与起始位置之差的绝对值,亦即,相对长度为线段ST的长度Δx。再次,将货架数量乘以货架长度,得到相乘结果,亦即,当货架长度为C时,货架数量为n时,相乘结果为P=C*n,在本实施例中,P=C*1=C。最后,将相乘结果与相对长度相加,得到相加结果,将相加结果作为移动长度,亦即,X1=P+Δx。
如前所述,当计算出移动长度后,最后,根据入口坐标及移动长度,计算移动载体在行进方向上的当前坐标,亦即,将入口坐标的x轴或y轴或z轴上的值加上移动长度,形成新的坐标值,并将新的坐标值作为移动载体在行进方向上的当前坐标。
总体而言,由于同侧货架的货架长度已知,可根据对检测到途经过同侧货架的货架数量,根据以下公式:
x=x 0+nc+Δx
其中,x为行进方向的当前坐标,x 0为在行进方向上的巷道的入口坐标,n为途经过同侧货架的货架数量,c为一个货架在行进方向上的货架长度,Δx为移动载体在当前货架的行进方向上的相对长度。
因此,根据上述公式,便可以得到移动载体在行进方向上的当前坐标。
在一些实施例中,确定移动载体在当前货架的行进方向上的相对长度的方法比较繁多,举例而言,请继续参阅图6b,首先,计算与当前货架相邻并位于同侧的两个第一侧边货架,例如,当前货架为货架CA,货架C’C与货架CA相邻,货架A’A与货架CA相邻,因此,货架C’C为第一侧 边货架,货架A’A也为第一侧边货架。
其次,根据两个第一侧边货架的各自货架腿的腿部特征信息,计算由两个第一侧边货架确定的第一侧边直线方程,例如,货架A’A与货架C’C确定的第一侧边直线为CA,第一侧边货架的货架腿的腿部特征信息为(x a,y a),另一个第一侧边货架的货架腿的腿部特征信息为(x c,y c),于是:
线段AC的斜率为
Figure PCTCN2020100879-appb-000032
线段AC的第一侧边直线方程y=k ac*x+(y a-k ac*x a)      (12)
再次,根据第一侧边直线方程及坐标系的原点坐标,确定第一垂点的坐标信息,第一垂点为过原点作垂直于第一侧边直线并相交的点,例如,点U为第一垂点。
穿过O点垂直于AC的第一垂线方程为
Figure PCTCN2020100879-appb-000033
联立直线方程(12)和(13)可求得过O点作垂线交于线段AC的点U的坐标信息(x e,y e)。
最后,计算第一垂点的坐标信息与背向移动载体的第一侧边货架的腿部特征信息之间的第一侧向距离,并将第一侧向距离作为相对长度,在本实施例中,货架AA’与货架CC’都属于同侧的第一侧边货架,由于移动载体是沿着行进方向而前进的,于是,货架AA’是移动载体在行进方向上面向的货架,货架CC’是移动载体在行进方向上背向的货架。
因此,移动载体根据第一垂点的坐标信息U(x e,y e)与(x c,y c),计算出线段UC之间的距离
Figure PCTCN2020100879-appb-000034
亦即,第一侧向距离为相对长度Δx1。
与上述各个实施例计算相对长度的方法不同点在于,在一些实施例中,确定移动载体在当前货架的行进方向上的相对长度时,首先移动载体计算与当前货架相邻并位于同侧的两个第二侧边货架,其中,第二侧边货架与第一侧边货架位于不同侧并且相对,例如,当前货架为货架DB,货架D’D及货架BB’都属于第二侧边货架,其中,货架D’D及货架BB’都与货架DB相邻,并且,货架D’D与货架C’C正相对,货架BB’与货架AA’正相对。
其次,根据两个第二侧边货架的各自货架腿的腿部特征信息,计算由 两个第二侧边货架确定的第二侧边直线方程,例如,货架D’D与货架BB’确定的第二侧边直线为DB,第二侧边货架的货架腿的腿部特征信息为(x b,y b),另一个第一侧边货架的货架腿的腿部特征信息为(x d,y d),于是:
线段BD的斜率为
Figure PCTCN2020100879-appb-000035
线段BD的第二侧边直线方程
y=k bd*x+(y b-k bd*x b)      (14)
再次,根据第二侧边直线方程及坐标系的原点坐标,确定第二垂点的坐标信息,第二垂点为过所述原点作垂直于第二侧边直线并相交的点,例如,点V为第二垂点。
穿过O点垂直于BD的第一垂线方程为
Figure PCTCN2020100879-appb-000036
联立直线方程(14)和(15)可求得过O点作垂线交于线段BD的点V的坐标信息(x g,y g)。
最后,计算第二垂点的坐标信息与背向移动载体的第二侧边货架的腿部特征信息之间的第二侧向距离,并将第二侧向距离作为相对长度,在本实施例中,货架DD’与货架BB’都属于同侧的第二侧边货架,由于移动载体是沿着行进方向而前进的,于是,货架BB’是移动载体在行进方向上面向的货架,货架DD’是移动载体在行进方向上背向的货架。
因此,移动载体根据第二垂点的坐标信息V(x g,y g)与(x d,y d),计算出线段VD之间的距离
Figure PCTCN2020100879-appb-000037
亦即,第二侧向距离为相对长度Δx2。
在一些实施例中,移动载体还可以求取第二侧向距离Δx2与第一侧向距离Δx1两者的平均值,并将平均值作为相对长度。
在一些实施例中,移动载体还可以计算由SR确定直线的直线方程,并求取SR直线方程的斜率的反相角,得到偏移角。或者,移动载体还可以计算由ST确定直线的直线方程,并求取ST直线方程的斜率的反相角,得到偏移角。
总体而言,通过上述各个实施例,不仅能够实现移动载体在非行进方向的偏移角及偏移距离的精确计算,而且还能够在行进方向对当前位置实施精确的定位,从而保证移动载体不会跑偏而碰撞到货架,并且可靠安全地接近目标取放货位置或离开巷道。
并且,综上各个实施例,可知:由于传统技术需要在巷道内的地面贴设二维码以便导航,因此,此种作法存在贴码施工复杂、维护不便、成本高、结构复杂、速度慢、效率低、误差大、易损坏、不安全的问题,因此,采用本实施例提供的导航方法,其无需在巷道内贴码,便可以在巷道内安全可靠地导航,并且,此种作法的成本低、无需维护贴码、误差小、不存在损坏问题、安全可靠,并且,移动载体在相隔一定距离便可以根据货架各个特征信息实施导航,因此,导航速度快和效率高。
如前所述,移动载体自公共区域进入巷道,一般的,移动载体在公共区域的定位方法比较粗糙,定位误差比较大。当移动载体开始进入巷道时,若直接使用公共区域的定位方法用于在开始进入巷道时的定位,会存在一开始进入巷道便撞击到货架的风险。
因此,在一些实施例中,在进入巷道之前,请参阅图6b与图6c,图6c是本发明另一实施例提供的一种导航方法的流程示意图,导航方法S400还包括:
S43、计算移动载体相对巷道中心点的进巷偏转角及进巷相对距离;
S44、根据偏转角及进巷相对距离,导航移动载体进入巷道的入口。
在本实施例中,点W为巷道中心点,进巷偏转角为直线C’D’与移动载体坐标系的X轴之间的夹角λ,作过原点O作垂直于直线C’D’的垂线并交于点J,进巷相对距离Δd2为线段JW。
在一些实施例中,在计算进巷偏转角之前,用户可以在巷道入口处的两相对侧的货架的侧面皆安装有标识对象物61,例如,货架CC’及货架DD’是位于巷道入口处的两相对侧的两个货架,在移动载体进入巷道之前,货架CC’朝向移动载体的侧面设置有标识对象物61,同理,货架DD’朝向移动载体的侧面也设置有标识对象物61,其中,标识对象物61呈方形、弧形或者其它合适形状,在一些实施例中,标识对象物61可由多条边缘线段构成的物体,其中,对于其中一条边缘线段而言,其一端连接至货架的货架腿的一侧支架上,另一端连接至同条货架腿的另一侧支架上,所述两个支架相对,例如,请继续参阅图6b,对于设置在货架CC’的标识对象物61,其边缘线段一端连接在货架CC’的一侧上,另一端连接在货架CC’的另一侧上。同理可得,对于设置在货架DD’的标识对象物61,其 边缘线段一端连接在货架DD’的一侧上,另一端连接在货架DD’的另一侧上。可以理解的是,标识对象物61在货架上的设置可以不用如上述实施例的设置方式,只要后期计算所用的数学模型合适,其都可以根据标识对象物计算出进巷偏转角或进巷相对距离。
可以理解的是,标识对象物还可以选择挡板等等合适物体,其中,挡板的性能包括:坚硬、耐用、平整、反光能力良好、成本较低。
当设置好标识对象物后,计算进巷偏转角时,在一些实施例中,移动载体可以计算标识对象物的边缘线段在坐标系的边缘直线方程,根据边缘直线方程的斜率,计算移动载体相对巷道中心点的进巷偏转角,举例而言,移动载体通过诸如激光雷达或拍摄设备等传感器扫描到标识对象物安装在货架上的挡板图像时,通过直线线段检测算法,从所述挡板图像中解析出标识对象物的边缘线段。并且,由于边缘线段的两个端点坐标在传感器采集数据时便可以获得各个端点的坐标信息,因此,根据直线线段检测算法,结合各个端点的坐标信息,便可以计算出边缘线段的直线方程y=k*x+b,则边缘线段的直线方程的斜率为k,因此移动载体相对于巷道入口的进巷偏转角为θ=tan -1(k)。
进一步的,在一些实施例中,移动载体计算相对巷道中心点的进巷相对距离时,首先,移动载体分别确定每侧标识对象物的边缘线段最靠近巷道入口的端点坐标,例如,由于每侧标识对象物的边缘线段与货架的侧面首尾对接,因此,对于货架CC’,标识对象物的边缘线段最靠近巷道入口的端点为C’,端点C’的坐标值为(x c,y c)。对于货架DD’,标识对象物的边缘线段最靠近巷道入口的端点为D’,端点D’的坐标值为(x d,y d)。
其次,移动载体根据两个端点坐标,确定巷道中心点的中心坐标,其中,令两个端点确定的直线为标识直线,过坐标系的原点作垂直于标识直线的垂线为进巷垂线,举例而言,端点C’与D’确定的直线为标识直线C’D’,直线OJ为进巷垂线,巷道中心点W的中心坐标为
Figure PCTCN2020100879-appb-000038
再次,移动载体确定进巷垂线与标识直线之间的交点坐标,亦即,求取点J的坐标值,举例而言,进巷垂线的直线方程为
Figure PCTCN2020100879-appb-000039
标识直线的直线方程为y=k*x+b,联立上述两个直线方程,得到点J的坐标 值为(x j,y j)。
最后,移动载体计算交点坐标与中心坐标之间的距离,并将距离作为进巷相对距离,举例而言,根据两点距离的计算方法,移动载体根据点J(x j,y j)与
Figure PCTCN2020100879-appb-000040
两者坐标,计算出进巷相对距离为:
Figure PCTCN2020100879-appb-000041
因此,移动载体可以根据进巷偏转角及进巷相对距离,安全可靠地导航移动载体进入巷道的入口。
在上述实施例中,在计算进巷偏转角时,通过使用检测直线的方法替代传统检测角点的方法,再使用直线段顶点坐标计算移动载体相对于巷道中心点的进巷相对距离会更加稳健,因为检测直线可使用大量的点云数据进行计算,其能够提高计算地可靠性。
在一些实施例中,预设空间还包括公共区域。当移动载体进入公共区域时,获取移动载体的当前位置信息,根据当前位置信息与获取的目标位置信息,导航移动载体。其中,当前位置信息可由移动载体诸如IMU、里程计或其它内传感器结合预设运动方程计算而来,或者,还可由UWB方法计算出的,或者,还可以将由预设运动方程计算而来的当前位置信息与UWB发送来的当前位置信息作融合处理,得到的位置融合信息作为最终的当前位置信息。
在公共区域内,移动载体通过根据全局定位信息和获取的目标位置信息,使移动载体更能接近目标巷道或操作台区域。在一些实施例中,考虑到公共区域的移动载体众多,各个移动载体还可以使用拍摄设备或激光雷达实施紧急避障。
在公共区域内,一般而言,由于移动载体缺乏精确定位手段,因此,在一些实施例中,需要增大各个移动载体之间的预留安全距离,或者在关键位置和频繁经过位置设定二维码等标识物以供拍摄设备实施精确的定位,其中,标识物封装有定位信息。
在一些实施例中,预设空间还包括操作台区域,操作台区域设置有标识物。当移动载体进入操作台区域时,获取标识物的定位信息,根据定位 信息,控制移动载体,例如,当移动载体抵达操作台区域时,拍摄设备开始读取操作台区域的二维码(或其他用于定位的标识物),以便根据二维码封装的定位信息,对目标位置作出精确地并且对应的控制逻辑。
需要说明的是,在上述各个实施例中,上述各步骤之间并不必然存在一定的先后顺序,本领域普通技术人员,根据本发明实施例的描述可以理解,不同实施例中,上述各步骤可以有不同的执行顺序,亦即,可以并行执行,亦可以交换执行等等。
作为本发明实施例的另一方面,本发明实施例提供一种导航装置,应用于移动载体,移动载体可在预设空间内行进,预设空间包括由相对摆放的至少两排货架形成的巷道。请参阅图7a,是本发明实施例提供的一种导航装置的结构示意图,导航装置700包括:计算模块71与导航模块72。
计算模块71用于计算移动载体在巷道内,相对货架在非行进方向的偏移位置信息;
导航模块72用于根据偏移位置信息,导航移动载体。
综上,由于能够根据在非行进方向上的偏移位置信息导航移动载体,一方面,防止移动载体碰撞到货架,另一方面,能够在巷道内可靠地导航移动载体。
在一些实施例中,请参阅图7b,是图7a中计算模块的结构示意图,计算模块71包括:获取单元711与计算单元712。
获取单元711用于获取货架的特征信息;
计算单元712用于根据所述特征信息,计算所述移动载体在所述巷道内,相对所述货架在非行进方向的偏移位置信息。
在一些实施例中,货架安装有层板,特征信息为层板的边缘特征信息。
在一些实施例中,移动载体安装有传感器,所述特征信息由传感器获得。计算单元712用于根据特征信息在传感器的坐标系的坐标信息,计算偏移位置信息。
在一些实施例中,计算单元712用于获取传感器安装在移动载体的姿态信息,根据姿态信息及边缘特征信息在传感器的坐标系的坐标信息,计算偏移位置信息。
在一些实施例中,传感器包括拍摄设备,姿态信息包括拍摄设备安装 在移动载体上的安装高度及俯仰角。计算单元712用于根据拍摄设备的相机模型及边缘特征信息在坐标系的坐标信息,计算边缘特征信息在相机模型的边缘直线方程,根据相机模型、边缘直线方程、安装高度及俯仰角,计算偏移位置信息。
在一些实施例中,令拍摄设备为原点0,光轴方向为z轴,光轴与地面相交于D点,过O点向地面作垂线交地面于Q点,在ODQ平面内过O点作OD垂线交地面于E点,OE定义为y轴,过O点做zOy平面的垂线为x轴,建立所述坐标系。
在一些实施例中,每个货架至少包括间隔预设距离的两个货架腿,特征信息为货架腿的腿部特征信息。
在一些实施例中,计算单元712用于确定移动载体在行进方向上面向的第一货架腿的第一腿部特征信息以及第二货架腿的第二腿部特征信息,其中,所述第一货架腿与所述第二货架腿位于不同排的货架上并且两者正相对,根据所述第一腿部特征信息及所述第二腿部特征信息在所述传感器的坐标系的各自坐标信息,计算所述偏移位置信息。
在一些实施例中,令所述第一货架腿与所述第二货架腿确定的线段为第一线段,过所述第一线段的中点作垂直于所述第一线段的第一直线。计算单元712用于根据所述第一腿部特征信息及所述第二腿部特征信息在所述传感器的坐标系的各自坐标信息,计算所述第一直线在所述坐标系的第一中线方程;根据所述第一中线方程,计算所述坐标系的原点到所述第一直线的第一距离,并将所述第一距离作为所述偏移位置信息。
在一些实施例中,计算单元712用于确定所述移动载体在行进方向上背向的第三货架腿的第三腿部特征信息以及第四货架腿的第四腿部特征信息,其中,所述第三货架腿与所述第四货架腿位于不同排的货架上并且两者正相对;根据所述第三腿部特征信息及所述第四腿部特征信息在所述传感器的坐标系的各自坐标信息,计算所述偏移位置信息。
令所述第三货架腿与所述第四货架腿确定的线段为第二线段,过所述第二线段的中点作垂直于所述第二线段的第二直线。在一些实施例中,计算单元712用于根据所述第三腿部特征信息及所述第四腿部特征信息在所述传感器的坐标系的各自坐标信息,计算所述第二直线在所述坐标系的第 二中线方程;根据所述第二中线方程,计算所述坐标系的原点到所述第二直线的第二距离,并将所述第二距离作为所述偏移位置信息,或者,求取所述第二距离与所述第一距离两者的平均值,并将所述平均值作为所述偏移位置信息。
在一些实施例中,请参阅图7c,是本发明另一实施例提供的一种导航装置的结构示意图,导航装置700还包括确定模块73,确定模块73用于确定所述移动载体在行进方向上的当前坐标。
在一些实施例中,确定模块73用于确定所述移动载体进入所述巷道入口时,在行进方向上的入口坐标;计算所述移动载体在所述巷道内行进方向上的移动长度;根据所述入口坐标及所述移动长度,计算所述移动载体在行进方向上的当前坐标。
位于同侧货架的数量为多个,每个所述货架的货架长度皆被预设并且相同,令所述移动载体在行进方向上开始进入所述当前货架的位置为起始位置,在行进方向上与当前位置对应的位置为最终位置。在一些实施例中,确定模块73用于获取所述移动载体在所述巷道内途经过同侧货架的货架数量;确定所述移动载体在当前货架的行进方向上的相对长度,所述相对长度为所述最终位置与所述起始位置之差的绝对值;将所述货架数量乘以所述货架长度,得到相乘结果;将所述相乘结果与所述相对长度相加,得到相加结果,将所述相加结果作为所述移动长度。
在一些实施例中,确定模块73用于计算与所述当前货架相邻并位于同侧的两个第一侧边货架;根据所述两个第一侧边货架的各自货架腿的腿部特征信息,计算由所述两个第一侧边货架确定的第一侧边直线方程;根据所述第一侧边直线方程及所述坐标系的原点坐标,确定第一垂点的坐标信息,所述第一垂点为过所述原点作垂直于所述第一侧边直线并相交的点;计算所述第一垂点的坐标信息与背向所述移动载体的第一侧边货架的腿部特征信息之间的第一侧向距离,并将所述第一侧向距离作为所述相对长度。
在一些实施例中,确定模块73用于计算与所述当前货架相邻并位于同侧的两个第二侧边货架,其中,所述第二侧边货架与所述第一侧边货架位于不同侧并且相对;根据所述两个第二侧边货架的各自货架腿的腿部特 征信息,计算由所述两个第二侧边货架确定的第二侧边直线方程;根据所述第二侧边直线方程及所述坐标系的原点坐标,确定第二垂点的坐标信息,所述第二垂点为过所述原点作垂直于所述第二侧边直线并相交的点;计算所述第二垂点的坐标信息与背向所述移动载体的第二侧边货架的腿部特征信息之间的第二侧向距离,并将所述第二侧向距离作为所述相对长度,或者,求取所述第二侧向距离与所述第一侧向距离两者的平均值,并将所述平均值作为所述相对长度。
在进入所述巷道之前,在一些实施例中,请参阅图7d,是本发明再另一实施例提供的一种导航装置的结构示意图,导航装置700还包括入口计算模块74与入口导航模块75。
入口计算模块74用于计算所述移动载体相对所述巷道中心点的进巷偏转角及进巷相对距离;
入口导航模块75用于根据所述偏转角及所述进巷相对距离,导航所述移动载体进入所述巷道的入口。
在一些实施例中,在所述巷道入口处的两相对侧的货架的侧面皆安装有标识对象物;入口计算模块74用于计算所述标识对象物的边缘线段在坐标系的边缘直线方程;根据所述边缘直线方程的斜率,计算所述移动载体相对所述巷道中心点的进巷偏转角。
在一些实施例中,入口导航模块75用于分别确定每侧标识对象物的边缘线段最靠近所述巷道入口的端点坐标;根据两个所述端点坐标,确定所述巷道中心点的中心坐标,其中,令所述两个端点确定的直线为标识直线,过所述坐标系的原点作垂直于所述标识直线的垂线为进巷垂线;确定所述进巷垂线与所述标识直线之间的交点坐标;计算所述交点坐标与所述中心坐标之间的距离,并将所述距离作为所述进巷相对距离。
在一些实施例中,所述传感器包括激光雷达。
在一些实施例中,导航模块72用于:根据所述偏移位置信息,调节所述移动载体行进至预设行进方向;导航所述移动载体。
在一些实施例中,所述预设空间还包括公共区域;请再参阅图7d,所述装置700还包括:公共区域导航模块76及操作台区域导航模块77。
公共区域导航模块76用于当所述移动载体进入所述公共区域时,获 取所述移动载体的当前位置信息;根据所述当前位置信息与获取的目标位置信息,导航所述移动载体。
所述预设空间还包括操作台区域,所述操作台区域设置有标识物,所述标识物封装有定位信息;操作台区域导航模块77用于当所述移动载体进入所述操作台区域时,获取所述标识物的定位信息;根据所述定位信息,控制所述移动载体。
需要说明的是,上述导航装置可执行本发明实施例所提供的导航方法,具备执行方法相应的功能模块和有益效果。未在导航装置实施例中详尽描述的技术细节,可参见本发明实施例所提供的导航方法。
图8是本发明实施例提供一种移动载体的电路原理框图。如图8所示,该移动载体800包括一个或多个处理器81以及存储器82。其中,图8中以一个处理器81为例。
处理器81和存储器82可以通过总线或者其他方式连接,图8中以通过总线连接为例。
存储器82作为一种非易失性计算机可读存储介质,可用于存储非易失性软件程序、非易失性计算机可执行程序以及模块,如本发明实施例中的导航方法对应的程序指令/模块。处理器81通过运行存储在存储器82中的非易失性软件程序、指令以及模块,从而执行导航装置的各种功能应用以及数据处理,即实现上述方法实施例导航方法以及上述装置实施例的各个模块的功能。
存储器82可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中,存储器82可选包括相对于处理器81远程设置的存储器,这些远程存储器可以通过网络连接至处理器81。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
所述程序指令/模块存储在所述存储器82中,当被所述一个或者多个处理器81执行时,执行上述任意方法实施例中的导航方法。
本发明实施例的移动载体800以多种形式存在,在执行以上描述的各个步骤。
本发明实施例还提供了一种非易失性计算机存储介质,所述计算机存 储介质存储有计算机可执行指令,该计算机可执行指令被一个或多个处理器执行,例如图8中的一个处理器81,可使得上述一个或多个处理器可执行上述任意方法实施例中的导航方法。
本发明实施例还提供了一种计算机程序产品,所述计算机程序产品包括存储在非易失性计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被移动载体执行时,使所述移动载体执行任一项所述的导航方法。
一方面,防止移动载体碰撞到货架,另一方面,能够在巷道内可靠地导航移动载体。
以上所描述的装置或设备实施例仅仅是示意性的,其中所述作为分离部件说明的单元模块可以是或者也可以不是物理上分开的,作为模块单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络模块单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到各实施方式可借助软件加通用硬件平台的方式来实现,当然也可以通过硬件。基于这样的理解,上述技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。
最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;在本发明的思路下,以上实施例或者不同实施例中的技术特征之间也可以进行组合,步骤可以以任意顺序实现,并存在如上所述的本发明的不同方面的许多其它变化,为了简明,它们没有在细节中提供;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。

Claims (27)

  1. 一种导航方法,应用于移动载体,所述移动载体可在预设空间内行进,所述预设空间包括由相对摆放的至少两排货架形成的巷道,其特征在于,所述方法包括:
    获取所述移动载体在所述巷道内,相对所述货架在非行进方向的偏移位置信息;
    根据所述偏移位置信息,导航所述移动载体。
  2. 根据权利要求1所述的方法,其特征在于,所述获取所述移动载体在所述巷道内,相对所述货架在非行进方向的偏移位置信息,包括:
    获取所述货架的特征信息;
    根据所述特征信息,计算所述移动载体在所述巷道内,相对所述货架在非行进方向的偏移位置信息。
  3. 根据权利要求2所述的方法,其特征在于,所述特征信息由传感器获得并由所述传感器发送给所述移动载体;
    所述根据所述特征信息,计算所述移动载体在所述巷道内,相对所述货架在非行进方向的偏移位置信息,包括:
    根据所述特征信息在所述传感器的坐标系的坐标信息,计算所述偏移位置信息。
  4. 根据权利要求2所述的方法,其特征在于,所述货架安装有层板,所述特征信息为所述层板的边缘特征信息。
  5. 根据权利要求4所述的方法,其特征在于,所述根据所述特征信息在所述传感器的坐标系的坐标信息,计算所述偏移位置信息,包括:
    获取所述传感器安装在所述移动载体的姿态信息;
    根据所述姿态信息及所述边缘特征信息在所述传感器的坐标系的坐标信息,计算所述偏移位置信息。
  6. 根据权利要求5所述的方法,其特征在于,所述传感器包括拍摄设备,所述姿态信息包括所述拍摄设备安装在所述移动载体上的安装高度及俯仰角;
    所述根据所述姿态信息及所述边缘特征信息在所述传感器的坐标系的坐标信息,计算所述偏移位置信息,包括:
    根据所述拍摄设备的相机模型及所述边缘特征信息在所述坐标系的坐标信息,计算所述边缘特征信息在所述相机模型的边缘直线方程;
    根据所述相机模型、所述边缘直线方程、所述安装高度及所述俯仰角,计算所述偏移位置信息。
  7. 根据权利要求6所述的方法,其特征在于,令所述拍摄设备为原点0,光轴方向为z轴,所述光轴与地面相交于D点,过O点向地面作垂线交地面于Q点,在ODQ平面内过O点作OD垂线交地面于E点,OE定义为y轴,过O点作zOy平面的垂线为x轴,建立所述坐标系。
  8. 根据权利要求7所述的方法,其特征在于,所述根据所述相机模型、所述边缘直线方程、所述安装高度及所述俯仰角,计算所述偏移位置信息,包括:
    在所述边缘特征信息中任选一个参考点P,并令所述参考点P在所述坐标系的坐标信息为(x,y,z);
    根据所述边缘特征信息与所述坐标系之间的位置关系,推导出x与所述安装高度、所述俯仰角及所述偏移位置信息之间的第一等式,以及y与所述安装高度及所述俯仰角之间的第二等式;
    根据所述相机模型与所述边缘直线方程之间的等式关系,推导出集成x、y及z在同一个等式下的第三等式;
    联立所述第一等式、所述第二等式及所述第三等式,得到第四等式;
    根据所述第四等式,计算所述偏移位置信息。
  9. 根据权利要求3所述的方法,其特征在于,每个所述货架至少包 括间隔预设距离的两个货架腿,所述特征信息为所述货架腿的腿部特征信息。
  10. 根据权利要求9所述的方法,其特征在于,所述根据所述特征信息在所述传感器的坐标系的坐标信息,计算所述偏移位置信息,包括:
    确定所述移动载体在行进方向上面向的第一货架腿的第一腿部特征信息以及第二货架腿的第二腿部特征信息,其中,所述第一货架腿与所述第二货架腿位于不同排的货架上并且两者正相对;
    根据所述第一腿部特征信息及所述第二腿部特征信息在所述传感器的坐标系的各自坐标信息,计算所述偏移位置信息。
  11. 根据权利要求10所述的方法,其特征在于,令所述第一货架腿与所述第二货架腿确定的线段为第一线段,过所述第一线段的中点作垂直于所述第一线段的第一直线;
    所述根据所述第一腿部特征信息及所述第二腿部特征信息在所述传感器的坐标系的各自坐标信息,计算所述偏移位置信息,包括:
    根据所述第一腿部特征信息及所述第二腿部特征信息在所述传感器的坐标系的各自坐标信息,计算所述第一直线在所述坐标系的第一中线方程;
    根据所述第一中线方程,计算所述坐标系的原点到所述第一直线的第一距离,并将所述第一距离作为所述偏移位置信息。
  12. 根据权利要求10或11所述的方法,其特征在于,所述根据所述特征信息在所述传感器的坐标系的坐标信息,计算所述偏移位置信息,包括:
    确定所述移动载体在行进方向上背向的第三货架腿的第三腿部特征信息以及第四货架腿的第四腿部特征信息,其中,所述第三货架腿与所述第四货架腿位于不同排的货架上并且两者正相对;
    根据所述第三腿部特征信息及所述第四腿部特征信息在所述传感器的坐标系的各自坐标信息,计算所述偏移位置信息。
  13. 根据权利要求11或12所述的方法,其特征在于,令所述第三货架腿与所述第四货架腿确定的线段为第二线段,过所述第二线段的中点作垂直于所述第二线段的第二直线;
    所述根据所述第三腿部特征信息及所述第四腿部特征信息在所述传感器的坐标系的各自坐标信息,计算所述偏移位置信息,包括:
    根据所述第三腿部特征信息及所述第四腿部特征信息在所述传感器的坐标系的各自坐标信息,计算所述第二直线在所述坐标系的第二中线方程;
    根据所述第二中线方程,计算所述坐标系的原点到所述第二直线的第二距离,并将所述第二距离作为所述偏移位置信息,或者,求取所述第二距离与所述第一距离两者的平均值,并将所述平均值作为所述偏移位置信息。
  14. 根据权利要求1至13任一项所述的方法,其特征在于,所述方法还包括:
    确定所述移动载体在行进方向上的当前坐标。
  15. 根据权利要求14所述的方法,其特征在于,所述确定所述移动载体在行进方向上的当前坐标,包括:
    确定所述移动载体进入所述巷道入口时,在行进方向上的入口坐标;
    计算所述移动载体在所述巷道内行进方向上的移动长度;
    根据所述入口坐标及所述移动长度,计算所述移动载体在行进方向上的当前坐标。
  16. 根据权利要求15所述的方法,其特征在于,位于同侧货架的数量为多个,每个所述货架的货架长度皆被预设并且相同,令所述移动载体在行进方向上开始进入所述当前货架的位置为起始位置,在行进方向上与当前位置对应的位置为最终位置;
    所述计算所述移动载体在所述巷道内行进方向上的移动长度,包括:
    获取所述移动载体在所述巷道内途经过同侧货架的货架数量;
    确定所述移动载体在当前货架的行进方向上的相对长度,所述相对长度为所述最终位置与所述起始位置之差的绝对值;
    将所述货架数量乘以所述货架长度,得到相乘结果;
    将所述相乘结果与所述相对长度相加,得到相加结果,将所述相加结果作为所述移动长度。
  17. 根据权利要求16所述的方法,其特征在于,所述确定所述移动载体在当前货架的行进方向上的相对长度,包括:
    计算与所述当前货架相邻并位于同侧的两个第一侧边货架;
    根据所述两个第一侧边货架的各自货架腿的腿部特征信息,计算由所述两个第一侧边货架确定的第一侧边直线方程;
    根据所述第一侧边直线方程及所述坐标系的原点坐标,确定第一垂点的坐标信息,所述第一垂点为过所述原点作垂直于所述第一侧边直线并相交的点;
    计算所述第一垂点的坐标信息与背向所述移动载体的第一侧边货架的腿部特征信息之间的第一侧向距离,并将所述第一侧向距离作为所述相对长度。
  18. 根据权利要求16或17所述的方法,其特征在于,所述确定所述移动载体在当前货架的行进方向上的相对长度,包括:
    计算与所述当前货架相邻并位于同侧的两个第二侧边货架,其中,所述第二侧边货架与所述第一侧边货架位于不同侧并且相对;
    根据所述两个第二侧边货架的各自货架腿的腿部特征信息,计算由所述两个第二侧边货架确定的第二侧边直线方程;
    根据所述第二侧边直线方程及所述坐标系的原点坐标,确定第二垂点的坐标信息,所述第二垂点为过所述原点作垂直于所述第二侧边直线并相交的点;
    计算所述第二垂点的坐标信息与背向所述移动载体的第二侧边货架的腿部特征信息之间的第二侧向距离,并将所述第二侧向距离作为所述相 对长度,或者,求取所述第二侧向距离与所述第一侧向距离两者的平均值,并将所述平均值作为所述相对长度。
  19. 根据权利要求1至18任一项所述的方法,其特征在于,在进入所述巷道之前,所述方法还包括:
    计算所述移动载体相对所述巷道中心点的进巷偏转角及进巷相对距离;
    根据所述偏转角及所述进巷相对距离,导航所述移动载体进入所述巷道的入口。
  20. 根据权利要求19所述的方法,其特征在于,在所述巷道入口处的两相对侧的货架的侧面皆安装有标识对象物;
    所述计算所述移动载体相对所述巷道中心点的进巷偏转角,包括:
    计算所述标识对象物的边缘线段在坐标系的边缘直线方程;
    根据所述边缘直线方程的斜率,计算所述移动载体相对所述巷道中心点的进巷偏转角。
  21. 根据权利要求20所述的方法,其特征在于,所述计算所述移动载体相对所述巷道中心点的进巷相对距离,包括:
    分别确定每侧标识对象物的边缘线段最靠近所述巷道入口的端点坐标;
    根据两个所述端点坐标,确定所述巷道中心点的中心坐标,其中,令所述两个端点确定的直线为标识直线,过所述坐标系的原点作垂直于所述标识直线的垂线为进巷垂线;
    确定所述进巷垂线与所述标识直线之间的交点坐标;
    计算所述交点坐标与所述中心坐标之间的距离,并将所述距离作为所述进巷相对距离。
  22. 根据权利要求9所述的方法,其特征在于,所述传感器包括激光雷达。
  23. 根据权利要求1至22任一项所述的方法,其特征在于,所述根据所述偏移位置信息,导航所述移动载体,包括:
    根据所述偏移位置信息,调节所述移动载体行进至预设行进方向;
    导航所述移动载体。
  24. 根据权利要求1至22任一项所述的方法,其特征在于,所述预设空间还包括公共区域;
    所述方法还包括:
    当所述移动载体进入所述公共区域时,获取所述移动载体的当前位置信息;
    根据所述当前位置信息与获取的目标位置信息,导航所述移动载体。
  25. 根据权利要求1至22任一项所述的方法,其特征在于,所述预设空间还包括操作台区域,所述操作台区域设置有标识物,所述标识物封装有定位信息;
    所述方法还包括:
    当所述移动载体进入所述操作台区域时,获取所述标识物的定位信息;
    根据所述定位信息,控制所述移动载体。
  26. 一种移动载体,其特征在于,包括:
    至少一个处理器;以及
    与所述至少一个处理器通信连接的存储器;
    其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行如权利要求1至25任一项所述的导航方法。
  27. 一种导航系统,其特征在于,包括:
    服务器;以及
    如权利要求26所述的移动载体,与所述服务器通讯。
PCT/CN2020/100879 2019-07-11 2020-07-08 一种导航方法、移动载体及导航系统 WO2021004483A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP20837065.0A EP3998451A4 (en) 2019-07-11 2020-07-08 NAVIGATION PROCEDURES, MOBILE CARRIER AND NAVIGATION SYSTEM
US17/570,732 US20220128998A1 (en) 2019-07-11 2022-01-07 Navigation method, moving carrier and navigation system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910625924.3 2019-07-11
CN201910625924.3A CN112214012A (zh) 2019-07-11 2019-07-11 一种导航方法、移动载体及导航系统

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/570,732 Continuation US20220128998A1 (en) 2019-07-11 2022-01-07 Navigation method, moving carrier and navigation system

Publications (1)

Publication Number Publication Date
WO2021004483A1 true WO2021004483A1 (zh) 2021-01-14

Family

ID=74047681

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/100879 WO2021004483A1 (zh) 2019-07-11 2020-07-08 一种导航方法、移动载体及导航系统

Country Status (4)

Country Link
US (1) US20220128998A1 (zh)
EP (1) EP3998451A4 (zh)
CN (1) CN112214012A (zh)
WO (1) WO2021004483A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112977443A (zh) * 2021-03-23 2021-06-18 中国矿业大学 一种井下无人驾驶无轨胶轮车的路径规划方法

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113838097B (zh) * 2021-09-29 2024-01-09 成都新潮传媒集团有限公司 摄像机镜头角度偏离检测方法、装置及存储介质
WO2023061501A1 (zh) * 2021-10-15 2023-04-20 北京极智嘉科技股份有限公司 基于货架标识的导航系统、方法
CN114132679A (zh) * 2021-10-29 2022-03-04 北京极智嘉科技股份有限公司 基于货架标识的导航系统、方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105974922A (zh) * 2016-06-29 2016-09-28 上海诺力智能科技有限公司 一种巷道自动导引车、导引系统及其操作方法
CN108051007A (zh) * 2017-10-30 2018-05-18 上海神添实业有限公司 基于超声波组网和立体视觉的agv导航定位方法
CN108089574A (zh) * 2016-11-22 2018-05-29 永恒力股份公司 用于提供仓库中的存放位的位置的方法和物料搬运车
US10289990B2 (en) * 2016-10-17 2019-05-14 Conduent Business Services, Llc Store shelf imaging system and method
US20190171220A1 (en) * 2016-02-05 2019-06-06 Invia Robotics, Inc. Robotic Navigation and Mapping
CN109990784A (zh) * 2017-12-30 2019-07-09 广州大正新材料科技有限公司 一种超市导航系统及方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9864377B2 (en) * 2016-04-01 2018-01-09 Locus Robotics Corporation Navigation using planned robot travel paths
CN114999308A (zh) * 2018-11-19 2022-09-02 深圳市海柔创新科技有限公司 地图生成方法、装置、计算机可读存储介质和计算机设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190171220A1 (en) * 2016-02-05 2019-06-06 Invia Robotics, Inc. Robotic Navigation and Mapping
CN105974922A (zh) * 2016-06-29 2016-09-28 上海诺力智能科技有限公司 一种巷道自动导引车、导引系统及其操作方法
US10289990B2 (en) * 2016-10-17 2019-05-14 Conduent Business Services, Llc Store shelf imaging system and method
CN108089574A (zh) * 2016-11-22 2018-05-29 永恒力股份公司 用于提供仓库中的存放位的位置的方法和物料搬运车
CN108051007A (zh) * 2017-10-30 2018-05-18 上海神添实业有限公司 基于超声波组网和立体视觉的agv导航定位方法
CN109990784A (zh) * 2017-12-30 2019-07-09 广州大正新材料科技有限公司 一种超市导航系统及方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3998451A4 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112977443A (zh) * 2021-03-23 2021-06-18 中国矿业大学 一种井下无人驾驶无轨胶轮车的路径规划方法

Also Published As

Publication number Publication date
US20220128998A1 (en) 2022-04-28
EP3998451A4 (en) 2022-08-17
CN112214012A (zh) 2021-01-12
EP3998451A1 (en) 2022-05-18

Similar Documents

Publication Publication Date Title
WO2021004483A1 (zh) 一种导航方法、移动载体及导航系统
JP6978799B2 (ja) 経路計画方法、電子装置、ロボット及びコンピュータ読取可能な記憶媒体
US11748700B2 (en) Automated warehousing using robotic forklifts or other material handling vehicles
KR101623359B1 (ko) 산업 차량을 위한 정확한 로컬리제이션을 제공하기 위한 방법 및 장치
CN110275538A (zh) 智能巡航车导航方法及系统
KR20200041355A (ko) 마커를 결합한 동시 위치결정과 지도작성 내비게이션 방법, 장치 및 시스템
CN110186459B (zh) 导航方法、移动载体及导航系统
JP2023531391A (ja) 倉庫ロボットの制御方法、装置、機器、および読み取り可能記憶媒体
US20170108874A1 (en) Vision-based system for navigating a robot through an indoor space
CN102419178A (zh) 基于红外路标的移动机器人定位系统和方法
EP3512785B1 (en) Integrated obstacle detection and payload centering sensor system
WO2023029776A1 (zh) 搬运机器人的控制方法、装置、设备和存储介质
Novoselov et al. Development of the method local navigation of mobile robot a based on the tags with QR code and wireless sensor network
US20220366599A1 (en) Positioning system and moving body for measuring position of moving body using image capturing apparatus
US20230280759A1 (en) Autonomous Robotic Navigation In Storage Site
US20220366596A1 (en) Positioning system for measuring position of moving body using image capturing apparatus
CN108180913A (zh) 一种基于3d摄像头的二维码定位系统
US20210312661A1 (en) Positioning apparatus capable of measuring position of moving body using image capturing apparatus
CA2957380C (en) Vision-based system for navigating a robot through an indoor space
JP2023036635A (ja) 車両監視方法、車両監視装置、車両、及び車両監視システム
CN113632029B (zh) 信息处理装置、程序及信息处理方法
JP2021039388A (ja) 測位装置及び車両
Karakaya et al. A hybrid indoor localization system based on infra-red imaging and odometry
JPWO2020032157A1 (ja) 物品位置推定システム及び物品位置推定方法
US20230075332A1 (en) Navigation method, navigation apparatus and non-volatile computer storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20837065

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020837065

Country of ref document: EP

Effective date: 20220211