WO2021093420A1 - Vehicle navigation method and apparatus, and computer readable storage medium - Google Patents

Vehicle navigation method and apparatus, and computer readable storage medium Download PDF

Info

Publication number
WO2021093420A1
WO2021093420A1 PCT/CN2020/112216 CN2020112216W WO2021093420A1 WO 2021093420 A1 WO2021093420 A1 WO 2021093420A1 CN 2020112216 W CN2020112216 W CN 2020112216W WO 2021093420 A1 WO2021093420 A1 WO 2021093420A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
target
straight line
ground image
ground
Prior art date
Application number
PCT/CN2020/112216
Other languages
French (fr)
Chinese (zh)
Inventor
赵健章
刘瑞超
Original Assignee
深圳创维数字技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳创维数字技术有限公司 filed Critical 深圳创维数字技术有限公司
Publication of WO2021093420A1 publication Critical patent/WO2021093420A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05Geographic models
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/24Aligning, centring, orientation detection or correction of the image
    • G06V10/245Aligning, centring, orientation detection or correction of the image by locating a pattern; Special marks for positioning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle

Definitions

  • This application relates to the field of intelligent driving technology, and in particular to a vehicle navigation method, device, and computer-readable storage medium.
  • SLAM Simultaneous Localization and mapping, real-time positioning and map construction
  • SLAM includes two major functions: positioning and mapping.
  • the main function of mapping is to understand the surrounding environment and establish the corresponding relationship between the surrounding environment and space; the main function of positioning is to judge the position of the car body on the map based on the built map, so as to obtain the information in the environment.
  • lidar is an active detection sensor that does not depend on external light conditions and has high-precision ranging information. Therefore, the SLAM method based on lidar is still the most widely used method in the robot SLAM method, and in ROS (Robot Operating System, robot software platform) SLAM applications have also been very extensive.
  • the distance between pallet positions should be reduced as much as possible.
  • the aisle between the two deep pile positions is only a little longer than the length of the vehicle.
  • the existing navigation method is difficult. This allows the vehicle to enter the target location accurately and quickly, which in turn affects the navigation efficiency of the vehicle.
  • the main purpose of this application is to provide a vehicle navigation method, device, and computer-readable storage medium, aiming to solve the technical problem that the existing navigation method is difficult to make the vehicle enter the target location accurately and quickly.
  • the present application provides a vehicle navigation method, which includes the following steps:
  • the vehicle is controlled to stop rotating.
  • the present application also provides a vehicle navigation device, the vehicle navigation device comprising: a memory, a processor, and computer-readable instructions stored in the memory and running on the processor, When the computer-readable instructions are executed by the processor, the steps of the vehicle navigation method described in any one of the above are implemented.
  • the present application also provides a computer-readable storage medium having computer-readable instructions stored on the computer-readable storage medium, and when the computer-readable instructions are executed by a processor, any one of the above is realized.
  • This application obtains the coordinate origin corresponding to the vehicle when it is determined that the vehicle is located at the first designated position corresponding to the target storage location based on the current first position information of the vehicle; then controls the rotation of the vehicle based on the coordinate origin, and Based on the first ground image currently captured by the camera device installed on the vehicle, it is determined whether the edge identification line corresponding to the target location is perpendicular to the vehicle; and then when the edge identification line is perpendicular to the vehicle, the control station is controlled When the vehicle stops rotating and moves in the narrow lane corresponding to the vehicle location, by rotating the vehicle to make the vehicle perpendicular to the edge marking line of the target location, so that the vehicle and the target location can be accurately aligned, so that the vehicle can enter accurately and quickly Target storage location to improve the efficiency of vehicle navigation.
  • FIG. 1 is a schematic structural diagram of a path navigation device in a hardware operating environment involved in a solution of an embodiment of the application;
  • FIG. 2 is a schematic flowchart of a first embodiment of a vehicle navigation method according to this application;
  • Fig. 3 is a detailed flow of the step of determining whether the edge marking line of the target location corresponding to the first designated location is perpendicular to the vehicle based on the first ground image currently captured by the camera device installed on the vehicle in the vehicle navigation method of this application
  • FIG. 4 is a schematic diagram of a scene in an embodiment of the route navigation method of this application.
  • Fig. 5 is a schematic flowchart of a second embodiment of a vehicle navigation method according to this application.
  • FIG. 1 is a schematic structural diagram of a path navigation device in a hardware operating environment involved in a solution of an embodiment of the present application.
  • the route navigation apparatus may include a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002.
  • the communication bus 1002 is used to implement connection and communication between these components.
  • the user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
  • the network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).
  • the memory 1005 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a magnetic disk memory.
  • the memory 1005 may also be a storage device independent of the aforementioned processor 1001.
  • the route navigation device may also include a camera, RF (Radio Frequency, radio frequency) circuits, sensors, audio circuits, WiFi modules, etc.
  • sensors such as light sensors, motion sensors and other sensors.
  • the light sensor may include a proximity sensor, where the proximity sensor may control the vehicle to stop when the movement path navigation device moves to an obstacle.
  • the structure of the route navigation device shown in FIG. 1 does not constitute a limitation on the route navigation device, and may include more or fewer components than those shown in the figure, or a combination of certain components, or different components. Layout.
  • the memory 1005 which is a computer storage medium, may include an operating system, a network communication module, a user interface module, and a route navigation program.
  • the network interface 1004 is mainly used to connect to the back-end server and communicate with the back-end server; the user interface 1003 is mainly used to connect to the client (user side) and communicate with the client; and
  • the processor 1001 may be used to call a route navigation program stored in the memory 1005.
  • the path navigation device includes: a memory 1005, a processor 1001, and a path navigation program stored on the memory 1005 and running on the processor 1001, wherein the processor 1001 calls the memory 1005 to store When the route navigation program, and perform the following operations in the various embodiments of the vehicle navigation method.
  • FIG. 2 is a schematic flowchart of the first embodiment of the vehicle navigation method of this application.
  • the vehicle navigation method of this embodiment can be applied to the process of intelligent automatic driving, where intelligent automatic driving can be applied to warehouse freight in a closed environment and also applicable to road transportation in an open environment.
  • This embodiment takes warehouse freight as an example for illustration;
  • the vehicle corresponding to warehouse freight can be a forklift, a truck, or an AGV (Automated Guided Vehicle, automatic guided transport vehicle) trolley and other equipment that can realize the transportation of goods; goods are stacked in warehouse freight, and the goods are placed on pallets, and the vehicle realizes the transportation of goods by transporting the pallets.
  • AGV Automate Guided Vehicle, automatic guided transport vehicle
  • a preset identification line is preset on the floor of the warehouse, and the driving route of the vehicle is formed between two adjacent and parallel preset identification lines.
  • the vehicle navigation method includes:
  • Step S100 when it is determined that the vehicle is located at the first designated location corresponding to the target storage location based on the current first location information of the vehicle, obtain the origin of the coordinates corresponding to the vehicle;
  • the vehicle is equipped with a lidar, and the position information of the vehicle can be obtained in real time through the lidar.
  • the target location corresponding to the vehicle is obtained, that is, the goods to be stored or the goods to be picked up.
  • the first designated location corresponding to the target warehouse is determined according to the preset rules for the location where the vehicle is located.
  • the vehicle can rotate at the first designated location to match the target location, and the first designated location is based on The target location, the length and width of the vehicle are determined.
  • the vehicle is located at the first designated position, that is, whether the vehicle currently reaches the first designated position, and when the vehicle is at the first designated position, the coordinate origin corresponding to the vehicle is obtained, for example, the vehicle For forklifts that carry pallets, the center position (near) of the rear axle of the forklift is the origin of the coordinates (center of the circle) corresponding to the vehicle.
  • Step S200 controlling the rotation of the vehicle based on the coordinate origin, and determining whether the edge marking line corresponding to the target storage location is perpendicular to the vehicle based on the first ground image currently captured by the camera installed on the vehicle;
  • the vehicle is controlled to rotate according to the origin of the coordinates. Specifically, when the camera device is installed on the left side of the vehicle, the vehicle is controlled to rotate clockwise, and the camera device is installed on the right side of the vehicle. When turning, control the vehicle to rotate counterclockwise.
  • an image is taken in real time by the camera installed on the vehicle to obtain the corresponding first ground image, and the first ground image is used to determine whether the edge marking line corresponding to the target location is perpendicular to the vehicle.
  • the device is a depth camera.
  • the camera device includes two camera devices, and the two camera devices are respectively arranged in the front and the side of the vehicle,
  • step S200 includes:
  • Step S210 Acquire a first ground image currently captured by the camera device, and identify the initial position of each identification element in the first ground image;
  • Step S220 Separate the ground feature area from the first ground image, and determine the centroid position of the target element in each of the identification elements according to the ground feature area and each of the initial positions;
  • Step S230 Determine the depth data coordinates of each target element according to each of the centroid positions, and determine the first target straight line equation corresponding to the edge identification line according to each of the depth data coordinates;
  • Step S240 Determine whether the edge identification line is perpendicular to the vehicle based on the first target straight line equation.
  • the image is taken in real time by the camera installed on the vehicle to obtain the corresponding first ground image. Understandably, the edge markings of the storage locations in the warehouse are actually pasted on the ground.
  • the tape on the top is usually composed of diamond-shaped blocks with two colors spaced apart from each other, such as black diamond-shaped blocks with yellow diamond-shaped blocks, black diamond-shaped blocks with white diamond-shaped blocks, etc.
  • each identification element is extracted from the background-processed first ground image; each of the identification elements is sequentially processed by edge extraction, contour search, and polyline fitting. , Obtain the initial contour of each of the identification elements; transmit each of the initial outlines to a preset function, and determine the initial coordinates of each of the identification elements in the ground image; take each of the initial coordinates as the center of the circle, and set Defining a circular area, and identifying each of the circular areas as the initial position of each identification element in the ground image.
  • the first ground image is stripped of the background by flood filling, and 8-10 multi-color seeds are preset to fill the first ground image to remove other substances in the first ground image; wherein
  • the seed is set according to actual requirements.
  • the vertices of the four corners in the first ground image and the third halves of the edge of the first ground image can be set, which is not limited. Since then, combined with OpenCV (Open Source Computer Vision Library, an open source computer vision library) is used to realize the preset function of HSV (hue, saturation, value, hue, color saturation, value) color recognition, and extract the black diamond block as the identification element.
  • OpenCV Open Source Computer Vision Library, an open source computer vision library
  • the preset function used to extract the edge in OpenCV set the edge range parameters and transfer to the preset function, and perform edge extraction on the extracted identification elements; when the edge size of a certain identification element is in the edge range Within the parameters, the edge extraction operation is performed on the identification element to obtain the edge pixels formed by each black diamond block in the first ground image; when the edge size of a certain identification element is not within the edge range parameters, no edge extraction is performed on it Operation, and remove it as interference.
  • the preset function for contour search in OpenCV is called, the parameters of the set contour range are transferred to the preset function, and the contour search is performed on each identification element on the basis of edge extraction; when the contour size of a certain identification element is in Within the contour range parameter, the contour of the identification element is retained to obtain its contour point; when the contour size of a certain identification element is not within the contour range parameter, its contour is removed to remove the first ground image Interfere with contours.
  • the contour points of each identification element are processed by polyline fitting to obtain the initial contour of each identification element.
  • this embodiment has a pre-established three-dimensional space coordinate system.
  • the three-dimensional space coordinate system uses the position of the stereo camera as the coordinate origin, the plane where the AGV car is located is the XY plane, and the upper space perpendicular to the XY plane is the positive direction of the Z axis. Space; where for the XY plane, the direction of the X axis is the direction directly in front of the vehicle and the direction perpendicular to the X axis on the right side of the vehicle is the Y axis.
  • the preset function used to calculate the centroid position in OpenCV is called, the initial contour of each identification element is transferred to the preset function, and the coordinate value is output through the processing of the preset function.
  • the coordinate value is the initial coordinate of each identification element in the first ground image.
  • the preset radius value is called, and the circular area corresponding to each identification element is set with the initial coordinate as the center of the circle, and the circular area is the initial position of the identification element in the first ground image.
  • the obstacles are imaged in the first ground image, resulting in interference signals that are misidentified as identification elements; in order to avoid interference from interference signals, a ground feature region extraction mechanism is provided .
  • the ground feature area is the area occupied by the ground image in the first ground image. Because the obstacle has a certain projection height on the Z axis of the three-dimensional space coordinate system, a certain projection threshold can be set to identify the first ground image And remove the identified obstacles from the first ground image to obtain the ground feature area.
  • the coordinate origin in the three-dimensional space coordinate system is used as the preset coordinate origin, and the ground feature area and each initial position are generated according to the three-dimensional space coordinate system.
  • the image and The images representing each initial position are processed to determine the target element in each identification element and the centroid coordinates of each target element.
  • the ground feature area and each of the initial positions are combined, and the overlapping feature area between the ground feature area and each of the initial positions is extracted; and each of the overlapping feature areas is It is transmitted to a preset model, the target elements in each of the identification elements are screened out, and the element coordinates of each of the target elements are calculated as the centroid position of each of the target elements.
  • the preset model Call the preset model, and transfer each overlapping feature area to the preset model, classify the features of each overlapping feature area, and filter out the areas that meet the ground features and have black blocks, and this area is the identification element
  • the target element that meets the characteristics of the black diamond block.
  • the preset model has the function of calculating the coordinates of the filtered area, and the element coordinates of each target element are obtained through the calculation function; the element coordinates are essentially the centroid coordinates of the target element, which is taken as the centroid position of the target element.
  • the ground restoration identification line is generated from the first target straight line equation.
  • the hole data in the ground feature area is detected one by one, and the peripheral depth data corresponding to the hole data is read; the hole data is filled according to the peripheral depth data until the ground feature area The hole data in are all filled, so as to determine the depth data coordinates based on the filled ground feature area.
  • the hole data is expanded in the neighborhood to realize the filling of the hole data. All the hole data in the ground feature area are filled, and then on the basis of the filled ground feature area, the polar coordinate conversion of each centroid coordinate can be performed to obtain the depth data coordinates of each target element.
  • the preset algorithm is called to calculate the converted depth data coordinates to identify the edge identification line in the first ground image; specifically, the target of each depth data coordinate is determined according to the preset range interval Data coordinates, and generate a first target straight line equation according to each of the target data coordinates.
  • the preset algorithm in this embodiment is preferably the least squares method.
  • the circular area as the initial position of the target element is taken as the preset range interval, and the depth data coordinates of each target element are based on the preset range interval. Points adjacent to the front, back, left, and right. Whenever the front and back or left and right points are found, the three points are removed and saved in an array as the target coordinate data of each depth data coordinate.
  • the least square method is used to generate each target coordinate data into the first target straight line equation, and the straight line corresponding to the first target straight line equation is the edge identification line in the first ground image Location.
  • the depth data coordinates determined by the centroid position accurately reflect the position of each marking element, which improves Accuracy of edge identification line recognition.
  • the straight line equation of the vehicle can be determined, and the edge is determined according to the first target straight line equation of the edge identification line and the straight line equation of the vehicle Whether the identification line is perpendicular to the vehicle.
  • Step S300 when the edge marking line is perpendicular to the vehicle, control the vehicle to stop rotating.
  • the vehicle when the edge marking line is perpendicular to the vehicle, the vehicle has rotated to the designated storage point. At this time, the vehicle is controlled to stop rotating to match the vehicle with the target storage location, which is convenient for subsequent direct reverse linear movement Vehicles so that the vehicles can be accurately stored.
  • 1.1-1.3 are the position of the origin of the vehicle's coordinates, 2.1 is the direction of movement of the vehicle; 2.2 is the trajectory of the vehicle.
  • the dotted line is the ground marking line of the storage location, including parallel yellow and black warning lines and yellow and black edge markings at the entrance (exit) of the storage location.
  • the camera includes two camera devices, and the two camera devices are respectively arranged in front of and on the side of the vehicle.
  • Step S230 includes:
  • Step a According to each of the depth data coordinates, determine a first straight line equation of the edge identification line corresponding to a front camera device, and a second straight line equation of the edge identification line corresponding to a side camera device;
  • Step b Perform fusion based on the first straight line equation and the second straight line equation to obtain the first target straight line equation.
  • the first ground image includes the front ground image and the side ground image
  • the edge identification line corresponding to the front camera device can be obtained according to the front ground image.
  • the first straight line equation, and the second straight line equation that obtains the edge identification line corresponding to the side camera device according to the side ground image, and then the coordinate system where the first straight line equation is located and the coordinate system where the second straight line equation is located are merged ,
  • the fusion is specifically performed according to the fusion filtering algorithm, and the fused coordinate system and the first target straight line equation in the fused coordinate system are obtained.
  • the straight line equation in the fused coordinate system is the first target straight line equation needed. If there are two straight line equations in the fused coordinate system, and two If the straight line equation is vertical, it means that the vertical ratio of the two straight line equations is the yellow and black warning line of the target storage location and the edge marking line of the storage location entrance. The straight line equation with the largest angle between the straight line equations is the first target straight line equation.
  • the vehicle navigation method proposed in this embodiment obtains the coordinate origin corresponding to the vehicle when it is determined based on the current first position information of the vehicle that the vehicle is located at the first designated location corresponding to the target storage location; and then based on the coordinate origin Control the rotation of the vehicle, and determine whether the edge identification line corresponding to the target storage location is perpendicular to the vehicle based on the first ground image currently captured by the camera installed on the vehicle;
  • the vehicle is vertical, the vehicle is controlled to stop rotating, and when moving in the narrow lane corresponding to the vehicle location, the vehicle is perpendicular to the edge marking line of the target location by rotating the vehicle, so that the vehicle and the target location can be accurately aligned.
  • the vehicle navigation method proposed in this embodiment obtains the coordinate origin corresponding to the vehicle when it is determined based on the current first position information of the vehicle that the vehicle is located at the first designated location corresponding to the target storage location; and then based on the coordinate origin Control the rotation of the vehicle, and determine whether the edge identification line corresponding to the target storage location is
  • the vehicle navigation method further includes:
  • Step S400 acquiring a second ground image based on the camera device, and determining a relative position parameter between the vehicle and a preset identification line according to the second ground image;
  • Step S500 reading the historical ground image acquired based on the camera device, and determining the displacement parameter of the vehicle according to the second ground image and the historical ground image;
  • Step S600 Determine a position adjustment parameter according to the relative position parameter, and use the position adjustment parameter and the displacement parameter as posture adjustment parameters to adjust the posture of the vehicle.
  • the stereo camera photographs and images the side ground in the driving direction in real time, and generates a second ground image that characterizes the relative position between the vehicle and the preset marking line. If the driving path of the vehicle deviates, the relative position between the vehicle and the preset identification line also deviates, so that the preset identification line in the second ground image deviates.
  • the preset identification line is a straight line corresponding to the edge identification line of the target storage location.
  • a three-dimensional space coordinate system is established based on the current position of the vehicle, the position of the stereo camera is taken as the coordinate origin, and the plane where the vehicle is located is the XY plane, which is compared with the XY plane.
  • the vertical upper space is the space where the positive direction of the Z-axis is located; among them, for the XY plane, the direction directly in front of the vehicle is the X-axis direction, and the direction perpendicular to the X-axis direction on the right side of the vehicle is the Y-axis direction.
  • the linear equation of the preset identification line on the XY plane is determined, and the relative position parameter of the vehicle relative to the preset identification line is determined.
  • the relative position parameter includes the relative position of the vehicle.
  • the passing angle indicates whether the vehicle is parallel to the preset identification line
  • the passing distance indicates whether the distance between the vehicle and the preset identification line on the left and right sides is equal.
  • the straight line equation corresponding to the preset identification line is obtained, and the slope of the straight line equation is calculated; the driving direction of the vehicle is taken as the reference direction, and the straight line equation and the reference are calculated according to the slope.
  • the included angle between directions; according to the straight line equation, the distance between the vehicle and the preset identification line is calculated, and the included angle and the distance are determined as the relative position parameter.
  • the preset marking line is essentially a pattern composed of rhombuses with yellow and black intervals or black and white intervals. After the second ground image is obtained, image processing is performed on it, and the black rhombuses are extracted, and each black is determined. The position of the center of mass of the rhombus; fitting the position of the center of mass to generate a straight line equation, which is the straight line where the preset marking line is located. After that, the slope of the linear equation is calculated.
  • the historical ground image acquired by the camera device at the previous moment is read, and the relative position change of the vehicle is reflected by the comparison between the historical ground image at the previous moment and the second ground image, thereby determining the displacement parameter of the vehicle .
  • a preset included angle and a preset distance are preset. Compare the included angle in the relative position parameter with the preset included angle to get the angle difference between the two.
  • the angle difference is used to characterize the difference between the actual angle and the theoretical angle of the vehicle. The smaller the difference, the smaller the difference between the vehicle and the theoretical angle.
  • the parallelism between the preset marking lines is better; at the same time, the distance in the relative position parameter is compared with the preset distance to obtain the distance difference between the two.
  • the distance difference is used to characterize the actual distance between the vehicle and the theoretical distance. The size of the difference between the two, the smaller the difference, the greater the possibility that the distance between the vehicle and the preset signs on both sides is equal.
  • the angle difference and distance difference obtained through the comparison are determined as the position adjustment parameters, and the position adjustment parameters and the displacement parameters are used as the attitude adjustment parameters to adjust the angle of the vehicle position and the preset marking line on both sides Adjust the attitude of the distance between the two, and calculate the displacement of the vehicle at the front and rear moments; while avoiding collisions with the goods stacked on both sides, the displacement distance is calculated to determine the driving distance to the destination.
  • the posture adjustment of the vehicle can be adjusted through the control center of the vehicle, or through an upper computer connected to the vehicle in communication.
  • the vehicle sends the position adjustment parameters and displacement parameters as the attitude adjustment parameters to the upper computer; the upper computer adjusts the driving angle of the vehicle according to the angle difference represented by the angle difference.
  • the distance difference represented by the distance difference the left and right positions of the vehicle are adjusted.
  • the displacement distance of the vehicle from the previous moment to the current moment is calculated according to the displacement parameter; the displacement distance is used to update the driving distance of the vehicle to represent the vehicle The distance to the destination.
  • the host computer will determine whether to adjust or not, and the adjusted parameters will be sent to the vehicle to control the driving state of the vehicle and realize the precise transportation of the vehicle.
  • the control center When the vehicle's control center adjusts the attitude of the vehicle, the control center directly adjusts the driving angle of the vehicle according to the angle difference represented by the angle difference, and adjusts the vehicle's driving angle according to the distance difference represented by the distance difference.
  • the left and right positions are adjusted, and the displacement distance of the vehicle from the last moment to the current moment is calculated according to the displacement parameters.
  • the displacement distance is used to update the travel distance of the vehicle, which represents the distance between the vehicle and the destination; in this way, the vehicle is controlled
  • the driving state of the vehicle can realize the accurate transportation of the vehicle.
  • step S500 includes: identifying the first data point in the second ground image and the second data point in the historical ground image, and filtering out the first coordinate point and the second data point in each of the first data points.
  • the second coordinate point in each of the second data points; the first center coordinates in each of the first coordinate points and the second center coordinates in each of the second coordinate points are determined respectively, and according to the first The center coordinates and the second center coordinates determine the displacement parameters of the vehicle.
  • the displacement parameters used to calculate the displacement distance include displacement value and displacement angle, where the displacement value is the distance value between the position of the vehicle at the previous moment and the position point of the current moment, and the displacement angle is the distance between the vehicle and the driving direction , That is, the included angle in the x-axis direction.
  • the displacement value is the distance value between the position of the vehicle at the previous moment and the position point of the current moment
  • the displacement angle is the distance between the vehicle and the driving direction , That is, the included angle in the x-axis direction.
  • first extract the black diamond blocks of the preset marking line in the second ground image identify the centroid of each black diamond block, and determine each centroid as the first data in the second ground image Point;
  • extract the black diamond blocks of the preset marking line in the historical ground image identify the centroid of each black diamond block, and determine each centroid as the second data point in the historical ground image.
  • the first data point filter according to the straight line equation of the preset identification line in the second ground image, and determine the point belonging to the straight line equation as the first coordinate point; at the same time, for the second data point, according to the preset
  • the line equation of the marking line in the historical ground image is screened, and the point belonging to the line equation is determined as the second coordinate point.
  • the slopes of the two linear equations are within the preset range. If it exceeds the preset range, it means that the vehicle has a large displacement at the front and rear moments and an abnormal situation has occurred. At this time, the displacement of the vehicle is monitored on the one hand, and the other Regenerate the linear equation to ensure the correctness of the calculation.
  • first coordinate point and the second coordinate point are screened, and the valid points in the historical ground image and the second ground image are determined, and the first center in the first coordinate point is determined by the respective valid points. Coordinates and the second center coordinates in the second coordinate point. Specifically, according to each of the second coordinate points, a first effective point corresponding to each of the first coordinate points is determined, and the averaging process is performed on each of the first effective points to determine the first center coordinate; For each of the first coordinate points, a second effective point corresponding to each of the second coordinate points is determined, and average processing is performed on each of the second effective points to generate the second center coordinate.
  • each second coordinate point When determining the first center coordinates of each first coordinate point, use each second coordinate point as a basis to filter out the point with the closest distance to each first coordinate point from each second coordinate point; after that, the closest distance to each first coordinate point is selected.
  • the point is used as the first effective point to perform the average value processing of the coordinate values, and the average value obtained is the first center coordinate corresponding to each first coordinate point.
  • the first coordinate point contains a1 (x1, y1), a2 (x2, y2), a3 (x3, y3), a4 (x4, y4)•••an(xn, yn) N points
  • the first point is determined by searching Among the two coordinate points, the point closest to a1 is b1, the point closest to a2 is b2, the point closest to a3 is b3, the point closest to a4 is b4, and the point closest to an is bn;
  • the coordinate values of b1, b2, b3, b4•••bn are averaged, and the average value (x, y) of the coordinate values is obtained.
  • the average value (x, y) is the first center of each first coordinate point coordinate.
  • each first coordinate point as a basis to filter out the point with the closest distance to each second coordinate point from each first coordinate point;
  • the closest point is used as the second effective point to perform the average value processing of the coordinate values, and the average value obtained is the second center coordinate corresponding to each second coordinate point.
  • the displacement value and the displacement angle in the displacement parameter can be calculated. Specifically, according to the first center coordinates and the second center coordinates, calculate the slope of the straight line formed by the first center coordinates and the second center coordinates, and calculate the relative displacement value of the vehicle; The slope of the straight line calculates the displacement angle of the vehicle, and the relative displacement value and the displacement angle are determined as the displacement parameters of the vehicle.
  • (x1, y1) are the first center coordinates
  • (x0, y0) are the second center coordinates
  • a straight line is formed between the first center coordinates and the second center coordinates, passing through the first center coordinates and the second center coordinates
  • the slope of the straight line formed is calculated, and the angle corresponding to the slope reflects the angle change of the vehicle relative to the preset marking line at the front and back two moments.
  • the first center coordinate and the second center coordinate also reflect the displacement of the vehicle at the front and rear moments, so that the relative displacement value of the vehicle can be calculated through the first center coordinate and the second center coordinate.
  • the calculated relative displacement value and displacement angle are determined as the displacement parameters of the vehicle, so as to calculate the displacement distance traveled by the vehicle at two moments before and after the displacement parameters.
  • the projected value is the displacement distance the vehicle travels along the direction of travel; and the displacement distance is used to compare the distance between the vehicle and the destination.
  • the driving distance between the two is updated to achieve accurate transportation.
  • a second ground image is acquired based on the camera device, and the relative position parameter between the vehicle and a preset identification line is determined according to the second ground image;
  • the historical ground image acquired by the camera device determines the displacement parameter of the vehicle according to the second ground image and the historical ground image; then the position adjustment parameter is determined according to the relative position parameter, and the position adjustment parameter And the displacement parameter is used as the attitude adjustment parameter to adjust the attitude of the vehicle. Because the attitude adjustment parameter used to realize the adjustment is generated according to the relative position parameter and the displacement parameter of the vehicle, it can accurately characterize the displacement change of the vehicle, and realize The accurate adjustment of the vehicle posture is conducive to accurate transportation.
  • the vehicle navigation method further includes:
  • Step S700 Determine the marking lines on both sides of the target storage location based on the third ground image currently captured by the camera device;
  • Step S800 Control the vehicle to move in the reverse direction based on the marking lines on both sides, and control the vehicle to stop moving when the rear stop line is monitored or it is determined that the anti-collision sensor currently detects the cargo, wherein the anti-collision sensor Installed at the end of the vehicle.
  • the vehicle is a forklift
  • the forklift is equipped with two anti-collision sensors, which are respectively installed at the end of the fork of the forklift.
  • the fork When the fork is lifted, it can detect the pallet cargo at a specified distance behind, and it can be inserted when the fork is down. Pallet anti-collision detection.
  • the identification lines on both sides of the target location are determined, wherein the determination method of the identification lines on both sides is the same as that of the edge identification lines.
  • the determination method is similar. First, the straight line equations of the identification lines on both sides are determined, the identification lines on both sides are determined according to the straight line equation, and then the vehicle is controlled to move in the reverse direction based on the identification lines on both sides, so that the vehicle can move to the target storage location.
  • the ground image captured by the camera device and the detection result of the collision avoidance sensor are collected in real time, and the rear stop line is determined according to the ground image captured by the camera device, or according to the detection result of the collision avoidance sensor
  • the detection result determines that when the anti-collision sensor currently detects goods, the vehicle is controlled to stop moving.
  • the steps in the second embodiment can be executed first to realize the posture adjustment of the vehicle.
  • the vehicle navigation method proposed in this embodiment determines the identification lines on both sides of the target location based on the third ground image currently captured by the camera; and then controls the vehicle to move in the reverse direction based on the identification lines on both sides , And when the rear stop line is monitored or it is determined that the anti-collision sensor currently detects the goods, the vehicle is controlled to stop moving, wherein the anti-collision sensor is installed at the end of the vehicle to realize the accurate movement of the vehicle in the warehouse , To further improve the navigation efficiency of the vehicle.
  • the vehicle navigation method further includes:
  • Step c determining whether the vehicle satisfies a U-turn condition based on the first location information and the target storage location;
  • Step d if it is not met, execute the step of acquiring the origin of the coordinates corresponding to the vehicle when it is determined based on the first location information that the vehicle is located at the first designated location corresponding to the target storage location.
  • the moving direction and the target location determine whether the vehicle currently needs to move to the other side of the warehouse, and if not, execute step S200.
  • step c it further includes:
  • Step e if it is satisfied, determine a second designated location corresponding to the vehicle based on the current location information
  • Step f controlling the vehicle based on the second designated position
  • Step g when the current second position information of the vehicle determines that the vehicle is located at the second designated position, control the rotation of the vehicle based on the origin of the second coordinate corresponding to the vehicle;
  • Step h when the vehicle rotates to a third designated position corresponding to the target storage location, control the vehicle to stop rotating.
  • the second designated position corresponding to the vehicle is determined based on the current position information, and the vehicle is controlled based on the second designated position, so that the second designated position of the vehicle is moving.
  • the designated location, where the second designated location can be set according to the target storage location, so that the vehicle can quickly reach the target storage location after turning around at the second specified location.
  • the vehicle is controlled to rotate based on the origin of the second coordinate corresponding to the vehicle, even if the vehicle rotates 180 degrees, a U-turn of the vehicle is realized, And when the vehicle rotates to the third designated position corresponding to the target storage location, that is, when the vehicle completes a U-turn operation, the vehicle is controlled to stop rotating, thereby realizing a U-turn of the vehicle.
  • the steps in the third embodiment can be executed to adjust the vehicle's posture.
  • the vehicle navigation method proposed in this embodiment determines whether the vehicle satisfies the U-turn condition based on the first location information and the target location, and then if it is not met, then executes the determination that the vehicle is located based on the first location information.
  • the target location corresponds to the first designated location
  • the step of obtaining the coordinate origin corresponding to the vehicle and then execute the subsequent steps when the vehicle does not need to turn around, so as to realize the accurate navigation of the vehicle and further improve the navigation efficiency of the vehicle.
  • the vehicle navigation method further includes:
  • Step i When it is determined that the vehicle is in a narrow-track linear movement state based on the current third position information of the vehicle and the navigation path corresponding to the vehicle, acquire the fourth ground image currently captured by the camera device, and identify the first 4. The initial position of each identification element in the ground image;
  • Step j Separate the ground feature area from the fourth ground image, and determine the centroid position of the target element in each of the identification elements according to the ground feature area and each of the initial positions;
  • Step k Determine the depth data coordinates of each target element according to each of the centroid positions, and according to each of the depth data coordinates;
  • Step 1 Identify the second target straight line equation corresponding to the edge identification line in the fourth ground image according to each of the depth data coordinates, and determine the calibration position of the vehicle based on the second target straight line equation;
  • Step m Determine the target position and attitude information of the vehicle based on the calibration position, and control the vehicle based on the target position and the attitude information.
  • the fourth ground image currently captured by the camera device is acquired, and the fourth ground image is acquired according to the first
  • the fourth ground image determines the second target straight line equation corresponding to the edge identification line in the fourth ground image, where the narrow-track linear movement state refers to the driving state of the vehicle moving linearly in the narrow lane between the two ground stack warehouses, specifically , Determining that the vehicle is in a narrow lane according to the third location information and the navigation path corresponding to the vehicle, and determining that the vehicle needs to move in a straight line according to the third location information and the target location, the vehicle is in a state of straight moving in the narrow lane,
  • the method for determining the second target straight line equation corresponding to the edge identification line in the fourth ground image is similar to the method for determining the first target straight line equation in the foregoing embodiment, and will not be repeated here.
  • the calibration position of the vehicle is determined based on the second target straight line equation; and the target position and attitude information of the vehicle are determined based on the calibration position, and the vehicle is controlled based on the target position and the attitude information , In order to realize the straight line movement of the vehicle in the narrow lane.
  • the camera device includes two camera devices, the two camera devices are respectively arranged in the front and the side of the vehicle, and the edge marking line includes, according to each of the depth data coordinates, identifying in the ground image
  • the steps of the second target straight line equation corresponding to the edge identification line include:
  • the third straight line equation of the edge identification line corresponding to the front camera device and the fourth straight line equation of the edge identification line corresponding to the side camera device are determined according to each of the depth data coordinates; based on the third The straight line equation and the fourth straight line equation are fused to obtain the second target straight line equation.
  • the first ground image includes the front ground image and the side ground image
  • the edge identification line corresponding to the front camera device can be obtained according to the front ground image.
  • the first straight line equation, and the second straight line equation that obtains the edge identification line corresponding to the side camera device according to the side ground image, and then the coordinate system where the first straight line equation is located and the coordinate system where the second straight line equation is located are merged ,
  • the fusion is specifically performed according to the fusion filtering algorithm, and the fused coordinate system and the second target straight line equation in the fused coordinate system are obtained.
  • the coordinate origin in the coordinate system after the fusion is the calibration position. If there are two linear equations in the coordinate system after the fusion, and the two linear equations are perpendicular, then The intersection of the two straight line equations is the calibration position.
  • the vehicle navigation method proposed in this embodiment acquires the fourth ground currently photographed by the camera device when it is determined that the vehicle is in a state of linear movement in a narrow lane based on the current third position information of the vehicle and the navigation path corresponding to the vehicle.
  • Image and identify the initial position of each identification element in the fourth ground image; then separate the ground feature area from the fourth ground image, and determine each location based on the ground feature area and each of the initial positions
  • the position of the center of mass of the target element in the identification element; then according to the position of the center of mass, the depth data coordinates of each of the target elements are determined, and according to each of the depth data coordinates; and then according to each of the depth data coordinates, the
  • the second target straight line equation corresponding to the edge identification line in the ground image, and the calibration position of the vehicle is determined based on the second target straight line equation; finally, the target position and attitude information of the vehicle are determined based on the calibration position, and The vehicle is controlled based on the target position and the posture information, and then when the
  • an embodiment of the present application also proposes a computer-readable storage medium having computer-readable instructions stored on the computer-readable storage medium, and when the computer-readable instructions are executed by a processor, any of the foregoing The steps of the vehicle navigation method.
  • the technical solution of this application essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above. , Magnetic disks, optical disks), including several instructions to make a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the method described in each embodiment of the present application.
  • a terminal device which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.

Abstract

Disclosed in the present application is a vehicle navigation method. The vehicle navigation method comprises the following steps: when determining, on the basis of the current first position information of a vehicle, that the vehicle is located at a first specified position corresponding to a target storage location, obtaining a coordinate origin corresponding to the vehicle; controlling, on the basis of the coordinate origin, the vehicle to rotate, and on the basis of a first ground image currently photographed by a photographing apparatus installed on the vehicle, determining whether an edge marking line corresponding to the target storage location is perpendicular to the vehicle; and when the edge marking line is perpendicular to the vehicle, controlling the vehicle to stop rotating.

Description

车辆导航方法、装置及计算机可读存储介质Vehicle navigation method, device and computer readable storage medium
本申请要求深圳创维数字技术有限公司于2019年11月12日提交中国专利局、申请号为201911117651.8、发明名称为“车辆导航方法、装置及计算机可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在申请中。This application requires Shenzhen Skyworth Digital Technology Co., Ltd. to submit the priority of a Chinese patent application with the application number 201911117651.8 and the invention title of "Vehicle Navigation Method, Device and Computer Readable Storage Medium" to the Chinese Patent Office on November 12, 2019. The entire content is incorporated into the application by reference.
技术领域Technical field
本申请涉及智能驾驶技术领域,尤其涉及一种车辆导航方法、装置及计算机可读存储介质。This application relates to the field of intelligent driving technology, and in particular to a vehicle navigation method, device, and computer-readable storage medium.
背景技术Background technique
基于自然环境的SLAM(simultaneous localization and mapping,即时定位与地图构建)包括两大功能:定位与建图。其中,建图的主要作用是对周边环境的理解,建立周边环境与空间的对应关系;定位的主要作用是根据建好的图,判断车体在地图中的位置,从而得到环境中的信息。其次,激光雷达是一种主动式探测传感器,不依赖于外界光照条件,且具备高精度的测距信息。因此,基于激光雷达的SLAM方法依旧是机器人SLAM方法中应用最为广泛的方法,并且在ROS(Robot Operating System,机器人软件平台)的SLAM应用也已非常广泛。SLAM (simultaneous Localization and mapping, real-time positioning and map construction) includes two major functions: positioning and mapping. Among them, the main function of mapping is to understand the surrounding environment and establish the corresponding relationship between the surrounding environment and space; the main function of positioning is to judge the position of the car body on the map based on the built map, so as to obtain the information in the environment. Secondly, lidar is an active detection sensor that does not depend on external light conditions and has high-precision ranging information. Therefore, the SLAM method based on lidar is still the most widely used method in the robot SLAM method, and in ROS (Robot Operating System, robot software platform) SLAM applications have also been very extensive.
而在实际应用中,由于要节省仓库面积,托盘仓位之间的距离尽可能缩小,通常在两边深堆位仓位之间的过道,只比车辆的车长多一点点,现有的导航方式难以使得车辆准确快速的进入目标库位,进而影响车辆的导航效率。In practical applications, in order to save storage space, the distance between pallet positions should be reduced as much as possible. Usually, the aisle between the two deep pile positions is only a little longer than the length of the vehicle. The existing navigation method is difficult. This allows the vehicle to enter the target location accurately and quickly, which in turn affects the navigation efficiency of the vehicle.
上述内容仅用于辅助理解本申请的技术方案,并不代表承认上述内容是现有技术。The above content is only used to assist the understanding of the technical solutions of this application, and does not mean that the above content is recognized as prior art.
技术解决方案Technical solutions
本申请的主要目的在于提供一种车辆导航方法、装置及计算机可读存储介质,旨在解决现有的导航方式难以使得车辆准确快速的进入目标库位的技术问题。The main purpose of this application is to provide a vehicle navigation method, device, and computer-readable storage medium, aiming to solve the technical problem that the existing navigation method is difficult to make the vehicle enter the target location accurately and quickly.
为实现上述目的,本申请提供一种车辆导航方法,所述车辆导航方法包括以下步骤:To achieve the above objective, the present application provides a vehicle navigation method, which includes the following steps:
在基于车辆当前的第一位置信息确定所述车辆位于目标库位对应的第一指定位置时,获取所述车辆对应的坐标原点;When it is determined that the vehicle is located at the first designated location corresponding to the target storage location based on the current first location information of the vehicle, acquiring the coordinate origin corresponding to the vehicle;
基于所述坐标原点控制所述车辆旋转,并基于车辆上所安装的摄像装置当前拍摄的第一地面图像,确定所述目标库位对应的边缘标识线与所述车辆是否垂直;Controlling the rotation of the vehicle based on the origin of the coordinates, and determining whether the edge identification line corresponding to the target storage location is perpendicular to the vehicle based on the first ground image currently captured by the camera installed on the vehicle;
在所述边缘标识线与所述车辆垂直时,控制所述车辆停止旋转。When the edge marking line is perpendicular to the vehicle, the vehicle is controlled to stop rotating.
此外,为实现上述目的,本申请还提供一种车辆导航装置,所述车辆导航装置包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机可读指令,所述计算机可读指令被所述处理器执行时实现上述中任一项所述的车辆导航方法的步骤。In addition, in order to achieve the above object, the present application also provides a vehicle navigation device, the vehicle navigation device comprising: a memory, a processor, and computer-readable instructions stored in the memory and running on the processor, When the computer-readable instructions are executed by the processor, the steps of the vehicle navigation method described in any one of the above are implemented.
此外,为实现上述目的,本申请还提供一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机可读指令,所述计算机可读指令被处理器执行时实现上述中任一项所述的车辆导航方法的步骤。In addition, in order to achieve the above object, the present application also provides a computer-readable storage medium having computer-readable instructions stored on the computer-readable storage medium, and when the computer-readable instructions are executed by a processor, any one of the above is realized. The steps of the vehicle navigation method described in the item.
本申请通过在基于车辆当前的第一位置信息确定所述车辆位于目标库位对应的第一指定位置时,获取所述车辆对应的坐标原点;接着基于所述坐标原点控制所述车辆旋转,并基于车辆上所安装的摄像装置当前拍摄的第一地面图像,确定所述目标库位对应的边缘标识线与所述车辆是否垂直;而后在所述边缘标识线与所述车辆垂直时,控制所述车辆停止旋转,在车辆库位对应的窄道中移动时,通过旋转车辆使车辆与目标库位的边缘标识线垂直,使得车辆与目标库位进行准确的对位,以使得车辆准确快速的进入目标库位,提高车辆导航的效率。This application obtains the coordinate origin corresponding to the vehicle when it is determined that the vehicle is located at the first designated position corresponding to the target storage location based on the current first position information of the vehicle; then controls the rotation of the vehicle based on the coordinate origin, and Based on the first ground image currently captured by the camera device installed on the vehicle, it is determined whether the edge identification line corresponding to the target location is perpendicular to the vehicle; and then when the edge identification line is perpendicular to the vehicle, the control station is controlled When the vehicle stops rotating and moves in the narrow lane corresponding to the vehicle location, by rotating the vehicle to make the vehicle perpendicular to the edge marking line of the target location, so that the vehicle and the target location can be accurately aligned, so that the vehicle can enter accurately and quickly Target storage location to improve the efficiency of vehicle navigation.
附图说明Description of the drawings
图1是本申请实施例方案涉及的硬件运行环境的路径导航装置结构示意图;FIG. 1 is a schematic structural diagram of a path navigation device in a hardware operating environment involved in a solution of an embodiment of the application;
图2为本申请车辆导航方法第一实施例的流程示意图;FIG. 2 is a schematic flowchart of a first embodiment of a vehicle navigation method according to this application;
图3为本申请车辆导航方法基于车辆上所安装的摄像装置当前拍摄的第一地面图像,确定所述第一指定位置对应目标库位的边缘标识线与所述车辆是否垂直步骤的细化流程示意图;Fig. 3 is a detailed flow of the step of determining whether the edge marking line of the target location corresponding to the first designated location is perpendicular to the vehicle based on the first ground image currently captured by the camera device installed on the vehicle in the vehicle navigation method of this application Schematic diagram
图4为本申请路径导航方法一实施例中的场景示意图;4 is a schematic diagram of a scene in an embodiment of the route navigation method of this application;
图5为本申请车辆导航方法第二实施例的流程示意图。Fig. 5 is a schematic flowchart of a second embodiment of a vehicle navigation method according to this application.
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization, functional characteristics, and advantages of the purpose of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
本发明的实施方式Embodiments of the present invention
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。It should be understood that the specific embodiments described here are only used to explain the application, and not used to limit the application.
如图1所示,图1是本申请实施例方案涉及的硬件运行环境的路径导航装置结构示意图。As shown in FIG. 1, FIG. 1 is a schematic structural diagram of a path navigation device in a hardware operating environment involved in a solution of an embodiment of the present application.
如图1所示,该路径导航装置可以包括:处理器1001,例如CPU,网络接口1004,用户接口1003,存储器1005,通信总线1002。其中,通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard),可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。As shown in FIG. 1, the route navigation apparatus may include a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to implement connection and communication between these components. The user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a magnetic disk memory. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.
可选地,路径导航装置还可以包括摄像头、RF(Radio Frequency,射频)电路,传感器、音频电路、WiFi模块等等。其中,传感器比如光传感器、运动传感器以及其他传感器。具体地,光传感器可包括接近传感器,其中,接近传感器可在移动路径导航装置移动到障碍物时,控制车辆停止。Optionally, the route navigation device may also include a camera, RF (Radio Frequency, radio frequency) circuits, sensors, audio circuits, WiFi modules, etc. Among them, sensors such as light sensors, motion sensors and other sensors. Specifically, the light sensor may include a proximity sensor, where the proximity sensor may control the vehicle to stop when the movement path navigation device moves to an obstacle.
本领域技术人员可以理解,图1中示出的路径导航装置结构并不构成对路径导航装置的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Those skilled in the art can understand that the structure of the route navigation device shown in FIG. 1 does not constitute a limitation on the route navigation device, and may include more or fewer components than those shown in the figure, or a combination of certain components, or different components. Layout.
如图1所示,作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及路径导航程序。As shown in FIG. 1, the memory 1005, which is a computer storage medium, may include an operating system, a network communication module, a user interface module, and a route navigation program.
在图1所示的路径导航装置中,网络接口1004主要用于连接后台服务器,与后台服务器进行数据通信;用户接口1003主要用于连接客户端(用户端),与客户端进行数据通信;而处理器1001可以用于调用存储器1005中存储的路径导航程序。In the route navigation device shown in FIG. 1, the network interface 1004 is mainly used to connect to the back-end server and communicate with the back-end server; the user interface 1003 is mainly used to connect to the client (user side) and communicate with the client; and The processor 1001 may be used to call a route navigation program stored in the memory 1005.
在本实施例中,路径导航装置包括:存储器1005、处理器1001及存储在所述存储器1005上并可在所述处理器1001上运行的路径导航程序,其中,处理器1001调用存储器1005中存储的路径导航程序时,并执行以下车辆导航方法的各个实施例中的操作。In this embodiment, the path navigation device includes: a memory 1005, a processor 1001, and a path navigation program stored on the memory 1005 and running on the processor 1001, wherein the processor 1001 calls the memory 1005 to store When the route navigation program, and perform the following operations in the various embodiments of the vehicle navigation method.
本申请还提供一种车辆导航方法,参照图2,图2为本申请车辆导航方法第一实施例的流程示意图。The present application also provides a vehicle navigation method. Referring to FIG. 2, FIG. 2 is a schematic flowchart of the first embodiment of the vehicle navigation method of this application.
本实施例的车辆导航方法可应用于智能自动驾驶过程中,其中智能自动驾驶可适用于封闭环境的仓库货运、也可适用于开放环境的道路运输,本实施例以仓库货运为例加以说明;与仓库货运对应的车辆可以为叉车、也可以为抱车、还可以是AGV(Automated Guided Vehicle,自动引导运输车)小车等可实现货物运输的设备;仓库货运中堆放有货物,货物放置在托盘上,车辆通过对托盘的运输来实现货物的运输。可以理解的是,仓库地面上预先设置有预设标识线,两条相邻并平行的预设标识线之间形成了车辆的行驶路线。The vehicle navigation method of this embodiment can be applied to the process of intelligent automatic driving, where intelligent automatic driving can be applied to warehouse freight in a closed environment and also applicable to road transportation in an open environment. This embodiment takes warehouse freight as an example for illustration; The vehicle corresponding to warehouse freight can be a forklift, a truck, or an AGV (Automated Guided Vehicle, automatic guided transport vehicle) trolley and other equipment that can realize the transportation of goods; goods are stacked in warehouse freight, and the goods are placed on pallets, and the vehicle realizes the transportation of goods by transporting the pallets. It is understandable that a preset identification line is preset on the floor of the warehouse, and the driving route of the vehicle is formed between two adjacent and parallel preset identification lines.
该车辆导航方法包括:The vehicle navigation method includes:
步骤S100,在基于车辆当前的第一位置信息确定所述车辆位于目标库位对应的第一指定位置时,获取所述车辆对应的坐标原点;Step S100, when it is determined that the vehicle is located at the first designated location corresponding to the target storage location based on the current first location information of the vehicle, obtain the origin of the coordinates corresponding to the vehicle;
本实施例中,车辆设有激光雷达,可通过激光雷达实时获取车辆的位置信息,同时,若该车辆在存取货物的途中,则获取车辆对应的目标库位即待存放货物或待取货物所在的库位,根据预设规则确定该目标库位所对应的第一指定位置,该车辆可在该第一指定位置进行旋转移动至与该目标库位为匹配姿态,该第一指定位置根据该目标库位、车辆的长度以及宽度进行确定。In this embodiment, the vehicle is equipped with a lidar, and the position information of the vehicle can be obtained in real time through the lidar. At the same time, if the vehicle is on the way of accessing goods, the target location corresponding to the vehicle is obtained, that is, the goods to be stored or the goods to be picked up. The first designated location corresponding to the target warehouse is determined according to the preset rules for the location where the vehicle is located. The vehicle can rotate at the first designated location to match the target location, and the first designated location is based on The target location, the length and width of the vehicle are determined.
而后,基于第一位置信息确定车辆是否位于第一指定位置,即该车辆当前是否达到该第一指定位置,在该车辆位于第一指定位置时,获取该车辆对应的坐标原点,例如,该车辆为托盘搬运的叉车,以叉车的后轮轴中心位置(附近)为车辆对应的坐标原点(圆心)。Then, based on the first position information, it is determined whether the vehicle is located at the first designated position, that is, whether the vehicle currently reaches the first designated position, and when the vehicle is at the first designated position, the coordinate origin corresponding to the vehicle is obtained, for example, the vehicle For forklifts that carry pallets, the center position (near) of the rear axle of the forklift is the origin of the coordinates (center of the circle) corresponding to the vehicle.
步骤S200,基于所述坐标原点控制所述车辆旋转,并基于车辆上所安装的摄像装置当前拍摄的第一地面图像,确定所述目标库位对应的边缘标识线与所述车辆是否垂直;Step S200, controlling the rotation of the vehicle based on the coordinate origin, and determining whether the edge marking line corresponding to the target storage location is perpendicular to the vehicle based on the first ground image currently captured by the camera installed on the vehicle;
本实施例中,在确定坐标原点后,控制该车辆按照该坐标原点进行旋转,具体地,在摄像装置安装于车辆的左侧时,控制该车辆顺时针旋转,在摄像装置安装于车辆的右侧时,控制该车辆逆时针旋转。In this embodiment, after the origin of the coordinates is determined, the vehicle is controlled to rotate according to the origin of the coordinates. Specifically, when the camera device is installed on the left side of the vehicle, the vehicle is controlled to rotate clockwise, and the camera device is installed on the right side of the vehicle. When turning, control the vehicle to rotate counterclockwise.
在车辆旋转过程中,通过车辆上所安装的摄像装置实时拍摄图像,以获得对应的第一地面图像,并通过该第一地面图像确定目标库位对应的边缘标识线与车辆是否垂直,该摄像装置为深度摄像头。During the rotation of the vehicle, an image is taken in real time by the camera installed on the vehicle to obtain the corresponding first ground image, and the first ground image is used to determine whether the edge marking line corresponding to the target location is perpendicular to the vehicle. The device is a depth camera.
具体地,本实施例中,摄像装置包括两个,两个摄像装置分别设置于所述车辆的前方以及侧方,Specifically, in this embodiment, the camera device includes two camera devices, and the two camera devices are respectively arranged in the front and the side of the vehicle,
参照图3,在一实施例中,步骤S200包括:3, in an embodiment, step S200 includes:
步骤S210,获取所述摄像装置当前拍摄的第一地面图像,并识别所述第一地面图像中各标识元素的初始位置;Step S210: Acquire a first ground image currently captured by the camera device, and identify the initial position of each identification element in the first ground image;
步骤S220,从所述第一地面图像中分离出地面特征区域,并根据所述地面特征区域和各所述初始位置,确定各所述标识元素中目标元素的质心位置;Step S220: Separate the ground feature area from the first ground image, and determine the centroid position of the target element in each of the identification elements according to the ground feature area and each of the initial positions;
步骤S230,根据各所述质心位置,确定各所述目标元素的深度数据坐标,并根据各所述深度数据坐标,确定所述边缘标识线对应的第一目标直线方程;Step S230: Determine the depth data coordinates of each target element according to each of the centroid positions, and determine the first target straight line equation corresponding to the edge identification line according to each of the depth data coordinates;
步骤S240,基于所述第一目标直线方程确定所述边缘标识线与所述车辆是否垂直。Step S240: Determine whether the edge identification line is perpendicular to the vehicle based on the first target straight line equation.
本实施例中,在车辆旋转过程中,通过车辆上所安装的摄像装置实时拍摄图像,以获得对应的第一地面图像,可理解地,仓库中库位的边缘标识线其实质为粘贴在地面上的胶带,通常由两种颜色相互间隔形成的菱形块图案组成,如黑色菱形块搭配黄色菱形块,黑色菱形块搭配白色菱形块等。In this embodiment, during the rotation of the vehicle, the image is taken in real time by the camera installed on the vehicle to obtain the corresponding first ground image. Understandably, the edge markings of the storage locations in the warehouse are actually pasted on the ground. The tape on the top is usually composed of diamond-shaped blocks with two colors spaced apart from each other, such as black diamond-shaped blocks with yellow diamond-shaped blocks, black diamond-shaped blocks with white diamond-shaped blocks, etc.
而后,对所述第一地面图像进行背景处理,并从经背景处理的所述第一地面图像中提取出各标识元素;对各所述标识元素依次经过边缘提取、轮廓查找和折线拟合处理,得到各所述标识元素的初始轮廓;将各所述初始轮廓传输到预设函数中,确定各所述标识元素在所述地面图像中的初始坐标;以各所述初始坐标为圆心,设定圆形区域,并将各所述圆形区域识别为所述地面图像中各标识元素的初始位置。Then, the first ground image is subjected to background processing, and each identification element is extracted from the background-processed first ground image; each of the identification elements is sequentially processed by edge extraction, contour search, and polyline fitting. , Obtain the initial contour of each of the identification elements; transmit each of the initial outlines to a preset function, and determine the initial coordinates of each of the identification elements in the ground image; take each of the initial coordinates as the center of the circle, and set Defining a circular area, and identifying each of the circular areas as the initial position of each identification element in the ground image.
进一步地,通过漫水填充对第一地面图像进行剥离背景的处理,预先设定8-10个多种颜色的种子对第一地面图像进行填充,以去除第一地面图像中的其他物质;其中种子依据实际需求设定,如可设定第一地面图像中的4个角的顶点,以及第一地面图像边缘三等分点等,对此不做限定。此后,结合OpenCV(Open Source Computer Vision Library,开源计算机视觉库)中用于实现HSV(hue、saturation、value,色调、色饱和度、值)颜色识别的预设函数,提取出作为标识元素的黑色菱块。Further, the first ground image is stripped of the background by flood filling, and 8-10 multi-color seeds are preset to fill the first ground image to remove other substances in the first ground image; wherein The seed is set according to actual requirements. For example, the vertices of the four corners in the first ground image and the third halves of the edge of the first ground image can be set, which is not limited. Since then, combined with OpenCV (Open Source Computer Vision Library, an open source computer vision library) is used to realize the preset function of HSV (hue, saturation, value, hue, color saturation, value) color recognition, and extract the black diamond block as the identification element.
更进一步地,调用OpenCV中用于提取边缘的预设函数,设定边缘范围参数传输到该预设函数中,对提取的各标识元素进行边缘提取;当某一标识元素的边缘大小在边缘范围参数内,则对该标识元素进行边缘提取操作,得到各黑色菱块在第一地面图像中形成的边缘像素点;当某一标识元素的边缘大小不在边缘范围参数内,则不对其进行边缘提取操作,而将其作为干扰去除。此后,调用OpenCV中用于轮廓查找的预设函数,设定轮廓范围参数传输到该预设函数中,在边缘提取的基础上对各标识元素进行轮廓查找;当某一标识元素的轮廓大小在轮廓范围参数内,则对该标识元素的轮廓进行保留操作,得到其轮廓点;当某一标识元素的轮廓大小不在轮廓范围参数内,则对其轮廓进行去除,以去除第一地面图像中的干扰轮廓。在各标识元素均经过边缘提取和轮廓查找,得到满足需求的各标识元素的轮廓点之后,对各标识元素的轮廓点进行折线拟合处理,得到各标识元素的初始轮廓。Further, call the preset function used to extract the edge in OpenCV, set the edge range parameters and transfer to the preset function, and perform edge extraction on the extracted identification elements; when the edge size of a certain identification element is in the edge range Within the parameters, the edge extraction operation is performed on the identification element to obtain the edge pixels formed by each black diamond block in the first ground image; when the edge size of a certain identification element is not within the edge range parameters, no edge extraction is performed on it Operation, and remove it as interference. After that, the preset function for contour search in OpenCV is called, the parameters of the set contour range are transferred to the preset function, and the contour search is performed on each identification element on the basis of edge extraction; when the contour size of a certain identification element is in Within the contour range parameter, the contour of the identification element is retained to obtain its contour point; when the contour size of a certain identification element is not within the contour range parameter, its contour is removed to remove the first ground image Interfere with contours. After each identification element undergoes edge extraction and contour search to obtain the contour points of each identification element that meets the requirements, the contour points of each identification element are processed by polyline fitting to obtain the initial contour of each identification element.
此外,本实施例预先建立有三维空间坐标系,该三维空间坐标系以立体相机所在位置作为坐标原点,以AGV小车所在平面为XY平面,以与XY平面垂直的上部空间为Z轴正方向所在空间;其中对于XY平面,车辆行驶正前方为X轴方向,车辆右侧与X轴方向垂直的方向为Y轴方向。在得到各表示元素的初始轮廓后,调用OpenCV中用于计算质心位置的预设函数,将各标识元素的初始轮廓传输到该预设函数中,经过该预设函数的处理,输出坐标值,该坐标值即为各标识元素的在第一地面图像中的初始坐标。此后,调用预先设定的半径数值,以初始坐标作为为圆心设定与各个标识元素对应的圆形区域,该圆形区域即为标识元素在第一地面图像中的初始位置。In addition, this embodiment has a pre-established three-dimensional space coordinate system. The three-dimensional space coordinate system uses the position of the stereo camera as the coordinate origin, the plane where the AGV car is located is the XY plane, and the upper space perpendicular to the XY plane is the positive direction of the Z axis. Space; where for the XY plane, the direction of the X axis is the direction directly in front of the vehicle and the direction perpendicular to the X axis on the right side of the vehicle is the Y axis. After the initial contour of each representative element is obtained, the preset function used to calculate the centroid position in OpenCV is called, the initial contour of each identification element is transferred to the preset function, and the coordinate value is output through the processing of the preset function. The coordinate value is the initial coordinate of each identification element in the first ground image. Thereafter, the preset radius value is called, and the circular area corresponding to each identification element is set with the initial coordinate as the center of the circle, and the circular area is the initial position of the identification element in the first ground image.
可理解地,在车辆行驶的路径中可能存在有障碍物,障碍物在第一地面图像中成像,形成干扰信号被误识别为标识元素;为了避免干扰信号的干扰,设置有地面特征区域提取机制。地面特征区域为地面在第一地面图像中成像所占的区域,因障碍物在三维空间坐标系的Z轴上具有一定的投影高度,可通过设定一定的投影阈值来识别第一地面图像中的障碍物,并将识别的障碍物从第一地面图像中去除,得到地面特征区域。Understandably, there may be obstacles in the path of the vehicle. The obstacles are imaged in the first ground image, resulting in interference signals that are misidentified as identification elements; in order to avoid interference from interference signals, a ground feature region extraction mechanism is provided . The ground feature area is the area occupied by the ground image in the first ground image. Because the obstacle has a certain projection height on the Z axis of the three-dimensional space coordinate system, a certain projection threshold can be set to identify the first ground image And remove the identified obstacles from the first ground image to obtain the ground feature area.
而后,将三维空间坐标系中的坐标原点作为预设坐标原点,地面特征区域和各初始位置均依据三维空间坐标系生成,可在预设坐标原点的基础上,对表征地面特征区域的图像和表征各初始位置的图像进行处理,以确定各标识元素中的目标元素,以及各目标元素的质心坐标。具体地,根据预设坐标原点,将所述地面特征区域和各所述初始位置进行合并,提取所述地面特征区域和各所述初始位置之间的重合特征区域;将各所述重合特征区域传输到预设模型,筛选出各所述标识元素中的目标元素,并计算各所述目标元素的元素坐标作为各所述目标元素的质心位置。Then, the coordinate origin in the three-dimensional space coordinate system is used as the preset coordinate origin, and the ground feature area and each initial position are generated according to the three-dimensional space coordinate system. Based on the preset coordinate origin, the image and The images representing each initial position are processed to determine the target element in each identification element and the centroid coordinates of each target element. Specifically, according to a preset coordinate origin, the ground feature area and each of the initial positions are combined, and the overlapping feature area between the ground feature area and each of the initial positions is extracted; and each of the overlapping feature areas is It is transmitted to a preset model, the target elements in each of the identification elements are screened out, and the element coordinates of each of the target elements are calculated as the centroid position of each of the target elements.
调用预先设定的预设模型,并将各重合特征区域传输到预设模型中,对各重合特征区域进行特征分类,筛选出符合地面特征并且有黑色块的区域,该区域即为各标识元素中满足黑色菱块特征的目标元素。同时预设模型具有对筛选出的区域进行坐标计算的功能,通过该计算功能得到各目标元素的元素坐标;该元素坐标其实质为目标元素的质心坐标,将其作为目标元素的质心位置。Call the preset model, and transfer each overlapping feature area to the preset model, classify the features of each overlapping feature area, and filter out the areas that meet the ground features and have black blocks, and this area is the identification element The target element that meets the characteristics of the black diamond block. At the same time, the preset model has the function of calculating the coordinates of the filtered area, and the element coordinates of each target element are obtained through the calculation function; the element coordinates are essentially the centroid coordinates of the target element, which is taken as the centroid position of the target element.
接着,在得到各目标元素的质心位置后,结合立体相机的安装参数对表征质心位置的质心坐标进行极坐标转换,得到各目标元素的深度数据坐标,以依据深度数据坐标拟合成第一目标直线方程,由第一目标直线方程生成地面还原标识线考虑到立体相机在成像过程中,可能因其本身特征、反光、吸收、折射等因素的影响,使得第一地面图像中会存在空洞数据,空洞数据在转换过程中无法得到深度数据坐标,导致极坐标转换的失败,需要在转换之间进行预处理,对空洞数据进行填充。具体地,逐一检测所述地面特征区域中的空洞数据,并读取与所述空洞数据对应的周边深度数据;根据所述周边深度数据,对所述空洞数据进行填充,直到所述地面特征区域中的空洞数据均填充完成,以基于经填充的所述地面特征区域确定所述深度数据坐标。Then, after obtaining the centroid position of each target element, combine the installation parameters of the stereo camera to perform polar coordinate conversion on the centroid coordinates representing the centroid position to obtain the depth data coordinates of each target element to fit the first target according to the depth data coordinates Straight line equation, the ground restoration identification line is generated from the first target straight line equation. Considering that during the imaging process of the stereo camera, there may be holes in the first ground image due to its own characteristics, reflection, absorption, refraction and other factors. The depth data coordinates cannot be obtained during the conversion of the hole data, which leads to the failure of the polar coordinate conversion. It is necessary to perform preprocessing between the conversions to fill the hole data. Specifically, the hole data in the ground feature area is detected one by one, and the peripheral depth data corresponding to the hole data is read; the hole data is filled according to the peripheral depth data until the ground feature area The hole data in are all filled, so as to determine the depth data coordinates based on the filled ground feature area.
对地面特征区域进行扫描,逐一检测其中的空洞数据,每当检测到空洞数据,则读取其周围的其他数据作为与检测到的空洞数据对应的周边深度数据,通过膨胀算法用周边深度数据对空洞数据进行邻域扩张,实现空洞数据的填平。在地面特征区域中的所有空洞数据均进行了填充,则可在填充后的地面特征区域的基础上,对各质心坐标进行极坐标转换,得到各目标元素的深度数据坐标。此后,调用预先设置的预设算法来对转换的各深度数据坐标进行计算,以识别第一地面图像中的边缘标识线;具体地,根据预设范围区间,确定各所述深度数据坐标的目标数据坐标,并根据各所述目标数据坐标生成第一目标直线方程。Scan the ground feature area, and detect the hole data one by one. Whenever the hole data is detected, the other data around it is read as the peripheral depth data corresponding to the detected hole data, and the peripheral depth data is used to pair with the peripheral depth data through the expansion algorithm. The hole data is expanded in the neighborhood to realize the filling of the hole data. All the hole data in the ground feature area are filled, and then on the basis of the filled ground feature area, the polar coordinate conversion of each centroid coordinate can be performed to obtain the depth data coordinates of each target element. After that, the preset algorithm is called to calculate the converted depth data coordinates to identify the edge identification line in the first ground image; specifically, the target of each depth data coordinate is determined according to the preset range interval Data coordinates, and generate a first target straight line equation according to each of the target data coordinates.
进一步地,本实施例中预设算法优选为最小二乘法,将作为目标元素初始位置的圆形区域作为预设范围区间,各目标元素的深度数据坐标均以该预设范围区间为基础,查找与其前后左右相邻的点。每当找到前后或者左右有点的时候,将三个点去除保存到一个数组中,作为各深度数据坐标的目标坐标数据。在各深度数据坐标均查找到目标坐标数据后,采用最小二乘法将各目标坐标数据生成为第一目标直线方程,该第一目标直线方程所对应的直线即为第一地面图像中边缘标识线所在的位置。通过先初步识别边缘标识线中标识元素的初始位置,再在排除干扰的基础上精确识别其精准的质心位置,使得由质心位置所确定的深度数据坐标准确反映了各标识元素的位置,提高了边缘标识线识别的准确性。Further, the preset algorithm in this embodiment is preferably the least squares method. The circular area as the initial position of the target element is taken as the preset range interval, and the depth data coordinates of each target element are based on the preset range interval. Points adjacent to the front, back, left, and right. Whenever the front and back or left and right points are found, the three points are removed and saved in an array as the target coordinate data of each depth data coordinate. After finding the target coordinate data for each depth data coordinate, the least square method is used to generate each target coordinate data into the first target straight line equation, and the straight line corresponding to the first target straight line equation is the edge identification line in the first ground image Location. By initially identifying the initial position of the marking element in the edge marking line, and then accurately identifying its precise centroid position on the basis of eliminating interference, the depth data coordinates determined by the centroid position accurately reflect the position of each marking element, which improves Accuracy of edge identification line recognition.
而后,基于所述第一目标直线方程确定所述边缘标识线与所述车辆是否垂直,可确定车辆的直线方程,并根据边缘标识线的第一目标直线方程与车辆的直线方程确定所述边缘标识线与所述车辆是否垂直。Then, it is determined whether the edge identification line is perpendicular to the vehicle based on the first target straight line equation, the straight line equation of the vehicle can be determined, and the edge is determined according to the first target straight line equation of the edge identification line and the straight line equation of the vehicle Whether the identification line is perpendicular to the vehicle.
步骤S300,在所述边缘标识线与所述车辆垂直时,控制所述车辆停止旋转。Step S300, when the edge marking line is perpendicular to the vehicle, control the vehicle to stop rotating.
本实施例中,在缘标识线与所述车辆垂直时,该车辆已旋转至指定的入库点,此时控制车辆停止旋转,以使车辆与目标库位匹配,便于后续直接反向直线移动车辆以使车辆准确入库。In this embodiment, when the edge marking line is perpendicular to the vehicle, the vehicle has rotated to the designated storage point. At this time, the vehicle is controlled to stop rotating to match the vehicle with the target storage location, which is convenient for subsequent direct reverse linear movement Vehicles so that the vehicles can be accurately stored.
需要说明的是,本实施例应用于车辆在多个库位之间的窄道移动的场景,以使先车辆的快速移动,通常窄道宽度L≥叉车对角长+0.2米;库位宽度l≥托盘宽+0.1米;例如,本实施例中,叉车长=1.8米,托盘宽=1米,布置地堆仓位尺寸位:过道L=2米、库位l=1.1米。It should be noted that this embodiment is applied to a scene where vehicles move in a narrow lane between multiple storage locations, so that the vehicle moves quickly, usually the narrow lane width L≥the forklift diagonal length + 0.2 meters; the storage location width l ≥ pallet width + 0.1 meters; for example, in this embodiment, the forklift length = 1.8 meters, the pallet width = 1 meter, and the size of the storage location: aisle L = 2 meters, and storage location l = 1.1 meters.
参照图4,图4中,1.1-1.3为车辆的坐标原点的位置,2.1为车辆的运动方向;2.2为车辆的运动轨迹。虚线为库位地面标识线,包括平行的黄黑相间警示线以及库位入口(出口)黄黑相间的边缘标识线。在车辆的坐标原点位于第一指定位置1.1时,车辆开始按照2.1所示的运动方向旋转,边缘标识线与车辆垂直即车辆旋转90度时,停止旋转。Referring to Figure 4, in Figure 4, 1.1-1.3 are the position of the origin of the vehicle's coordinates, 2.1 is the direction of movement of the vehicle; 2.2 is the trajectory of the vehicle. The dotted line is the ground marking line of the storage location, including parallel yellow and black warning lines and yellow and black edge markings at the entrance (exit) of the storage location. When the coordinate origin of the vehicle is at the first designated position 1.1, the vehicle starts to rotate according to the direction of movement shown in 2.1, and the edge marking line is perpendicular to the vehicle, that is, when the vehicle rotates 90 degrees, the rotation stops.
在一实施例中,所述摄像装置包括两个,两个摄像装置分别设置于所述车辆的前方以及侧方,步骤S230包括:In an embodiment, the camera includes two camera devices, and the two camera devices are respectively arranged in front of and on the side of the vehicle. Step S230 includes:
步骤a,所述根据各所述深度数据坐标,确定前方摄像装置对应的所述边缘标识线的第一直线方程,以及侧方摄像装置对应的所述边缘标识线的第二直线方程;Step a: According to each of the depth data coordinates, determine a first straight line equation of the edge identification line corresponding to a front camera device, and a second straight line equation of the edge identification line corresponding to a side camera device;
步骤b,基于所述第一直线方程以及所述第二直线方程进行融合,以获得所述第一目标直线方程。Step b: Perform fusion based on the first straight line equation and the second straight line equation to obtain the first target straight line equation.
由于摄像装置包括分别设置于所述车辆的前方以及侧方两个深度摄像头,第一地面图像包括前方地面图像以及侧方地面图像,进而能够根据前方地面图像得到前方摄像装置对应的边缘标识线的第一直线方程,以及根据侧方地面图像得到侧方摄像装置对应的边缘标识线的第二直线方程,而后对第一直线方程所在的坐标系以及第二直线方程所在的坐标系进行融合,具体根据融合滤波算法进行融合,得到融合后的坐标系以及融合后坐标系中的第一目标直线方程。Since the camera device includes two depth cameras respectively arranged in the front and the side of the vehicle, the first ground image includes the front ground image and the side ground image, and the edge identification line corresponding to the front camera device can be obtained according to the front ground image. The first straight line equation, and the second straight line equation that obtains the edge identification line corresponding to the side camera device according to the side ground image, and then the coordinate system where the first straight line equation is located and the coordinate system where the second straight line equation is located are merged , The fusion is specifically performed according to the fusion filtering algorithm, and the fused coordinate system and the first target straight line equation in the fused coordinate system are obtained.
其中,若融合后坐标系中的直线方程仅有一个,则融合后坐标系中的直线方程即为需要的第一目标直线方程,若融合后坐标系中的直线方程有两个,且两个直线方程垂直,则表明两个直线方程垂直分比为目标库位的黄黑相间警示线以及库位入口的边缘标识线,其中,若车辆旋转角度大于预设角度例如60度,则与车辆的直线方程夹角最大的直线方程为第一目标直线方程。Among them, if there is only one straight line equation in the coordinate system after fusion, then the straight line equation in the fused coordinate system is the first target straight line equation needed. If there are two straight line equations in the fused coordinate system, and two If the straight line equation is vertical, it means that the vertical ratio of the two straight line equations is the yellow and black warning line of the target storage location and the edge marking line of the storage location entrance. The straight line equation with the largest angle between the straight line equations is the first target straight line equation.
本实施例提出的车辆导航方法,通过在基于车辆当前的第一位置信息确定所述车辆位于目标库位对应的第一指定位置时,获取所述车辆对应的坐标原点;接着基于所述坐标原点控制所述车辆旋转,并基于车辆上所安装的摄像装置当前拍摄的第一地面图像,确定所述目标库位对应的边缘标识线与所述车辆是否垂直;而后在所述边缘标识线与所述车辆垂直时,控制所述车辆停止旋转,在车辆库位对应的窄道中移动时,通过旋转车辆使车辆与目标库位的边缘标识线垂直,使得车辆与目标库位进行准确的对位,以使得车辆准确快速的进入目标库位,提高车辆导航的效率。The vehicle navigation method proposed in this embodiment obtains the coordinate origin corresponding to the vehicle when it is determined based on the current first position information of the vehicle that the vehicle is located at the first designated location corresponding to the target storage location; and then based on the coordinate origin Control the rotation of the vehicle, and determine whether the edge identification line corresponding to the target storage location is perpendicular to the vehicle based on the first ground image currently captured by the camera installed on the vehicle; When the vehicle is vertical, the vehicle is controlled to stop rotating, and when moving in the narrow lane corresponding to the vehicle location, the vehicle is perpendicular to the edge marking line of the target location by rotating the vehicle, so that the vehicle and the target location can be accurately aligned. In order to make the vehicle enter the target location accurately and quickly, and improve the efficiency of vehicle navigation.
基于第一实施例,提出本申请车辆导航方法的第二实施例,参照图5,在本实施例中,在步骤S200之前,该车辆导航方法还包括:Based on the first embodiment, a second embodiment of the vehicle navigation method of the present application is proposed. Referring to FIG. 5, in this embodiment, before step S200, the vehicle navigation method further includes:
步骤S400,基于所述摄像装置获取第二地面图像,并根据所述第二地面图像,确定所述车辆与预设标识线之间的相对位置参数;Step S400, acquiring a second ground image based on the camera device, and determining a relative position parameter between the vehicle and a preset identification line according to the second ground image;
步骤S500,读取基于所述摄像装置获取的历史地面图像,并根据所述第二地面图像和历史地面图像,确定所述车辆的位移参数;Step S500, reading the historical ground image acquired based on the camera device, and determining the displacement parameter of the vehicle according to the second ground image and the historical ground image;
步骤S600,根据所述相对位置参数确定位置调整参数,并将所述位置调整参数和所述位移参数作为姿态调整参数,以对所述车辆的姿态进行调整。Step S600: Determine a position adjustment parameter according to the relative position parameter, and use the position adjustment parameter and the displacement parameter as posture adjustment parameters to adjust the posture of the vehicle.
车辆在行驶过程中,立体相机实时对行驶方向的侧面地面进行拍摄成像,生成表征车辆与预设标识线之间相对位置的第二地面图像。若车辆的行驶路径出现偏差,则车辆与预设标识线之间的相对位置也出现偏差,使得第二地面图像中的预设标识线出现偏差。该预设标识线为目标库位的边缘标识线对应的直线。During the driving of the vehicle, the stereo camera photographs and images the side ground in the driving direction in real time, and generates a second ground image that characterizes the relative position between the vehicle and the preset marking line. If the driving path of the vehicle deviates, the relative position between the vehicle and the preset identification line also deviates, so that the preset identification line in the second ground image deviates. The preset identification line is a straight line corresponding to the edge identification line of the target storage location.
为了确定第二地面图像中的预设标识线是否出现偏差,以车辆当前所在位置为基础建立三维空间坐标系,将立体相机所在位置作为坐标原点,以车辆所在平面为XY平面,以与XY平面垂直的上部空间为Z轴正方向所在空间;其中对于XY平面,车辆行驶正前方为X轴方向,车辆右侧与X轴方向垂直的方向为Y轴方向。In order to determine whether the preset marking line in the second ground image is deviated, a three-dimensional space coordinate system is established based on the current position of the vehicle, the position of the stereo camera is taken as the coordinate origin, and the plane where the vehicle is located is the XY plane, which is compared with the XY plane. The vertical upper space is the space where the positive direction of the Z-axis is located; among them, for the XY plane, the direction directly in front of the vehicle is the X-axis direction, and the direction perpendicular to the X-axis direction on the right side of the vehicle is the Y-axis direction.
依据预设标识线在第二地面图像中的位置,确定预设标识线在XY平面上的直线方程,进而确定车辆相对于预设标识线之间的相对位置参数,该相对位置参数包括车辆相对于预设标识线的角度和距离,以通过角度表征车辆是否与预设标识线平行,并通过距离表征车辆到左右两侧的预设标识线的距离是否相等。具体地,获取与所述预设标识线对应的直线方程,并计算所述直线方程的斜率;将所述车辆的行驶方向作为参考方向,根据所述斜率,计算所述直线方程与所述参考方向之间的夹角;根据所述直线方程,计算所述车辆与所述预设标识线之间的距离,并将所述夹角和所述距离确定为所述相对位置参数。According to the position of the preset identification line in the second ground image, the linear equation of the preset identification line on the XY plane is determined, and the relative position parameter of the vehicle relative to the preset identification line is determined. The relative position parameter includes the relative position of the vehicle. For the angle and distance of the preset identification line, the passing angle indicates whether the vehicle is parallel to the preset identification line, and the passing distance indicates whether the distance between the vehicle and the preset identification line on the left and right sides is equal. Specifically, the straight line equation corresponding to the preset identification line is obtained, and the slope of the straight line equation is calculated; the driving direction of the vehicle is taken as the reference direction, and the straight line equation and the reference are calculated according to the slope. The included angle between directions; according to the straight line equation, the distance between the vehicle and the preset identification line is calculated, and the included angle and the distance are determined as the relative position parameter.
可理解地,预设标识线实质是以黄黑间隔或者黑白间隔的菱块组成图案,在获取到第二地面图像之后,对其进行图像处理,提取出其中的黑色菱块,并确定各黑色菱块的质心位置;对质心位置进行拟合生成直线方程,该直线方程即为预设标识线所在的直线。此后对直线方程的斜率进行计算。Understandably, the preset marking line is essentially a pattern composed of rhombuses with yellow and black intervals or black and white intervals. After the second ground image is obtained, image processing is performed on it, and the black rhombuses are extracted, and each black is determined. The position of the center of mass of the rhombus; fitting the position of the center of mass to generate a straight line equation, which is the straight line where the preset marking line is located. After that, the slope of the linear equation is calculated.
进一步地,将车辆的行驶方向作为参考方向,以斜率为基础,计算直线方程与参考方向之间的夹角。因三维空间坐标系中行驶负方向为x轴正方向,从而参考方向其实质为x轴方向,所计算的夹角为预设标识线相对于x轴的夹角,即车辆行驶方向与预设标识线之间的夹角。同时依据直线方程的参数,对车辆与预设标识线之间的距离进行计算;其中夹角△α通过公式△α=tan k进行计算,距离△L通过公式△L= /(A +B )进行计算。此后,将经计算得到的夹角和距离确定为相对位置参数,以通过相对位置参数判定是否需要调整车辆的姿态。Further, the driving direction of the vehicle is taken as the reference direction, and the angle between the linear equation and the reference direction is calculated based on the slope. Since the negative direction of travel in the three-dimensional space coordinate system is the positive direction of the x-axis, the reference direction is essentially the direction of the x-axis, and the calculated included angle is the included angle between the preset marking line and the x-axis, that is, the vehicle travel direction and the preset Identify the angle between the lines. At the same time, the distance between the vehicle and the preset marking line is calculated according to the parameters of the straight line equation; the angle △α is calculated by the formula △α=tan k, and the distance △L is calculated by the formula △L= /(A +B) Calculation. Thereafter, the calculated included angle and distance are determined as relative position parameters to determine whether the posture of the vehicle needs to be adjusted through the relative position parameters.
更进一步地,对摄像装置上一时刻获取的历史地面图像进行读取,通过上一时刻的历史地面图像和第二地面图像的对比,来体现车辆的相对位置变化,以此确定车辆的位移参数。Furthermore, the historical ground image acquired by the camera device at the previous moment is read, and the relative position change of the vehicle is reflected by the comparison between the historical ground image at the previous moment and the second ground image, thereby determining the displacement parameter of the vehicle .
可理解地,为了判定车辆是否与预设标识线平行,且到两边预设标识线之间的距离相等,预先设置有预设夹角和预设距离。将相对位置参数中的夹角和预设夹角对比,得到两者之间的夹角差值,通过夹角差值来表征车辆的实际角度与理论角度的差异大小,差异越小表征车辆与预设标识线之间的平行性越好;同时将相对位置参数中的距离和预设距离对比,得到两者之间的距离差值,通过距离差值来表征车辆的实际距离与理论距离之间的差异大小,差异越小表征车辆到两边预设标识之间距离相等的可能性越大。Understandably, in order to determine whether the vehicle is parallel to the preset identification line and the distance to the preset identification lines on both sides is equal, a preset included angle and a preset distance are preset. Compare the included angle in the relative position parameter with the preset included angle to get the angle difference between the two. The angle difference is used to characterize the difference between the actual angle and the theoretical angle of the vehicle. The smaller the difference, the smaller the difference between the vehicle and the theoretical angle. The parallelism between the preset marking lines is better; at the same time, the distance in the relative position parameter is compared with the preset distance to obtain the distance difference between the two. The distance difference is used to characterize the actual distance between the vehicle and the theoretical distance. The size of the difference between the two, the smaller the difference, the greater the possibility that the distance between the vehicle and the preset signs on both sides is equal.
将通过对比得到的夹角差值和距离差值确定为位置调整参数,并将位置调整参数和位移参数一并作为姿态调整参数,以对车辆所在位置的角度,以及与两边预设标识线之间的距离进行姿态调整,并对车辆前后时刻的位移进行计算;在避免与两边所堆放货物发生碰撞的同时,计算位移距离,确定与目的地之间的行驶距离。The angle difference and distance difference obtained through the comparison are determined as the position adjustment parameters, and the position adjustment parameters and the displacement parameters are used as the attitude adjustment parameters to adjust the angle of the vehicle position and the preset marking line on both sides Adjust the attitude of the distance between the two, and calculate the displacement of the vehicle at the front and rear moments; while avoiding collisions with the goods stacked on both sides, the displacement distance is calculated to determine the driving distance to the destination.
进一步地,对车辆进行姿态调整可通过车辆的控制中心调整,也可以通过与车辆通信连接的上位机进行调整。具体地,在通过上位机进行调整时,车辆将作为姿态调整参数的位置调整参数和位移参数发送到上位机;由上位机依据角度差值表征的角度差异大小来对车辆的行驶角度进行调整,并依据距离差值表征的距离差异大小对车辆的左右侧位置进行调整,同时依据位移参数计算车辆从上一时刻到当前时刻所运行的位移距离;由位移距离来更新车辆的行驶距离,表征车辆与目的地之间的距离。上位机将确定调整与否,以及调整的参数下发到车辆,控制车辆的行驶状态,实现车辆的精准运输。Further, the posture adjustment of the vehicle can be adjusted through the control center of the vehicle, or through an upper computer connected to the vehicle in communication. Specifically, when the upper computer is used for adjustment, the vehicle sends the position adjustment parameters and displacement parameters as the attitude adjustment parameters to the upper computer; the upper computer adjusts the driving angle of the vehicle according to the angle difference represented by the angle difference. According to the distance difference represented by the distance difference, the left and right positions of the vehicle are adjusted. At the same time, the displacement distance of the vehicle from the previous moment to the current moment is calculated according to the displacement parameter; the displacement distance is used to update the driving distance of the vehicle to represent the vehicle The distance to the destination. The host computer will determine whether to adjust or not, and the adjusted parameters will be sent to the vehicle to control the driving state of the vehicle and realize the precise transportation of the vehicle.
当由车辆的控制中心对车辆的姿态进行调整时,则由控制中心直接依据角度差值表征的角度差异大小来对车辆的行驶角度进行调整,并依据距离差值表征的距离差异大小对车辆的左右侧位置进行调整,同时依据位移参数计算车辆从上一时刻到当前时刻所运行的位移距离,由位移距离来更新车辆的行驶距离,表征车辆与目的地之间的距离;以此,控制车辆的行驶状态,实现车辆的精准运输。When the vehicle's control center adjusts the attitude of the vehicle, the control center directly adjusts the driving angle of the vehicle according to the angle difference represented by the angle difference, and adjusts the vehicle's driving angle according to the distance difference represented by the distance difference. The left and right positions are adjusted, and the displacement distance of the vehicle from the last moment to the current moment is calculated according to the displacement parameters. The displacement distance is used to update the travel distance of the vehicle, which represents the distance between the vehicle and the destination; in this way, the vehicle is controlled The driving state of the vehicle can realize the accurate transportation of the vehicle.
进一步地,步骤S500包括:识别所述第二地面图像中的第一数据点和所述历史地面图像中的第二数据点,并筛选出各所述第一数据点中的第一坐标点和各所述第二数据点中的第二坐标点;分别确定各所述第一坐标点中的第一中心坐标和各所述第二坐标点中的第二中心坐标,并根据所述第一中心坐标和第二中心坐标,确定所述车辆的位移参数。Further, step S500 includes: identifying the first data point in the second ground image and the second data point in the historical ground image, and filtering out the first coordinate point and the second data point in each of the first data points. The second coordinate point in each of the second data points; the first center coordinates in each of the first coordinate points and the second center coordinates in each of the second coordinate points are determined respectively, and according to the first The center coordinates and the second center coordinates determine the displacement parameters of the vehicle.
更进一步地,用于计算位移距离的位移参数包括位移值和位移角,其中位移值为车辆在上一时刻所在位置点到当前时刻所在位置点之间的距离值,位移角为车辆与行驶方向,即x轴方向的夹角。本实施例在确定位移参数时,先对第二地面图像中预设标识线的黑色菱块进行提取,识别各黑色菱块的质心,并将各质心确定为第二地面图像中的第一数据点;同时对历史地面图像中预设标识线的黑色菱块进行提取,识别各黑色菱块的质心,并将各质心确定为历史地面图像中的第二数据点。此后,针对第一数据点,依据预设标识线在第二地面图像中的直线方程进行筛选,将其中属于直线方程上的点确定为第一坐标点;同时针对第二数据点,依据预设标识线在历史地面图像中的直线方程进行筛选,将其中属于直线方程上的点确定为第二坐标点。需要说明的是,两个直线方程的斜率在预设范围内,若超出预设范围,则说明车辆前后时刻的位移较大,出现异常情况;此时一方面对车辆的位移进行监测,另一方面重新生成直线方程,以确保计算的正确性。Further, the displacement parameters used to calculate the displacement distance include displacement value and displacement angle, where the displacement value is the distance value between the position of the vehicle at the previous moment and the position point of the current moment, and the displacement angle is the distance between the vehicle and the driving direction , That is, the included angle in the x-axis direction. In this embodiment, when determining the displacement parameters, first extract the black diamond blocks of the preset marking line in the second ground image, identify the centroid of each black diamond block, and determine each centroid as the first data in the second ground image Point; At the same time, extract the black diamond blocks of the preset marking line in the historical ground image, identify the centroid of each black diamond block, and determine each centroid as the second data point in the historical ground image. After that, for the first data point, filter according to the straight line equation of the preset identification line in the second ground image, and determine the point belonging to the straight line equation as the first coordinate point; at the same time, for the second data point, according to the preset The line equation of the marking line in the historical ground image is screened, and the point belonging to the line equation is determined as the second coordinate point. It should be noted that the slopes of the two linear equations are within the preset range. If it exceeds the preset range, it means that the vehicle has a large displacement at the front and rear moments and an abnormal situation has occurred. At this time, the displacement of the vehicle is monitored on the one hand, and the other Regenerate the linear equation to ensure the correctness of the calculation.
进一步地,对第一坐标点和第二坐标点进行筛选,确定其中同时属于历史地面图像和第二地面图像中的有效点,由各自的有效点来分别确定第一坐标点中的第一中心坐标以及第二坐标点中的第二中心坐标。具体地,根据各所述第二坐标点,确定与各所述第一坐标点对应的第一有效点,并对各所述第一有效点进行均值处理,确定所述第一中心坐标;根据各所述第一坐标点,确定与各所述第二坐标点对应的第二有效点,并对各所述第二有效点进行均值处理,生成所述第二中心坐标。Further, the first coordinate point and the second coordinate point are screened, and the valid points in the historical ground image and the second ground image are determined, and the first center in the first coordinate point is determined by the respective valid points. Coordinates and the second center coordinates in the second coordinate point. Specifically, according to each of the second coordinate points, a first effective point corresponding to each of the first coordinate points is determined, and the averaging process is performed on each of the first effective points to determine the first center coordinate; For each of the first coordinate points, a second effective point corresponding to each of the second coordinate points is determined, and average processing is performed on each of the second effective points to generate the second center coordinate.
在确定各第一坐标点中的第一中心坐标时,以各个第二坐标点为依据,从各个第二坐标点中筛选出与各第一坐标点距离最近的点;此后将各个距离最近的点作为第一有效点进行坐标值的均值处理,得到平均值即为与各第一坐标点对应的第一中心坐标。若第一坐标点包含a1(x1,y1)、a2(x2,y2)、a3(x3,y3)、a4(x4,y4)•••an(xn,yn)N个点,经查找确定第二坐标点中与a1距离最近的点为b1,与a2距离最近的点为b2,与a3距离最近的点为b3,与a4距离最近的点为b4,与an距离最近的点为bn;对b1、b2、b3、b4•••bn的坐标值进行均值处理,得到坐标值的平均值(x,y),该平均值(x,y)即为各第一坐标点中的第一中心坐标。When determining the first center coordinates of each first coordinate point, use each second coordinate point as a basis to filter out the point with the closest distance to each first coordinate point from each second coordinate point; after that, the closest distance to each first coordinate point is selected. The point is used as the first effective point to perform the average value processing of the coordinate values, and the average value obtained is the first center coordinate corresponding to each first coordinate point. If the first coordinate point contains a1 (x1, y1), a2 (x2, y2), a3 (x3, y3), a4 (x4, y4)•••an(xn, yn) N points, the first point is determined by searching Among the two coordinate points, the point closest to a1 is b1, the point closest to a2 is b2, the point closest to a3 is b3, the point closest to a4 is b4, and the point closest to an is bn; The coordinate values of b1, b2, b3, b4•••bn are averaged, and the average value (x, y) of the coordinate values is obtained. The average value (x, y) is the first center of each first coordinate point coordinate.
同样地,在确定各第二坐标点中的第二中心坐标时,以各个第一坐标点为依据,从各个第一坐标点中筛选出与各第二坐标点距离最近的点;此后将各个距离最近的点作为第二有效点进行坐标值的均值处理,得到平均值即为与各第二坐标点对应的第二中心坐标。Similarly, when determining the second center coordinates of each second coordinate point, use each first coordinate point as a basis to filter out the point with the closest distance to each second coordinate point from each first coordinate point; The closest point is used as the second effective point to perform the average value processing of the coordinate values, and the average value obtained is the second center coordinate corresponding to each second coordinate point.
进一步地,依据第一中心坐标和第二中心坐标,即可对位移参数中的位移值和位移角进行计算。具体地,根据所述第一中心坐标和所述第二中心坐标,计算由所述第一中心坐标和所述第二中心坐标所形成直线的斜率,以及计算所述车辆的相对位移值;根据所述直线的斜率计算所述车辆的位移角,并将所述相对位移值和所述位移角确定为所述车辆的位移参数。Further, according to the first center coordinate and the second center coordinate, the displacement value and the displacement angle in the displacement parameter can be calculated. Specifically, according to the first center coordinates and the second center coordinates, calculate the slope of the straight line formed by the first center coordinates and the second center coordinates, and calculate the relative displacement value of the vehicle; The slope of the straight line calculates the displacement angle of the vehicle, and the relative displacement value and the displacement angle are determined as the displacement parameters of the vehicle.
更进一步地,(x1、y1)为第一中心坐标,(x0、y0)为第二中心坐标,第一中心坐标和第二中心坐标之间形成直线,通过第一中心坐标和第二中心坐标对所形成直线的斜率进行计算,由斜率对应的角度来反映车辆在前后两个时刻相对于预设标识线所发生的角度变化。同时第一中心坐标和第二中心坐标还反映了车辆在前后两个时刻的位移,从而可通过第一中心坐标和第二中心坐标对车辆的相对位移值进行计算。其中斜率k的计算公式为:k=(y1-y2)/(x1-x0),相对位移值△S的计算公式为:△S=((x1-x0) +(y1-y0))。Furthermore, (x1, y1) are the first center coordinates, (x0, y0) are the second center coordinates, a straight line is formed between the first center coordinates and the second center coordinates, passing through the first center coordinates and the second center coordinates The slope of the straight line formed is calculated, and the angle corresponding to the slope reflects the angle change of the vehicle relative to the preset marking line at the front and back two moments. At the same time, the first center coordinate and the second center coordinate also reflect the displacement of the vehicle at the front and rear moments, so that the relative displacement value of the vehicle can be calculated through the first center coordinate and the second center coordinate. The formula for calculating the slope k is: k=(y1-y2)/(x1-x0), and the formula for calculating the relative displacement value △S is: △S=((x1-x0) +(y1-y0)).
进一步地,通过斜率k对车辆的位移角进行计算,该位移角即为车辆在前后两个时刻相对于预设标识线所发生的角度变化;位移角ℬ的的计算公式为:ℬ = Tan k。将计算得到的相对位移值和位移角确定为车辆的位移参数,以便于依据位移参数计算车辆在前后两个时刻所行驶的位移距离。通过位移参数中的相对位移值和位移角度,计算相对位移值在x轴方向上的投影,投影的数值即为车辆沿着行驶方向所行驶的位移距离;进而通过位移距离对车辆与目的地之间的行驶距离进行更新,实现准确运输。Further, the displacement angle of the vehicle is calculated by the slope k, which is the angle change of the vehicle relative to the preset marking line at two moments before and after; the calculation formula for the displacement angle ℬ is: ℬ = Tan k . The calculated relative displacement value and displacement angle are determined as the displacement parameters of the vehicle, so as to calculate the displacement distance traveled by the vehicle at two moments before and after the displacement parameters. Calculate the projection of the relative displacement value in the x-axis direction through the relative displacement value and displacement angle in the displacement parameter. The projected value is the displacement distance the vehicle travels along the direction of travel; and the displacement distance is used to compare the distance between the vehicle and the destination. The driving distance between the two is updated to achieve accurate transportation.
本实施例提出的车辆导航方法,通过基于所述摄像装置获取第二地面图像,并根据所述第二地面图像,确定所述车辆与预设标识线之间的相对位置参数;接着读取基于所述摄像装置获取的历史地面图像,并根据所述第二地面图像和历史地面图像,确定所述车辆的位移参数;而后根据所述相对位置参数确定位置调整参数,并将所述位置调整参数和所述位移参数作为姿态调整参数,以对所述车辆的姿态进行调整,因用于实现调整的姿态调整参数依据车辆的相对位置参数以及位移参数生成,可准确表征车辆的位移变化,实现了车辆姿态的准确调整,有利于精准运输。In the vehicle navigation method proposed in this embodiment, a second ground image is acquired based on the camera device, and the relative position parameter between the vehicle and a preset identification line is determined according to the second ground image; The historical ground image acquired by the camera device determines the displacement parameter of the vehicle according to the second ground image and the historical ground image; then the position adjustment parameter is determined according to the relative position parameter, and the position adjustment parameter And the displacement parameter is used as the attitude adjustment parameter to adjust the attitude of the vehicle. Because the attitude adjustment parameter used to realize the adjustment is generated according to the relative position parameter and the displacement parameter of the vehicle, it can accurately characterize the displacement change of the vehicle, and realize The accurate adjustment of the vehicle posture is conducive to accurate transportation.
基于第一实施例,提出本申请车辆导航方法的第三实施例,在本实施例中,步骤S200之前,该车辆导航方法还包括:Based on the first embodiment, a third embodiment of the vehicle navigation method of the present application is proposed. In this embodiment, before step S200, the vehicle navigation method further includes:
步骤S700,基于所述摄像装置当前拍摄的第三地面图像,确定所述目标库位的两侧标识线;Step S700: Determine the marking lines on both sides of the target storage location based on the third ground image currently captured by the camera device;
步骤S800,基于所述两侧标识线控制所述车辆反向移动,并在监测到后方停止线或者确定防撞传感器当前检测到货物时,控制所述车辆停止移动,其中,所述防撞传感器安装于所述车辆的末端。Step S800: Control the vehicle to move in the reverse direction based on the marking lines on both sides, and control the vehicle to stop moving when the rear stop line is monitored or it is determined that the anti-collision sensor currently detects the cargo, wherein the anti-collision sensor Installed at the end of the vehicle.
其中,车辆为叉车,叉车设有两个防撞传感器,分别安装在叉车的货叉末端,在货叉抬起状态下,能检测后方指定距离的托盘货物,在货叉放下状态下,实现插入托盘防撞检测。Among them, the vehicle is a forklift, and the forklift is equipped with two anti-collision sensors, which are respectively installed at the end of the fork of the forklift. When the fork is lifted, it can detect the pallet cargo at a specified distance behind, and it can be inserted when the fork is down. Pallet anti-collision detection.
本实施例中,在车辆停止旋转时,基于所述摄像装置当前拍摄的第三地面图像,确定所述目标库位的两侧标识线,其中,两侧标识线的确定方式与边缘标识线的确定方式类似,先确定两侧标识线的直线方程,根据该直线方程确定两侧标识线,而后基于所述两侧标识线控制所述车辆反向移动,以使车辆进行目标库位。车辆反向移动过程中,实时采集摄像装置的所拍摄的地面图像以及防撞传感器的检测结果,在根据摄像装置的所拍摄的地面图像确定监测到后方停止线,或者根据防撞传感器的检测结果的检测结果确定防撞传感器当前检测到货物时,控制所述车辆停止移动。In this embodiment, when the vehicle stops rotating, based on the third ground image currently captured by the camera device, the identification lines on both sides of the target location are determined, wherein the determination method of the identification lines on both sides is the same as that of the edge identification lines. The determination method is similar. First, the straight line equations of the identification lines on both sides are determined, the identification lines on both sides are determined according to the straight line equation, and then the vehicle is controlled to move in the reverse direction based on the identification lines on both sides, so that the vehicle can move to the target storage location. During the reverse movement of the vehicle, the ground image captured by the camera device and the detection result of the collision avoidance sensor are collected in real time, and the rear stop line is determined according to the ground image captured by the camera device, or according to the detection result of the collision avoidance sensor The detection result determines that when the anti-collision sensor currently detects goods, the vehicle is controlled to stop moving.
可以理解的是,在车辆停止旋转时,可先执行第二实施例中的步骤,以实现车辆的姿态调整。It is understandable that when the vehicle stops rotating, the steps in the second embodiment can be executed first to realize the posture adjustment of the vehicle.
本实施例提出的车辆导航方法,通过基于所述摄像装置当前拍摄的第三地面图像,确定所述目标库位的两侧标识线;接着基于所述两侧标识线控制所述车辆反向移动,并在监测到后方停止线或者确定防撞传感器当前检测到货物时,控制所述车辆停止移动,其中,所述防撞传感器安装于所述车辆的末端,实现车辆在库位内的准确移动,进一步提高车辆的导航效率。The vehicle navigation method proposed in this embodiment determines the identification lines on both sides of the target location based on the third ground image currently captured by the camera; and then controls the vehicle to move in the reverse direction based on the identification lines on both sides , And when the rear stop line is monitored or it is determined that the anti-collision sensor currently detects the goods, the vehicle is controlled to stop moving, wherein the anti-collision sensor is installed at the end of the vehicle to realize the accurate movement of the vehicle in the warehouse , To further improve the navigation efficiency of the vehicle.
基于第一实施例,提出本申请车辆导航方法的第四实施例,在本实施例中,步骤S100之后,该车辆导航方法还包括:Based on the first embodiment, a fourth embodiment of the vehicle navigation method of the present application is proposed. In this embodiment, after step S100, the vehicle navigation method further includes:
步骤c,基于所述第一位置信息以及目标库位确定所述车辆是否满足掉头条件;Step c, determining whether the vehicle satisfies a U-turn condition based on the first location information and the target storage location;
步骤d,若未满足,则执行在基于所述第一位置信息确定所述车辆位于目标库位对应的第一指定位置时,获取所述车辆对应的坐标原点的步骤。Step d, if it is not met, execute the step of acquiring the origin of the coordinates corresponding to the vehicle when it is determined based on the first location information that the vehicle is located at the first designated location corresponding to the target storage location.
本实施例中,在获取到第一位置信息时,基于所述第一位置信息以及目标库位确定所述车辆是否满足掉头条件,具体地根据第一位置信息确定车辆的移动方向,并基于该移动方向以及目标库位确定该车辆当前是否需要移动至另外一边的地堆仓库,若不需要,则执行步骤S200。In this embodiment, when the first location information is acquired, it is determined whether the vehicle meets the U-turn condition based on the first location information and the target location, and specifically the moving direction of the vehicle is determined based on the first location information. The moving direction and the target location determine whether the vehicle currently needs to move to the other side of the warehouse, and if not, execute step S200.
进一步地,在一实施例中,步骤c之后,还包括:Further, in an embodiment, after step c, it further includes:
步骤e,若满足,则基于所述当前位置信息确定所述车辆对应的第二指定位置;Step e, if it is satisfied, determine a second designated location corresponding to the vehicle based on the current location information;
步骤f,基于所述第二指定位置控制所述车辆;Step f, controlling the vehicle based on the second designated position;
步骤g,在所述车辆当前的第二位置信息确定车辆位于所述第二指定位置时,基于所述车辆对应的第二坐标原点控制所述车辆旋转;Step g, when the current second position information of the vehicle determines that the vehicle is located at the second designated position, control the rotation of the vehicle based on the origin of the second coordinate corresponding to the vehicle;
步骤h,在所述车辆旋转至所述目标库位对应的第三指定位置时,控制所述车辆停止旋转。Step h, when the vehicle rotates to a third designated position corresponding to the target storage location, control the vehicle to stop rotating.
本实施例中,若车辆满足掉头条件,则基于所述当前位置信息确定所述车辆对应的第二指定位置,并基于所述第二指定位置控制所述车辆,以使车辆移动中该第二指定位置,其中,第二指定位置可根据目标库位进行设置,以使该车辆在该第二指定位置掉头后能够快速到达该目标库位。In this embodiment, if the vehicle satisfies the U-turn condition, the second designated position corresponding to the vehicle is determined based on the current position information, and the vehicle is controlled based on the second designated position, so that the second designated position of the vehicle is moving. The designated location, where the second designated location can be set according to the target storage location, so that the vehicle can quickly reach the target storage location after turning around at the second specified location.
而后,在所述车辆当前的第二位置信息确定车辆位于所述第二指定位置时,基于所述车辆对应的第二坐标原点控制所述车辆旋转,即使车辆旋转180度,实现车辆的掉头,并在车辆旋转至目标库位对应的第三指定位置,即车辆完成掉头操作时,控制所述车辆停止旋转,进而实现车辆的掉头。Then, when the current second position information of the vehicle determines that the vehicle is located at the second designated position, the vehicle is controlled to rotate based on the origin of the second coordinate corresponding to the vehicle, even if the vehicle rotates 180 degrees, a U-turn of the vehicle is realized, And when the vehicle rotates to the third designated position corresponding to the target storage location, that is, when the vehicle completes a U-turn operation, the vehicle is controlled to stop rotating, thereby realizing a U-turn of the vehicle.
可以理解的是,在所述车辆当前的第二位置信息确定车辆位于所述第二指定位置时,可执行第三实施例中的各个步骤,以调整车辆的位姿。It is understandable that when the current second position information of the vehicle determines that the vehicle is located at the second designated position, the steps in the third embodiment can be executed to adjust the vehicle's posture.
本实施例提出的车辆导航方法,通过基于所述第一位置信息以及目标库位确定所述车辆是否满足掉头条件,接着若未满足,则执行在基于所述第一位置信息确定所述车辆位于目标库位对应的第一指定位置时,获取所述车辆对应的坐标原点的步骤,进而在车辆无需掉头时,执行后续的步骤,以实现车辆的准确导航,进一步提升车辆的导航效率。The vehicle navigation method proposed in this embodiment determines whether the vehicle satisfies the U-turn condition based on the first location information and the target location, and then if it is not met, then executes the determination that the vehicle is located based on the first location information. When the target location corresponds to the first designated location, the step of obtaining the coordinate origin corresponding to the vehicle, and then execute the subsequent steps when the vehicle does not need to turn around, so as to realize the accurate navigation of the vehicle and further improve the navigation efficiency of the vehicle.
基于上述各个实施例,提出本申请车辆导航方法的第五实施例,在本实施例中,该车辆导航方法还包括:Based on the foregoing embodiments, a fifth embodiment of the vehicle navigation method of the present application is proposed. In this embodiment, the vehicle navigation method further includes:
步骤i,在基于车辆当前的第三位置信息以及所述车辆对应的导航路径确定所述车辆处于窄道直线移动状态时,获取所述摄像装置当前拍摄的第四地面图像,并识别所述第四地面图像中各标识元素的初始位置;Step i: When it is determined that the vehicle is in a narrow-track linear movement state based on the current third position information of the vehicle and the navigation path corresponding to the vehicle, acquire the fourth ground image currently captured by the camera device, and identify the first 4. The initial position of each identification element in the ground image;
步骤j,从所述第四地面图像中分离出地面特征区域,并根据所述地面特征区域和各所述初始位置,确定各所述标识元素中目标元素的质心位置;Step j: Separate the ground feature area from the fourth ground image, and determine the centroid position of the target element in each of the identification elements according to the ground feature area and each of the initial positions;
步骤k,根据各所述质心位置,确定各所述目标元素的深度数据坐标,并根据各所述深度数据坐标;Step k: Determine the depth data coordinates of each target element according to each of the centroid positions, and according to each of the depth data coordinates;
步骤l,根据各所述深度数据坐标,识别所述第四地面图像中的边缘标识线对应的第二目标直线方程,并基于所述第二目标直线方程确定所述车辆的标定位置;Step 1. Identify the second target straight line equation corresponding to the edge identification line in the fourth ground image according to each of the depth data coordinates, and determine the calibration position of the vehicle based on the second target straight line equation;
步骤m,基于所述标定位置确定所述车辆的目标位置以及姿态信息,并基于所述目标位置以及所述姿态信息控制所述车辆。Step m: Determine the target position and attitude information of the vehicle based on the calibration position, and control the vehicle based on the target position and the attitude information.
本实施例中,在基于车辆当前的第三位置信息以及所述车辆对应的导航路径确定所述车辆处于窄道直线移动状态时,获取所述摄像装置当前拍摄的第四地面图像,并根据第四地面图像确定第四地面图像中的边缘标识线对应的第二目标直线方程,其中,窄道直线移动状态是指车辆在两个地堆仓库之间的窄道直线移动的行驶状态,具体地,根据的第三位置信息以及所述车辆对应的导航路径确定所述车辆处于窄道,并根据第三位置信息以及目标库位确定车辆需要进行直线移动时,该车辆处于窄道直线移动状态,第四地面图像中的边缘标识线对应的第二目标直线方程的确定方式与上述实施例中第一目标直线方程的确定方式类似,在此不再赘述。In this embodiment, when it is determined that the vehicle is in a narrow-track linear movement state based on the current third position information of the vehicle and the navigation path corresponding to the vehicle, the fourth ground image currently captured by the camera device is acquired, and the fourth ground image is acquired according to the first The fourth ground image determines the second target straight line equation corresponding to the edge identification line in the fourth ground image, where the narrow-track linear movement state refers to the driving state of the vehicle moving linearly in the narrow lane between the two ground stack warehouses, specifically , Determining that the vehicle is in a narrow lane according to the third location information and the navigation path corresponding to the vehicle, and determining that the vehicle needs to move in a straight line according to the third location information and the target location, the vehicle is in a state of straight moving in the narrow lane, The method for determining the second target straight line equation corresponding to the edge identification line in the fourth ground image is similar to the method for determining the first target straight line equation in the foregoing embodiment, and will not be repeated here.
而后,基于所述第二目标直线方程确定所述车辆的标定位置;并基于所述标定位置确定所述车辆的目标位置以及姿态信息,并基于所述目标位置以及所述姿态信息控制所述车辆,以实现车辆在窄道内的直线移动。Then, the calibration position of the vehicle is determined based on the second target straight line equation; and the target position and attitude information of the vehicle are determined based on the calibration position, and the vehicle is controlled based on the target position and the attitude information , In order to realize the straight line movement of the vehicle in the narrow lane.
进一步地,所述摄像装置包括两个,两个摄像装置分别设置于所述车辆的前方以及侧方,所述边缘标识线包括,所述根据各所述深度数据坐标,识别所述地面图像中的边缘标识线对应的第二目标直线方程的步骤包括:Further, the camera device includes two camera devices, the two camera devices are respectively arranged in the front and the side of the vehicle, and the edge marking line includes, according to each of the depth data coordinates, identifying in the ground image The steps of the second target straight line equation corresponding to the edge identification line include:
所述根据各所述深度数据坐标,确定前方摄像装置对应的所述边缘标识线的第三直线方程,以及侧方摄像装置对应的所述边缘标识线的第四直线方程;基于所述第三直线方程以及所述第四直线方程进行融合,以获得所述第二目标直线方程。The third straight line equation of the edge identification line corresponding to the front camera device and the fourth straight line equation of the edge identification line corresponding to the side camera device are determined according to each of the depth data coordinates; based on the third The straight line equation and the fourth straight line equation are fused to obtain the second target straight line equation.
由于摄像装置包括分别设置于所述车辆的前方以及侧方两个深度摄像头,第一地面图像包括前方地面图像以及侧方地面图像,进而能够根据前方地面图像得到前方摄像装置对应的边缘标识线的第一直线方程,以及根据侧方地面图像得到侧方摄像装置对应的边缘标识线的第二直线方程,而后对第一直线方程所在的坐标系以及第二直线方程所在的坐标系进行融合,具体根据融合滤波算法进行融合,得到融合后的坐标系以及融合后坐标系中的第二目标直线方程。Since the camera device includes two depth cameras respectively arranged in the front and the side of the vehicle, the first ground image includes the front ground image and the side ground image, and the edge identification line corresponding to the front camera device can be obtained according to the front ground image. The first straight line equation, and the second straight line equation that obtains the edge identification line corresponding to the side camera device according to the side ground image, and then the coordinate system where the first straight line equation is located and the coordinate system where the second straight line equation is located are merged , The fusion is specifically performed according to the fusion filtering algorithm, and the fused coordinate system and the second target straight line equation in the fused coordinate system are obtained.
其中,若融合后坐标系中的直线方程仅有一个,则融合后坐标系中的坐标原点即为标定位置,若融合后坐标系中的直线方程有两个,且两个直线方程垂直,则两个直线方程的交点为标定位置。Among them, if there is only one linear equation in the coordinate system after the fusion, the coordinate origin in the coordinate system after the fusion is the calibration position. If there are two linear equations in the coordinate system after the fusion, and the two linear equations are perpendicular, then The intersection of the two straight line equations is the calibration position.
本实施例提出的车辆导航方法,通过在基于车辆当前的第三位置信息以及所述车辆对应的导航路径确定所述车辆处于窄道直线移动状态时,获取所述摄像装置当前拍摄的第四地面图像,并识别所述第四地面图像中各标识元素的初始位置;接着从所述第四地面图像中分离出地面特征区域,并根据所述地面特征区域和各所述初始位置,确定各所述标识元素中目标元素的质心位置;然后根据各所述质心位置,确定各所述目标元素的深度数据坐标,并根据各所述深度数据坐标;而后根据各所述深度数据坐标,识别所述地面图像中的边缘标识线对应的第二目标直线方程,并基于所述第二目标直线方程确定所述车辆的标定位置;最后基于所述标定位置确定所述车辆的目标位置以及姿态信息,并基于所述目标位置以及所述姿态信息控制所述车辆,进而在车辆处于窄道直线移动状态时,通过调整车辆的姿态并根据目标位置控制该车辆,以实现车辆在窄道内的快速直线移动,进一步提高车辆导航的效率。The vehicle navigation method proposed in this embodiment acquires the fourth ground currently photographed by the camera device when it is determined that the vehicle is in a state of linear movement in a narrow lane based on the current third position information of the vehicle and the navigation path corresponding to the vehicle. Image, and identify the initial position of each identification element in the fourth ground image; then separate the ground feature area from the fourth ground image, and determine each location based on the ground feature area and each of the initial positions The position of the center of mass of the target element in the identification element; then according to the position of the center of mass, the depth data coordinates of each of the target elements are determined, and according to each of the depth data coordinates; and then according to each of the depth data coordinates, the The second target straight line equation corresponding to the edge identification line in the ground image, and the calibration position of the vehicle is determined based on the second target straight line equation; finally, the target position and attitude information of the vehicle are determined based on the calibration position, and The vehicle is controlled based on the target position and the posture information, and then when the vehicle is in a narrow lane linear movement state, the vehicle’s posture is adjusted and the vehicle is controlled according to the target position to achieve rapid linear movement of the vehicle in the narrow lane. Further improve the efficiency of vehicle navigation.
此外,本申请实施例还提出一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机可读指令,所述计算机可读指令被处理器执行时实现上述中任一项所述的车辆导航方法的步骤。In addition, an embodiment of the present application also proposes a computer-readable storage medium having computer-readable instructions stored on the computer-readable storage medium, and when the computer-readable instructions are executed by a processor, any of the foregoing The steps of the vehicle navigation method.
本申请计算机可读存储介质具体实施例与上述车辆导航方法的各实施例基本相同,在此不再详细赘述。The specific embodiments of the computer-readable storage medium of the present application are basically the same as the embodiments of the vehicle navigation method described above, and will not be described in detail here.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。It should be noted that in this article, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements not only includes those elements, It also includes other elements not explicitly listed, or elements inherent to the process, method, article, or system. Without more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or system that includes the element.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the foregoing embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above implementation manners, those skilled in the art can clearly understand that the above-mentioned embodiment method can be implemented by means of software plus the necessary general hardware platform, of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。 Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above. , Magnetic disks, optical disks), including several instructions to make a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the method described in each embodiment of the present application.
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only the preferred embodiments of the application, and do not limit the scope of the patent for this application. Any equivalent structure or equivalent process transformation made using the content of the description and drawings of the application, or directly or indirectly applied to other related technical fields , The same reason is included in the scope of patent protection of this application.

Claims (15)

  1. 一种车辆导航方法,其中,所述车辆导航方法包括以下步骤:A vehicle navigation method, wherein the vehicle navigation method includes the following steps:
    基于车辆当前的第一位置信息确定所述车辆位于目标库位对应的第一指定位置,获取所述车辆对应的坐标原点;以及,It is determined based on the current first location information of the vehicle that the vehicle is located at the first designated location corresponding to the target storage location, and the origin of the coordinates corresponding to the vehicle is acquired; and,
    基于所述坐标原点控制所述车辆旋转,并基于车辆上所安装的摄像装置当前拍摄的第一地面图像,确定所述目标库位对应的边缘标识线与所述车辆垂直,控制所述车辆停止旋转。Control the rotation of the vehicle based on the origin of the coordinates, and based on the first ground image currently captured by the camera installed on the vehicle, determine that the edge marking line corresponding to the target location is perpendicular to the vehicle, and control the vehicle to stop Spin.
  2. 如权利要求1所述的车辆导航方法,其中,所述基于车辆上所安装的摄像装置当前拍摄的第一地面图像,确定所述第一指定位置对应目标库位的边缘标识线与所述车辆垂直的步骤包括:The vehicle navigation method according to claim 1, wherein the first ground image currently captured by the camera installed on the vehicle is used to determine that the edge identification line of the target storage location corresponding to the first designated location is the same as that of the vehicle. The vertical steps include:
    获取所述摄像装置当前拍摄的第一地面图像,并识别所述第一地面图像中各标识元素的初始位置;Acquiring a first ground image currently captured by the camera device, and identifying the initial position of each identification element in the first ground image;
    从所述第一地面图像中分离出地面特征区域,并根据所述地面特征区域和各所述初始位置,确定各所述标识元素中目标元素的质心位置;Separating the ground feature area from the first ground image, and determining the centroid position of the target element in each of the identification elements according to the ground feature area and each of the initial positions;
    根据各所述质心位置,确定各所述目标元素的深度数据坐标,并根据各所述深度数据坐标,确定所述边缘标识线对应的第一目标直线方程;以及,Determine the depth data coordinates of each target element according to each of the centroid positions, and determine the first target straight line equation corresponding to the edge identification line according to each of the depth data coordinates; and,
    基于所述第一目标直线方程确定所述边缘标识线与所述车辆垂直。It is determined that the edge identification line is perpendicular to the vehicle based on the first target straight line equation.
  3. 如权利要求2所述的车辆导航方法,其中,所述摄像装置包括两个,两个摄像装置分别设置于所述车辆的前方以及侧方,所述根据各所述深度数据坐标,确定所述边缘标识线对应的第一目标直线方程的步骤包括:The vehicle navigation method according to claim 2, wherein the camera device includes two camera devices, and the two camera devices are respectively arranged in the front and the side of the vehicle, and the depth data coordinates are used to determine the The steps of the first target straight line equation corresponding to the edge identification line include:
    根据各所述深度数据坐标,确定前方摄像装置对应的所述边缘标识线的第一直线方程,以及侧方摄像装置对应的所述边缘标识线的第二直线方程;以及,According to each of the depth data coordinates, determine the first straight line equation of the edge identification line corresponding to the front camera device, and the second straight line equation of the edge identification line corresponding to the side camera device; and,
    基于所述第一直线方程以及所述第二直线方程进行融合,以获得所述第一目标直线方程。Fusion is performed based on the first straight line equation and the second straight line equation to obtain the first target straight line equation.
  4. 如权利要求1所述的车辆导航方法,其中,所述基于所述坐标原点控制所述车辆旋转的步骤之前,还包括:The vehicle navigation method according to claim 1, wherein before the step of controlling the rotation of the vehicle based on the coordinate origin, the method further comprises:
    基于所述摄像装置获取第二地面图像,并根据所述第二地面图像,确定所述车辆与预设标识线之间的相对位置参数;Acquiring a second ground image based on the camera device, and determining a relative position parameter between the vehicle and a preset identification line according to the second ground image;
    读取基于所述摄像装置获取的历史地面图像,并根据所述第二地面图像和历史地面图像,确定所述车辆的位移参数;以及,Reading the historical ground image acquired based on the camera device, and determining the displacement parameter of the vehicle based on the second ground image and the historical ground image; and,
    根据所述相对位置参数确定位置调整参数,并将所述位置调整参数和所述位移参数作为姿态调整参数,以对所述车辆的姿态进行调整。The position adjustment parameter is determined according to the relative position parameter, and the position adjustment parameter and the displacement parameter are used as the attitude adjustment parameter to adjust the attitude of the vehicle.
  5. 如权利要求1所述的车辆导航方法,其中,所述控制所述车辆停止旋转的步骤之后,所述车辆导航方法还包括:The vehicle navigation method according to claim 1, wherein, after the step of controlling the vehicle to stop rotating, the vehicle navigation method further comprises:
    基于所述摄像装置当前拍摄的第三地面图像,确定所述目标库位的两侧标识线;以及,Determine the marking lines on both sides of the target storage location based on the third ground image currently captured by the camera device; and,
    基于所述两侧标识线控制所述车辆反向移动,并监测到后方停止线或者确定防撞传感器当前检测到货物,控制所述车辆停止移动,其中,所述防撞传感器安装于所述车辆的末端。Control the vehicle to move in the reverse direction based on the identification lines on both sides, and monitor the rear stop line or determine that the anti-collision sensor currently detects goods, and control the vehicle to stop moving, wherein the anti-collision sensor is installed on the vehicle The end.
  6. 如权利要求1所述的车辆导航方法,其中,所述实时获取车辆当前的位置信息的步骤之后,所述车辆导航方法还包括:The vehicle navigation method according to claim 1, wherein, after the step of acquiring the current position information of the vehicle in real time, the vehicle navigation method further comprises:
    基于所述第一位置信息以及目标库位确定所述车辆未满足掉头条件,执行在基于所述第一位置信息确定所述车辆位于目标库位对应的第一指定位置时,获取所述车辆对应的坐标原点的步骤。It is determined based on the first location information and the target location that the vehicle does not meet the U-turn condition, and when it is determined that the vehicle is located at the first designated location corresponding to the target location based on the first location information, acquiring the vehicle corresponding The steps of the origin of the coordinates.
  7. 如权利要求6所述的车辆导航方法,其中,所述车辆导航方法还包括:7. The vehicle navigation method of claim 6, wherein the vehicle navigation method further comprises:
    若基于所述第一位置信息以及目标库位确定所述车辆满足掉头条件,则基于所述当前位置信息确定所述车辆对应的第二指定位置;If it is determined that the vehicle meets the U-turn condition based on the first location information and the target location, then determine the second designated location corresponding to the vehicle based on the current location information;
    基于所述第二指定位置控制所述车辆;Controlling the vehicle based on the second designated position;
    所述车辆当前的第二位置信息确定车辆位于所述第二指定位置,基于所述车辆对应的第二坐标原点控制所述车辆旋转;以及,The current second position information of the vehicle determines that the vehicle is located at the second designated position, and controls the rotation of the vehicle based on the second coordinate origin corresponding to the vehicle; and,
    所述车辆旋转至所述目标库位对应的第三指定位置,控制所述车辆停止旋转。The vehicle rotates to a third designated position corresponding to the target storage location, and the vehicle is controlled to stop rotating.
  8. 如权利要求1所述的车辆导航方法,其中,所述车辆导航方法还包括:The vehicle navigation method according to claim 1, wherein the vehicle navigation method further comprises:
    基于车辆当前的第三位置信息以及所述车辆对应的导航路径确定所述车辆处于窄道直线移动状态,获取所述摄像装置当前拍摄的第四地面图像,并识别所述第四地面图像中各标识元素的初始位置;Based on the current third position information of the vehicle and the navigation path corresponding to the vehicle, it is determined that the vehicle is in a narrow-track linear movement state, the fourth ground image currently captured by the camera device is acquired, and each of the fourth ground images is identified Identify the initial position of the element;
    从所述第四地面图像中分离出地面特征区域,并根据所述地面特征区域和各所述初始位置,确定各所述标识元素中目标元素的质心位置;Separating the ground feature area from the fourth ground image, and determining the centroid position of the target element in each of the identification elements according to the ground feature area and each of the initial positions;
    根据各所述质心位置,确定各所述目标元素的深度数据坐标,并根据各所述深度数据坐标;Determine the depth data coordinates of each target element according to each of the centroid positions, and according to each of the depth data coordinates;
    根据各所述深度数据坐标,识别所述第四地面图像中的边缘标识线对应的第二目标直线方程,并基于所述第二目标直线方程确定所述车辆的标定位置;以及,According to each of the depth data coordinates, identify the second target straight line equation corresponding to the edge identification line in the fourth ground image, and determine the calibration position of the vehicle based on the second target straight line equation; and,
    基于所述标定位置确定所述车辆的目标位置以及姿态信息,并基于所述目标位置以及所述姿态信息控制所述车辆。The target position and attitude information of the vehicle are determined based on the calibration position, and the vehicle is controlled based on the target position and the attitude information.
  9. 如权利要求8所述的车辆导航方法,其中,所述摄像装置包括两个,两个摄像装置分别设置于所述车辆的前方以及侧方,所述边缘标识线包括,所述根据各所述深度数据坐标,识别所述地面图像中的边缘标识线对应的第二目标直线方程的步骤包括:The vehicle navigation method according to claim 8, wherein the camera device includes two camera devices, and the two camera devices are respectively arranged in front and the side of the vehicle, and the edge marking line includes, according to each of the For depth data coordinates, the step of identifying the second target straight line equation corresponding to the edge identification line in the ground image includes:
    根据各所述深度数据坐标,确定前方摄像装置对应的所述边缘标识线的第三直线方程,以及侧方摄像装置对应的所述边缘标识线的第四直线方程;以及,According to each of the depth data coordinates, determine the third straight line equation of the edge identification line corresponding to the front camera device, and the fourth straight line equation of the edge identification line corresponding to the side camera device; and,
    基于所述第三直线方程以及所述第四直线方程进行融合,以获得所述第二目标直线方程。Fusion is performed based on the third straight line equation and the fourth straight line equation to obtain the second target straight line equation.
  10. 如权利要求2所述的车辆导航方法,其中,所述车辆导航方法还包括:The vehicle navigation method according to claim 2, wherein the vehicle navigation method further comprises:
    基于车辆当前的第三位置信息以及所述车辆对应的导航路径确定所述车辆处于窄道直线移动状态,获取所述摄像装置当前拍摄的第四地面图像,并识别所述第四地面图像中各标识元素的初始位置;Based on the current third position information of the vehicle and the navigation path corresponding to the vehicle, it is determined that the vehicle is in a narrow-track linear movement state, the fourth ground image currently captured by the camera device is acquired, and each of the fourth ground images is identified Identify the initial position of the element;
    从所述第四地面图像中分离出地面特征区域,并根据所述地面特征区域和各所述初始位置,确定各所述标识元素中目标元素的质心位置;Separating the ground feature area from the fourth ground image, and determining the centroid position of the target element in each of the identification elements according to the ground feature area and each of the initial positions;
    根据各所述质心位置,确定各所述目标元素的深度数据坐标,并根据各所述深度数据坐标;Determine the depth data coordinates of each target element according to each of the centroid positions, and according to each of the depth data coordinates;
    根据各所述深度数据坐标,识别所述第四地面图像中的边缘标识线对应的第二目标直线方程,并基于所述第二目标直线方程确定所述车辆的标定位置;以及,According to each of the depth data coordinates, identify the second target straight line equation corresponding to the edge identification line in the fourth ground image, and determine the calibration position of the vehicle based on the second target straight line equation; and,
    基于所述标定位置确定所述车辆的目标位置以及姿态信息,并基于所述目标位置以及所述姿态信息控制所述车辆。The target position and attitude information of the vehicle are determined based on the calibration position, and the vehicle is controlled based on the target position and the attitude information.
  11. 如权利要求3所述的车辆导航方法,其中,所述车辆导航方法还包括:The vehicle navigation method according to claim 3, wherein the vehicle navigation method further comprises:
    基于车辆当前的第三位置信息以及所述车辆对应的导航路径确定所述车辆处于窄道直线移动状态,获取所述摄像装置当前拍摄的第四地面图像,并识别所述第四地面图像中各标识元素的初始位置;Based on the current third position information of the vehicle and the navigation path corresponding to the vehicle, it is determined that the vehicle is in a narrow-track linear movement state, the fourth ground image currently captured by the camera device is acquired, and each of the fourth ground images is identified Identify the initial position of the element;
    从所述第四地面图像中分离出地面特征区域,并根据所述地面特征区域和各所述初始位置,确定各所述标识元素中目标元素的质心位置;Separating the ground feature area from the fourth ground image, and determining the centroid position of the target element in each of the identification elements according to the ground feature area and each of the initial positions;
    根据各所述质心位置,确定各所述目标元素的深度数据坐标,并根据各所述深度数据坐标;Determine the depth data coordinates of each target element according to each of the centroid positions, and according to each of the depth data coordinates;
    根据各所述深度数据坐标,识别所述第四地面图像中的边缘标识线对应的第二目标直线方程,并基于所述第二目标直线方程确定所述车辆的标定位置;以及,According to each of the depth data coordinates, identify the second target straight line equation corresponding to the edge identification line in the fourth ground image, and determine the calibration position of the vehicle based on the second target straight line equation; and,
    基于所述标定位置确定所述车辆的目标位置以及姿态信息,并基于所述目标位置以及所述姿态信息控制所述车辆。The target position and attitude information of the vehicle are determined based on the calibration position, and the vehicle is controlled based on the target position and the attitude information.
  12. 如权利要求4所述的车辆导航方法,其中,所述车辆导航方法还包括:The vehicle navigation method according to claim 4, wherein the vehicle navigation method further comprises:
    基于车辆当前的第三位置信息以及所述车辆对应的导航路径确定所述车辆处于窄道直线移动状态,获取所述摄像装置当前拍摄的第四地面图像,并识别所述第四地面图像中各标识元素的初始位置;Based on the current third position information of the vehicle and the navigation path corresponding to the vehicle, it is determined that the vehicle is in a narrow-track linear movement state, the fourth ground image currently captured by the camera device is acquired, and each of the fourth ground images is identified Identify the initial position of the element;
    从所述第四地面图像中分离出地面特征区域,并根据所述地面特征区域和各所述初始位置,确定各所述标识元素中目标元素的质心位置;Separating the ground feature area from the fourth ground image, and determining the centroid position of the target element in each of the identification elements according to the ground feature area and each of the initial positions;
    根据各所述质心位置,确定各所述目标元素的深度数据坐标,并根据各所述深度数据坐标;Determine the depth data coordinates of each target element according to each of the centroid positions, and according to each of the depth data coordinates;
    根据各所述深度数据坐标,识别所述第四地面图像中的边缘标识线对应的第二目标直线方程,并基于所述第二目标直线方程确定所述车辆的标定位置;以及,According to each of the depth data coordinates, identify the second target straight line equation corresponding to the edge identification line in the fourth ground image, and determine the calibration position of the vehicle based on the second target straight line equation; and,
    基于所述标定位置确定所述车辆的目标位置以及姿态信息,并基于所述目标位置以及所述姿态信息控制所述车辆。The target position and attitude information of the vehicle are determined based on the calibration position, and the vehicle is controlled based on the target position and the attitude information.
  13. 如权利要求5所述的车辆导航方法,其中,所述车辆导航方法还包括:The vehicle navigation method according to claim 5, wherein the vehicle navigation method further comprises:
    基于车辆当前的第三位置信息以及所述车辆对应的导航路径确定所述车辆处于窄道直线移动状态,获取所述摄像装置当前拍摄的第四地面图像,并识别所述第四地面图像中各标识元素的初始位置;Based on the current third position information of the vehicle and the navigation path corresponding to the vehicle, it is determined that the vehicle is in a narrow-track linear movement state, the fourth ground image currently captured by the camera device is acquired, and each of the fourth ground images is identified Identify the initial position of the element;
    从所述第四地面图像中分离出地面特征区域,并根据所述地面特征区域和各所述初始位置,确定各所述标识元素中目标元素的质心位置;Separating the ground feature area from the fourth ground image, and determining the centroid position of the target element in each of the identification elements according to the ground feature area and each of the initial positions;
    根据各所述质心位置,确定各所述目标元素的深度数据坐标,并根据各所述深度数据坐标;Determine the depth data coordinates of each target element according to each of the centroid positions, and according to each of the depth data coordinates;
    根据各所述深度数据坐标,识别所述第四地面图像中的边缘标识线对应的第二目标直线方程,并基于所述第二目标直线方程确定所述车辆的标定位置;以及,According to each of the depth data coordinates, identify the second target straight line equation corresponding to the edge identification line in the fourth ground image, and determine the calibration position of the vehicle based on the second target straight line equation; and,
    基于所述标定位置确定所述车辆的目标位置以及姿态信息,并基于所述目标位置以及所述姿态信息控制所述车辆。The target position and attitude information of the vehicle are determined based on the calibration position, and the vehicle is controlled based on the target position and the attitude information.
  14. 一种车辆导航装置,其中,所述车辆导航装置包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机可读指令,所述计算机可读指令被所述处理器执行时,实现如下步骤:A vehicle navigation device, wherein the vehicle navigation device includes a memory, a processor, and computer-readable instructions stored in the memory and capable of running on the processor, and the computer-readable instructions are When the processor executes, the following steps are implemented:
    基于车辆当前的第一位置信息确定所述车辆位于目标库位对应的第一指定位置,获取所述车辆对应的坐标原点;以及,It is determined based on the current first location information of the vehicle that the vehicle is located at the first designated location corresponding to the target storage location, and the origin of the coordinates corresponding to the vehicle is acquired; and,
    基于所述坐标原点控制所述车辆旋转,并基于车辆上所安装的摄像装置当前拍摄的第一地面图像,确定所述目标库位对应的边缘标识线与所述车辆垂直,控制所述车辆停止旋转。Control the rotation of the vehicle based on the origin of the coordinates, and based on the first ground image currently captured by the camera installed on the vehicle, determine that the edge marking line corresponding to the target location is perpendicular to the vehicle, and control the vehicle to stop Spin.
  15. 一种计算机可读存储介质,其中,所述计算机可读存储介质上存储有计算机可读指令,所述计算机可读指令被处理器执行时,实现如下步骤:A computer-readable storage medium, wherein computer-readable instructions are stored on the computer-readable storage medium, and when the computer-readable instructions are executed by a processor, the following steps are implemented:
    基于车辆当前的第一位置信息确定所述车辆位于目标库位对应的第一指定位置,获取所述车辆对应的坐标原点;以及,It is determined based on the current first location information of the vehicle that the vehicle is located at the first designated location corresponding to the target storage location, and the origin of the coordinates corresponding to the vehicle is acquired; and,
    基于所述坐标原点控制所述车辆旋转,并基于车辆上所安装的摄像装置当前拍摄的第一地面图像,确定所述目标库位对应的边缘标识线与所述车辆垂直,控制所述车辆停止旋转。Control the rotation of the vehicle based on the origin of the coordinates, and based on the first ground image currently captured by the camera installed on the vehicle, determine that the edge marking line corresponding to the target location is perpendicular to the vehicle, and control the vehicle to stop Spin.
PCT/CN2020/112216 2019-11-12 2020-08-28 Vehicle navigation method and apparatus, and computer readable storage medium WO2021093420A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911117651.8A CN110837814B (en) 2019-11-12 2019-11-12 Vehicle navigation method, device and computer readable storage medium
CN201911117651.8 2019-11-12

Publications (1)

Publication Number Publication Date
WO2021093420A1 true WO2021093420A1 (en) 2021-05-20

Family

ID=69575095

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/112216 WO2021093420A1 (en) 2019-11-12 2020-08-28 Vehicle navigation method and apparatus, and computer readable storage medium

Country Status (2)

Country Link
CN (1) CN110837814B (en)
WO (1) WO2021093420A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113378735A (en) * 2021-06-18 2021-09-10 北京东土科技股份有限公司 Road marking line identification method and device, electronic equipment and storage medium
CN114004881A (en) * 2021-12-30 2022-02-01 山东捷瑞数字科技股份有限公司 Remote control method for erecting ignition tube on well nozzle
CN114038191A (en) * 2021-11-05 2022-02-11 青岛海信网络科技股份有限公司 Method and device for collecting traffic data
CN115601271A (en) * 2022-11-29 2023-01-13 上海仙工智能科技有限公司(Cn) Visual information anti-shaking method, warehouse location state management method and system

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110837814B (en) * 2019-11-12 2022-08-19 深圳创维数字技术有限公司 Vehicle navigation method, device and computer readable storage medium
CN111856537B (en) * 2020-06-18 2023-03-07 北京九曜智能科技有限公司 Navigation method and device for automatically driving vehicle
CN113341443A (en) * 2021-05-26 2021-09-03 和芯星通科技(北京)有限公司 Processing method of positioning track information and vehicle-mounted navigation device
CN114265414A (en) * 2021-12-30 2022-04-01 深圳创维数字技术有限公司 Vehicle control method, device, equipment and computer readable storage medium
CN115218918B (en) * 2022-09-20 2022-12-27 上海仙工智能科技有限公司 Intelligent blind guiding method and blind guiding equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5410346A (en) * 1992-03-23 1995-04-25 Fuji Jukogyo Kabushiki Kaisha System for monitoring condition outside vehicle using imaged picture by a plurality of television cameras
CN101631695A (en) * 2007-05-30 2010-01-20 爱信精机株式会社 Parking assisting device
CN109934140A (en) * 2019-03-01 2019-06-25 武汉光庭科技有限公司 Automatic backing method for assisting in parking and system based on detection ground horizontal marking
CN110837814A (en) * 2019-11-12 2020-02-25 深圳创维数字技术有限公司 Vehicle navigation method, device and computer readable storage medium

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7599771B2 (en) * 2004-05-06 2009-10-06 Panasonic Corporation Parking assisting apparatus
JP5397321B2 (en) * 2009-06-09 2014-01-22 株式会社デンソー Parking assistance system
CN102152763A (en) * 2011-03-19 2011-08-17 重庆长安汽车股份有限公司 Parking auxiliary device
CN103234542B (en) * 2013-04-12 2015-11-04 东南大学 The truck combination negotiation of bends trajectory measurement method of view-based access control model
CN105094134B (en) * 2015-08-25 2017-10-31 杭州金人自动控制设备有限公司 A kind of AGV stopping a train at a target point methods based on image line walking
CN105128746A (en) * 2015-09-25 2015-12-09 武汉华安科技股份有限公司 Vehicle parking method and parking system adopting vehicle parking method
CN109508021B (en) * 2018-12-29 2022-04-26 歌尔股份有限公司 Guiding method, device and system of automatic guided vehicle

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5410346A (en) * 1992-03-23 1995-04-25 Fuji Jukogyo Kabushiki Kaisha System for monitoring condition outside vehicle using imaged picture by a plurality of television cameras
CN101631695A (en) * 2007-05-30 2010-01-20 爱信精机株式会社 Parking assisting device
CN109934140A (en) * 2019-03-01 2019-06-25 武汉光庭科技有限公司 Automatic backing method for assisting in parking and system based on detection ground horizontal marking
CN110837814A (en) * 2019-11-12 2020-02-25 深圳创维数字技术有限公司 Vehicle navigation method, device and computer readable storage medium

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113378735A (en) * 2021-06-18 2021-09-10 北京东土科技股份有限公司 Road marking line identification method and device, electronic equipment and storage medium
CN113378735B (en) * 2021-06-18 2023-04-07 北京东土科技股份有限公司 Road marking line identification method and device, electronic equipment and storage medium
CN114038191A (en) * 2021-11-05 2022-02-11 青岛海信网络科技股份有限公司 Method and device for collecting traffic data
CN114038191B (en) * 2021-11-05 2023-10-27 青岛海信网络科技股份有限公司 Method and device for collecting traffic data
CN114004881A (en) * 2021-12-30 2022-02-01 山东捷瑞数字科技股份有限公司 Remote control method for erecting ignition tube on well nozzle
CN114004881B (en) * 2021-12-30 2022-04-05 山东捷瑞数字科技股份有限公司 Remote control method for erecting ignition tube on well nozzle
CN115601271A (en) * 2022-11-29 2023-01-13 上海仙工智能科技有限公司(Cn) Visual information anti-shaking method, warehouse location state management method and system
CN115601271B (en) * 2022-11-29 2023-03-24 上海仙工智能科技有限公司 Visual information anti-shake method, storage warehouse location state management method and system

Also Published As

Publication number Publication date
CN110837814A (en) 2020-02-25
CN110837814B (en) 2022-08-19

Similar Documents

Publication Publication Date Title
WO2021093420A1 (en) Vehicle navigation method and apparatus, and computer readable storage medium
KR102194426B1 (en) Apparatus and method for environment recognition of indoor moving robot in a elevator and recording medium storing program for executing the same, and computer program stored in recording medium for executing the same
US11320833B2 (en) Data processing method, apparatus and terminal
CN110969655B (en) Method, device, equipment, storage medium and vehicle for detecting parking space
US10859684B1 (en) Method and system for camera-lidar calibration
JP7341652B2 (en) Information processing device, information processing method, program, and system
CN110796063B (en) Method, device, equipment, storage medium and vehicle for detecting parking space
CN111856491B (en) Method and apparatus for determining geographic position and orientation of a vehicle
US20190172215A1 (en) System and method for obstacle avoidance
WO2021046716A1 (en) Method, system and device for detecting target object and storage medium
WO2021037086A1 (en) Positioning method and apparatus
US20220012509A1 (en) Overhead-view image generation device, overhead-view image generation system, and automatic parking device
WO2019187816A1 (en) Mobile body and mobile body system
CN111797734A (en) Vehicle point cloud data processing method, device, equipment and storage medium
JP2020057307A (en) System and method for processing map data for use in self-position estimation, and moving entity and control system for the same
CN110764110B (en) Path navigation method, device and computer readable storage medium
WO2022000197A1 (en) Flight operation method, unmanned aerial vehicle, and storage medium
TW202020734A (en) Vehicle, vehicle positioning system, and vehicle positioning method
WO2021093413A1 (en) Method for acquiring attitude adjustment parameters of transportation device, transportation device and storage medium
CN114179788A (en) Automatic parking method, system, computer readable storage medium and vehicle terminal
Flade et al. Lane detection based camera to map alignment using open-source map data
CN112987748A (en) Robot narrow space control method and device, terminal and storage medium
CN114078247A (en) Target detection method and device
WO2023036212A1 (en) Shelf locating method, shelf docking method and apparatus, device, and medium
CN113605766B (en) Detection system and position adjustment method of automobile carrying robot

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20887661

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20887661

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 02.11.2022)

122 Ep: pct application non-entry in european phase

Ref document number: 20887661

Country of ref document: EP

Kind code of ref document: A1