WO2020206639A1 - Target object fitting method, point cloud sensor and mobile platform - Google Patents

Target object fitting method, point cloud sensor and mobile platform Download PDF

Info

Publication number
WO2020206639A1
WO2020206639A1 PCT/CN2019/082119 CN2019082119W WO2020206639A1 WO 2020206639 A1 WO2020206639 A1 WO 2020206639A1 CN 2019082119 W CN2019082119 W CN 2019082119W WO 2020206639 A1 WO2020206639 A1 WO 2020206639A1
Authority
WO
WIPO (PCT)
Prior art keywords
angle
fitting
point cloud
visible
area
Prior art date
Application number
PCT/CN2019/082119
Other languages
French (fr)
Chinese (zh)
Inventor
李星河
邱凡
刘寒颖
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2019/082119 priority Critical patent/WO2020206639A1/en
Priority to CN201980005593.1A priority patent/CN111316289A/en
Publication of WO2020206639A1 publication Critical patent/WO2020206639A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/255Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/06Topological mapping of higher dimensional structures onto lower dimensional surfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/584Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle

Definitions

  • This application relates to the field of automatic driving, and in particular to a method for fitting a target object, a point cloud sensor and a mobile platform.
  • vehicle point cloud is a set of discrete points. In actual processing, it is often necessary to fit the point cloud determined as the target vehicle to obtain the fitted vehicle to determine the orientation and size of the vehicle according to the fitted vehicle. Complete the tracking task.
  • the embodiments of the present application provide a method for fitting a target object, a point cloud sensor and a mobile platform, which improve the accuracy of fitting the target object.
  • an embodiment of the present application provides a method for fitting a target object, including: generating a two-dimensional point cloud in a top view according to a point cloud of the target object collected by a point cloud sensor, wherein the point cloud sensor is used for carrying In the mobile platform; determine the visible area of the two-dimensional point cloud toward the mobile platform; determine the fitting feature of the target object according to the visible area, and perform the target object according to the fitting feature Fitting.
  • determining the fitting feature of the target object according to the visible area includes: determining according to the visible area and the two-dimensional point cloud The fitting feature.
  • the fitting feature is the fitting angle of the target object, and the determining the fitting angle is based on the visible area and the two-dimensional point cloud.
  • the fitting feature includes: determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range.
  • the determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range includes: according to the The visible area, the two-dimensional point cloud, and the preset angle range determine the fitting angle with the least corresponding visible edge cost.
  • the fitting is determined according to the visible area, the two-dimensional point cloud, and a preset angle range.
  • the angle includes: selecting at least one reference angle from the preset angle range; according to the at least one reference angle, the visible area, and the two-dimensional point cloud, determining the corresponding fitting with the least visible edge cost angle.
  • Determining the corresponding fitting angle with the smallest visible edge cost includes: for any one of a plurality of reference angles, according to the visible area and the two-dimensional point cloud, in the first reference angle Determine the first preselected angle with the smallest visible edge cost within the first neighborhood range, where the first neighborhood range includes the first reference angle; determine the corresponding preselected angle with the least visible edge cost among the preselected angles as said Fitting angle.
  • the visible edge cost is the smallest within the first neighborhood of the first reference angle
  • the first preselected angle includes: obtaining a first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud, and updating the first reference angle to the first neighbor
  • the second visible edge cost corresponding to the first angle is obtained according to the visible area and the two-dimensional point cloud
  • the second visible edge cost and the first visible edge The relationship between the costs, update the first angle to the second angle in the first neighborhood; repeat the execution of obtaining the visible edge costs corresponding to the angles in the first neighborhood, according to two adjacent
  • the obtained relationship of the visible edge cost is an operation of updating the angle within the first neighborhood range until the first preselected angle with the smallest visible edge cost is obtained.
  • Determining the corresponding fitting angle with the smallest visible edge cost includes: determining the corresponding target reference angle with the smallest visible edge cost among multiple reference angles according to the visible area and the two-dimensional point cloud; For the visible area and the two-dimensional point cloud, determine the fitting angle with the smallest visible edge cost within a second neighborhood range of the target reference angle, and the second neighborhood range includes the target reference angle .
  • the fitting angle includes: acquiring a plurality of sub-reference angles from within a second neighborhood of the target reference angle; determining the visible edge cost corresponding to each sub-reference angle according to the visible area and the two-dimensional point cloud The smallest sub-reference angle is the fitting angle.
  • obtaining the first visible edge cost corresponding to the first reference angle includes: The first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first boundary and the second boundary corresponding to the visible area, to obtain the first visible edge cost; wherein, The first direction is a direction corresponding to the rotation of the first reference angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor.
  • the visible area corresponds to the visible area
  • Obtaining the first visible edge cost includes: obtaining the first area of the first area defined by the visible area, the first border and the second border; obtaining the The first outer envelope rectangle faces the visible side of the mobile platform, the second area of the second area defined by the first boundary and the second boundary; obtains the side of the first envelope rectangle outside the target area, A third area of a third area defined by the first boundary and the second boundary, the target area is the area between the first boundary and the second boundary, and the target area includes the two-dimensional point cloud ; According to the first area, the second area and the third area, determine the first visible edge cost.
  • the first visible edge cost includes: obtaining the first area, the second area, and the first preset weight, and obtaining the first preselected visible edge cost; according to the third area and the second preset weight, obtaining the first Two preselected visible edge costs; determining the first visible edge cost according to the first preselected visible edge cost and the second preselected visible edge cost.
  • the angle included in the preset angle range is an angle between a first preset angle and a second preset angle, and the first preset angle The angle minus the second preset angle is equal to 90°, and the preset angle range includes the first preset angle and/or the second preset angle.
  • the fitting feature includes at least one of the following: a fitting angle of the target object, a fitting direction of the target object, and The fitted bounding box of the target object, and the fitted visible edge of the target object;
  • the fitting direction is the direction corresponding to the rotation of the fitting angle from the coordinate origin of the point cloud sensor coordinate system
  • the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor
  • the fitting the target object according to the fitting feature includes:
  • the fitting feature includes at least one of the following: the fitting angle of the target object, and the fitting direction of the target object , Fitting visible edges of the target object, fitting the target object according to the fitting feature and the fitting height, including:
  • obtaining the fitting height of the target object according to the point cloud of the target object includes:
  • the fitting height is obtained.
  • an embodiment of the present application provides a point cloud sensor, which is used to be mounted on a mobile platform, and the point cloud sensor includes:
  • the processor is in communication connection with the collector, and is configured to execute the method described in the first aspect and any possible implementation manner of the first aspect. It is understandable that, in the second aspect, "generate a two-dimensional point cloud in the top view according to the point cloud of the target object collected by the point cloud sensor" is "the point cloud of the target object collected by the collector of the point cloud sensor, Generate a two-dimensional point cloud under the top view”.
  • embodiments of the present application provide a mobile platform, including: a point cloud sensor for collecting the point cloud of the target object; wherein the point cloud sensor is mounted on the mobile platform; a processor, and The point cloud sensor communication connection is used to execute the method described in the first aspect and any possible implementation manner of the first aspect.
  • an embodiment of the present application provides a mobile platform, characterized in that the point cloud sensor described in the second aspect is mounted on the mobile platform.
  • an embodiment of the present application provides a computer-readable storage medium, including a program or instruction.
  • the program or instruction runs on a computer, the first aspect and any possible implementation of the first aspect The method is executed.
  • an embodiment of the present invention provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, the computer program includes at least one piece of code, the at least one piece of code can be executed by a computer to control the computer to execute
  • the computer program includes at least one piece of code, the at least one piece of code can be executed by a computer to control the computer to execute
  • an embodiment of the present invention provides a computer program, when the computer program is executed by a computer, it is used to execute the foregoing first aspect and the method described in any possible implementation manner of the first aspect.
  • the program may be stored in whole or in part on a storage medium that is packaged with the processor, and may also be stored in part or all in a storage medium that is not packaged with the processor.
  • the storage medium is, for example, a memory.
  • the target object Since the target object is close to the point cloud sensor or one or two surfaces of the mobile platform equipped with the point cloud sensor can be observed by the point cloud sensor, it is away from the point cloud sensor or two or three surfaces of the mobile platform equipped with the point cloud sensor It cannot be observed by the point cloud sensor. Therefore, the point cloud sensor based on the target object in this application can be fitted to the target object, that is, according to the visible area of the target object’s two-dimensional point cloud towards the mobile platform, the target Object fitting can improve the accuracy of fitting the target object.
  • Figure 1 is a schematic diagram of an application scenario provided by an embodiment of the application
  • FIG. 2 is a first flowchart of a method for fitting a target object provided by an embodiment of the application
  • FIG. 3 is a schematic diagram of the visible area facing the mobile platform in the two-dimensional point cloud provided by an embodiment of the application;
  • FIG. 4 is a schematic diagram 1 of fitting visible edges of a target object provided by the implementation of this application.
  • 5 is a second schematic diagram of fitting visible edges of the target object provided by the implementation of this application.
  • FIG. 6 is the third schematic diagram of fitting visible edges of the target object provided by the implementation of this application.
  • FIG. 7 is a second flowchart of a method for fitting a target object provided by an embodiment of the application.
  • FIG. 8 is a schematic diagram of obtaining visible edge cost provided by an embodiment of the application.
  • FIG. 9 is a schematic structural diagram of a point cloud sensor provided by an embodiment of the application.
  • Fig. 10 is a schematic structural diagram of a mobile platform provided by an embodiment of the application.
  • FIG. 1 is a schematic diagram of an application scenario provided by an embodiment of the application.
  • a cloud sensor 12 is mounted on a mobile platform 11.
  • the point cloud sensor 12 is used to collect point cloud data of the target object, and the point cloud data of the target object is used to fit the target object.
  • FIG. 2 is a first flowchart of a method for fitting a target object provided by an embodiment of the application. Referring to Fig. 2, the method of this embodiment includes:
  • Step S101 Generate a two-dimensional point cloud in the top view according to the point cloud of the target object collected by the point cloud sensor, where the point cloud sensor is used to be mounted on the mobile platform.
  • the point cloud of the target object collected by the point cloud sensor is a three-dimensional point cloud
  • the three-dimensional point cloud can be projected on a plane in the vertical direction to obtain a two-dimensional point cloud, that is, the two-dimensional point cloud under the top view is generated according to the point cloud of the target object Point cloud.
  • the target object is a vehicle driving on the road
  • the collected three-dimensional point cloud of the vehicle can be projected on the plane of the road along the vertical direction, so as to obtain the two-dimensional point cloud in the top view.
  • the point cloud sensor in this embodiment may be a TOF sensor or a lidar.
  • the mobile platform in this embodiment may be a vehicle, and the target object may be other vehicles driving on the road.
  • the vehicle is equipped with a lidar, which may be one or more lidars, and may be a rotating lidar or a solid-state lidar. The lidar is used to obtain three-dimensional point cloud information around the vehicle.
  • Step S102 Determine the visible area facing the mobile platform in the two-dimensional point cloud.
  • the present embodiment performs fitting based on the face of the target object that can be observed by the point cloud sensor of the target object, that is, to determine the two-dimensional
  • the visible area facing the mobile platform in the point cloud is used to fit the target object according to the visible area facing the mobile platform in the two-dimensional point cloud.
  • the visible area of the two-dimensional point cloud of the target object facing the mobile platform is the area of the two-dimensional point cloud of the target object in the sensing range and the field of view of the point cloud sensor.
  • FIG. 3 is a schematic diagram of a visible area facing a mobile platform in a two-dimensional point cloud provided by an embodiment of the application.
  • Fig. 3 which illustrates some points in the two-dimensional point cloud.
  • the coordinate origin O shown in Fig. 3 is the position of the point cloud sensor
  • the irregular figure 21 in Fig. 3 is the contour or convex hull of the two-dimensional point cloud of the target object, and the contour or convex hull of the two-dimensional point cloud is added
  • the thick part 211 is the visible area facing the mobile platform in the two-dimensional point cloud
  • OA and OB are the boundaries corresponding to the visible area facing the mobile platform in the two-dimensional point cloud.
  • Step S103 Determine the fitting feature of the target object according to the visible area facing the mobile platform in the two-dimensional point cloud of the target object, and fit the target object according to the fitting feature.
  • the fitting feature of the target object can be determined according to the visible area, and the target object can be fitted according to the fitting feature.
  • fitting the target object according to the fitting feature includes:
  • the fitted maximum height and the fitted minimum height of the point cloud of the target object are obtained, and the fitted height of the target object is obtained according to the fitted maximum height and the fitted minimum height.
  • the difference between the maximum fitting height and the minimum fitting height is the fitting height of the target object.
  • the maximum fitting height can be the height of the point with the highest height in the point cloud of the target object, or the maximum height obtained according to hierarchical aggregation, such as fitting according to the height of all points in the point cloud with a certain thickness
  • the point cloud of a certain thickness includes the point with the largest height in the point cloud of the target object.
  • the minimum fitting height can be the height of the point with the smallest height in the point cloud of the target object, or the minimum height obtained according to hierarchical aggregation, such as fitting according to the height of all points in a point cloud with a certain thickness. It can be understood that the point cloud of a certain thickness includes the point with the smallest height in the point cloud of the target object.
  • the fitting feature of the target object may include at least one of the following: fitting angle of the target object, fitting direction of the target object, fitting bounding box of the target object, and fitting visible edge of the target object.
  • the fitting feature of the target object may also be other features, which is not limited in this embodiment.
  • fitting feature of the target object is the fitting angle of the target object
  • fitting the target object according to the fitting feature of the target object and the fitting height of the target object including:
  • the direction corresponding to the rotation fitting angle from the coordinate origin of the point cloud sensor coordinate system is the fitting direction of the target object, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor.
  • the preset angle range and the preselected angle range may be the same or different; the angle included in the preset angle range is the angle between the first preset angle and the second preset angle, and the second preset angle minus the first preset angle Set the angle equal to 90°, the preset angle range includes the first preset angle and/or the second preset angle; the preselected angle range includes the angle between the third preset angle and the fourth preset angle, and the fourth The preset angle minus the third preset angle is equal to 90°, and the preselected angle range includes the third preset angle and/or the fourth preset angle.
  • the pre-selected angle range is obtained according to the preset angle range.
  • the fitting angle of the target object is the angle corresponding to the minimum cost of the visible edge.
  • each angle corresponds to a visible edge cost.
  • the visible edge cost is the degree of fit between the outer envelope rectangle of the two-dimensional point cloud of the target object in the direction corresponding to the angle and the two-dimensional point cloud, and the overflow of the outer envelope rectangle The parameter of the overflow degree of the target area; where the direction corresponding to the angle is the direction corresponding to the angle after rotating the angle from the coordinate origin of the point cloud sensor coordinate system.
  • the target area is the area between the first boundary and the second boundary corresponding to the visible area facing the mobile platform in the two-dimensional point cloud of the target object, and the target area includes the two-dimensional point cloud of the target object; further, the The first boundary and the second boundary can surround the two-dimensional point cloud, and both the first boundary and the second boundary have intersection points with the convex hull of the two-dimensional point cloud.
  • OA in Figure 3 is the first boundary corresponding to the visible area facing the mobile platform in the two-dimensional point cloud of the target object
  • OB is the first boundary corresponding to the visible area facing the mobile platform in the two-dimensional point cloud of the target object. Two borders.
  • the outer envelope rectangle of the two-dimensional point cloud of the target object in the direction corresponding to the angle satisfies the following conditions: the two sides of the outer envelope rectangle are in the same direction as the direction corresponding to the angle, and the other The direction of the two sides is perpendicular to the direction corresponding to the angle.
  • the outer envelope rectangle of the two-dimensional point cloud of the target object in the fitting direction is obtained, and the outer envelope rectangle is the fitting bounding box of the target object.
  • the outer envelope rectangle of the two-dimensional point cloud of the target object in the fitting direction satisfies the following conditions: the two sides of the outer envelope rectangle are in the same direction as the fitting direction of the target object, and the outer envelope The direction of the other two sides of the rectangle is perpendicular to the fitting direction of the target object.
  • the fitting direction of the target object in the process of obtaining the fitted bounding box of the target object, first obtain the fitted visible edge of the target object according to the fitting direction, and then use the fitted visible edge of the target object as the edge to obtain the target
  • the outer envelope rectangle of the two-dimensional point cloud of the object in the fitting direction in the process of obtaining the fitted bounding box of the target object, first obtain the fitted visible edge of the target object according to the fitting direction, and then use the fitted visible edge of the target object as the edge to obtain the target The outer envelope rectangle of the two-dimensional point cloud of the object in the fitting direction.
  • the fitted visible edge of the target object can be referred to as the L-shaped feature or the I-shaped feature of the target object. It is understandable that the fitted visible edge of the target object satisfies the following conditions: (1) The two-dimensional point cloud of the target object is located on the same side of the fitted visible edge of the target object, and the convex hull of the two-dimensional point cloud of the target object is The fitted visible edges of the target object have intersections; (2) In the case of two fitted visible edges of the target object, one of the two fitted visible edges is located in the same direction as the fitting direction of the target object , The direction of the other edge is perpendicular to the fitting direction of the target object; in the case that the fitted visible edge of the target object has one, the fitted visible edge is located in the same direction as the fitting direction of the target object.
  • FIG. 4 is the first schematic diagram of the fitted visible edge of the target object provided by the implementation of this application
  • FIG. 5 is the second schematic diagram of the fitted visible edge of the target object provided by the implementation of this application
  • FIG. 6 is the simulated view of the target object provided by the implementation of this application Schematic three of the visible edges.
  • 41 and 42 are the fitted visible edges of the target object, and the fitted visible edges at this time are the L-shaped features of the target object.
  • 51 is the fitted visible edge of the target object, and the fitted visible edge at this time is the I-type feature of the target object.
  • 61 is the fitted visible edge of the target object, and the fitted visible edge at this time is the I-type feature of the target object.
  • the fitting feature of the target object is the fitting direction of the target object
  • the fitting feature of the target object is acquired according to the visible area of the two-dimensional point cloud of the target object toward the mobile platform, including:
  • fitting the target object according to the fitting feature of the target object and the fitting height of the target object including:
  • the fitting feature of the target object is the fitting bounding box of the target object
  • the fitting feature of the target object is determined according to the visible area of the two-dimensional point cloud of the target object toward the mobile platform, including:
  • fitting the target object according to the fitting feature of the target object and the fitting height of the target object including: according to the fitting bounding box of the target object and the fitting height of the target object, The object is fitted.
  • the fitting feature of the target object is the fitting visible edge of the target object
  • the fitting feature of the target object is obtained according to the visible area of the two-dimensional point cloud of the target object toward the mobile platform, including:
  • fitting the target object according to the fitting feature of the target object and the fitting height of the target object including:
  • the point cloud sensor based on the target object can perform fitting to the target object, that is, according to the visible area facing the mobile platform in the two-dimensional point cloud of the target object, Fitting the target object can improve the accuracy of fitting the target object.
  • FIG. 7 is the second flowchart of the target object fitting method provided by the embodiment of the application. Referring to FIG. 7, the method of this embodiment includes:
  • Step S201 Select at least one reference angle from a preset angle range.
  • the meaning of the preset angle range in this embodiment is the same as the meaning of the preset angle range in the previous embodiment.
  • At least one reference angle refers to one or more reference angles.
  • the reference angle can be any angle within the first preset reference range.
  • the preset angle range is [0°, 90°]
  • one reference angle may be 45°.
  • one reference angle can be selected at the same interval within the preset angle range to obtain multiple reference angles.
  • the multiple reference angles may include: 0°, 10°, 20°, 30°, 40°, 50°, 60°, 70°, 80°, 90°
  • multiple reference angles can include: 0°, 10°, 20°, 30°, 40°, 50°, 60°, 70 °, 80°.
  • Step S202 According to at least one reference angle, the visible area facing the mobile platform in the two-dimensional point cloud of the target object, and the two-dimensional point cloud, determine the corresponding fitting angle with the least visible edge cost.
  • the following takes multiple reference angles as an example to illustrate the method of “determining the corresponding fitting angle with the least visible edge cost based on the multiple reference angles and the visible area”.
  • the first preselected angle includes the first reference angle in the first neighborhood.
  • each reference angle has a neighborhood range, and therefore has multiple neighborhood ranges, and the union of the multiple neighborhood ranges is the preselected angle range in the previous embodiment.
  • the preset angle range is [P 1 °,P 2 °) or [P 1 °,P 2 °] or (P 1 °, P 2 °], and a reference is selected at intervals of ⁇ ° within the preset angle range
  • the first reference angle is N°
  • the first neighborhood range is (N°- ⁇ °/2, N°+ ⁇ °/2] or [N°- ⁇ ° /2, N°+ ⁇ °/2)
  • the preset angle range and the preselected angle range are not the same; in another way, if the first reference angle is N°, if N is not equal to P 1 and neither When equal to P 2 , the first neighborhood range is (N°- ⁇ °/2, N°+ ⁇ °/2] or [N°- ⁇ °/2, N°+ ⁇ °/2), where N is equal to
  • the first neighborhood range is [N°, N°+ ⁇ °/2] or (N°, N°+ ⁇ °/2] or [N°, N°+ ⁇ °/
  • the gradient descent method can be used to determine the first preselected angle with the least visible edge cost within the first neighborhood of the first reference angle, specifically:
  • the method for obtaining the first visible edge cost is as follows: According to the first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first boundary and the second boundary corresponding to the visible area, obtain The first visible edge cost corresponding to the first reference angle; where the first direction is the direction corresponding to the rotation of the first reference angle from the coordinate origin of the point cloud sensor coordinate system.
  • the first boundary and the second boundary corresponding to the visible area are the same as those described in the previous embodiment.
  • FIG. 8 is a schematic diagram of obtaining the visible edge cost provided by an embodiment of the application.
  • the following is a description of "according to the first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first visible area corresponding to the visible area in conjunction with FIG. A boundary and a second boundary, the process of obtaining the first visible edge cost corresponding to the first reference angle is described.
  • "According to the first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first and second boundaries corresponding to the visible area, obtain the first visible edge corresponding to the first reference angle Cost" including:
  • OA in FIG. 8 is the first boundary
  • OB is the second boundary
  • the first area is the area 81 in FIG. 8.
  • the first direction is the direction indicated by the arrow in FIG. 8
  • the second area is the area 82 in FIG. 8.
  • the target area includes a two-dimensional point cloud of the target object.
  • the third area is the area 83 in FIG. 8, that is, the area filled with solid lines.
  • determining the visible edge cost corresponding to the first reference angle according to the first area, the second area, and the third area includes:
  • the first preselected visible edge cost is used to characterize the degree of fit between the first outer envelope rectangle and the convex hull of the two-dimensional point cloud.
  • the first preselected visible edge cost is equal to the difference between the first area and the second area multiplied by the first preset weight.
  • the difference between the first area and the second area is the area of the area filled by the dotted line in the figure.
  • the second preselected visible edge cost is used to characterize the overflow degree of the first outer envelope rectangle overflowing the target area.
  • the second preselected visible edge cost is equal to the third area multiplied by the second preset weight.
  • the visible edge cost is a combination of the fit between the outer envelope rectangle of the two-dimensional point cloud of the target object in the direction corresponding to a certain angle and the two-dimensional point cloud and the overflow degree of the outer envelope rectangle overflowing the target area. parameter.
  • the first angle may be an angle greater than the first reference angle, or may be an angle smaller than the first reference angle.
  • the method of obtaining the second visible edge cost corresponding to the first angle is the same as the method of obtaining the first visible edge cost corresponding to the first reference angle, and will not be repeated here.
  • angle update rules are as follows:
  • first angle is greater than the first reference angle, and the first visible edge cost is greater than the second visible edge cost, update the first angle to a second angle smaller than the first angle in the first neighborhood.
  • first angle is greater than the first reference angle, and the first visible edge cost is less than the second visible edge cost, update the first angle to a second angle larger than the first angle in the first neighborhood.
  • first angle is smaller than the first reference angle, and the first visible edge cost is greater than the second visible edge cost, update the first angle to a second angle larger than the first angle in the first neighborhood.
  • first angle is smaller than the first reference angle, and the first visible edge cost is smaller than the second visible edge cost, update the first angle to a second angle smaller than the first angle in the first neighborhood.
  • the above j1 to j3 are specific implementations of using the gradient descent method to determine the first preselected angle with the smallest visible edge cost within the first neighborhood of the first reference angle.
  • the preselected angles corresponding to the other reference angles are obtained according to the method of obtaining the first preselected angle corresponding to the first reference angle, and finally multiple preselected angles are obtained.
  • the fitting angle of the target object with the least visible edge cost is determined according to at least one reference angle, the visible area and the two-dimensional point cloud of the target object ,include:
  • m1 according to the visible area and the two-dimensional point cloud of the target object, determine the corresponding target reference angle with the least visible edge cost among multiple reference angles.
  • the visible edge cost corresponding to each reference angle is obtained, and the reference angle with the smallest corresponding visible edge cost is determined as the target reference angle.
  • obtaining the visible edge cost corresponding to each reference angle refers to the method for obtaining the visible edge cost corresponding to the first reference angle.
  • the second neighborhood range is (S 1 °, S 2 °), where S 1 ° is the absolute value of the difference with the target reference angle being the smallest and smaller than the target reference angle S 2 ° is the reference angle with the smallest absolute value of the difference from the target reference angle and greater than the target reference angle.
  • the gradient descent method can be used to determine the fitting angle of the target object with the least visible edge cost within the second neighborhood of the target reference angle based on the visible area and the two-dimensional point cloud of the target object .
  • the specific implementation of this manner refers to the method of determining the first preselected angle in the gradient descent method within the first neighborhood of the first reference angle, which will not be repeated here.
  • multiple sub-reference angles are obtained from the second neighborhood of the target reference angle, and the smallest visible edge cost corresponding to each sub-reference angle is determined according to the visible area and the two-dimensional point cloud of the target object.
  • the sub-reference angle is the fitting angle of the target object.
  • obtaining the visible edge cost corresponding to each sub-reference angle refers to the obtaining method of obtaining the visible edge cost corresponding to the first reference angle, which will not be repeated here.
  • a sub-reference angle may be obtained at every interval of the same angle within the second neighborhood range of the target reference angle.
  • This embodiment provides a specific method for obtaining the fitting angle of the target object, and the method of this embodiment can further improve the accuracy of obtaining the fitting angle of the target object.
  • FIG. 9 is a schematic structural diagram of a point cloud sensor provided by an embodiment of the application.
  • the point cloud sensor provided in this embodiment is used to be mounted on a mobile platform.
  • the point cloud sensor includes a collector 91 and a processor 92.
  • the collector 91 is used to collect the point cloud of the target object
  • the processor 92 is communicatively connected to the collector and is configured to perform the following operations: generate a two-dimensional point cloud in the top view according to the point cloud of the target object collected by the collector; and determine the direction in the two-dimensional point cloud The visible area of the mobile platform; according to the visible area, the fitting feature of the target object is determined, and the target object is fitted according to the fitting feature.
  • the processor 92 when configured to perform the operation of determining the fitting feature of the target object according to the visible area, it is specifically configured to: determine according to the visible area and the two-dimensional point cloud The fitting feature.
  • the fitting feature is the fitting angle of the target object
  • the processor 92 is configured to perform the operation of determining the fitting feature based on the visible area and the two-dimensional point cloud , Specifically used for: determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range.
  • the processor 92 when configured to perform the operation of determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range, it is specifically configured to: , The two-dimensional point cloud and the preset angle range determine the corresponding fitting angle with the smallest visible edge cost.
  • the processor 92 when the processor 92 is configured to perform the operation of determining the corresponding fitting angle with the least visible edge cost according to the visible area, the two-dimensional point cloud, and a preset angle range, specifically use In: selecting at least one reference angle from the preset angle range; and determining the corresponding fitting angle with the least visible edge cost according to the at least one reference angle, the visible area, and the two-dimensional point cloud.
  • the processor 92 is configured to determine that the corresponding visible edge cost is the smallest according to the at least one reference angle, the visible area, and the two-dimensional point cloud.
  • the fitting angle it is specifically used to: for any one of the multiple reference angles, according to the visible area and the two-dimensional point cloud, in the first reference angle Determine a first preselected angle with the smallest visible edge cost within a neighborhood range, where the first neighborhood range includes the first reference angle; determine the corresponding preselected angle with the least visible edge cost among the preselected angles as the fitting angle.
  • the processor 92 is configured to perform determining a first preselected angle with the least visible edge cost within a first neighborhood range of the first reference angle based on the visible area and the two-dimensional point cloud During the operation, it is specifically used to obtain the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud, and update the first reference angle to the first neighbor According to the first angle within the domain, the second visible edge cost corresponding to the first angle is obtained according to the visible area and the two-dimensional point cloud; according to the second visible edge cost and the first visible edge The relationship between the costs, update the first angle to the second angle in the first neighborhood; repeat the execution of obtaining the visible edge costs corresponding to the angles in the first neighborhood, according to two adjacent The obtained relationship of the visible edge cost is an operation of updating the angle within the first neighborhood range until the first preselected angle with the smallest visible edge cost is obtained.
  • the processor 92 is configured to determine that the corresponding visible edge cost is the smallest according to the at least one reference angle, the visible area, and the two-dimensional point cloud.
  • the fitting angle it is specifically used to: determine the corresponding target reference angle with the least visible edge cost among multiple reference angles according to the visible area and the two-dimensional point cloud; according to the visible area And the two-dimensional point cloud, determining the corresponding fitting angle with the smallest visible edge cost within a second neighborhood range of the target reference angle, and the second neighborhood range includes the target reference angle.
  • the processor 92 is configured to determine the fitting angle with the least visible edge cost within the second neighborhood range of the target reference angle according to the visible area and the two-dimensional point cloud During the operation, it is specifically used to: obtain multiple sub-reference angles from within the second neighborhood of the target reference angle; determine the visible edge cost corresponding to each sub-reference angle according to the visible area and the two-dimensional point cloud The smallest sub-reference angle is the fitting angle.
  • the processor 92 when configured to perform the operation of obtaining the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud, it is specifically configured to: The first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first boundary and the second boundary corresponding to the visible area, to obtain the first visible edge cost; wherein, The first direction is a direction corresponding to the rotation of the first reference angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor.
  • the processor 92 is configured to execute the first outer envelope rectangle in the first direction according to the two-dimensional point cloud, the visible area and the first boundary and the second boundary corresponding to the visible area.
  • Boundary when the operation of obtaining the first visible edge cost is specifically used to: obtain the first area of the first area defined by the visible area, the first boundary, and the second boundary; The outer envelope rectangle faces the visible side of the mobile platform, and the second area of the second area defined by the first boundary and the second boundary; obtains the side of the first envelope rectangle outside the target area, the A third area of a third area defined by the first boundary and the second boundary, the target area is the area between the first boundary and the second boundary, and the target area includes the second boundary of the target object.
  • One-dimensional point cloud determine the first visible edge cost according to the first area, the second area, and the third area.
  • the processor 92 is configured to perform an operation of determining the first visible edge cost corresponding to the first reference angle according to the first area, the second area, and the third area. , It is specifically used to: obtain the first area, the second area, and the first preset weight, obtain the first preselected visible edge cost; according to the third area and the second preset weight, obtain the second preselect Visible edge cost; determining the first visible edge cost according to the first preselected visible edge cost and the second preselected visible edge cost.
  • the angle included in the preset angle range is an angle between a first preset angle and a second preset angle, and the first preset angle minus the second preset angle is equal to 90°,
  • the preset angle range includes the first preset angle and/or the second preset angle.
  • the fitting feature includes at least one of the following: the fitting angle of the target object, the fitting direction of the target object, the fitting bounding box of the target object, and the fitting of the target object.
  • the processor 92 when configured to perform the operation of fitting the target object according to the fitting feature, it is specifically configured to: obtain the information of the target object according to the point cloud of the target object Fitting height; fitting the target object according to the fitting feature and the fitting height.
  • the processing when the fitting feature includes at least one of the following: the fitting angle of the target object, the fitting direction of the target object, and the fitting visible edge of the target object, the processing When the device 92 is used to perform the operation of fitting the target object according to the fitting feature and the fitting height, it is specifically configured to: obtain the fitting boundary of the target object according to the fitting feature Box; according to the fitting bounding box and fitting height, fitting the target object.
  • the processor 92 when configured to perform the operation of obtaining the fitting height of the target object according to the point cloud of the target object, it is specifically configured to obtain the maximum fitting height of the target object. Height and fitting minimum height; obtaining the fitting height according to the fitting maximum height and the fitting minimum height.
  • the point cloud sensor in this embodiment can be used to implement the technical solutions in the foregoing method embodiments, and its implementation principles and technical effects are similar, and will not be repeated here.
  • FIG. 10 is a schematic structural diagram of a mobile platform provided by an embodiment of this application.
  • the mobile platform of this embodiment includes: a point cloud sensor 101 and a processor 102.
  • the point cloud sensor 101 is used to collect the point cloud of the target object; wherein, the point cloud sensor 101 is mounted on the mobile platform;
  • the processor 102 is in communication connection with the point cloud sensor 101, and is configured to perform the following operations: generate a two-dimensional point cloud in the top view according to the point cloud of the target object collected by the point cloud sensor; and determine the two-dimensional point cloud In the visible area facing the mobile platform; according to the visible area, the fitting feature of the target object is determined, and the target object is fitted according to the fitting feature.
  • the processor 102 when configured to perform the operation of determining the fitting feature of the target object according to the visible area, it is specifically configured to: determine according to the visible area and the two-dimensional point cloud The fitting feature.
  • the fitting feature is a fitting angle of the target object
  • the processor 102 when the processor 102 is configured to perform an operation of determining the fitting feature based on the visible area and the two-dimensional point cloud , Specifically used for: determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range.
  • the processor 102 when configured to perform the operation of determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range, it is specifically configured to: according to the visible area , The two-dimensional point cloud and the preset angle range determine the corresponding fitting angle with the smallest visible edge cost.
  • the processor 102 when the processor 102 is configured to perform the operation of determining the corresponding fitting angle with the least visible edge cost based on the visible area, the two-dimensional point cloud, and a preset angle range, specifically use In: selecting at least one reference angle from the preset angle range; and determining the corresponding fitting angle with the least visible edge cost according to the at least one reference angle, the visible area, and the two-dimensional point cloud.
  • the processor 102 is configured to determine that the corresponding visible edge cost is the smallest according to the at least one reference angle, the visible area, and the two-dimensional point cloud.
  • the fitting angle it is specifically used to: for any one of the multiple reference angles, according to the visible area and the two-dimensional point cloud, in the first reference angle Determine a first preselected angle with the smallest visible edge cost within a neighborhood range, where the first neighborhood range includes the first reference angle; determine the corresponding preselected angle with the least visible edge cost among the preselected angles as the fitting angle.
  • the processor 102 is configured to perform determining a first preselected angle with the least visible edge cost within a first neighborhood range of the first reference angle based on the visible area and the two-dimensional point cloud During the operation, it is specifically used to obtain the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud, and update the first reference angle to the first neighbor According to the first angle within the domain, the second visible edge cost corresponding to the first angle is obtained according to the visible area and the two-dimensional point cloud; according to the second visible edge cost and the first visible edge The relationship between the costs, update the first angle to the second angle in the first neighborhood; repeat the execution of obtaining the visible edge costs corresponding to the angles in the first neighborhood, according to two adjacent The obtained relationship of the visible edge cost is an operation of updating the angle within the first neighborhood range until the first preselected angle with the smallest visible edge cost is obtained.
  • the processor 102 is configured to determine that the corresponding visible edge cost is the smallest according to the at least one reference angle, the visible area, and the two-dimensional point cloud.
  • the fitting angle it is specifically used to: determine the corresponding target reference angle with the least visible edge cost among multiple reference angles according to the visible area and the two-dimensional point cloud; according to the visible area And the two-dimensional point cloud, determining the corresponding fitting angle with the smallest visible edge cost within a second neighborhood range of the target reference angle, and the second neighborhood range includes the target reference angle.
  • the processor 102 is configured to determine the fitting angle with the least visible edge cost within the second neighborhood range of the target reference angle according to the visible area and the two-dimensional point cloud During the operation, it is specifically used to: obtain multiple sub-reference angles from within the second neighborhood of the target reference angle; determine the visible edge cost corresponding to each sub-reference angle according to the visible area and the two-dimensional point cloud The smallest sub-reference angle is the fitting angle.
  • the processor 102 when configured to perform the operation of obtaining the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud, it is specifically configured to: The first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first boundary and the second boundary corresponding to the visible area, to obtain the first visible edge cost; wherein, The first direction is a direction corresponding to the rotation of the first reference angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor.
  • the processor 102 is configured to execute the first outer envelope rectangle in the first direction according to the two-dimensional point cloud, the visible area and the first boundary and the second boundary corresponding to the visible area.
  • Boundary when the operation of obtaining the first visible edge cost is specifically used to: obtain the first area of the first area defined by the visible area, the first boundary, and the second boundary; The outer envelope rectangle faces the visible side of the mobile platform, and the second area of the second area defined by the first boundary and the second boundary; obtains the side of the first envelope rectangle outside the target area, the A third area of a third area defined by the first boundary and the second boundary, the target area is the area between the first boundary and the second boundary, and the target area includes the two-dimensional point cloud ; According to the first area, the second area and the third area, determine the first visible edge cost.
  • the processor 102 is configured to perform an operation of determining the first visible edge cost corresponding to the first reference angle according to the first area, the second area, and the third area , It is specifically used to: obtain the first area, the second area, and the first preset weight, obtain the first preselected visible edge cost; according to the third area and the second preset weight, obtain the second preselect Visible edge cost; determining the first visible edge cost according to the first preselected visible edge cost and the second preselected visible edge cost.
  • the angle included in the preset angle range is an angle between a first preset angle and a second preset angle, and the first preset angle minus the second preset angle is equal to 90°,
  • the preset angle range includes the first preset angle and/or the second preset angle.
  • the fitting feature includes at least one of the following: the fitting angle of the target object, the fitting direction of the target object, the fitting bounding box of the target object, and the fitting of the target object.
  • the processor 102 when configured to perform the operation of fitting the target object according to the fitting feature, it is specifically configured to: obtain the information of the target object according to the point cloud of the target object Fitting height; fitting the target object according to the fitting feature and the fitting height.
  • the processing when the fitting feature includes at least one of the following: the fitting angle of the target object, the fitting direction of the target object, and the fitting visible edge of the target object, the processing When the device 102 is used to perform the operation of fitting the target object according to the fitting feature and the fitting height, it is specifically used to: obtain the fitting boundary of the target object according to the fitting feature Box; according to the fitting bounding box and fitting height, fitting the target object.
  • the processor 102 when configured to perform the operation of obtaining the fitting height of the target object according to the point cloud of the target object, it is specifically configured to obtain the maximum fitting height of the target object. Height and fitting minimum height; obtaining the fitting height according to the fitting maximum height and the fitting minimum height.
  • the mobile platform of this embodiment can be used to execute the technical solutions in the foregoing method embodiments, and its implementation principles and technical effects are similar, and will not be repeated here.
  • An embodiment of the present application also provides a computer-readable storage medium, including a program or instruction, and when the program or instruction runs on a computer, the method described in the foregoing method embodiment is executed.
  • the aforementioned program can be stored in a computer readable storage medium.
  • the program executes the steps including the above-mentioned method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk, or optical disk and other media that can store program code.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

A target object fitting method, a point cloud sensor and a mobile platform. The method comprises: according to a point cloud of a target object collected by a point cloud sensor, generating a two-dimensional point cloud with a top view, wherein the point cloud sensor is used for mounting a mobile platform (S101); determining a visible area, facing the mobile platform, in the two-dimensional point cloud (S102); and according to the visible area, facing the mobile platform and in the two-dimensional point cloud, of the target object, determining a fitting feature of the target object, and fitting the target object according to the fitting feature (S103). This method can improve the accuracy of fitting a target object.

Description

目标物体的拟合方法、点云传感器和移动平台Fitting method of target object, point cloud sensor and mobile platform 技术领域Technical field
本申请涉及自动驾驶领域,尤其涉及一种目标物体的拟合方法、点云传感器和移动平台。This application relates to the field of automatic driving, and in particular to a method for fitting a target object, a point cloud sensor and a mobile platform.
背景技术Background technique
在自动驾驶任务中,基于车辆点云的目标车辆的识别、跟踪是一项重要的感知任务。车辆点云是一组离散点,实际处理中往往需要对判定为目标车辆的点云进行拟合,得到拟合后的车辆,以根据拟合后的车辆来判断其车辆的朝向和尺寸,进而完成跟踪任务。In autonomous driving tasks, the identification and tracking of target vehicles based on vehicle point clouds is an important perception task. The vehicle point cloud is a set of discrete points. In actual processing, it is often necessary to fit the point cloud determined as the target vehicle to obtain the fitted vehicle to determine the orientation and size of the vehicle according to the fitted vehicle. Complete the tracking task.
通常用的拟合车辆的方法包括最小面积外包络矩形方法,该方法将车辆的三维点云投影至二维平面,得到二维点云,确定二维点云的面积最小的外包络矩形为拟合特征,根据该拟合特征得到拟合后的车辆。但是该方法对车辆的拟合均不够精确。Commonly used methods of fitting vehicles include the smallest area outer envelope rectangle method, which projects the vehicle's 3D point cloud onto a 2D plane to obtain a 2D point cloud and determine the outer envelope rectangle with the smallest area of the 2D point cloud In order to fit the feature, the fitted vehicle is obtained according to the fitted feature. But this method is not accurate enough to fit the vehicle.
发明内容Summary of the invention
本申请实施例提供一种目标物体的拟合方法、点云传感器和移动平台,提高了对目标物体拟合的精确度。The embodiments of the present application provide a method for fitting a target object, a point cloud sensor and a mobile platform, which improve the accuracy of fitting the target object.
第一方面,本申请实施例提供一种目标物体的拟合方法,包括:根据点云传感器采集的目标物体的点云,生成俯视图下的二维点云,其中所述点云传感器用于搭载于移动平台;确定所述二维点云中朝向所述移动平台的可见区域;根据所述可见区域,确定所述目标物体的拟合特征,并根据所述拟合特征对所述目标物体进行拟合。In a first aspect, an embodiment of the present application provides a method for fitting a target object, including: generating a two-dimensional point cloud in a top view according to a point cloud of the target object collected by a point cloud sensor, wherein the point cloud sensor is used for carrying In the mobile platform; determine the visible area of the two-dimensional point cloud toward the mobile platform; determine the fitting feature of the target object according to the visible area, and perform the target object according to the fitting feature Fitting.
结合第一方面,在第一方面的一种可能的实现方式中,根据所述可见区域,确定所述目标物体的拟合特征,包括:根据所述可见区域和所述二维点云,确定所述拟合特征。With reference to the first aspect, in a possible implementation of the first aspect, determining the fitting feature of the target object according to the visible area includes: determining according to the visible area and the two-dimensional point cloud The fitting feature.
结合第一方面,在第一方面的一种可能的实现方式中,所述拟合特征为所述目标物体的拟合角度,所述根据所述可见区域和所述二维点云,确定 所述拟合特征,包括:根据所述可见区域、所述二维点云和预设角度范围,确定所述拟合角度。With reference to the first aspect, in a possible implementation manner of the first aspect, the fitting feature is the fitting angle of the target object, and the determining the fitting angle is based on the visible area and the two-dimensional point cloud. The fitting feature includes: determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range.
结合第一方面,在第一方面的一种可能的实现方式中,所述根据所述可见区域、所述二维点云和预设角度范围,确定所述拟合角度,包括:根据所述可见区域、所述二维点云和预设角度范围,确定对应的可见边缘代价最小的所述拟合角度。With reference to the first aspect, in a possible implementation of the first aspect, the determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range includes: according to the The visible area, the two-dimensional point cloud, and the preset angle range determine the fitting angle with the least corresponding visible edge cost.
结合第一方面,在第一方面的一种可能的实现方式中,所述根据所述可见区域、所述二维点云和预设角度范围,确定对应的可见边缘代价最小的所述拟合角度,包括:从所述预设角度范围内选取至少一个参考角度;根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度。With reference to the first aspect, in a possible implementation of the first aspect, the fitting is determined according to the visible area, the two-dimensional point cloud, and a preset angle range. The angle includes: selecting at least one reference angle from the preset angle range; according to the at least one reference angle, the visible area, and the two-dimensional point cloud, determining the corresponding fitting with the least visible edge cost angle.
结合第一方面,在第一方面的一种可能的实现方式中,在参考角度的数目为多个时,所述根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度,包括:对于多个参考角度中的任意一个第一参考角度,根据所述可见区域和所述二维点云,在所述第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度,所述第一邻域范围包括所述第一参考角度;确定各预选角度中对应的可见边缘代价最小的预选角度为所述拟合角度。With reference to the first aspect, in a possible implementation of the first aspect, when the number of reference angles is more than one, according to the at least one reference angle, the visible area and the two-dimensional point cloud, Determining the corresponding fitting angle with the smallest visible edge cost includes: for any one of a plurality of reference angles, according to the visible area and the two-dimensional point cloud, in the first reference angle Determine the first preselected angle with the smallest visible edge cost within the first neighborhood range, where the first neighborhood range includes the first reference angle; determine the corresponding preselected angle with the least visible edge cost among the preselected angles as said Fitting angle.
结合第一方面,在第一方面的一种可能的实现方式中,根据所述可见区域和所述二维点云,在所述第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度,包括:根据所述可见区域和所述二维点云,获取所述第一参考角度对应的第一可见边缘代价,并更新所述第一参考角度至所述第一邻域范围内的第一角度,根据所述可见区域和所述二维点云,获取所述第一角度对应的第二可见边缘代价;根据所述第二可见边缘代价和所述第一可见边缘代价之间的关系,更新所述第一角度至所述第一邻域范围内的第二角度;重复执行获取所述第一邻域范围内的角度对应的可见边缘代价、根据相邻两次获取到的可见边缘代价的关系在所述第一邻域范围内更新角度的操作,直至获取到可见边缘代价最小的所述第一预选角度。With reference to the first aspect, in a possible implementation of the first aspect, according to the visible area and the two-dimensional point cloud, it is determined that the visible edge cost is the smallest within the first neighborhood of the first reference angle The first preselected angle includes: obtaining a first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud, and updating the first reference angle to the first neighbor According to the first angle within the domain, the second visible edge cost corresponding to the first angle is obtained according to the visible area and the two-dimensional point cloud; according to the second visible edge cost and the first visible edge The relationship between the costs, update the first angle to the second angle in the first neighborhood; repeat the execution of obtaining the visible edge costs corresponding to the angles in the first neighborhood, according to two adjacent The obtained relationship of the visible edge cost is an operation of updating the angle within the first neighborhood range until the first preselected angle with the smallest visible edge cost is obtained.
结合第一方面,在第一方面的一种可能的实现方式中,在参考角度的数目为多个时,所述根据所述至少一个参考角度、所述可见区域和所述二维 点云,确定对应的可见边缘代价最小的所述拟合角度,包括:根据所述可见区域和所述二维点云,在多个参考角度中确定对应的可见边缘代价最小的目标参考角度;根据所述可见区域和所述二维点云,在所述目标参考角度的第二邻域范围内确定对应的可见边缘代价最小的所述拟合角度,所述第二邻域范围包括所述目标参考角度。With reference to the first aspect, in a possible implementation of the first aspect, when the number of reference angles is more than one, according to the at least one reference angle, the visible area and the two-dimensional point cloud, Determining the corresponding fitting angle with the smallest visible edge cost includes: determining the corresponding target reference angle with the smallest visible edge cost among multiple reference angles according to the visible area and the two-dimensional point cloud; For the visible area and the two-dimensional point cloud, determine the fitting angle with the smallest visible edge cost within a second neighborhood range of the target reference angle, and the second neighborhood range includes the target reference angle .
结合第一方面,在第一方面的一种可能的实现方式中,根据所述可见区域和所述二维点云,在所述目标参考角度的第二邻域范围内确定可见边缘代价最小的所述拟合角度,包括:从所述目标参考角度的第二邻域范围内获取多个子参考角度;根据所述可见区域和所述二维点云,确定各子参考角度对应的可见边缘代价中最小的子参考角度为所述拟合角度。With reference to the first aspect, in a possible implementation of the first aspect, according to the visible area and the two-dimensional point cloud, determine the smallest visible edge cost within the second neighborhood of the target reference angle The fitting angle includes: acquiring a plurality of sub-reference angles from within a second neighborhood of the target reference angle; determining the visible edge cost corresponding to each sub-reference angle according to the visible area and the two-dimensional point cloud The smallest sub-reference angle is the fitting angle.
结合第一方面,在第一方面的一种可能的实现方式中,根据所述可见区域和所述二维点云,获取所述第一参考角度对应的第一可见边缘代价,包括:根据所述二维点云在第一方向上的第一外包络矩形、所述可见区域和所述可见区域对应的第一边界和第二边界,获取所述第一可见边缘代价;其中,所述第一方向为从点云传感器坐标系的坐标原点出发旋转所述第一参考角度后所对应的方向,所述点云传感器坐标系的坐标原点为所述点云传感器所在的位置。With reference to the first aspect, in a possible implementation of the first aspect, according to the visible area and the two-dimensional point cloud, obtaining the first visible edge cost corresponding to the first reference angle includes: The first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first boundary and the second boundary corresponding to the visible area, to obtain the first visible edge cost; wherein, The first direction is a direction corresponding to the rotation of the first reference angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor.
结合第一方面,在第一方面的一种可能的实现方式中,所述根据所述二维点云在第一方向上的第一外包络矩形、所述可见区域和所述可见区域对应的第一边界和第二边界,获取所述第一可见边缘代价,包括:获取由所述可见区域、所述第一边界和第二边界限定的第一区域的第一面积;获取由所述第一外包络矩形朝向所述移动平台的可见边、所述第一边界和第二边界限定的第二区域的第二面积;获取所述第一外包络矩形位于目标区域外的边、所述第一边界和第二边界限定的第三区域的第三面积,所述目标区域为所述第一边界和第二边界之间的区域,所述目标区域内包括所述二维点云;根据所述第一面积、所述第二面积和所述第三面积,确定所述第一可见边缘代价。With reference to the first aspect, in a possible implementation of the first aspect, according to the first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area corresponds to the visible area Obtaining the first visible edge cost includes: obtaining the first area of the first area defined by the visible area, the first border and the second border; obtaining the The first outer envelope rectangle faces the visible side of the mobile platform, the second area of the second area defined by the first boundary and the second boundary; obtains the side of the first envelope rectangle outside the target area, A third area of a third area defined by the first boundary and the second boundary, the target area is the area between the first boundary and the second boundary, and the target area includes the two-dimensional point cloud ; According to the first area, the second area and the third area, determine the first visible edge cost.
结合第一方面,在第一方面的一种可能的实现方式中,所述根据所述第一面积、所述第二面积和所述第三面积,确定所述第一参考角度对应的所述第一可见边缘代价,包括:获取所述第一面积、所述第二面积和第一预设权重,获取第一预选可见边缘代价;根据所述第三面积和第二预设权重,获 取第二预选可见边缘代价;根据所述第一预选可见边缘代价和所述第二预选可见边缘代价,确定所述第一可见边缘代价。With reference to the first aspect, in a possible implementation of the first aspect, the determining the first reference angle corresponding to the first area, the second area, and the third area The first visible edge cost includes: obtaining the first area, the second area, and the first preset weight, and obtaining the first preselected visible edge cost; according to the third area and the second preset weight, obtaining the first Two preselected visible edge costs; determining the first visible edge cost according to the first preselected visible edge cost and the second preselected visible edge cost.
结合第一方面,在第一方面的一种可能的实现方式中,所述预设角度范围包括的角度为第一预设角度与第二预设角度之间的角度,所述第一预设角度减去所述第二预设角度等于90°,所述预设角度范围包括所述第一预设角度和/或所述第二预设角度。With reference to the first aspect, in a possible implementation of the first aspect, the angle included in the preset angle range is an angle between a first preset angle and a second preset angle, and the first preset angle The angle minus the second preset angle is equal to 90°, and the preset angle range includes the first preset angle and/or the second preset angle.
结合第一方面,在第一方面的一种可能的实现方式中,所述拟合特征包括如下中的至少一项:所述目标物体的拟合角度、所述目标物体的拟合方向、所述目标物体拟合边界框、所述目标物体的拟合可见边;With reference to the first aspect, in a possible implementation of the first aspect, the fitting feature includes at least one of the following: a fitting angle of the target object, a fitting direction of the target object, and The fitted bounding box of the target object, and the fitted visible edge of the target object;
其中,所述拟合方向为从点云传感器坐标系的坐标原点出发旋转所述拟合角度后所对应的方向,所述点云传感器坐标系的坐标原点为所述点云传感器所在的位置。Wherein, the fitting direction is the direction corresponding to the rotation of the fitting angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor.
结合第一方面,在第一方面的一种可能的实现方式中,所述根据所述拟合特征对所述目标物体进行拟合,包括:With reference to the first aspect, in a possible implementation of the first aspect, the fitting the target object according to the fitting feature includes:
根据所述目标物体的点云,获取所述目标物体的拟合高度;Obtaining the fitting height of the target object according to the point cloud of the target object;
根据所述拟合特征和所述拟合高度,对所述目标物体进行拟合。Fit the target object according to the fitting feature and the fitting height.
结合第一方面,在第一方面的一种可能的实现方式中,在所述拟合特征包括如下中的至少一项时:所述目标物体的拟合角度、所述目标物体的拟合方向、所述目标物体的拟合可见边,根据所述拟合特征和所述拟合高度,对所述目标物体进行拟合,包括:With reference to the first aspect, in a possible implementation of the first aspect, when the fitting feature includes at least one of the following: the fitting angle of the target object, and the fitting direction of the target object , Fitting visible edges of the target object, fitting the target object according to the fitting feature and the fitting height, including:
根据所述拟合特征,获取所述目标物体拟合边界框;Obtaining a fitting bounding box of the target object according to the fitting feature;
根据所述拟合边界框和拟合高度,对所述目标物体进行拟合。Fit the target object according to the fitting bounding box and fitting height.
结合第一方面,在第一方面的一种可能的实现方式中,根据所述目标物体的点云,获取所述目标物体的拟合高度,包括:With reference to the first aspect, in a possible implementation of the first aspect, obtaining the fitting height of the target object according to the point cloud of the target object includes:
获取所述目标物体的点云拟合最大高度和拟合最小高度;Acquiring the maximum fitting height and the minimum fitting height of the target object;
根据所述拟合最大高度和拟合最小高度,获取所述拟合高度。According to the maximum fitting height and the minimum fitting height, the fitting height is obtained.
第二方面,本申请实施例提供一种点云传感器,该点云传感器用于搭载在移动平台上,该点云传感器包括:In a second aspect, an embodiment of the present application provides a point cloud sensor, which is used to be mounted on a mobile platform, and the point cloud sensor includes:
采集器,用于采集所述目标物体的点云;A collector for collecting the point cloud of the target object;
处理器,与所述采集器通信连接,用于执行第一方面以及第一方面任 一可能的实现方式所述的方法。可以理解的是,在第二方面中,“根据点云传感器采集的目标物体的点云,生成俯视图下的二维点云”为“根据点云传感器的采集器采集的目标物体的点云,生成俯视图下的二维点云”。The processor is in communication connection with the collector, and is configured to execute the method described in the first aspect and any possible implementation manner of the first aspect. It is understandable that, in the second aspect, "generate a two-dimensional point cloud in the top view according to the point cloud of the target object collected by the point cloud sensor" is "the point cloud of the target object collected by the collector of the point cloud sensor, Generate a two-dimensional point cloud under the top view".
第三方面,本申请实施例提供一种移动平台,包括:点云传感器,用于采集所述目标物体的点云;其中,所述点云传感器搭载于所述移动平台;处理器,与所述点云传感器通信连接,用于执行第一方面以及第一方面任一可能的实现方式所述的方法。In a third aspect, embodiments of the present application provide a mobile platform, including: a point cloud sensor for collecting the point cloud of the target object; wherein the point cloud sensor is mounted on the mobile platform; a processor, and The point cloud sensor communication connection is used to execute the method described in the first aspect and any possible implementation manner of the first aspect.
第四方面,本申请实施例提供一种移动平台,其特征在于,所述移动平台上搭载有第二方面所述的点云传感器。In a fourth aspect, an embodiment of the present application provides a mobile platform, characterized in that the point cloud sensor described in the second aspect is mounted on the mobile platform.
第五方面,本申请实施例提供一种计算机可读存储介质,包括程序或指令,当所述程序或指令在计算机上运行时,第一方面以及第一方面任一可能的实现方式所述的方法被执行。In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, including a program or instruction. When the program or instruction runs on a computer, the first aspect and any possible implementation of the first aspect The method is executed.
第六方面,本发明实施例提供一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,该计算机程序包含至少一段代码,该至少一段代码可由计算机执行,以控制所述计算机执行上述第一方面以及第一方面任一可能的实现方式所述的方法。In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, the computer program includes at least one piece of code, the at least one piece of code can be executed by a computer to control the computer to execute The foregoing first aspect and the method described in any possible implementation manner of the first aspect.
第七方面,本发明实施例提供一种计算机程序,当所述计算机程序被计算机执行时,用于执行上述第一方面以及第一方面任一可能的实现方式所述的方法。In a seventh aspect, an embodiment of the present invention provides a computer program, when the computer program is executed by a computer, it is used to execute the foregoing first aspect and the method described in any possible implementation manner of the first aspect.
所述程序可以全部或者部分存储在与处理器封装在一起的存储介质上,也可以部分或者全部存储在不与处理器封装在一起的存储介质上。存储介质例如为存储器。The program may be stored in whole or in part on a storage medium that is packaged with the processor, and may also be stored in part or all in a storage medium that is not packaged with the processor. The storage medium is, for example, a memory.
由于目标物体靠近点云传感器或者靠近搭载点云传感器的移动平台的一个或两个面能够被点云传感器观测到,背离点云传感器或者背离搭载点云传感器的移动平台的两个或三个面无法被点云传感器观测到,因此,本申请中基于目标物体的点云传感器能够观测的面对目标物体进行拟合,即根据目标物体的二维点云中朝向移动平台的可见区域,对目标物体进行拟合,可以提高对目标物体拟合的准确性。Since the target object is close to the point cloud sensor or one or two surfaces of the mobile platform equipped with the point cloud sensor can be observed by the point cloud sensor, it is away from the point cloud sensor or two or three surfaces of the mobile platform equipped with the point cloud sensor It cannot be observed by the point cloud sensor. Therefore, the point cloud sensor based on the target object in this application can be fitted to the target object, that is, according to the visible area of the target object’s two-dimensional point cloud towards the mobile platform, the target Object fitting can improve the accuracy of fitting the target object.
附图说明Description of the drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative labor.
图1为本申请实施例提供的应用场景示意图;Figure 1 is a schematic diagram of an application scenario provided by an embodiment of the application;
图2为本申请实施例提供的目标物体的拟合方法的流程图一;2 is a first flowchart of a method for fitting a target object provided by an embodiment of the application;
图3为本申请实施例提供给的二维点云中朝向移动平台的可见区域的示意图;3 is a schematic diagram of the visible area facing the mobile platform in the two-dimensional point cloud provided by an embodiment of the application;
图4为本申请实施提供的目标物体的拟合可见边的示意图一;4 is a schematic diagram 1 of fitting visible edges of a target object provided by the implementation of this application;
图5为本申请实施提供的目标物体的拟合可见边的示意图二;5 is a second schematic diagram of fitting visible edges of the target object provided by the implementation of this application;
图6为本申请实施提供的目标物体的拟合可见边的示意图三;FIG. 6 is the third schematic diagram of fitting visible edges of the target object provided by the implementation of this application;
图7为本申请实施例提供的目标物体的拟合方法的流程图二;FIG. 7 is a second flowchart of a method for fitting a target object provided by an embodiment of the application;
图8为本申请实施例提供的获取可见边缘代价的示意图;FIG. 8 is a schematic diagram of obtaining visible edge cost provided by an embodiment of the application;
图9为本申请实施例提供的点云传感器的结构示意图;FIG. 9 is a schematic structural diagram of a point cloud sensor provided by an embodiment of the application;
图10为本申请实施例提供的移动平台的结构示意图。Fig. 10 is a schematic structural diagram of a mobile platform provided by an embodiment of the application.
具体实施方式detailed description
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of this application.
下面结合附图,对本申请实施例进行说明。The embodiments of the present application will be described below in conjunction with the drawings.
图1为本申请实施例提供的应用场景示意图,参见图1,移动平台11上搭载有点云传感器12。FIG. 1 is a schematic diagram of an application scenario provided by an embodiment of the application. Referring to FIG. 1, a cloud sensor 12 is mounted on a mobile platform 11.
其中,点云传感器12用于采集目标物体的点云数据,目标物体的点云数据用于对目标物体进行拟合。The point cloud sensor 12 is used to collect point cloud data of the target object, and the point cloud data of the target object is used to fit the target object.
首先采用具体的实施例对本申请的目标物体的拟合方法进行说明。图2为本申请实施例提供的目标物体的拟合方法的流程图一。参见图2,本实施例的方法包括:First, specific embodiments are used to describe the fitting method of the target object of the present application. FIG. 2 is a first flowchart of a method for fitting a target object provided by an embodiment of the application. Referring to Fig. 2, the method of this embodiment includes:
步骤S101、根据点云传感器采集的目标物体的点云,生成俯视图下的二维点云,其中,点云传感器用于搭载于移动平台。Step S101: Generate a two-dimensional point cloud in the top view according to the point cloud of the target object collected by the point cloud sensor, where the point cloud sensor is used to be mounted on the mobile platform.
具体地,点云传感器采集的目标物体的点云为三维点云,可将三维点云沿垂直方向投影到平面上得到二维点云,也就是根据目标物体的点云生成俯视图下的二维点云。例如,当目标物体为行驶在路面上的车辆时,可以将采集得到的车辆的三维点云沿垂直方向投影到路面的平面上,从而得到俯视图下的二维点云。Specifically, the point cloud of the target object collected by the point cloud sensor is a three-dimensional point cloud, and the three-dimensional point cloud can be projected on a plane in the vertical direction to obtain a two-dimensional point cloud, that is, the two-dimensional point cloud under the top view is generated according to the point cloud of the target object Point cloud. For example, when the target object is a vehicle driving on the road, the collected three-dimensional point cloud of the vehicle can be projected on the plane of the road along the vertical direction, so as to obtain the two-dimensional point cloud in the top view.
其中,本实施例中的点云传感器可以为TOF传感器,或者激光雷达。本实施例中的移动平台可为车辆,目标物体可为行驶在路上的其他车辆。在一个实施方式中,车辆上搭载有激光雷达,可以为一个或多个激光雷达,可以为旋转激光雷达或固态激光雷达,所述激光雷达用于获取所述车辆周围的三维点云信息。Among them, the point cloud sensor in this embodiment may be a TOF sensor or a lidar. The mobile platform in this embodiment may be a vehicle, and the target object may be other vehicles driving on the road. In one embodiment, the vehicle is equipped with a lidar, which may be one or more lidars, and may be a rotating lidar or a solid-state lidar. The lidar is used to obtain three-dimensional point cloud information around the vehicle.
步骤S102、确定二维点云中朝向移动平台的可见区域。Step S102: Determine the visible area facing the mobile platform in the two-dimensional point cloud.
具体地,通常由于目标物体靠近点云传感器或者靠近搭载点云传感器的移动平台的一个或两个面能够被点云传感器观测到,背离点云传感器或者背离搭载点云传感器的移动平台的两个或三个面无法被点云传感器观测到,因此,为了拟合的准确性,本实施例基于目标物体的点云传感器能够观测到的面对目标物体进行拟合,即确定目标物体的二维点云中朝向移动平台的可见区域,以根据二维点云中朝向移动平台的可见区域,对目标物体进行拟合。其中,目标物体的二维点云中朝向移动平台的可见区域即为目标物体的二维点云在点云传感器的感知范围和视野范围内的区域。Specifically, usually because the target object is close to the point cloud sensor or close to one or two surfaces of the mobile platform equipped with the point cloud sensor can be observed by the point cloud sensor, it is away from the point cloud sensor or away from the two points of the mobile platform equipped with the point cloud sensor. Or the three faces cannot be observed by the point cloud sensor. Therefore, for the accuracy of fitting, the present embodiment performs fitting based on the face of the target object that can be observed by the point cloud sensor of the target object, that is, to determine the two-dimensional The visible area facing the mobile platform in the point cloud is used to fit the target object according to the visible area facing the mobile platform in the two-dimensional point cloud. Among them, the visible area of the two-dimensional point cloud of the target object facing the mobile platform is the area of the two-dimensional point cloud of the target object in the sensing range and the field of view of the point cloud sensor.
图3为本申请实施例提供给的二维点云中朝向移动平台的可见区域的示意图。参见图3,图3中示意出了二维点云中的部分点。图3中所示的坐标原点O为点云传感器所在的位置,图3中的不规则图形21为目标物体的二维点云的轮廓或者凸壳,二维点云的轮廓或者凸壳中加粗部分211即为二维点云中朝向移动平台的可见区域,OA和OB为二维点云中朝向移动平台的可见区域对应的边界。FIG. 3 is a schematic diagram of a visible area facing a mobile platform in a two-dimensional point cloud provided by an embodiment of the application. Refer to Fig. 3, which illustrates some points in the two-dimensional point cloud. The coordinate origin O shown in Fig. 3 is the position of the point cloud sensor, and the irregular figure 21 in Fig. 3 is the contour or convex hull of the two-dimensional point cloud of the target object, and the contour or convex hull of the two-dimensional point cloud is added The thick part 211 is the visible area facing the mobile platform in the two-dimensional point cloud, and OA and OB are the boundaries corresponding to the visible area facing the mobile platform in the two-dimensional point cloud.
步骤S103、根据目标物体的二维点云中朝向移动平台的可见区域,确定目标物体的拟合特征,并根据拟合特征对目标物体进行拟合。Step S103: Determine the fitting feature of the target object according to the visible area facing the mobile platform in the two-dimensional point cloud of the target object, and fit the target object according to the fitting feature.
具体地,在确定了目标物体的二维点云中朝向移动平台的可见区域后, 即可根据该可见区域,确定目标物体的拟合特征,并根据拟合特征对目标物体进行拟合。Specifically, after determining the visible area facing the mobile platform in the two-dimensional point cloud of the target object, the fitting feature of the target object can be determined according to the visible area, and the target object can be fitted according to the fitting feature.
在一种方式中,根据拟合特征对目标物体进行拟合,包括:In one method, fitting the target object according to the fitting feature includes:
a1、根据目标物体的点云,获取目标物体的拟合高度;a1. Obtain the fitting height of the target object according to the point cloud of the target object;
具体地,获取目标物体的点云的拟合最大高度和拟合最小高度,根据该拟合最大高度和该拟合最小高度,获取目标物体的拟合高度。其中,该拟合最大高度和拟合最小高度的差值即为目标物体的拟合高度。Specifically, the fitted maximum height and the fitted minimum height of the point cloud of the target object are obtained, and the fitted height of the target object is obtained according to the fitted maximum height and the fitted minimum height. Among them, the difference between the maximum fitting height and the minimum fitting height is the fitting height of the target object.
其中,拟合最大高度可为目标物体的点云中高度最大的点的高度,也可为根据分层聚合得到的最大高度,比如根据具有一定厚度的点云中所有的点的高度拟合出来的,可以理解的是该一定厚度的点云包括目标物体的点云中高度最大的点。拟合最小高度可为目标物体的点云中高度最小的点的高度,也可为根据分层聚合得到的最小高度,比如根据具有一定厚度的点云中所有的点的高度拟合出来的,可以理解的是该一定厚度的点云包括目标物体的点云中高度最小的点。Among them, the maximum fitting height can be the height of the point with the highest height in the point cloud of the target object, or the maximum height obtained according to hierarchical aggregation, such as fitting according to the height of all points in the point cloud with a certain thickness Yes, it can be understood that the point cloud of a certain thickness includes the point with the largest height in the point cloud of the target object. The minimum fitting height can be the height of the point with the smallest height in the point cloud of the target object, or the minimum height obtained according to hierarchical aggregation, such as fitting according to the height of all points in a point cloud with a certain thickness. It can be understood that the point cloud of a certain thickness includes the point with the smallest height in the point cloud of the target object.
a2、根据目标物体的拟合特征和目标物体的拟合高度,对目标物体进行拟合。a2. Fit the target object according to the fitting feature of the target object and the fitting height of the target object.
具体地,目标物体的拟合特征可包括如下中的至少一项:目标物体的拟合角度、目标物体的拟合方向、目标物体拟合边界框、目标物体的拟合可见边。目标物体的拟合特征还可为其它的特征,本实施例中并不限定。Specifically, the fitting feature of the target object may include at least one of the following: fitting angle of the target object, fitting direction of the target object, fitting bounding box of the target object, and fitting visible edge of the target object. The fitting feature of the target object may also be other features, which is not limited in this embodiment.
在目标物体的拟合特征为目标物体的拟合角度的情况下,根据目标物体的拟合特征和目标物体的拟合高度,对目标物体进行拟合,包括:In the case where the fitting feature of the target object is the fitting angle of the target object, fitting the target object according to the fitting feature of the target object and the fitting height of the target object, including:
b1、根据目标物体的拟合角度,获取目标物体的拟合方向;b1. Obtain the fitting direction of the target object according to the fitting angle of the target object;
具体地,确定从点云传感器坐标系的坐标原点出发旋转拟合角度后所对应的方向为目标物体的拟合方向,点云传感器坐标系的坐标原点为点云传感器所在的位置。Specifically, it is determined that the direction corresponding to the rotation fitting angle from the coordinate origin of the point cloud sensor coordinate system is the fitting direction of the target object, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor.
对于拟合角度的获取:根据目标物体的二维点云中朝向移动平台的可见区域、目标物体的二维点云和预设角度范围,确定目标物体的拟合角度,具体可为:根据目标物体的二维点云中朝向移动平台的可见区域、目标物体的二维点云和预设角度范围,在预选角度范围内确定目标物体的拟合角度。其中,预设角度范围和预选角度范围可相同也可不相同;预设角度范围包括的 角度为第一预设角度与第二预设角度之间的角度,第二预设角度减去第一预设角度等于90°,预设角度范围包括第一预设角度和/或第二预设角度;预选角度范围包括的角度为第三预设角度与第四预设角度之间的角度,第四预设角度减去第三预设角度等于90°,预选角度范围包括第三预设角度和/或第四预设角度。预选角度范围时根据预设角度范围得到的。For the acquisition of the fitting angle: Determine the fitting angle of the target object according to the visible area facing the mobile platform in the two-dimensional point cloud of the target object, the two-dimensional point cloud of the target object and the preset angle range, which can be specifically: The visible area of the two-dimensional point cloud of the object facing the mobile platform, the two-dimensional point cloud of the target object and the preset angle range, and the fitting angle of the target object is determined within the preselected angle range. The preset angle range and the preselected angle range may be the same or different; the angle included in the preset angle range is the angle between the first preset angle and the second preset angle, and the second preset angle minus the first preset angle Set the angle equal to 90°, the preset angle range includes the first preset angle and/or the second preset angle; the preselected angle range includes the angle between the third preset angle and the fourth preset angle, and the fourth The preset angle minus the third preset angle is equal to 90°, and the preselected angle range includes the third preset angle and/or the fourth preset angle. The pre-selected angle range is obtained according to the preset angle range.
在一种方式中,目标物体的拟合角度为对应可见边缘代价最小的角度。具体地,每个角度均对应一个可见边缘代价。对于任意的一个角度:可见边缘代价为用于综合评价目标物体的二维点云在该角度对应的方向上的外包络矩形与该二维点云的贴合度以及该外包络矩形溢出目标区域的溢出度的参数;其中,该角度对应的方向为从点云传感器坐标系的坐标原点出发旋转该角度后所对应的方向。该目标区域为目标物体的二维点云中朝向移动平台的可见区域对应的第一边界和第二边界之间的区域,且该目标区域内包括目标物体的二维点云;进一步地,该第一边界和该第二边界能够包围该二维点云且该第一边界和该第二边界均与该二维点云的凸壳具有交点。继续参见图3,图3中的OA为目标物体的二维点云中朝向移动平台的可见区域对应的第一边界,OB为目标物体的二维点云中朝向移动平台的可见区域对应的第二边界。目标物体的二维点云在该角度对应的方向上的外包络矩形满足如下条件:该外包络矩形的两条边所在的方向与该角度对应的方向相同,该外包络矩形的另外两条边所在的方向与该角度对应的方向垂直。In one method, the fitting angle of the target object is the angle corresponding to the minimum cost of the visible edge. Specifically, each angle corresponds to a visible edge cost. For any angle: the visible edge cost is the degree of fit between the outer envelope rectangle of the two-dimensional point cloud of the target object in the direction corresponding to the angle and the two-dimensional point cloud, and the overflow of the outer envelope rectangle The parameter of the overflow degree of the target area; where the direction corresponding to the angle is the direction corresponding to the angle after rotating the angle from the coordinate origin of the point cloud sensor coordinate system. The target area is the area between the first boundary and the second boundary corresponding to the visible area facing the mobile platform in the two-dimensional point cloud of the target object, and the target area includes the two-dimensional point cloud of the target object; further, the The first boundary and the second boundary can surround the two-dimensional point cloud, and both the first boundary and the second boundary have intersection points with the convex hull of the two-dimensional point cloud. Continuing to refer to Figure 3, OA in Figure 3 is the first boundary corresponding to the visible area facing the mobile platform in the two-dimensional point cloud of the target object, and OB is the first boundary corresponding to the visible area facing the mobile platform in the two-dimensional point cloud of the target object. Two borders. The outer envelope rectangle of the two-dimensional point cloud of the target object in the direction corresponding to the angle satisfies the following conditions: the two sides of the outer envelope rectangle are in the same direction as the direction corresponding to the angle, and the other The direction of the two sides is perpendicular to the direction corresponding to the angle.
其中,角度对应的可见边缘代价越小,在从点云传感器坐标系的坐标原点出发旋转该角度后所对应的方向上得到的目标物体的二维点云的外包络矩形与目标物体的横截面越接近,因此,目标物体的拟合角度为对应可见边缘代价最小的角度。Among them, the lower the cost of the visible edge corresponding to the angle, the outer rectangle of the two-dimensional point cloud of the target object and the horizontal direction of the target object obtained in the direction corresponding to the angle from the coordinate origin of the point cloud sensor coordinate system. The closer the section is, therefore, the fitting angle of the target object is the angle with the least cost for the visible edge.
对于“根据目标物体的二维点云中朝向移动平台的可见区域、目标物体的二维点云和预设角度范围,确定目标物体的拟合角度”的具体实现,将在后续的实施例中进行详细阐述。The specific implementation of "determine the fitting angle of the target object according to the visible area of the target object’s two-dimensional point cloud facing the mobile platform, the two-dimensional point cloud of the target object and the preset angle range" will be described in subsequent embodiments. Explain in detail.
b2、在目标物体的拟合方向上,获取目标物体的拟合边界框。b2, in the fitting direction of the target object, obtain the fitting bounding box of the target object.
具体地,获取目标物体的二维点云在拟合方向上的外包络矩形,该外包络矩形即为目标物体的拟合边界框。同样地,目标物体的二维点云在拟合方向上的外包络矩形满足如下条件:该外包络矩形的两条边所在的方向与该目 标物体的拟合方向相同,该外包络矩形的另外两条边所在的方向与该目标物体的拟合方向垂直。Specifically, the outer envelope rectangle of the two-dimensional point cloud of the target object in the fitting direction is obtained, and the outer envelope rectangle is the fitting bounding box of the target object. Similarly, the outer envelope rectangle of the two-dimensional point cloud of the target object in the fitting direction satisfies the following conditions: the two sides of the outer envelope rectangle are in the same direction as the fitting direction of the target object, and the outer envelope The direction of the other two sides of the rectangle is perpendicular to the fitting direction of the target object.
在目标物体的拟合方向上,获取目标物体的拟合边界框的过程中,可先根据拟合方向,获取目标物体的拟合可见边,再以目标物体的拟合可见边为边得到目标物体的二维点云在拟合方向上的外包络矩形。In the fitting direction of the target object, in the process of obtaining the fitted bounding box of the target object, first obtain the fitted visible edge of the target object according to the fitting direction, and then use the fitted visible edge of the target object as the edge to obtain the target The outer envelope rectangle of the two-dimensional point cloud of the object in the fitting direction.
具体地,目标物体的拟合可见边可称为目标物体的L型特征或I型特征。可以理解的是,目标物体的拟合可见边满足以下条件:(1)目标物体的二维点云位于目标物体的拟合可见边的同一侧,且目标物体的二维点云的凸壳与目标物体的拟合可见边具有交点;(2)在目标物体的拟合可见边具有两条的情况下,两条拟合可见边中的一条边所在的方向与该目标物体的拟合方向相同,另一条边所在的方向与该目标物体的拟合方向垂直;在目标物体的拟合可见边具有一条的情况下,该拟合可见边所在的方向与该目标物体的拟合方向相同。Specifically, the fitted visible edge of the target object can be referred to as the L-shaped feature or the I-shaped feature of the target object. It is understandable that the fitted visible edge of the target object satisfies the following conditions: (1) The two-dimensional point cloud of the target object is located on the same side of the fitted visible edge of the target object, and the convex hull of the two-dimensional point cloud of the target object is The fitted visible edges of the target object have intersections; (2) In the case of two fitted visible edges of the target object, one of the two fitted visible edges is located in the same direction as the fitting direction of the target object , The direction of the other edge is perpendicular to the fitting direction of the target object; in the case that the fitted visible edge of the target object has one, the fitted visible edge is located in the same direction as the fitting direction of the target object.
图4为本申请实施提供的目标物体的拟合可见边的示意图一,图5为本申请实施提供的目标物体的拟合可见边的示意图二,图6为本申请实施提供的目标物体的拟合可见边的示意图三。4 is the first schematic diagram of the fitted visible edge of the target object provided by the implementation of this application, FIG. 5 is the second schematic diagram of the fitted visible edge of the target object provided by the implementation of this application, and FIG. 6 is the simulated view of the target object provided by the implementation of this application Schematic three of the visible edges.
参见图4,41和42为目标物体的拟合可见边,此时的拟合可见边为目标物体的L型特征。参见图5,51为目标物体的拟合可见边,此时的拟合可见边为目标物体的I型特征。参见图6,61为目标物体的拟合可见边,此时的拟合可见边为目标物体的I型特征。Referring to Fig. 4, 41 and 42 are the fitted visible edges of the target object, and the fitted visible edges at this time are the L-shaped features of the target object. Referring to Figure 5, 51 is the fitted visible edge of the target object, and the fitted visible edge at this time is the I-type feature of the target object. Refer to Figure 6, 61 is the fitted visible edge of the target object, and the fitted visible edge at this time is the I-type feature of the target object.
b3、根据目标物体的拟合边界框和目标物体拟合高度,对目标物体进行拟合。b3. Fit the target object according to the fitting bounding box of the target object and the fitting height of the target object.
具体地,获取以横截面为目标物体的拟合边界框,高度为目标物体的拟合高度的立方体,该立方体即为拟合后的目标物体。Specifically, obtaining a fitting bounding box with the cross section as the target object, and a cube whose height is the fitting height of the target object, and the cube is the fitted target object.
在目标物体的拟合特征为目标物体的拟合方向的情况下,根据目标物体的二维点云中朝向移动平台的可见区域,获取目标物体的拟合特征,包括:In the case that the fitting feature of the target object is the fitting direction of the target object, the fitting feature of the target object is acquired according to the visible area of the two-dimensional point cloud of the target object toward the mobile platform, including:
c1、根据目标物体的二维点云中朝向移动平台的可见区域,确定根据目标物体的拟合角度。c1. Determine the fitting angle according to the target object according to the visible area of the two-dimensional point cloud of the target object towards the mobile platform.
c2、根据目标物体的拟合角度,确定目标物体的拟合方向。c2. Determine the fitting direction of the target object according to the fitting angle of the target object.
具体地,c1~c2的具体实现参照b1中的阐述,本实施例中不在赘述Specifically, for the specific implementation of c1 to c2, refer to the description in b1, which will not be repeated in this embodiment
相应地,在该种情况下,根据目标物体的拟合特征和目标物体的拟合高度,对目标物体进行拟合,包括:Correspondingly, in this case, fitting the target object according to the fitting feature of the target object and the fitting height of the target object, including:
d1、根据目标物体的拟合方向,获取目标物体的拟合边界框;d1. Obtain the fitting bounding box of the target object according to the fitting direction of the target object;
具体地,该步骤的具体实现参照b2中的阐述,本实施例中不在赘述。Specifically, for the specific implementation of this step, refer to the description in b2, which is not repeated in this embodiment.
d2、根据目标物体的拟合边界框和目标物体拟合高度,对目标物体进行拟合。d2. Fit the target object according to the fitting bounding box of the target object and the fitting height of the target object.
具体地,该步骤的具体实现参照b3中的阐述,本实施例中不在赘述。Specifically, for the specific implementation of this step, refer to the description in b3, which will not be repeated in this embodiment.
在目标物体的拟合特征为目标物体的拟合边界框的情况下,根据目标物体的二维点云中朝向移动平台的可见区域,确定目标物体的拟合特征,包括:In the case where the fitting feature of the target object is the fitting bounding box of the target object, the fitting feature of the target object is determined according to the visible area of the two-dimensional point cloud of the target object toward the mobile platform, including:
e1、根据目标物体的二维点云中朝向移动平台的可见区域,确定根据目标物体的拟合角度。e1, according to the visible area of the two-dimensional point cloud of the target object facing the mobile platform, determine the fitting angle according to the target object.
e2、根据目标物体的拟合角度,确定根据目标物体的拟合方向;e2, according to the fitting angle of the target object, determine the fitting direction according to the target object;
e3、在目标物体的拟合方向上,获取目标物体的拟合边界框。e3. Obtain the fitting bounding box of the target object in the fitting direction of the target object.
相应地,在该情况下,根据目标物体的拟合特征和目标物体的拟合高度,对目标物体进行拟合,包括:根据目标物体的拟合边界框和目标物体的拟合高度,对目标物体进行拟合。Correspondingly, in this case, fitting the target object according to the fitting feature of the target object and the fitting height of the target object, including: according to the fitting bounding box of the target object and the fitting height of the target object, The object is fitted.
在目标物体的拟合特征为目标物体的拟合可见边的情况下,根据目标物体的二维点云中朝向移动平台的可见区域,获取目标物体的拟合特征,包括:In the case that the fitting feature of the target object is the fitting visible edge of the target object, the fitting feature of the target object is obtained according to the visible area of the two-dimensional point cloud of the target object toward the mobile platform, including:
f1、根据目标物体的二维点云中朝向移动平台的可见区域,确定根据目标物体的拟合角度。f1. Determine the fitting angle according to the target object according to the visible area in the two-dimensional point cloud of the target object towards the mobile platform.
f2、根据目标物体的拟合角度,确定根据目标物体的拟合方向;f2, according to the fitting angle of the target object, determine the fitting direction according to the target object;
f3、根据目标物体的拟合方向,获取目标物体的拟合可见边。f3. Obtain the fitted visible edge of the target object according to the fitting direction of the target object.
相应地,在该种情况下,根据目标物体的拟合特征和目标物体的拟合高度,对目标物体进行拟合,包括:Correspondingly, in this case, fitting the target object according to the fitting feature of the target object and the fitting height of the target object, including:
g1、根据目标物体的拟合可见边,获取目标物体的拟合边界框;g1. Obtain the fitted bounding box of the target object according to the fitted visible edge of the target object;
g2、根据目标物体的拟合边界框和目标物体的拟合高度,对目标物体进行拟合。g2. Fit the target object according to the fitting bounding box of the target object and the fitting height of the target object.
由于目标物体靠近点云传感器或者靠近搭载点云传感器的移动平台的一个或两个面能够被点云传感器观测到,背离点云传感器或者背离搭载点云传感器的移动平台的两个或三个面无法被点云传感器观测到,因此,本实施例 中基于目标物体的点云传感器能够观测到的面对目标物体进行拟合,即根据目标物体的二维点云中朝向移动平台的可见区域,对目标物体进行拟合,可以提高对目标物体拟合的准确性。Since the target object is close to the point cloud sensor or one or two surfaces of the mobile platform equipped with the point cloud sensor can be observed by the point cloud sensor, it is away from the point cloud sensor or two or three surfaces of the mobile platform equipped with the point cloud sensor It cannot be observed by the point cloud sensor. Therefore, in this embodiment, the point cloud sensor based on the target object can perform fitting to the target object, that is, according to the visible area facing the mobile platform in the two-dimensional point cloud of the target object, Fitting the target object can improve the accuracy of fitting the target object.
下面采用具体的实施例对上一实施例中的“根据目标物体的二维点云中朝向移动平台的可见区域、该二维点云和预设角度范围,确定目标物体的拟合角度”的一种可实现的方式进行详细说明。The following uses a specific embodiment to compare the previous embodiment of "determining the fitting angle of the target object according to the visible area facing the mobile platform in the two-dimensional point cloud of the target object, the two-dimensional point cloud and the preset angle range" An achievable way is described in detail.
图7为本申请实施例提供的目标物体的拟合方法的流程图二,参见图7,本实施例的方法包括:FIG. 7 is the second flowchart of the target object fitting method provided by the embodiment of the application. Referring to FIG. 7, the method of this embodiment includes:
步骤S201、从预设角度范围内选取至少一个参考角度。Step S201: Select at least one reference angle from a preset angle range.
具体地,本实施例中的预设角度范围的含义与上一实施例中的预设角度范围的含义相同。Specifically, the meaning of the preset angle range in this embodiment is the same as the meaning of the preset angle range in the previous embodiment.
其中,至少一个参考角度是指一个或多个参考角度。在参考角度为一个时,参考角度可为第一预设参考范围内的任一角度。示例性地,在预设角度范围为[0°,90°]时,一个参考角度可为45°。Wherein, at least one reference angle refers to one or more reference angles. When the reference angle is one, the reference angle can be any angle within the first preset reference range. Exemplarily, when the preset angle range is [0°, 90°], one reference angle may be 45°.
在参考角度为多个时,可在预设角度范围内每间隔相同的角度选取一个参考角度,得到多个参考角度。示例性地,在预设角度范围为[0°,90°]时,多个参考角度可包括:0°、10°、20°、30°、40°、50°、60°、70°、80°、90°,在预设角度范围为[0°,90°)时,多个参考角度可包括:0°、10°、20°、30°、40°、50°、60°、70°、80°。When there are multiple reference angles, one reference angle can be selected at the same interval within the preset angle range to obtain multiple reference angles. Exemplarily, when the preset angle range is [0°, 90°], the multiple reference angles may include: 0°, 10°, 20°, 30°, 40°, 50°, 60°, 70°, 80°, 90°, when the preset angle range is [0°,90°), multiple reference angles can include: 0°, 10°, 20°, 30°, 40°, 50°, 60°, 70 °, 80°.
步骤S202、根据至少一个参考角度、目标物体的二维点云中朝向移动平台的可见区域和该二维点云,确定对应的可见边缘代价最小的拟合角度。Step S202: According to at least one reference angle, the visible area facing the mobile platform in the two-dimensional point cloud of the target object, and the two-dimensional point cloud, determine the corresponding fitting angle with the least visible edge cost.
具体地,下面以多个参考角度为例来说明“根据多个参考角度和该可见区域,确定对应的可见边缘代价最小的拟合角度”的方法。Specifically, the following takes multiple reference angles as an example to illustrate the method of “determining the corresponding fitting angle with the least visible edge cost based on the multiple reference angles and the visible area”.
在第一种实现方式中:“根据多个参考角度和该可见区域,确定对应的可见边缘代价最小的拟合角度”可通过如下的步骤h1~h2实现。In the first implementation manner: "determining the corresponding fitting angle with the smallest visible edge cost based on multiple reference angles and the visible area" can be implemented through the following steps h1 to h2.
h1、对于多个参考角度中的任意一个第一参考角度,根据目标物体的二维点云中朝向移动平台的可见区域,在第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度,第一邻域范围内包括第一参考角度。h1. For any first reference angle among multiple reference angles, according to the visible area facing the mobile platform in the two-dimensional point cloud of the target object, determine the smallest visible edge cost within the first neighborhood of the first reference angle The first preselected angle includes the first reference angle in the first neighborhood.
具体地,每个参考角度具有一个邻域范围,因此具有多个邻域范围,多个邻域范围的并集为上一实施例中的预选角度范围。Specifically, each reference angle has a neighborhood range, and therefore has multiple neighborhood ranges, and the union of the multiple neighborhood ranges is the preselected angle range in the previous embodiment.
在预设角度范围为[P 1°,P 2°)或[P 1°,P 2°]或(P 1°,P 2°],且在预设角度范围内每间隔α°选取一个参考角度的情况下,在一种方式中,若第一参考角度为N°,第一邻域范围为(N°-α°/2,N°+α°/2]或[N°-α°/2,N°+α°/2),此时,预设角度范围和预选角度范围不相同;在另一种方式中,若第一参考角度为N°,在N不等于P 1也不等于P 2时,第一邻域范围为(N°-α°/2,N°+α°/2]或[N°-α°/2,N°+α°/2),在N等于P 1时,第一邻域范围为[N°,N°+α°/2]或(N°,N°+α°/2]或[N°,N°+α°/2)或(N°,N°+α°/2),在N等于P 2时,第一邻域范围为(N°-α°/2,N°)或(N°-α°/2,N°]或[N°-α°/2,N°)或[N°-α°/2,N°],此时,预设角度范围和预选角度范围可能相同 The preset angle range is [P 1 °,P 2 °) or [P 1 °,P 2 °] or (P 1 °, P 2 °], and a reference is selected at intervals of α° within the preset angle range In the case of angle, in one way, if the first reference angle is N°, the first neighborhood range is (N°-α°/2, N°+α°/2] or [N°-α° /2, N°+α°/2), at this time, the preset angle range and the preselected angle range are not the same; in another way, if the first reference angle is N°, if N is not equal to P 1 and neither When equal to P 2 , the first neighborhood range is (N°-α°/2, N°+α°/2] or [N°-α°/2, N°+α°/2), where N is equal to At P 1 , the first neighborhood range is [N°, N°+α°/2] or (N°, N°+α°/2] or [N°, N°+α°/2) or ( N°, N°+α°/2), when N is equal to P 2 , the first neighborhood range is (N°-α°/2, N°) or (N°-α°/2, N°] Or [N°-α°/2, N°) or [N°-α°/2, N°], at this time, the preset angle range and the preselected angle range may be the same
可采用梯度下降法,在第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度,具体为:The gradient descent method can be used to determine the first preselected angle with the least visible edge cost within the first neighborhood of the first reference angle, specifically:
j1、根据该可见区域和目标物体的二维点云,获取第一参考角度对应的第一可见边缘代价。j1. Obtain the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud of the target object.
具体地,获取第一可见边缘代价的方法具体如下:根据二维点云在第一方向上的第一外包络矩形、该可见区域和该可见区域对应的第一边界和第二边界,获取第一参考角度对应的第一可见边缘代价;其中,第一方向为从点云传感器坐标系的坐标原点出发旋转第一参考角度后所对应的方向。该可见区域对应的第一边界和第二边界同上一实施例中的阐述。Specifically, the method for obtaining the first visible edge cost is as follows: According to the first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first boundary and the second boundary corresponding to the visible area, obtain The first visible edge cost corresponding to the first reference angle; where the first direction is the direction corresponding to the rotation of the first reference angle from the coordinate origin of the point cloud sensor coordinate system. The first boundary and the second boundary corresponding to the visible area are the same as those described in the previous embodiment.
图8为本申请实施例提供的获取可见边缘代价的示意图,下面结合图8对“根据二维点云在第一方向上的第一外包络矩形、该可见区域和该可见区域对应的第一边界和第二边界,获取第一参考角度对应的第一可见边缘代价”的过程进行说明。具体地,“根据二维点云在第一方向上的第一外包络矩形、该可见区域和该可见区域对应的第一边界和第二边界,获取第一参考角度对应的第一可见边缘代价”,包括:FIG. 8 is a schematic diagram of obtaining the visible edge cost provided by an embodiment of the application. The following is a description of "according to the first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first visible area corresponding to the visible area in conjunction with FIG. A boundary and a second boundary, the process of obtaining the first visible edge cost corresponding to the first reference angle is described. Specifically, "According to the first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first and second boundaries corresponding to the visible area, obtain the first visible edge corresponding to the first reference angle Cost", including:
j11、获取由该可见区域、第一边界和第二边界限定的第一区域的第一面积。j11. Obtain the first area of the first area defined by the visible area, the first boundary, and the second boundary.
具体地,图8中的OA为第一边界,OB为第二边界,第一区域即为图8中的区域81。Specifically, OA in FIG. 8 is the first boundary, OB is the second boundary, and the first area is the area 81 in FIG. 8.
j12、获取由该第一外包络矩形朝向移动平台的可见边、第一边界和第二边界限定的第二区域的第二面积。j12. Obtain the second area of the second area defined by the visible side of the first outer envelope rectangle facing the mobile platform, the first boundary, and the second boundary.
具体地,第一方向为图8中箭头所指示的方向,第二区域为图8中的区域82。Specifically, the first direction is the direction indicated by the arrow in FIG. 8, and the second area is the area 82 in FIG. 8.
j13、获取第一外包络矩形位于目标区域外的边、该第一边界和该第二边界限定的第三区域的第三面积,该目标区域为该第一边界和该第二边界之间的区域且该目标区域内包括目标物体的二维点云。j13. Obtain the side of the first outer envelope rectangle located outside the target area, the third area of the third area defined by the first boundary and the second boundary, and the target area is between the first boundary and the second boundary And the target area includes a two-dimensional point cloud of the target object.
具体地,第三区域为图8中的区域83,也就是实线填充的区域。Specifically, the third area is the area 83 in FIG. 8, that is, the area filled with solid lines.
j14、根据第一面积、第二面积和第三面积,确定第一参考角度对应的可见边缘代价。j14. Determine the visible edge cost corresponding to the first reference angle according to the first area, the second area, and the third area.
具体地,根据第一面积、第二面积和第三面积,确定第一参考角度对应的可见边缘代价,包括:Specifically, determining the visible edge cost corresponding to the first reference angle according to the first area, the second area, and the third area includes:
j141、根据第一面积、第二面积和第一预设权重,获取第一预选可见边缘代价。j141. Obtain the first preselected visible edge cost according to the first area, the second area, and the first preset weight.
具体地,第一预选可见边缘代价用于表征第一外包络矩形与二维点云的凸壳的贴合度。其中,第一预选可见边缘代价等于第一面积与第二面积的差值乘以第一预设权重。第一面积与第二面积的差值为图中虚线填充的区域的面积。Specifically, the first preselected visible edge cost is used to characterize the degree of fit between the first outer envelope rectangle and the convex hull of the two-dimensional point cloud. Wherein, the first preselected visible edge cost is equal to the difference between the first area and the second area multiplied by the first preset weight. The difference between the first area and the second area is the area of the area filled by the dotted line in the figure.
第一预选可见边缘代价的计算过程可表示为:cost1=α×(S 1-S 2),其中,cost1为第一预选可见边缘代价,α为第一预设权重,S 1为第一面积,S 2为第二面积。α可为0.5。 The calculation process of the first preselected visible edge cost can be expressed as: cost1=α×(S 1 -S 2 ), where cost1 is the first preselected visible edge cost, α is the first preset weight, and S 1 is the first area , S 2 is the second area. α can be 0.5.
j142、根据第三面积和第二预设权重,获取第二预选可见边缘代价。j142. Obtain the second preselected visible edge cost according to the third area and the second preset weight.
具体地,第二预选可见边缘代价用于表征第一外包络矩形溢出目标区域的溢出度。其中,第二预选可见边缘代价等于第三面积乘以第二预设权重。Specifically, the second preselected visible edge cost is used to characterize the overflow degree of the first outer envelope rectangle overflowing the target area. Among them, the second preselected visible edge cost is equal to the third area multiplied by the second preset weight.
第二预选可见边缘代价的计算过程可表示为:cost2=β×S 3,其中,cost2为第二预选可见边缘代价,β为第二预设权重,S 3为第三面积,β可为0.5,α+β=1。 The calculation process of the second preselected visible edge cost can be expressed as: cost2=β×S 3 , where cost2 is the second preselected visible edge cost, β is the second preset weight, S 3 is the third area, and β can be 0.5 , Α+β=1.
j143、根据第一预选可见边缘代价和第二预选可见边缘代价,确定第一参考角度对应的第一可见边缘代价。j143. Determine the first visible edge cost corresponding to the first reference angle according to the first preselected visible edge cost and the second preselected visible edge cost.
具体地,第一预选可见边缘代价和第二预选可见边缘代价之和为第一参考角度对应的第一可见边缘代价。可表示为:cost=cost1+cost2,其中,cost为第一可见边缘代价。Specifically, the sum of the first preselected visible edge cost and the second preselected visible edge cost is the first visible edge cost corresponding to the first reference angle. It can be expressed as: cost=cost1+cost2, where cost is the first visible edge cost.
因此,可见边缘代价是综合目标物体的二维点云在某一角度对应的方向上的外包络矩形与该二维点云的贴合度以及该外包络矩形溢出目标区域的溢出度的参数。Therefore, the visible edge cost is a combination of the fit between the outer envelope rectangle of the two-dimensional point cloud of the target object in the direction corresponding to a certain angle and the two-dimensional point cloud and the overflow degree of the outer envelope rectangle overflowing the target area. parameter.
j2、更新第一参考角度至第一邻域范围内的第一角度,并根据该可见区域和目标物体的二维点云,获取该第一角度对应的第二可见边缘代价。j2. Update the first reference angle to the first angle within the first neighborhood, and obtain the second visible edge cost corresponding to the first angle according to the visible area and the two-dimensional point cloud of the target object.
具体地,第一角度可为大于第一参考角度的角度,也可为小于第一参考角度的角度。Specifically, the first angle may be an angle greater than the first reference angle, or may be an angle smaller than the first reference angle.
此处,获取该第一角度对应的第二可见边缘代价的方法与获取第一参考角度对应的第一可见边缘代价的方法相同,此处不再赘述。Here, the method of obtaining the second visible edge cost corresponding to the first angle is the same as the method of obtaining the first visible edge cost corresponding to the first reference angle, and will not be repeated here.
j3、根据该第二可见边缘代价和该第一可见边缘代价之间的关系,更新该第一角度至第一邻域范围内的第二角度。j3. According to the relationship between the second visible edge cost and the first visible edge cost, update the first angle to the second angle in the first neighborhood.
具体地,角度更新规则如下:Specifically, the angle update rules are as follows:
若第一角度大于第一参考角度,且第一可见边缘代价大于第二可见边缘代价,则更新该第一角度至第一邻域范围内比第一角度小的第二角度。If the first angle is greater than the first reference angle, and the first visible edge cost is greater than the second visible edge cost, update the first angle to a second angle smaller than the first angle in the first neighborhood.
若第一角度大于第一参考角度,且第一可见边缘代价小于第二可见边缘代价,则更新该第一角度至第一邻域范围内比第一角度大的第二角度。If the first angle is greater than the first reference angle, and the first visible edge cost is less than the second visible edge cost, update the first angle to a second angle larger than the first angle in the first neighborhood.
若第一角度小于第一参考角度,且第一可见边缘代价大于第二可见边缘代价,则更新该第一角度至第一邻域范围内比第一角度大的第二角度。If the first angle is smaller than the first reference angle, and the first visible edge cost is greater than the second visible edge cost, update the first angle to a second angle larger than the first angle in the first neighborhood.
若第一角度小于第一参考角度,且第一可见边缘代价小于第二可见边缘代价,则更新该第一角度至第一邻域范围内比第一角度小的第二角度。If the first angle is smaller than the first reference angle, and the first visible edge cost is smaller than the second visible edge cost, update the first angle to a second angle smaller than the first angle in the first neighborhood.
更新该第一角度至第一邻域范围内的第二角度后,重复执行获取第一邻域范围内的角度对应的可见边缘代价、根据相邻两次获取到的可见边缘代价的关系在第一邻域范围内更新角度的操作,直至获取到可见边缘代价最小的第一预选角度。After updating the first angle to the second angle in the range of the first neighborhood, repeatedly execute the acquisition of the visible edge cost corresponding to the angle in the first neighborhood, and the relationship between the visible edge costs obtained twice adjacently is in the first The operation of updating the angle within a neighborhood until the first preselected angle with the least visible edge cost is obtained.
如上的j1~j3为采用梯度下降法在第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度的具体实现。The above j1 to j3 are specific implementations of using the gradient descent method to determine the first preselected angle with the smallest visible edge cost within the first neighborhood of the first reference angle.
对于多个参考角度中的其它参考角度,均按照获取第一参考角度对应的第一预选角度的方法,获取其它参考角度对应的预选角度,最终得到多个预选角度。For other reference angles among the multiple reference angles, the preselected angles corresponding to the other reference angles are obtained according to the method of obtaining the first preselected angle corresponding to the first reference angle, and finally multiple preselected angles are obtained.
其中,在采用梯度下降法获取目标物体的拟合角度时,选取多个参考角 度,可以防止限于局部最小值,提高了目标物体拟合的准确度。Among them, when the gradient descent method is used to obtain the fitting angle of the target object, multiple reference angles are selected, which can prevent being limited to the local minimum and improve the accuracy of the fitting of the target object.
h2、确定各预选角度中对应可见边缘代价最小的预选角度为目标物体的拟合角度。h2. Determine the preselected angle corresponding to the smallest visible edge cost among the preselected angles as the fitting angle of the target object.
根据至少一个参考角度、该可见区域和目标物体的二维点云,确定对应的可见边缘代价最小的目标物体的拟合角度的第一种实现方式,使得获取到的目标物体的拟合角度具有较高的准确度。According to at least one reference angle, the visible area and the two-dimensional point cloud of the target object, the first implementation method of determining the fitting angle of the corresponding target object with the least visible edge cost, so that the obtained fitting angle of the target object has Higher accuracy.
在第二种实现方式中:在参考角度的数目为多个时,根据至少一个参考角度、该可见区域和目标物体的二维点云,确定对应的可见边缘代价最小的目标物体的拟合角度,包括:In the second implementation manner: when the number of reference angles is multiple, the fitting angle of the target object with the least visible edge cost is determined according to at least one reference angle, the visible area and the two-dimensional point cloud of the target object ,include:
m1、根据可见区域和目标物体的二维点云,在多个参考角度中确定对应的可见边缘代价最小的目标参考角度。m1, according to the visible area and the two-dimensional point cloud of the target object, determine the corresponding target reference angle with the least visible edge cost among multiple reference angles.
具体地,获取每个参考角度对应的可见边缘代价,将对应的可见边缘代价最小的参考角度确定为目标参考角度。其中,获取每个参考角度对应的可见边缘代价参照获取第一参考角度对应的可见边缘代价的获取方法。Specifically, the visible edge cost corresponding to each reference angle is obtained, and the reference angle with the smallest corresponding visible edge cost is determined as the target reference angle. Wherein, obtaining the visible edge cost corresponding to each reference angle refers to the method for obtaining the visible edge cost corresponding to the first reference angle.
m2、根据该可见区域和目标物体的二维点云,在目标参考角度的第二邻域范围内确定对应的可见边缘代价最小的目标物体的拟合角度,第二邻域范围包括目标参考角度。m2, according to the visible area and the two-dimensional point cloud of the target object, determine the fitting angle of the target object with the least visible edge cost in the second neighborhood of the target reference angle, and the second neighborhood range includes the target reference angle .
具体地,在目标参考角度为N°时,第二邻域范围为(S 1°,S 2°),其中,S 1°为与目标参考角度的差值的绝对值最小且小于目标参考角度的参考角度,S 2°为与目标参考角度的差值的绝对值最小且大于目标参考角度的参考角度。 Specifically, when the target reference angle is N°, the second neighborhood range is (S 1 °, S 2 °), where S 1 ° is the absolute value of the difference with the target reference angle being the smallest and smaller than the target reference angle S 2 ° is the reference angle with the smallest absolute value of the difference from the target reference angle and greater than the target reference angle.
在一种方式中,可采用梯度下降法,根据该可见区域和目标物体的二维点云,在目标参考角度的第二邻域范围内确定对应的可见边缘代价最小的目标物体的拟合角度。该方式的具体实现参照在第一参考角度的第一邻域范围内采用梯度下降法中确定第一预选角度的方法,此处不再赘述。In one method, the gradient descent method can be used to determine the fitting angle of the target object with the least visible edge cost within the second neighborhood of the target reference angle based on the visible area and the two-dimensional point cloud of the target object . The specific implementation of this manner refers to the method of determining the first preselected angle in the gradient descent method within the first neighborhood of the first reference angle, which will not be repeated here.
在另一种方式中,从目标参考角度的第二邻域范围内获取多个子参考角度,根据该可见区域和目标物体的二维点云,确定各子参考角度对应的可见边缘代价中最小的子参考角度为目标物体的拟合角度。In another way, multiple sub-reference angles are obtained from the second neighborhood of the target reference angle, and the smallest visible edge cost corresponding to each sub-reference angle is determined according to the visible area and the two-dimensional point cloud of the target object. The sub-reference angle is the fitting angle of the target object.
具体地,在该种方式中,从目标参考角度的第二邻域范围内获取多个子参考角度,获取每个子参考角度对应的可见边缘代价,将对应的可见边缘代价最小的子参考角度确定为目标物体的拟合角度。其中,获取每个子参考角 度对应的可见边缘代价参照获取第一参考角度对应的可见边缘代价的获取方法,此处不再赘述。Specifically, in this manner, multiple sub-reference angles are obtained from within the second neighborhood of the target reference angle, the visible edge cost corresponding to each sub-reference angle is obtained, and the corresponding sub-reference angle with the smallest visible edge cost is determined as The fitting angle of the target object. Wherein, obtaining the visible edge cost corresponding to each sub-reference angle refers to the obtaining method of obtaining the visible edge cost corresponding to the first reference angle, which will not be repeated here.
具体地,可在目标参考角度的第二邻域范围内每间隔相同的角度获取一个子参考角度。Specifically, a sub-reference angle may be obtained at every interval of the same angle within the second neighborhood range of the target reference angle.
根据至少一个参考角度、该可见区域和目标物体的二维点云,确定对应的可见边缘代价最小的目标物体的拟合角度的第二种实现方式,使得获取目标物体的拟合角度的效率比较高。According to at least one reference angle, the visible area and the two-dimensional point cloud of the target object, the second implementation method of determining the fitting angle of the target object with the smallest visible edge cost, so that the efficiency of obtaining the fitting angle of the target object is compared high.
本实施例提供了获取目标物体的拟合角度的具体方法,本实施例的方法可进一步提高获取目标物体的拟合角度的准确度。This embodiment provides a specific method for obtaining the fitting angle of the target object, and the method of this embodiment can further improve the accuracy of obtaining the fitting angle of the target object.
下面采用具体的实施例对实现上述目标物体的拟合方法的装置进行说明。In the following, specific embodiments are used to describe the device for implementing the above-mentioned fitting method of the target object.
图9为本申请实施例提供的点云传感器的结构示意图,本实施例提供的点云传感器用于搭载在移动平台上,该点云传感器包括:采集器91和处理器92。FIG. 9 is a schematic structural diagram of a point cloud sensor provided by an embodiment of the application. The point cloud sensor provided in this embodiment is used to be mounted on a mobile platform. The point cloud sensor includes a collector 91 and a processor 92.
采集器91,用于采集所述目标物体的点云;The collector 91 is used to collect the point cloud of the target object;
处理器92,与所述采集器通信连接,用于执行如下操作:根据所述采集器采集的目标物体的点云,生成俯视图下的二维点云;确定所述二维点云中朝向所述移动平台的可见区域;根据所述可见区域,确定所述目标物体的拟合特征,并根据所述拟合特征对所述目标物体进行拟合。The processor 92 is communicatively connected to the collector and is configured to perform the following operations: generate a two-dimensional point cloud in the top view according to the point cloud of the target object collected by the collector; and determine the direction in the two-dimensional point cloud The visible area of the mobile platform; according to the visible area, the fitting feature of the target object is determined, and the target object is fitted according to the fitting feature.
可选地,所述处理器92在用于执行根据所述可见区域,确定所述目标物体的拟合特征的操作时,具体用于:根据所述可见区域和所述二维点云,确定所述拟合特征。Optionally, when the processor 92 is configured to perform the operation of determining the fitting feature of the target object according to the visible area, it is specifically configured to: determine according to the visible area and the two-dimensional point cloud The fitting feature.
可选地,所述拟合特征为所述目标物体的拟合角度,所述处理器92在用于执行根据所述可见区域和所述二维点云,确定所述拟合特征的操作时,具体用于:根据所述可见区域、所述二维点云和预设角度范围,确定所述拟合角度。Optionally, the fitting feature is the fitting angle of the target object, and the processor 92 is configured to perform the operation of determining the fitting feature based on the visible area and the two-dimensional point cloud , Specifically used for: determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range.
可选地,所述处理器92在用于执行根据所述可见区域、所述二维点云和预设角度范围,确定所述拟合角度的操作时,具体用于:根据所述可见区域、所述二维点云和预设角度范围,确定对应的可见边缘代价最小的所述拟合角度。Optionally, when the processor 92 is configured to perform the operation of determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range, it is specifically configured to: , The two-dimensional point cloud and the preset angle range determine the corresponding fitting angle with the smallest visible edge cost.
可选地,所述处理器92在用于执行根据所述可见区域、所述二维点云和 预设角度范围,确定对应的可见边缘代价最小的所述拟合角度的操作时,具体用于:从所述预设角度范围内选取至少一个参考角度;根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度。Optionally, when the processor 92 is configured to perform the operation of determining the corresponding fitting angle with the least visible edge cost according to the visible area, the two-dimensional point cloud, and a preset angle range, specifically use In: selecting at least one reference angle from the preset angle range; and determining the corresponding fitting angle with the least visible edge cost according to the at least one reference angle, the visible area, and the two-dimensional point cloud.
可选地,在参考角度的数目为多个时,所述处理器92在用于执行根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度的操作时,具体用于:对于多个参考角度中的任意一个第一参考角度,根据所述可见区域和所述二维点云,在所述第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度,所述第一邻域范围包括所述第一参考角度;确定各预选角度中对应的可见边缘代价最小的预选角度为所述拟合角度。Optionally, when the number of reference angles is multiple, the processor 92 is configured to determine that the corresponding visible edge cost is the smallest according to the at least one reference angle, the visible area, and the two-dimensional point cloud. During the operation of the fitting angle, it is specifically used to: for any one of the multiple reference angles, according to the visible area and the two-dimensional point cloud, in the first reference angle Determine a first preselected angle with the smallest visible edge cost within a neighborhood range, where the first neighborhood range includes the first reference angle; determine the corresponding preselected angle with the least visible edge cost among the preselected angles as the fitting angle.
可选地,所述处理器92在用于执行根据所述可见区域和所述二维点云,在所述第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度的操作时,具体用于:根据所述可见区域和所述二维点云,获取所述第一参考角度对应的第一可见边缘代价,并更新所述第一参考角度至所述第一邻域范围内的第一角度,根据所述可见区域和所述二维点云,获取所述第一角度对应的第二可见边缘代价;根据所述第二可见边缘代价和所述第一可见边缘代价之间的关系,更新所述第一角度至所述第一邻域范围内的第二角度;重复执行获取所述第一邻域范围内的角度对应的可见边缘代价、根据相邻两次获取到的可见边缘代价的关系在所述第一邻域范围内更新角度的操作,直至获取到可见边缘代价最小的所述第一预选角度。Optionally, the processor 92 is configured to perform determining a first preselected angle with the least visible edge cost within a first neighborhood range of the first reference angle based on the visible area and the two-dimensional point cloud During the operation, it is specifically used to obtain the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud, and update the first reference angle to the first neighbor According to the first angle within the domain, the second visible edge cost corresponding to the first angle is obtained according to the visible area and the two-dimensional point cloud; according to the second visible edge cost and the first visible edge The relationship between the costs, update the first angle to the second angle in the first neighborhood; repeat the execution of obtaining the visible edge costs corresponding to the angles in the first neighborhood, according to two adjacent The obtained relationship of the visible edge cost is an operation of updating the angle within the first neighborhood range until the first preselected angle with the smallest visible edge cost is obtained.
可选地,在参考角度的数目为多个时,所述处理器92在用于执行根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度的操作时,具体用于:根据所述可见区域和所述二维点云,在多个参考角度中确定对应的可见边缘代价最小的目标参考角度;根据所述可见区域和所述二维点云,在所述目标参考角度的第二邻域范围内确定对应的可见边缘代价最小的所述拟合角度,所述第二邻域范围包括所述目标参考角度。Optionally, when the number of reference angles is multiple, the processor 92 is configured to determine that the corresponding visible edge cost is the smallest according to the at least one reference angle, the visible area, and the two-dimensional point cloud. During the operation of the fitting angle, it is specifically used to: determine the corresponding target reference angle with the least visible edge cost among multiple reference angles according to the visible area and the two-dimensional point cloud; according to the visible area And the two-dimensional point cloud, determining the corresponding fitting angle with the smallest visible edge cost within a second neighborhood range of the target reference angle, and the second neighborhood range includes the target reference angle.
可选地,所述处理器92在用于执行根据所述可见区域和所述二维点云,在所述目标参考角度的第二邻域范围内确定可见边缘代价最小的所述拟合角 度的操作时,具体用于:从所述目标参考角度的第二邻域范围内获取多个子参考角度;根据所述可见区域和所述二维点云,确定各子参考角度对应的可见边缘代价中最小的子参考角度为所述拟合角度。Optionally, the processor 92 is configured to determine the fitting angle with the least visible edge cost within the second neighborhood range of the target reference angle according to the visible area and the two-dimensional point cloud During the operation, it is specifically used to: obtain multiple sub-reference angles from within the second neighborhood of the target reference angle; determine the visible edge cost corresponding to each sub-reference angle according to the visible area and the two-dimensional point cloud The smallest sub-reference angle is the fitting angle.
可选地,所述处理器92在用于执行根据所述可见区域和所述二维点云,获取所述第一参考角度对应的第一可见边缘代价的操作时,具体用于:根据所述二维点云在第一方向上的第一外包络矩形、所述可见区域和所述可见区域对应的第一边界和第二边界,获取所述第一可见边缘代价;其中,所述第一方向为从点云传感器坐标系的坐标原点出发旋转所述第一参考角度后所对应的方向,所述点云传感器坐标系的坐标原点为所述点云传感器所在的位置。Optionally, when the processor 92 is configured to perform the operation of obtaining the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud, it is specifically configured to: The first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first boundary and the second boundary corresponding to the visible area, to obtain the first visible edge cost; wherein, The first direction is a direction corresponding to the rotation of the first reference angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor.
可选地,所述处理器92在用于执行根据所述二维点云在第一方向上的第一外包络矩形、所述可见区域和所述可见区域对应的第一边界和第二边界,获取所述第一可见边缘代价的操作时,具体用于:获取由所述可见区域、所述第一边界和第二边界限定的第一区域的第一面积;获取由所述第一外包络矩形朝向所述移动平台的可见边、所述第一边界和第二边界限定的第二区域的第二面积;获取所述第一外包络矩形位于目标区域外的边、所述第一边界和所述第二边界限定的第三区域的第三面积,所述目标区域为所述第一边界和所述第二边界之间的区域,所述目标区域内包括目标物体的二维点云;根据所述第一面积、所述第二面积和所述第三面积,确定所述第一可见边缘代价。Optionally, the processor 92 is configured to execute the first outer envelope rectangle in the first direction according to the two-dimensional point cloud, the visible area and the first boundary and the second boundary corresponding to the visible area. Boundary, when the operation of obtaining the first visible edge cost is specifically used to: obtain the first area of the first area defined by the visible area, the first boundary, and the second boundary; The outer envelope rectangle faces the visible side of the mobile platform, and the second area of the second area defined by the first boundary and the second boundary; obtains the side of the first envelope rectangle outside the target area, the A third area of a third area defined by the first boundary and the second boundary, the target area is the area between the first boundary and the second boundary, and the target area includes the second boundary of the target object. One-dimensional point cloud; determine the first visible edge cost according to the first area, the second area, and the third area.
可选地,所述处理器92在用于执行根据所述第一面积、所述第二面积和所述第三面积,确定所述第一参考角度对应的所述第一可见边缘代价的操作时,具体用于:获取所述第一面积、所述第二面积和第一预设权重,获取第一预选可见边缘代价;根据所述第三面积和第二预设权重,获取第二预选可见边缘代价;根据所述第一预选可见边缘代价和所述第二预选可见边缘代价,确定所述第一可见边缘代价。Optionally, the processor 92 is configured to perform an operation of determining the first visible edge cost corresponding to the first reference angle according to the first area, the second area, and the third area. , It is specifically used to: obtain the first area, the second area, and the first preset weight, obtain the first preselected visible edge cost; according to the third area and the second preset weight, obtain the second preselect Visible edge cost; determining the first visible edge cost according to the first preselected visible edge cost and the second preselected visible edge cost.
可选地,所述预设角度范围包括的角度为第一预设角度与第二预设角度之间的角度,所述第一预设角度减去所述第二预设角度等于90°,所述预设角度范围包括所述第一预设角度和/或所述第二预设角度。Optionally, the angle included in the preset angle range is an angle between a first preset angle and a second preset angle, and the first preset angle minus the second preset angle is equal to 90°, The preset angle range includes the first preset angle and/or the second preset angle.
可选地,所述拟合特征包括如下中的至少一项:所述目标物体的拟合角度、所述目标物体的拟合方向、所述目标物体拟合边界框、所述目标物体的 拟合可见边;其中,所述拟合方向为从点云传感器坐标系的坐标原点出发旋转所述拟合角度后所对应的方向,所述点云传感器坐标系的坐标原点为所述点云传感器所在的位置。Optionally, the fitting feature includes at least one of the following: the fitting angle of the target object, the fitting direction of the target object, the fitting bounding box of the target object, and the fitting of the target object. The visible edge; wherein the fitting direction is the direction corresponding to the rotation of the fitting angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the point cloud sensor Location.
可选地,所述处理器92在用于执行根据所述拟合特征对所述目标物体进行拟合的操作时,具体用于:根据所述目标物体的点云,获取所述目标物体的拟合高度;根据所述拟合特征和所述拟合高度,对所述目标物体进行拟合。Optionally, when the processor 92 is configured to perform the operation of fitting the target object according to the fitting feature, it is specifically configured to: obtain the information of the target object according to the point cloud of the target object Fitting height; fitting the target object according to the fitting feature and the fitting height.
可选地,在所述拟合特征包括如下中的至少一项时:所述目标物体的拟合角度、所述目标物体的拟合方向、所述目标物体的拟合可见边,所述处理器92在用于执行根据所述拟合特征和所述拟合高度,对所述目标物体进行拟合的操作时,具体用于:根据所述拟合特征,获取所述目标物体拟合边界框;根据所述拟合边界框和拟合高度,对所述目标物体进行拟合。Optionally, when the fitting feature includes at least one of the following: the fitting angle of the target object, the fitting direction of the target object, and the fitting visible edge of the target object, the processing When the device 92 is used to perform the operation of fitting the target object according to the fitting feature and the fitting height, it is specifically configured to: obtain the fitting boundary of the target object according to the fitting feature Box; according to the fitting bounding box and fitting height, fitting the target object.
可选地,所述处理器92在用于执行根据所述目标物体的点云,获取所述目标物体的拟合高度的操作时,具体用于:获取所述目标物体的点云拟合最大高度和拟合最小高度;根据所述拟合最大高度和拟合最小高度,获取所述拟合高度。Optionally, when the processor 92 is configured to perform the operation of obtaining the fitting height of the target object according to the point cloud of the target object, it is specifically configured to obtain the maximum fitting height of the target object. Height and fitting minimum height; obtaining the fitting height according to the fitting maximum height and the fitting minimum height.
本实施例的点云传感器,可以用于执行上述各方法实施例中的技术方案,其实现原理和技术效果类似,此处不再赘述。The point cloud sensor in this embodiment can be used to implement the technical solutions in the foregoing method embodiments, and its implementation principles and technical effects are similar, and will not be repeated here.
图10为本申请实施例提供的移动平台的结构示意图,参见图10,本实施例的移动平台,包括:点云传感器101和处理器102。FIG. 10 is a schematic structural diagram of a mobile platform provided by an embodiment of this application. Referring to FIG. 10, the mobile platform of this embodiment includes: a point cloud sensor 101 and a processor 102.
点云传感器101,用于采集所述目标物体的点云;其中,所述点云传感器101搭载于所述移动平台;The point cloud sensor 101 is used to collect the point cloud of the target object; wherein, the point cloud sensor 101 is mounted on the mobile platform;
处理器102,与所述点云传感器101通信连接,用于执行如下操作:根据所述点云传感器采集的目标物体的点云,生成俯视图下的二维点云;确定所述二维点云中朝向所述移动平台的可见区域;根据所述可见区域,确定所述目标物体的拟合特征,并根据所述拟合特征对所述目标物体进行拟合。The processor 102 is in communication connection with the point cloud sensor 101, and is configured to perform the following operations: generate a two-dimensional point cloud in the top view according to the point cloud of the target object collected by the point cloud sensor; and determine the two-dimensional point cloud In the visible area facing the mobile platform; according to the visible area, the fitting feature of the target object is determined, and the target object is fitted according to the fitting feature.
可选地,所述处理器102在用于执行根据所述可见区域,确定所述目标物体的拟合特征的操作时,具体用于:根据所述可见区域和所述二维点云,确定所述拟合特征。Optionally, when the processor 102 is configured to perform the operation of determining the fitting feature of the target object according to the visible area, it is specifically configured to: determine according to the visible area and the two-dimensional point cloud The fitting feature.
可选地,所述拟合特征为所述目标物体的拟合角度,所述处理器102在用于执行根据所述可见区域和所述二维点云,确定所述拟合特征的操作时, 具体用于:根据所述可见区域、所述二维点云和预设角度范围,确定所述拟合角度。Optionally, the fitting feature is a fitting angle of the target object, and when the processor 102 is configured to perform an operation of determining the fitting feature based on the visible area and the two-dimensional point cloud , Specifically used for: determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range.
可选地,所述处理器102在用于执行根据所述可见区域、所述二维点云和预设角度范围,确定所述拟合角度的操作时,具体用于:根据所述可见区域、所述二维点云和预设角度范围,确定对应的可见边缘代价最小的所述拟合角度。Optionally, when the processor 102 is configured to perform the operation of determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range, it is specifically configured to: according to the visible area , The two-dimensional point cloud and the preset angle range determine the corresponding fitting angle with the smallest visible edge cost.
可选地,所述处理器102在用于执行根据所述可见区域、所述二维点云和预设角度范围,确定对应的可见边缘代价最小的所述拟合角度的操作时,具体用于:从所述预设角度范围内选取至少一个参考角度;根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度。Optionally, when the processor 102 is configured to perform the operation of determining the corresponding fitting angle with the least visible edge cost based on the visible area, the two-dimensional point cloud, and a preset angle range, specifically use In: selecting at least one reference angle from the preset angle range; and determining the corresponding fitting angle with the least visible edge cost according to the at least one reference angle, the visible area, and the two-dimensional point cloud.
可选地,在参考角度的数目为多个时,所述处理器102在用于执行根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度的操作时,具体用于:对于多个参考角度中的任意一个第一参考角度,根据所述可见区域和所述二维点云,在所述第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度,所述第一邻域范围包括所述第一参考角度;确定各预选角度中对应的可见边缘代价最小的预选角度为所述拟合角度。Optionally, when the number of reference angles is multiple, the processor 102 is configured to determine that the corresponding visible edge cost is the smallest according to the at least one reference angle, the visible area, and the two-dimensional point cloud. During the operation of the fitting angle, it is specifically used to: for any one of the multiple reference angles, according to the visible area and the two-dimensional point cloud, in the first reference angle Determine a first preselected angle with the smallest visible edge cost within a neighborhood range, where the first neighborhood range includes the first reference angle; determine the corresponding preselected angle with the least visible edge cost among the preselected angles as the fitting angle.
可选地,所述处理器102在用于执行根据所述可见区域和所述二维点云,在所述第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度的操作时,具体用于:根据所述可见区域和所述二维点云,获取所述第一参考角度对应的第一可见边缘代价,并更新所述第一参考角度至所述第一邻域范围内的第一角度,根据所述可见区域和所述二维点云,获取所述第一角度对应的第二可见边缘代价;根据所述第二可见边缘代价和所述第一可见边缘代价之间的关系,更新所述第一角度至所述第一邻域范围内的第二角度;重复执行获取所述第一邻域范围内的角度对应的可见边缘代价、根据相邻两次获取到的可见边缘代价的关系在所述第一邻域范围内更新角度的操作,直至获取到可见边缘代价最小的所述第一预选角度。Optionally, the processor 102 is configured to perform determining a first preselected angle with the least visible edge cost within a first neighborhood range of the first reference angle based on the visible area and the two-dimensional point cloud During the operation, it is specifically used to obtain the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud, and update the first reference angle to the first neighbor According to the first angle within the domain, the second visible edge cost corresponding to the first angle is obtained according to the visible area and the two-dimensional point cloud; according to the second visible edge cost and the first visible edge The relationship between the costs, update the first angle to the second angle in the first neighborhood; repeat the execution of obtaining the visible edge costs corresponding to the angles in the first neighborhood, according to two adjacent The obtained relationship of the visible edge cost is an operation of updating the angle within the first neighborhood range until the first preselected angle with the smallest visible edge cost is obtained.
可选地,在参考角度的数目为多个时,所述处理器102在用于执行根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边 缘代价最小的所述拟合角度的操作时,具体用于:根据所述可见区域和所述二维点云,在多个参考角度中确定对应的可见边缘代价最小的目标参考角度;根据所述可见区域和所述二维点云,在所述目标参考角度的第二邻域范围内确定对应的可见边缘代价最小的所述拟合角度,所述第二邻域范围包括所述目标参考角度。Optionally, when the number of reference angles is multiple, the processor 102 is configured to determine that the corresponding visible edge cost is the smallest according to the at least one reference angle, the visible area, and the two-dimensional point cloud. During the operation of the fitting angle, it is specifically used to: determine the corresponding target reference angle with the least visible edge cost among multiple reference angles according to the visible area and the two-dimensional point cloud; according to the visible area And the two-dimensional point cloud, determining the corresponding fitting angle with the smallest visible edge cost within a second neighborhood range of the target reference angle, and the second neighborhood range includes the target reference angle.
可选地,所述处理器102在用于执行根据所述可见区域和所述二维点云,在所述目标参考角度的第二邻域范围内确定可见边缘代价最小的所述拟合角度的操作时,具体用于:从所述目标参考角度的第二邻域范围内获取多个子参考角度;根据所述可见区域和所述二维点云,确定各子参考角度对应的可见边缘代价中最小的子参考角度为所述拟合角度。Optionally, the processor 102 is configured to determine the fitting angle with the least visible edge cost within the second neighborhood range of the target reference angle according to the visible area and the two-dimensional point cloud During the operation, it is specifically used to: obtain multiple sub-reference angles from within the second neighborhood of the target reference angle; determine the visible edge cost corresponding to each sub-reference angle according to the visible area and the two-dimensional point cloud The smallest sub-reference angle is the fitting angle.
可选地,所述处理器102在用于执行根据所述可见区域和所述二维点云,获取所述第一参考角度对应的第一可见边缘代价的操作时,具体用于:根据所述二维点云在第一方向上的第一外包络矩形、所述可见区域和所述可见区域对应的第一边界和第二边界,获取所述第一可见边缘代价;其中,所述第一方向为从点云传感器坐标系的坐标原点出发旋转所述第一参考角度后所对应的方向,所述点云传感器坐标系的坐标原点为所述点云传感器所在的位置。Optionally, when the processor 102 is configured to perform the operation of obtaining the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud, it is specifically configured to: The first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first boundary and the second boundary corresponding to the visible area, to obtain the first visible edge cost; wherein, The first direction is a direction corresponding to the rotation of the first reference angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor.
可选地,所述处理器102在用于执行根据所述二维点云在第一方向上的第一外包络矩形、所述可见区域和所述可见区域对应的第一边界和第二边界,获取所述第一可见边缘代价的操作时,具体用于:获取由所述可见区域、所述第一边界和第二边界限定的第一区域的第一面积;获取由所述第一外包络矩形朝向所述移动平台的可见边、所述第一边界和第二边界限定的第二区域的第二面积;获取所述第一外包络矩形位于目标区域外的边、所述第一边界和所述第二边界限定的第三区域的第三面积,所述目标区域为所述第一边界和第二边界之间的区域,所述目标区域内包括所述二维点云;根据所述第一面积、所述第二面积和所述第三面积,确定所述第一可见边缘代价。Optionally, the processor 102 is configured to execute the first outer envelope rectangle in the first direction according to the two-dimensional point cloud, the visible area and the first boundary and the second boundary corresponding to the visible area. Boundary, when the operation of obtaining the first visible edge cost is specifically used to: obtain the first area of the first area defined by the visible area, the first boundary, and the second boundary; The outer envelope rectangle faces the visible side of the mobile platform, and the second area of the second area defined by the first boundary and the second boundary; obtains the side of the first envelope rectangle outside the target area, the A third area of a third area defined by the first boundary and the second boundary, the target area is the area between the first boundary and the second boundary, and the target area includes the two-dimensional point cloud ; According to the first area, the second area and the third area, determine the first visible edge cost.
可选地,所述处理器102在用于执行根据所述第一面积、所述第二面积和所述第三面积,确定所述第一参考角度对应的所述第一可见边缘代价的操作时,具体用于:获取所述第一面积、所述第二面积和第一预设权重,获取第一预选可见边缘代价;根据所述第三面积和第二预设权重,获取第二预选可见边缘代价;根据所述第一预选可见边缘代价和所述第二预选可见边缘代 价,确定所述第一可见边缘代价。Optionally, the processor 102 is configured to perform an operation of determining the first visible edge cost corresponding to the first reference angle according to the first area, the second area, and the third area , It is specifically used to: obtain the first area, the second area, and the first preset weight, obtain the first preselected visible edge cost; according to the third area and the second preset weight, obtain the second preselect Visible edge cost; determining the first visible edge cost according to the first preselected visible edge cost and the second preselected visible edge cost.
可选地,所述预设角度范围包括的角度为第一预设角度与第二预设角度之间的角度,所述第一预设角度减去所述第二预设角度等于90°,所述预设角度范围包括所述第一预设角度和/或所述第二预设角度。Optionally, the angle included in the preset angle range is an angle between a first preset angle and a second preset angle, and the first preset angle minus the second preset angle is equal to 90°, The preset angle range includes the first preset angle and/or the second preset angle.
可选地,所述拟合特征包括如下中的至少一项:所述目标物体的拟合角度、所述目标物体的拟合方向、所述目标物体拟合边界框、所述目标物体的拟合可见边;其中,所述拟合方向为从点云传感器坐标系的坐标原点出发旋转所述拟合角度后所对应的方向,所述点云传感器坐标系的坐标原点为所述点云传感器所在的位置。Optionally, the fitting feature includes at least one of the following: the fitting angle of the target object, the fitting direction of the target object, the fitting bounding box of the target object, and the fitting of the target object. The visible edge; wherein the fitting direction is the direction corresponding to the rotation of the fitting angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the point cloud sensor Location.
可选地,所述处理器102在用于执行根据所述拟合特征对所述目标物体进行拟合的操作时,具体用于:根据所述目标物体的点云,获取所述目标物体的拟合高度;根据所述拟合特征和所述拟合高度,对所述目标物体进行拟合。Optionally, when the processor 102 is configured to perform the operation of fitting the target object according to the fitting feature, it is specifically configured to: obtain the information of the target object according to the point cloud of the target object Fitting height; fitting the target object according to the fitting feature and the fitting height.
可选地,在所述拟合特征包括如下中的至少一项时:所述目标物体的拟合角度、所述目标物体的拟合方向、所述目标物体的拟合可见边,所述处理器102在用于执行根据所述拟合特征和所述拟合高度,对所述目标物体进行拟合的操作时,具体用于:根据所述拟合特征,获取所述目标物体拟合边界框;根据所述拟合边界框和拟合高度,对所述目标物体进行拟合。Optionally, when the fitting feature includes at least one of the following: the fitting angle of the target object, the fitting direction of the target object, and the fitting visible edge of the target object, the processing When the device 102 is used to perform the operation of fitting the target object according to the fitting feature and the fitting height, it is specifically used to: obtain the fitting boundary of the target object according to the fitting feature Box; according to the fitting bounding box and fitting height, fitting the target object.
可选地,所述处理器102在用于执行根据所述目标物体的点云,获取所述目标物体的拟合高度的操作时,具体用于:获取所述目标物体的点云拟合最大高度和拟合最小高度;根据所述拟合最大高度和拟合最小高度,获取所述拟合高度。Optionally, when the processor 102 is configured to perform the operation of obtaining the fitting height of the target object according to the point cloud of the target object, it is specifically configured to obtain the maximum fitting height of the target object. Height and fitting minimum height; obtaining the fitting height according to the fitting maximum height and the fitting minimum height.
本实施例移动平台,可以用于执行上述各方法实施例中的技术方案,其实现原理和技术效果类似,此处不再赘述。The mobile platform of this embodiment can be used to execute the technical solutions in the foregoing method embodiments, and its implementation principles and technical effects are similar, and will not be repeated here.
本申请实施例还提供一种计算机可读存储介质,包括程序或指令,当所述程序或指令在计算机上运行时,上述方法实施例所述的方法被执行。An embodiment of the present application also provides a computer-readable storage medium, including a program or instruction, and when the program or instruction runs on a computer, the method described in the foregoing method embodiment is executed.
本领域普通技术人员可以理解:实现上述各方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成。前述的程序可以存储于一计算机可读取存储介质中。该程序在执行时,执行包括上述各方法实施例的步骤;而前述的存储介质包括:ROM、RAM、磁碟或者光盘等各种可以存 储程序代码的介质。A person of ordinary skill in the art can understand that all or part of the steps in the foregoing method embodiments can be implemented by a program instructing relevant hardware. The aforementioned program can be stored in a computer readable storage medium. When the program is executed, it executes the steps including the above-mentioned method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk, or optical disk and other media that can store program code.
最后应说明的是:以上各实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述各实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the application, not to limit them; although the application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: It is still possible to modify the technical solutions described in the foregoing embodiments, or equivalently replace some or all of the technical features; these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the application range.

Claims (53)

  1. 一种目标物体的拟合方法,其特征在于,包括:A method for fitting a target object, characterized in that it comprises:
    根据点云传感器采集的目标物体的点云,生成俯视图下的二维点云,其中所述点云传感器用于搭载于移动平台;According to the point cloud of the target object collected by the point cloud sensor, generate a two-dimensional point cloud in the top view, wherein the point cloud sensor is used to be mounted on a mobile platform;
    确定所述二维点云中朝向所述移动平台的可见区域;Determining a visible area in the two-dimensional point cloud facing the mobile platform;
    根据所述可见区域,确定所述目标物体的拟合特征,并根据所述拟合特征对所述目标物体进行拟合。According to the visible area, the fitting feature of the target object is determined, and the target object is fitted according to the fitting feature.
  2. 根据权利要求1所述的方法,其特征在于,根据所述可见区域,确定所述目标物体的拟合特征,包括:The method according to claim 1, wherein determining the fitting feature of the target object according to the visible area comprises:
    根据所述可见区域和所述二维点云,确定所述拟合特征。The fitting feature is determined according to the visible area and the two-dimensional point cloud.
  3. 根据权利要求2所述的方法,其特征在于,所述拟合特征为所述目标物体的拟合角度,所述根据所述可见区域和所述二维点云,确定所述拟合特征,包括:The method according to claim 2, wherein the fitting feature is a fitting angle of the target object, and the fitting feature is determined according to the visible area and the two-dimensional point cloud, include:
    根据所述可见区域、所述二维点云和预设角度范围,确定所述拟合角度。The fitting angle is determined according to the visible area, the two-dimensional point cloud, and a preset angle range.
  4. 根据权利要求3所述的方法,其特征在于,所述根据所述可见区域、所述二维点云和预设角度范围,确定所述拟合角度,包括:The method according to claim 3, wherein the determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range comprises:
    根据所述可见区域、所述二维点云和预设角度范围,确定对应的可见边缘代价最小的所述拟合角度。According to the visible area, the two-dimensional point cloud, and a preset angle range, the fitting angle with the least corresponding visible edge cost is determined.
  5. 根据权利要求4所述的方法,其特征在于,所述根据所述可见区域、所述二维点云和预设角度范围,确定对应的可见边缘代价最小的所述拟合角度,包括:The method according to claim 4, wherein the determining the fitting angle corresponding to the minimum visible edge cost according to the visible area, the two-dimensional point cloud, and a preset angle range comprises:
    从所述预设角度范围内选取至少一个参考角度;Selecting at least one reference angle from the preset angle range;
    根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度。According to the at least one reference angle, the visible area, and the two-dimensional point cloud, determine the corresponding fitting angle with the least visible edge cost.
  6. 根据权利要求5所述的方法,其特征在于,在参考角度的数目为多个时,所述根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度,包括:The method according to claim 5, wherein when the number of reference angles is multiple, the corresponding visible edge is determined according to the at least one reference angle, the visible area, and the two-dimensional point cloud The fitting angle with the least cost includes:
    对于多个参考角度中的任意一个第一参考角度,根据所述可见区域和所述二维点云,在所述第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度,所述第一邻域范围包括所述第一参考角度;For any first reference angle among multiple reference angles, according to the visible area and the two-dimensional point cloud, determine the first preselection with the least visible edge cost within the first neighborhood range of the first reference angle Angle, the first neighborhood range includes the first reference angle;
    确定各预选角度中对应的可见边缘代价最小的预选角度为所述拟合角度。It is determined that the corresponding preselected angle with the smallest visible edge cost among the preselected angles is the fitting angle.
  7. 根据权利要求6所述的方法,其特征在于,根据所述可见区域和所述二维点云,在所述第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度,包括:The method according to claim 6, characterized in that, according to the visible area and the two-dimensional point cloud, the first preselected angle with the least visible edge cost is determined within a first neighborhood of the first reference angle ,include:
    根据所述可见区域和所述二维点云,获取所述第一参考角度对应的第一可见边缘代价,并更新所述第一参考角度至所述第一邻域范围内的第一角度,根据所述可见区域和所述二维点云,获取所述第一角度对应的第二可见边缘代价;Obtaining the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud, and updating the first reference angle to a first angle within the first neighborhood, Obtaining a second visible edge cost corresponding to the first angle according to the visible area and the two-dimensional point cloud;
    根据所述第二可见边缘代价和所述第一可见边缘代价之间的关系,更新所述第一角度至所述第一邻域范围内的第二角度;According to the relationship between the second visible edge cost and the first visible edge cost, update the first angle to a second angle in the range of the first neighborhood;
    重复执行获取所述第一邻域范围内的角度对应的可见边缘代价、根据相邻两次获取到的可见边缘代价的关系在所述第一邻域范围内更新角度的操作,直至获取到可见边缘代价最小的所述第一预选角度。Repeat the operations of obtaining the visible edge cost corresponding to the angle in the first neighborhood, and updating the angle in the first neighborhood according to the relationship between the two adjacent visible edge costs, until the visibility is obtained The first preselected angle with the smallest edge cost.
  8. 根据权利要求5所述的方法,其特征在于,在参考角度的数目为多个时,所述根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度,包括:The method according to claim 5, wherein when the number of reference angles is multiple, the corresponding visible edge is determined according to the at least one reference angle, the visible area, and the two-dimensional point cloud The fitting angle with the least cost includes:
    根据所述可见区域和所述二维点云,在多个参考角度中确定对应的可见边缘代价最小的目标参考角度;According to the visible area and the two-dimensional point cloud, determine a corresponding target reference angle with the least visible edge cost among multiple reference angles;
    根据所述可见区域和所述二维点云,在所述目标参考角度的第二邻域范围内确定对应的可见边缘代价最小的所述拟合角度,所述第二邻域范围包括所述目标参考角度。According to the visible area and the two-dimensional point cloud, determine the corresponding fitting angle with the smallest visible edge cost within a second neighborhood range of the target reference angle, and the second neighborhood range includes the The target reference angle.
  9. 根据权利要求8所述的方法,其特征在于,根据所述可见区域和所述二维点云,在所述目标参考角度的第二邻域范围内确定可见边缘代价最小的所述拟合角度,包括:8. The method according to claim 8, characterized in that, according to the visible area and the two-dimensional point cloud, the fitting angle with the least visible edge cost is determined within a second neighborhood of the target reference angle ,include:
    从所述目标参考角度的第二邻域范围内获取多个子参考角度;Acquiring multiple sub-reference angles from within the second neighborhood of the target reference angle;
    根据所述可见区域和所述二维点云,确定各子参考角度对应的可见边缘代价中最小的子参考角度为所述拟合角度。According to the visible area and the two-dimensional point cloud, determine the smallest sub-reference angle among the visible edge costs corresponding to each sub-reference angle as the fitting angle.
  10. 根据权利要求7所述的方法,其特征在于,根据所述可见区域和所述二维点云,获取所述第一参考角度对应的第一可见边缘代价,包括:The method according to claim 7, wherein, according to the visible area and the two-dimensional point cloud, obtaining the first visible edge cost corresponding to the first reference angle comprises:
    根据所述二维点云在第一方向上的第一外包络矩形、所述可见区域和所 述可见区域对应的第一边界和第二边界,获取所述第一可见边缘代价;Obtaining the first visible edge cost according to the first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area, and the first boundary and the second boundary corresponding to the visible area;
    其中,所述第一方向为从点云传感器坐标系的坐标原点出发旋转所述第一参考角度后所对应的方向,所述点云传感器坐标系的坐标原点为所述点云传感器所在的位置。Wherein, the first direction is the direction corresponding to the rotation of the first reference angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor .
  11. 根据权利要求10所述的方法,其特征在于,所述根据所述二维点云在第一方向上的第一外包络矩形、所述可见区域和所述可见区域对应的第一边界和第二边界,获取所述第一可见边缘代价,包括:The method according to claim 10, wherein the first outer envelope rectangle in the first direction according to the two-dimensional point cloud, the visible area and the first boundary corresponding to the visible area and The second boundary, acquiring the first visible edge cost, includes:
    获取由所述可见区域、所述第一边界和所述第二边界限定的第一区域的第一面积;Acquiring a first area of a first area defined by the visible area, the first boundary, and the second boundary;
    获取由所述第一外包络矩形朝向所述移动平台的可见边、所述第一边界和第二边界限定的第二区域的第二面积;Acquiring the second area of the second area defined by the visible side of the first outer envelope rectangle facing the mobile platform, the first boundary and the second boundary;
    获取所述第一外包络矩形位于目标区域外的边、所述第一边界和第二边界限定的第三区域的第三面积,所述目标区域为所述第一边界和第二边界之间的区域,所述目标区域内包括所述二维点云;Obtain the side of the first envelope rectangle located outside the target area, the third area of the third area defined by the first boundary and the second boundary, the target area being between the first boundary and the second boundary An area between, the target area includes the two-dimensional point cloud;
    根据所述第一面积、所述第二面积和所述第三面积,确定所述第一可见边缘代价。The first visible edge cost is determined according to the first area, the second area, and the third area.
  12. 根据权利要求11所述的方法,其特征在于,所述根据所述第一面积、所述第二面积和所述第三面积,确定所述第一参考角度对应的所述第一可见边缘代价,包括:11. The method according to claim 11, wherein the first visible edge cost corresponding to the first reference angle is determined according to the first area, the second area, and the third area ,include:
    获取所述第一面积、所述第二面积和第一预设权重,获取第一预选可见边缘代价;Acquiring the first area, the second area, and the first preset weight, and acquiring the first preselected visible edge cost;
    根据所述第三面积和第二预设权重,获取第二预选可见边缘代价;Obtaining the second preselected visible edge cost according to the third area and the second preset weight;
    根据所述第一预选可见边缘代价和所述第二预选可见边缘代价,确定所述第一可见边缘代价。Determine the first visible edge cost according to the first preselected visible edge cost and the second preselected visible edge cost.
  13. 根据权利要求3~12任一项所述的方法,其特征在于,所述预设角度范围包括的角度为第一预设角度与第二预设角度之间的角度,所述第一预设角度减去所述第二预设角度等于90°,所述预设角度范围包括所述第一预设角度和/或所述第二预设角度。The method according to any one of claims 3-12, wherein the angle included in the preset angle range is an angle between a first preset angle and a second preset angle, and the first preset angle The angle minus the second preset angle is equal to 90°, and the preset angle range includes the first preset angle and/or the second preset angle.
  14. 根据权利要求1所述的方法,其特征在于,所述拟合特征包括如下中的至少一项:所述目标物体的拟合角度、所述目标物体的拟合方向、所述 目标物体拟合边界框、所述目标物体的拟合可见边;The method according to claim 1, wherein the fitting feature includes at least one of the following: a fitting angle of the target object, a fitting direction of the target object, and the fitting of the target object Bounding box, the fitted visible edge of the target object;
    其中,所述拟合方向为从点云传感器坐标系的坐标原点出发旋转所述拟合角度后所对应的方向,所述点云传感器坐标系的坐标原点为所述点云传感器所在的位置。Wherein, the fitting direction is the direction corresponding to the rotation of the fitting angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor.
  15. 根据权利要求1或14所述方法,其特征在于,所述根据所述拟合特征对所述目标物体进行拟合,包括:The method according to claim 1 or 14, wherein the fitting the target object according to the fitting feature comprises:
    根据所述目标物体的点云,获取所述目标物体的拟合高度;Obtaining the fitting height of the target object according to the point cloud of the target object;
    根据所述拟合特征和所述拟合高度,对所述目标物体进行拟合。Fit the target object according to the fitting feature and the fitting height.
  16. 根据权利要求15所述的方法,其特征在于,在所述拟合特征包括如下中的至少一项时:目标物体的拟合角度、所述目标物体的拟合方向、所述目标物体的拟合可见边,根据所述拟合特征和所述拟合高度,对所述目标物体进行拟合,包括:The method according to claim 15, wherein when the fitting feature includes at least one of the following: the fitting angle of the target object, the fitting direction of the target object, the fitting direction of the target object Integrating visible edges, fitting the target object according to the fitting feature and the fitting height, including:
    根据所述拟合特征,获取所述目标物体拟合边界框;Obtaining a fitting bounding box of the target object according to the fitting feature;
    根据所述拟合边界框和拟合高度,对所述目标物体进行拟合。Fit the target object according to the fitting bounding box and fitting height.
  17. 根据权利要求15所述的方法,其特征在于,根据所述目标物体的点云,获取所述目标物体的拟合高度,包括:The method according to claim 15, wherein obtaining the fitting height of the target object according to the point cloud of the target object comprises:
    获取所述目标物体的点云的拟合最大高度和拟合最小高度;Acquiring the maximum fitting height and the minimum fitting height of the point cloud of the target object;
    根据所述拟合最大高度和拟合最小高度,获取所述拟合高度。According to the maximum fitting height and the minimum fitting height, the fitting height is obtained.
  18. 一种点云传感器,所述点云传感器用于搭载在移动平台上,其特征在于,包括:A point cloud sensor, which is used to be mounted on a mobile platform, and is characterized in that it includes:
    采集器,用于采集所述目标物体的点云;A collector for collecting the point cloud of the target object;
    处理器,与所述采集器通信连接,用于执行如下操作:The processor is in communication connection with the collector, and is configured to perform the following operations:
    根据所述采集器采集的目标物体的点云,生成俯视图下的二维点云;Generate a two-dimensional point cloud in the top view according to the point cloud of the target object collected by the collector;
    确定所述二维点云中朝向所述移动平台的可见区域;Determining a visible area in the two-dimensional point cloud facing the mobile platform;
    根据所述可见区域,确定所述目标物体的拟合特征,并根据所述拟合特征对所述目标物体进行拟合。According to the visible area, the fitting feature of the target object is determined, and the target object is fitted according to the fitting feature.
  19. 根据权利要求18所述的点云传感器,其特征在于,所述处理器在用于执行根据所述可见区域,确定所述目标物体的拟合特征的操作时,具体用于:The point cloud sensor according to claim 18, wherein when the processor is configured to perform the operation of determining the fitting feature of the target object according to the visible area, it is specifically configured to:
    根据所述可见区域和所述二维点云,确定所述拟合特征。The fitting feature is determined according to the visible area and the two-dimensional point cloud.
  20. 根据权利要求19所述的点云传感器,其特征在于,所述拟合特征为所述目标物体的拟合角度,所述处理器在用于执行根据所述可见区域和所述二维点云,确定所述拟合特征的操作时,具体用于:The point cloud sensor according to claim 19, wherein the fitting feature is a fitting angle of the target object, and the processor is configured to execute the calculation based on the visible area and the two-dimensional point cloud , When determining the operation of the fitting feature, it is specifically used for:
    根据所述可见区域、所述二维点云和预设角度范围,确定所述拟合角度。The fitting angle is determined according to the visible area, the two-dimensional point cloud, and a preset angle range.
  21. 根据权利要求20所述的点云传感器,其特征在于,所述处理器在用于执行根据所述可见区域、所述二维点云和预设角度范围,确定所述拟合角度的操作时,具体用于:The point cloud sensor according to claim 20, wherein the processor is configured to perform the operation of determining the fitting angle based on the visible area, the two-dimensional point cloud, and a preset angle range. , Specifically used for:
    根据所述可见区域、所述二维点云和预设角度范围,确定对应的可见边缘代价最小的所述拟合角度。According to the visible area, the two-dimensional point cloud, and a preset angle range, the fitting angle with the least corresponding visible edge cost is determined.
  22. 根据权利要求21所述的点云传感器,其特征在于,所述处理器在用于执行根据所述可见区域、所述二维点云和预设角度范围,确定对应的可见边缘代价最小的所述拟合角度的操作时,具体用于:The point cloud sensor according to claim 21, wherein the processor is configured to determine the corresponding visible edge cost according to the visible area, the two-dimensional point cloud, and a preset angle range. When describing the fitting angle operation, it is specifically used for:
    从所述预设角度范围内选取至少一个参考角度;Selecting at least one reference angle from the preset angle range;
    根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度。According to the at least one reference angle, the visible area, and the two-dimensional point cloud, determine the corresponding fitting angle with the least visible edge cost.
  23. 根据权利要求22所述的点云传感器,其特征在于,在参考角度的数目为多个时,所述处理器在用于执行根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度的操作时,具体用于:The point cloud sensor according to claim 22, wherein when the number of reference angles is more than one, the processor is configured to perform the calculation according to the at least one reference angle, the visible area, and the two-dimensional The point cloud is specifically used for the operation of determining the fitting angle corresponding to the smallest visible edge cost:
    对于多个参考角度中的任意一个第一参考角度,根据所述可见区域和所述二维点云,在所述第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度,所述第一邻域范围包括所述第一参考角度;For any first reference angle among multiple reference angles, according to the visible area and the two-dimensional point cloud, determine the first preselection with the least visible edge cost within the first neighborhood range of the first reference angle Angle, the first neighborhood range includes the first reference angle;
    确定各预选角度中对应的可见边缘代价最小的预选角度为所述拟合角度。It is determined that the corresponding preselected angle with the smallest visible edge cost among the preselected angles is the fitting angle.
  24. 根据权利要求23所述的点云传感器,其特征在于,所述处理器在用于执行根据所述可见区域和所述二维点云,在所述第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度的操作时,具体用于:22. The point cloud sensor according to claim 23, wherein the processor is configured to execute the operation according to the visible area and the two-dimensional point cloud, within a first neighborhood range of the first reference angle The operation of determining the first preselected angle with the smallest visible edge cost is specifically used for:
    根据所述可见区域和所述二维点云,获取所述第一参考角度对应的第一可见边缘代价,并更新所述第一参考角度至所述第一邻域范围内的第一角度,根据所述可见区域和所述二维点云,获取所述第一角度对应的第二可见边缘代价;Obtaining the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud, and updating the first reference angle to a first angle within the first neighborhood, Obtaining a second visible edge cost corresponding to the first angle according to the visible area and the two-dimensional point cloud;
    根据所述第二可见边缘代价和所述第一可见边缘代价之间的关系,更新所述第一角度至所述第一邻域范围内的第二角度;According to the relationship between the second visible edge cost and the first visible edge cost, update the first angle to a second angle in the range of the first neighborhood;
    重复执行获取所述第一邻域范围内的角度对应的可见边缘代价、根据相邻两次获取到的可见边缘代价的关系在所述第一邻域范围内更新角度的操作,直至获取到可见边缘代价最小的所述第一预选角度。Repeat the operations of obtaining the visible edge cost corresponding to the angle in the first neighborhood, and updating the angle in the first neighborhood according to the relationship between the two adjacent visible edge costs, until the visibility is obtained The first preselected angle with the smallest edge cost.
  25. 根据权利要求22所述的点云传感器,其特征在于,在参考角度的数目为多个时,所述处理器在用于执行根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度的操作时,具体用于:The point cloud sensor according to claim 22, wherein when the number of reference angles is more than one, the processor is configured to perform the calculation according to the at least one reference angle, the visible area, and the two-dimensional The point cloud is specifically used for the operation of determining the fitting angle corresponding to the smallest visible edge cost:
    根据所述可见区域和所述二维点云,在多个参考角度中确定对应的可见边缘代价最小的目标参考角度;According to the visible area and the two-dimensional point cloud, determine a corresponding target reference angle with the least visible edge cost among multiple reference angles;
    根据所述可见区域和所述二维点云,在所述目标参考角度的第二邻域范围内确定对应的可见边缘代价最小的所述拟合角度,所述第二邻域范围包括所述目标参考角度。According to the visible area and the two-dimensional point cloud, determine the corresponding fitting angle with the smallest visible edge cost within a second neighborhood range of the target reference angle, and the second neighborhood range includes the The target reference angle.
  26. 根据权利要求25所述的点云传感器,其特征在于,所述处理器在用于执行根据所述可见区域和所述二维点云,在所述目标参考角度的第二邻域范围内确定可见边缘代价最小的所述拟合角度的操作时,具体用于:The point cloud sensor according to claim 25, wherein the processor is configured to perform a determination based on the visible area and the two-dimensional point cloud within a second neighborhood range of the target reference angle It can be seen that the operation of the fitting angle with the smallest edge cost is specifically used for:
    从所述目标参考角度的第二邻域范围内获取多个子参考角度;Acquiring multiple sub-reference angles from within the second neighborhood of the target reference angle;
    根据所述可见区域和所述二维点云,确定各子参考角度对应的可见边缘代价中最小的子参考角度为所述拟合角度。According to the visible area and the two-dimensional point cloud, determine the smallest sub-reference angle among the visible edge costs corresponding to each sub-reference angle as the fitting angle.
  27. 根据权利要求24所述的点云传感器,其特征在于,所述处理器在用于执行根据所述可见区域和所述二维点云,获取所述第一参考角度对应的第一可见边缘代价的操作时,具体用于:The point cloud sensor according to claim 24, wherein the processor is configured to obtain the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud. When operating, specifically used for:
    根据所述二维点云在第一方向上的第一外包络矩形、所述可见区域和所述可见区域对应的第一边界和第二边界,获取所述第一可见边缘代价;Acquiring the first visible edge cost according to the first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first boundary and the second boundary corresponding to the visible area;
    其中,所述第一方向为从点云传感器坐标系的坐标原点出发旋转所述第一参考角度后所对应的方向,所述点云传感器坐标系的坐标原点为所述点云传感器所在的位置。Wherein, the first direction is the direction corresponding to the rotation of the first reference angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor .
  28. 根据权利要求27所述的点云传感器,其特征在于,所述处理器在用于执行根据所述二维点云在第一方向上的第一外包络矩形、所述可见区域和 所述可见区域对应的第一边界和第二边界,获取所述第一可见边缘代价的操作时,具体用于:The point cloud sensor according to claim 27, wherein the processor is configured to execute a first outer envelope rectangle in a first direction according to the two-dimensional point cloud, the visible area and the The first boundary and the second boundary corresponding to the visible area are specifically used for the operation of obtaining the first visible edge cost:
    获取由所述可见区域、所述第一边界和第二边界限定的第一区域的第一面积;Acquiring a first area of a first area defined by the visible area, the first boundary, and the second boundary;
    获取由所述第一外包络矩形朝向所述移动平台的可见边、所述第一边界和第二边界限定的第二区域的第二面积;Acquiring the second area of the second area defined by the visible side of the first outer envelope rectangle facing the mobile platform, the first boundary and the second boundary;
    获取所述第一外包络矩形位于目标区域外的边、所述第一边界和第二边界限定的第三区域的第三面积,所述目标区域为所述第一边界和第二边界之间的区域,所述目标区域内包括所述二维点云;Obtain the side of the first envelope rectangle located outside the target area, the third area of the third area defined by the first boundary and the second boundary, the target area being between the first boundary and the second boundary An area between, the target area includes the two-dimensional point cloud;
    根据所述第一面积、所述第二面积和所述第三面积,确定所述第一可见边缘代价。The first visible edge cost is determined according to the first area, the second area, and the third area.
  29. 根据权利要求28所述的点云传感器,其特征在于,所述处理器在用于执行根据所述第一面积、所述第二面积和所述第三面积,确定所述第一参考角度对应的所述第一可见边缘代价的操作时,具体用于:The point cloud sensor according to claim 28, wherein the processor is configured to determine the corresponding first reference angle according to the first area, the second area, and the third area. The operation of the first visible edge cost is specifically used for:
    获取所述第一面积、所述第二面积和第一预设权重,获取第一预选可见边缘代价;Acquiring the first area, the second area, and the first preset weight, and acquiring the first preselected visible edge cost;
    根据所述第三面积和第二预设权重,获取第二预选可见边缘代价;Obtaining the second preselected visible edge cost according to the third area and the second preset weight;
    根据所述第一预选可见边缘代价和所述第二预选可见边缘代价,确定所述第一可见边缘代价。Determine the first visible edge cost according to the first preselected visible edge cost and the second preselected visible edge cost.
  30. 根据权利要求20~29任一项所述的点云传感器,其特征在于,所述预设角度范围包括的角度为第一预设角度与第二预设角度之间的角度,所述第一预设角度减去所述第二预设角度等于90°,所述预设角度范围包括所述第一预设角度和/或所述第二预设角度。The point cloud sensor according to any one of claims 20-29, wherein the angle included in the preset angle range is an angle between a first preset angle and a second preset angle, and the first The preset angle minus the second preset angle is equal to 90°, and the preset angle range includes the first preset angle and/or the second preset angle.
  31. 根据权利要求18所述的点云传感器,其特征在于,所述拟合特征包括如下中的至少一项:所述目标物体的拟合角度、所述目标物体的拟合方向、所述目标物体拟合边界框、所述目标物体的拟合可见边;The point cloud sensor according to claim 18, wherein the fitting feature comprises at least one of the following: a fitting angle of the target object, a fitting direction of the target object, and the target object Fitting a bounding box and fitting visible edges of the target object;
    其中,所述拟合方向为从点云传感器坐标系的坐标原点出发旋转所述拟合角度后所对应的方向,所述点云传感器坐标系的坐标原点为所述点云传感器所在的位置。Wherein, the fitting direction is the direction corresponding to the rotation of the fitting angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor.
  32. 根据权利要求18或31所述的点云传感器,其特征在于,所述处理 器在用于执行根据所述拟合特征对所述目标物体进行拟合的操作时,具体用于:The point cloud sensor according to claim 18 or 31, wherein when the processor is used to perform the operation of fitting the target object according to the fitting feature, it is specifically used for:
    根据所述目标物体的点云,获取所述目标物体的拟合高度;Obtaining the fitting height of the target object according to the point cloud of the target object;
    根据所述拟合特征和所述拟合高度,对所述目标物体进行拟合。Fit the target object according to the fitting feature and the fitting height.
  33. 根据权利要求32所述的点云传感器,其特征在于,在所述拟合特征包括如下中的至少一项时:所述目标物体的拟合角度、所述目标物体的拟合方向、所述目标物体的拟合可见边,所述处理器在用于执行根据所述拟合特征和所述拟合高度,对所述目标物体进行拟合的操作时,具体用于:The point cloud sensor according to claim 32, wherein when the fitting feature includes at least one of the following: the fitting angle of the target object, the fitting direction of the target object, and the Fitting visible edges of the target object, when the processor is used to perform the operation of fitting the target object according to the fitting feature and the fitting height, it is specifically used for:
    根据所述拟合特征,获取所述目标物体拟合边界框;Obtaining a fitting bounding box of the target object according to the fitting feature;
    根据所述拟合边界框和拟合高度,对所述目标物体进行拟合。Fit the target object according to the fitting bounding box and fitting height.
  34. 根据权利要求32所述的点云传感器,其特征在于,所述处理器在用于执行根据所述目标物体的点云,获取所述目标物体的拟合高度的操作时,具体用于:The point cloud sensor according to claim 32, wherein, when the processor is configured to perform the operation of obtaining the fitting height of the target object according to the point cloud of the target object, it is specifically configured to:
    获取所述目标物体的点云拟合最大高度和拟合最小高度;Acquiring the maximum fitting height and the minimum fitting height of the target object;
    根据所述拟合最大高度和拟合最小高度,获取所述拟合高度。According to the maximum fitting height and the minimum fitting height, the fitting height is obtained.
  35. 一种移动平台,其特征在于,包括:点云传感器,用于采集所述目标物体的点云;其中,所述点云传感器搭载于所述移动平台;A mobile platform, characterized by comprising: a point cloud sensor for collecting the point cloud of the target object; wherein the point cloud sensor is mounted on the mobile platform;
    处理器,与所述点云传感器通信连接,用于执行如下操作:The processor is in communication connection with the point cloud sensor, and is configured to perform the following operations:
    根据所述点云传感器采集的目标物体的点云,生成俯视图下的二维点云,其中所述点云传感器搭载于移动平台;According to the point cloud of the target object collected by the point cloud sensor, generate a two-dimensional point cloud in a top view, wherein the point cloud sensor is mounted on a mobile platform;
    确定所述二维点云中朝向所述移动平台的可见区域;Determining a visible area in the two-dimensional point cloud facing the mobile platform;
    根据所述可见区域,确定所述目标物体的拟合特征,并根据所述拟合特征对所述目标物体进行拟合。According to the visible area, the fitting feature of the target object is determined, and the target object is fitted according to the fitting feature.
  36. 根据权利要求35所述的移动平台,其特征在于,所述处理器在用于执行根据所述可见区域,确定所述目标物体的拟合特征的操作时,具体用于:The mobile platform according to claim 35, wherein when the processor is configured to perform the operation of determining the fitting feature of the target object according to the visible area, it is specifically configured to:
    根据所述可见区域和所述二维点云,确定所述拟合特征。The fitting feature is determined according to the visible area and the two-dimensional point cloud.
  37. 根据权利要求36所述的移动平台,其特征在于,所述拟合特征为所述目标物体的拟合角度,所述处理器在用于执行根据所述可见区域和所述二维点云,确定所述拟合特征的操作时,具体用于:The mobile platform according to claim 36, wherein the fitting feature is a fitting angle of the target object, and the processor is configured to execute according to the visible area and the two-dimensional point cloud, When determining the operation of the fitting feature, it is specifically used for:
    根据所述可见区域、所述二维点云和预设角度范围,确定所述拟合角度。The fitting angle is determined according to the visible area, the two-dimensional point cloud, and a preset angle range.
  38. 根据权利要求37所述的移动平台,其特征在于,所述处理器在用于执行根据所述可见区域、所述二维点云和预设角度范围,确定所述拟合角度的操作时,具体用于:The mobile platform according to claim 37, wherein when the processor is configured to perform an operation of determining the fitting angle according to the visible area, the two-dimensional point cloud, and a preset angle range, Specifically used for:
    根据所述可见区域、所述二维点云和预设角度范围,确定对应的可见边缘代价最小的所述拟合角度。According to the visible area, the two-dimensional point cloud, and a preset angle range, the fitting angle with the least corresponding visible edge cost is determined.
  39. 根据权利要求38所述的移动平台,其特征在于,所述处理器在用于执行根据所述可见区域、所述二维点云和预设角度范围,确定对应的可见边缘代价最小的所述拟合角度的操作时,具体用于:The mobile platform according to claim 38, wherein the processor is configured to determine the corresponding visible edge cost of the least expensive according to the visible area, the two-dimensional point cloud, and a preset angle range. When fitting the angle, it is specifically used for:
    从所述预设角度范围内选取至少一个参考角度;Selecting at least one reference angle from the preset angle range;
    根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度。According to the at least one reference angle, the visible area, and the two-dimensional point cloud, determine the corresponding fitting angle with the least visible edge cost.
  40. 根据权利要求39所述的移动平台,其特征在于,在参考角度的数目为多个时,所述处理器在用于执行根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度的操作时,具体用于:The mobile platform according to claim 39, wherein when the number of reference angles is more than one, the processor is configured to execute the operation according to the at least one reference angle, the visible area, and the two-dimensional point. Cloud, when determining the corresponding fitting angle with the smallest visible edge cost, it is specifically used for:
    对于多个参考角度中的任意一个第一参考角度,根据所述可见区域和所述二维点云,在所述第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度,所述第一邻域范围包括所述第一参考角度;For any first reference angle among multiple reference angles, according to the visible area and the two-dimensional point cloud, determine the first preselection with the least visible edge cost within the first neighborhood range of the first reference angle Angle, the first neighborhood range includes the first reference angle;
    确定各预选角度中对应的可见边缘代价最小的预选角度为所述拟合角度。It is determined that the corresponding preselected angle with the smallest visible edge cost among the preselected angles is the fitting angle.
  41. 根据权利要求40所述的移动平台,其特征在于,所述处理器在用于执行根据所述可见区域和所述二维点云,在所述第一参考角度的第一邻域范围内确定可见边缘代价最小的第一预选角度的操作时,具体用于:The mobile platform according to claim 40, wherein the processor is configured to perform a determination based on the visible area and the two-dimensional point cloud within a first neighborhood of the first reference angle It can be seen that the operation of the first preselected angle with the smallest edge cost is specifically used for:
    根据所述可见区域和所述二维点云,获取所述第一参考角度对应的第一可见边缘代价,并更新所述第一参考角度至所述第一邻域范围内的第一角度,根据所述可见区域和所述二维点云,获取所述第一角度对应的第二可见边缘代价;Obtaining the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud, and updating the first reference angle to a first angle within the first neighborhood, Obtaining a second visible edge cost corresponding to the first angle according to the visible area and the two-dimensional point cloud;
    根据所述第二可见边缘代价和所述第一可见边缘代价之间的关系,更新所述第一角度至所述第一邻域范围内的第二角度;According to the relationship between the second visible edge cost and the first visible edge cost, update the first angle to a second angle in the range of the first neighborhood;
    重复执行获取所述第一邻域范围内的角度对应的可见边缘代价、根据相邻两次获取到的可见边缘代价的关系在所述第一邻域范围内更新角度的操作, 直至获取到可见边缘代价最小的所述第一预选角度。Repeat the operations of obtaining the visible edge cost corresponding to the angle in the first neighborhood, and updating the angle in the first neighborhood according to the relationship between the two adjacent visible edge costs, until the visibility is obtained The first preselected angle with the smallest edge cost.
  42. 根据权利要求39所述的移动平台,其特征在于,在参考角度的数目为多个时,所述处理器在用于执行根据所述至少一个参考角度、所述可见区域和所述二维点云,确定对应的可见边缘代价最小的所述拟合角度的操作时,具体用于:The mobile platform according to claim 39, wherein when the number of reference angles is more than one, the processor is configured to execute the operation according to the at least one reference angle, the visible area, and the two-dimensional point. Cloud, when determining the corresponding fitting angle with the smallest visible edge cost, it is specifically used for:
    根据所述可见区域和所述二维点云,在多个参考角度中确定对应的可见边缘代价最小的目标参考角度;According to the visible area and the two-dimensional point cloud, determine a corresponding target reference angle with the least visible edge cost among multiple reference angles;
    根据所述可见区域和所述二维点云,在所述目标参考角度的第二邻域范围内确定对应的可见边缘代价最小的所述拟合角度,所述第二邻域范围包括所述目标参考角度。According to the visible area and the two-dimensional point cloud, determine the corresponding fitting angle with the smallest visible edge cost within a second neighborhood range of the target reference angle, and the second neighborhood range includes the The target reference angle.
  43. 根据权利要求42所述的移动平台,其特征在于,所述处理器在用于执行根据所述可见区域和所述二维点云,在所述目标参考角度的第二邻域范围内确定可见边缘代价最小的所述拟合角度的操作时,具体用于:The mobile platform according to claim 42, wherein the processor is configured to determine the visibility within the second neighborhood of the target reference angle according to the visible area and the two-dimensional point cloud. The operation of the fitting angle with the smallest edge cost is specifically used for:
    从所述目标参考角度的第二邻域范围内获取多个子参考角度;Acquiring multiple sub-reference angles from within the second neighborhood of the target reference angle;
    根据所述可见区域和所述二维点云,确定各子参考角度对应的可见边缘代价中最小的子参考角度为所述拟合角度。According to the visible area and the two-dimensional point cloud, determine the smallest sub-reference angle among the visible edge costs corresponding to each sub-reference angle as the fitting angle.
  44. 根据权利要求43所述的移动平台,其特征在于,所述处理器在用于执行根据所述可见区域和所述二维点云,获取所述第一参考角度对应的第一可见边缘代价的操作时,具体用于:The mobile platform according to claim 43, wherein the processor is configured to perform a method of obtaining the first visible edge cost corresponding to the first reference angle according to the visible area and the two-dimensional point cloud. During operation, it is specifically used for:
    根据所述二维点云在第一方向上的第一外包络矩形、所述可见区域和所述可见区域对应的第一边界和第二边界,获取所述第一可见边缘代价;Acquiring the first visible edge cost according to the first outer envelope rectangle of the two-dimensional point cloud in the first direction, the visible area and the first boundary and the second boundary corresponding to the visible area;
    其中,所述第一方向为从点云传感器坐标系的坐标原点出发旋转所述第一参考角度后所对应的方向,所述点云传感器坐标系的坐标原点为所述点云传感器所在的位置。Wherein, the first direction is the direction corresponding to the rotation of the first reference angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor .
  45. 根据权利要求41所述的移动平台,其特征在于,所述处理器在用于执行根据所述二维点云在第一方向上的第一外包络矩形、所述可见区域和所述可见区域对应的第一边界和第二边界,获取所述第一可见边缘代价的操作时,具体用于:The mobile platform according to claim 41, wherein the processor is configured to execute the first outer envelope rectangle in the first direction according to the two-dimensional point cloud, the visible area and the visible The first boundary and the second boundary corresponding to the region are specifically used for the operation of obtaining the first visible edge cost:
    获取由所述可见区域、所述第一边界和第二边界限定的第一区域的第一面积;Acquiring a first area of a first area defined by the visible area, the first boundary, and the second boundary;
    获取由所述第一外包络矩形朝向所述移动平台的可见边、所述第一边界和第二边界限定的第二区域的第二面积;Acquiring the second area of the second area defined by the visible side of the first outer envelope rectangle facing the mobile platform, the first boundary and the second boundary;
    获取所述第一外包络矩形位于目标区域外的边、所述第一边界和第二边界限定的第三区域的第三面积,所述目标区域为所述第一边界和第二边界之间的区域,所述目标区域内包括所述二维点云;Obtain the side of the first envelope rectangle located outside the target area, the third area of the third area defined by the first boundary and the second boundary, the target area being between the first boundary and the second boundary An area between, the target area includes the two-dimensional point cloud;
    根据所述第一面积、所述第二面积和所述第三面积,确定所述第一可见边缘代价。The first visible edge cost is determined according to the first area, the second area, and the third area.
  46. 根据权利要求45所述的移动平台,其特征在于,所述处理器在用于执行根据所述第一面积、所述第二面积和所述第三面积,确定所述第一参考角度对应的所述第一可见边缘代价的操作时,具体用于:The mobile platform according to claim 45, wherein the processor is configured to determine the corresponding first reference angle according to the first area, the second area, and the third area. The operation of the first visible edge cost is specifically used for:
    获取所述第一面积、所述第二面积和第一预设权重,获取第一预选可见边缘代价;Acquiring the first area, the second area, and the first preset weight, and acquiring the first preselected visible edge cost;
    根据所述第三面积和第二预设权重,获取第二预选可见边缘代价;Obtaining the second preselected visible edge cost according to the third area and the second preset weight;
    根据所述第一预选可见边缘代价和所述第二预选可见边缘代价,确定所述第一可见边缘代价。Determine the first visible edge cost according to the first preselected visible edge cost and the second preselected visible edge cost.
  47. 根据权利要求37~46任一项所述的移动平台,其特征在于,所述预设角度范围包括的角度为第一预设角度与第二预设角度之间的角度,所述第一预设角度减去所述第二预设角度等于90°,所述预设角度范围包括所述第一预设角度和/或所述第二预设角度。The mobile platform according to any one of claims 37 to 46, wherein the angle included in the preset angle range is an angle between a first preset angle and a second preset angle, and the first preset angle Assuming that the angle minus the second preset angle is equal to 90°, the preset angle range includes the first preset angle and/or the second preset angle.
  48. 根据权利要求35所述的移动平台,其特征在于,所述拟合特征包括如下中的至少一项:述目标物体的拟合角度、所述目标物体的拟合方向、所述目标物体拟合边界框、所述目标物体的拟合可见边;The mobile platform of claim 35, wherein the fitting feature comprises at least one of the following: a fitting angle of the target object, a fitting direction of the target object, and a fitting direction of the target object Bounding box, the fitted visible edge of the target object;
    其中,所述拟合方向为从点云传感器坐标系的坐标原点出发旋转所述拟合角度后所对应的方向,所述点云传感器坐标系的坐标原点为所述点云传感器所在的位置。Wherein, the fitting direction is the direction corresponding to the rotation of the fitting angle from the coordinate origin of the point cloud sensor coordinate system, and the coordinate origin of the point cloud sensor coordinate system is the position of the point cloud sensor.
  49. 根据权利要求35或48所述的移动平台,其特征在于,所述处理器在用于执行根据所述拟合特征对所述目标物体进行拟合的操作时,具体用于:The mobile platform according to claim 35 or 48, wherein, when the processor is configured to perform an operation of fitting the target object according to the fitting feature, it is specifically configured to:
    根据所述目标物体的点云,获取所述目标物体的拟合高度;Obtaining the fitting height of the target object according to the point cloud of the target object;
    根据所述拟合特征和所述拟合高度,对所述目标物体进行拟合。Fit the target object according to the fitting feature and the fitting height.
  50. 根据权利要求49所述的移动平台,其特征在于,在所述拟合特征包 括如下中的至少一项时:所述目标物体的拟合角度、所述目标物体的拟合方向、所述目标物体的拟合可见边,所述处理器在用于执行根据所述拟合特征和所述拟合高度,对所述目标物体进行拟合的操作时,具体用于:The mobile platform according to claim 49, wherein when the fitting feature includes at least one of the following: the fitting angle of the target object, the fitting direction of the target object, and the target Fitting visible edges of the object, when the processor is used to perform the operation of fitting the target object according to the fitting feature and the fitting height, it is specifically used for:
    根据所述拟合特征,获取所述目标物体拟合边界框;Obtaining a fitting bounding box of the target object according to the fitting feature;
    根据所述拟合边界框和拟合高度,对所述目标物体进行拟合。Fit the target object according to the fitting bounding box and fitting height.
  51. 根据权利要求49所述的移动平台,其特征在于,所述处理器在用于执行根据所述目标物体的点云,获取所述目标物体的拟合高度的操作时,具体用于:The mobile platform according to claim 49, wherein when the processor is used to perform the operation of obtaining the fitting height of the target object according to the point cloud of the target object, it is specifically configured to:
    获取所述目标物体的点云拟合最大高度和拟合最小高度;Acquiring the maximum fitting height and the minimum fitting height of the target object;
    根据所述拟合最大高度和拟合最小高度,获取所述拟合高度。According to the maximum fitting height and the minimum fitting height, the fitting height is obtained.
  52. 一种移动平台,其特征在于,所述移动平台上搭载有权利要求18~34任一项所述的点云传感器。A mobile platform, characterized in that the point cloud sensor according to any one of claims 18 to 34 is mounted on the mobile platform.
  53. 一种计算机可读存储介质,包括程序或指令,当所述程序或指令在计算机上运行时,权利要求1~17任一所述的方法被执行。A computer-readable storage medium, comprising a program or instruction, when the program or instruction runs on a computer, the method according to any one of claims 1-17 is executed.
PCT/CN2019/082119 2019-04-10 2019-04-10 Target object fitting method, point cloud sensor and mobile platform WO2020206639A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2019/082119 WO2020206639A1 (en) 2019-04-10 2019-04-10 Target object fitting method, point cloud sensor and mobile platform
CN201980005593.1A CN111316289A (en) 2019-04-10 2019-04-10 Target object fitting method, point cloud sensor and mobile platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/082119 WO2020206639A1 (en) 2019-04-10 2019-04-10 Target object fitting method, point cloud sensor and mobile platform

Publications (1)

Publication Number Publication Date
WO2020206639A1 true WO2020206639A1 (en) 2020-10-15

Family

ID=71161148

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/082119 WO2020206639A1 (en) 2019-04-10 2019-04-10 Target object fitting method, point cloud sensor and mobile platform

Country Status (2)

Country Link
CN (1) CN111316289A (en)
WO (1) WO2020206639A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022077190A1 (en) * 2020-10-12 2022-04-21 深圳市大疆创新科技有限公司 Data processing method, control device, and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105404844A (en) * 2014-09-12 2016-03-16 广州汽车集团股份有限公司 Road boundary detection method based on multi-line laser radar
EP3332218A1 (en) * 2015-08-03 2018-06-13 TomTom Global Content B.V. Methods and systems for generating and using localisation reference data
CN109061703A (en) * 2018-06-11 2018-12-21 百度在线网络技术(北京)有限公司 Method, apparatus, equipment and computer readable storage medium used for positioning
CN109271880A (en) * 2018-08-27 2019-01-25 深圳清创新科技有限公司 Vehicle checking method, device, computer equipment and storage medium
CN109446886A (en) * 2018-09-07 2019-03-08 百度在线网络技术(北京)有限公司 Obstacle detection method, device, equipment and storage medium based on unmanned vehicle

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102005000652A1 (en) * 2005-01-04 2006-07-13 Robert Bosch Gmbh Method for object detection
JP6945785B2 (en) * 2016-03-14 2021-10-06 イムラ ウーロプ ソシエテ・パ・アクシオンス・シンプリフィエ 3D point cloud processing method
CN108875804B (en) * 2018-05-31 2019-12-20 腾讯科技(深圳)有限公司 Data processing method based on laser point cloud data and related device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105404844A (en) * 2014-09-12 2016-03-16 广州汽车集团股份有限公司 Road boundary detection method based on multi-line laser radar
EP3332218A1 (en) * 2015-08-03 2018-06-13 TomTom Global Content B.V. Methods and systems for generating and using localisation reference data
CN109061703A (en) * 2018-06-11 2018-12-21 百度在线网络技术(北京)有限公司 Method, apparatus, equipment and computer readable storage medium used for positioning
CN109271880A (en) * 2018-08-27 2019-01-25 深圳清创新科技有限公司 Vehicle checking method, device, computer equipment and storage medium
CN109446886A (en) * 2018-09-07 2019-03-08 百度在线网络技术(北京)有限公司 Obstacle detection method, device, equipment and storage medium based on unmanned vehicle

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
YE GANG: "Research on Multi-target Detection and Tracking Algorithm of Autonomous Vehicle Based on 3D Lidar in Urban Environment", MASTER THESIS, 31 August 2016 (2016-08-31), CN, pages 1 - 72, XP009523617 *

Also Published As

Publication number Publication date
CN111316289A (en) 2020-06-19

Similar Documents

Publication Publication Date Title
EP3620823B1 (en) Method and device for detecting precision of internal parameter of laser radar
US8072450B2 (en) System and method for measuring a three-dimensional object
CN110031824A (en) Laser radar combined calibrating method and device
KR101858902B1 (en) System for extracting position information of object in point cloud data by using component
CN107766405A (en) Automotive vehicle road model defines system
CN106887020A (en) A kind of road vertical and horizontal section acquisition methods based on LiDAR point cloud
JP2010541051A (en) Geospace modeling system and related methods with user-selectable building shape options
WO2020168685A1 (en) Three-dimensional scanning viewpoint planning method, device, and computer readable storage medium
CN107622530B (en) Efficient and robust triangulation network cutting method
JP2010541050A (en) Geospace modeling system and related method with inpainting and error calculation configuration
CN103761739A (en) Image registration method based on half energy optimization
CN105184854B (en) For the fast modeling method of underground space scanning element cloud performance data
CN110503723B (en) Determination method of dentition defect digital model observation line
WO2020206639A1 (en) Target object fitting method, point cloud sensor and mobile platform
CN108563915B (en) Vehicle digital simulation test model construction system and method, and computer program
CN114299242A (en) Method, device and equipment for processing images in high-precision map and storage medium
CN110796735B (en) Grid division method for NURBS curved surface finite element plate shell and computer realization system
CN112197773A (en) Visual and laser positioning mapping method based on plane information
CN116958218A (en) Point cloud and image registration method and equipment based on calibration plate corner alignment
CN104036096A (en) Method for mapping bump features on inclined face to manufacturing feature bodies
CN114820505A (en) Non-contact measurement method of dynamic target
CN112950708A (en) Positioning method, positioning device and robot
CN112084854A (en) Obstacle detection method, obstacle detection device and robot
CN107146286B (en) Three-dimensional model automatic adjustment method based on image edge characteristics
CN115861561B (en) Contour line generation method and device based on semantic constraint

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19924327

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19924327

Country of ref document: EP

Kind code of ref document: A1