WO2020151664A1 - Vehicle-mounted control device, field end positioning device, and vehicle - Google Patents

Vehicle-mounted control device, field end positioning device, and vehicle Download PDF

Info

Publication number
WO2020151664A1
WO2020151664A1 PCT/CN2020/073247 CN2020073247W WO2020151664A1 WO 2020151664 A1 WO2020151664 A1 WO 2020151664A1 CN 2020073247 W CN2020073247 W CN 2020073247W WO 2020151664 A1 WO2020151664 A1 WO 2020151664A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
positioning
positioning information
field
field end
Prior art date
Application number
PCT/CN2020/073247
Other languages
French (fr)
Chinese (zh)
Inventor
安淑苗
张凯
张瀛
高崇桂
杜康
张召强
Original Assignee
长城汽车股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201910075294.7A external-priority patent/CN110775054B/en
Priority claimed from CN201910073984.9A external-priority patent/CN110794821B/en
Priority claimed from CN201910074340.1A external-priority patent/CN110794822A/en
Priority claimed from CN201910075542.8A external-priority patent/CN110775055B/en
Application filed by 长城汽车股份有限公司 filed Critical 长城汽车股份有限公司
Publication of WO2020151664A1 publication Critical patent/WO2020151664A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions

Definitions

  • the present invention relates to the technical field of automatic control, in particular to a vehicle-mounted control device, a field-end positioning device and a vehicle.
  • the solutions for controlling vehicles in the parking lot are:
  • the heavy-duty, light-vehicle, and field-side solutions use a variety of acquisition technologies, and the vehicle side does not require sensing functions.
  • the disadvantage of this solution is that the parking lot needs to be transformed, and multiple collections at the field side need to be carried out all the time, cost and equipment
  • the maintenance cost is very high in the later period, and the promotion is difficult.
  • the vehicle already has a certain perception sensor, which will cause a waste if not used.
  • the heavy vehicle end and the light field end are equipped with a variety of acquisition technologies at the vehicle end. In some special scenes, such as too bright or dark light, turning and fewer feature points, etc., the positioning method based on the vehicle end acquisition technology cannot always Work accurately.
  • the present invention aims to propose a vehicle-mounted control device to avoid the problem that the positioning method of the vehicle-end acquisition technology cannot always work accurately, and to achieve accurate full-course positioning and/or obstacle avoidance.
  • a vehicle-mounted control device comprising: a vehicle-mounted positioning unit and a main control unit, wherein the vehicle-mounted positioning unit is used for collecting current scene images or generating and outputting vehicle-side positioning information; the main control unit is used for: When the current scene image or the vehicle-side positioning information meets a preset condition, send a field-side positioning information acquisition request, where the field-side positioning information includes the position coordinates of the vehicle and/or the position coordinates of the obstacle; receive The field end positioning information; and using the field end positioning information for positioning and/or obstacle avoidance.
  • the preset condition includes that the pixel grayscale value of the current scene image is not within a preset range.
  • the preset condition includes alternately changing the size of the drivable area determined according to the current scene image during the driving of the vehicle.
  • the preset condition includes: during the running of the vehicle, the deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to a preset value, wherein the expected positioning information is based on the vehicle's direction, speed, and initial The positioning information is obtained; or during the driving of the vehicle, the update frequency of the vehicle-side positioning information within a predetermined time is less than or equal to a preset frequency.
  • the preset condition includes that the distance between the vehicle and the set area determined according to the vehicle-end positioning information is less than or equal to the set distance.
  • the main control unit is further configured to: when the pixel gray value of the current scene image is in the preset range, use the vehicle-side positioning information obtained by the vehicle-mounted positioning unit to perform positioning and/or avoidance. barrier.
  • the main control unit is also used to: during the driving process of the vehicle, when the drivable area does not change in size, use the vehicle-side positioning information obtained by the vehicle-mounted positioning unit to perform positioning and/or Avoidance.
  • the main control unit is further configured to: in a period in which the drivable area is alternately changed in size, when the number of times the ground undulation of the drivable area is greater than or equal to a preset value is greater than or equal to a preset number of times , Determining whether the front and rear vehicles are slipping according to the field end positioning information; when the front and rear vehicles slipping, the field end positioning information is used to avoid obstacles to avoid the slipping vehicle.
  • the main control unit is further configured to: during the running of the vehicle, the deviation between the vehicle positioning information and the expected positioning information is less than a preset value or the update frequency of the vehicle positioning information within a predetermined time is greater than When the preset value is set, the vehicle terminal positioning information is used for positioning and/or obstacle avoidance.
  • the main control unit is also used for positioning and/or avoiding obstacles by using vehicle-side positioning information obtained by the vehicle-mounted positioning unit when the vehicle is greater than a set distance from the set area.
  • the vehicle-mounted control device of the present invention uses the vehicle-mounted positioning unit to collect current scene images or generate and output vehicle-side positioning information, and according to whether the current scene image or vehicle-side positioning information meets preset conditions, request the field-side positioning information according to Positioning and/or obstacle avoidance based on field end positioning information. According to whether the current scene image or vehicle-side positioning information meets the preset conditions, the problem that the positioning method of the vehicle-side collection technology cannot always work accurately can be avoided, and accurate full-course positioning and/or obstacle avoidance can be achieved.
  • Another object of the present invention is to provide a field end positioning device to provide accurate field end positioning information when needed to achieve accurate positioning and/or obstacle avoidance.
  • a field-side positioning device comprising: a plurality of field-side positioning units and a field-side server, wherein the plurality of field-side positioning units are used to collect information related to the position of a vehicle and/or Information related to the location of the obstacle; the field-side server is used to: receive a field-side positioning information acquisition request from the vehicle; in response to the field-side positioning information acquisition request, according to the information related to the position of the vehicle And/or information related to the location of the obstacle obtains field end positioning information; and sends the field end positioning information to the vehicle.
  • the multiple field end positioning units are arranged in the area around the corner and/or the area around the transparent glass.
  • the plurality of field end positioning units are arranged in the continuous turning area.
  • the multiple field end positioning units are arranged in areas where the characteristic points are insufficient for the on-board positioning device to correctly perform positioning.
  • the field end positioning device of the present invention has the following advantages:
  • the field-side positioning device of the present invention uses multiple field-side positioning units to collect information related to the position of the vehicle and/or information related to the location of obstacles, and upon receiving the field-side positioning information acquisition request of the vehicle,
  • the field-side server sends field-side positioning information obtained based on information related to the location of the vehicle and/or information related to the location of obstacles, and can provide accurate field-side positioning information when needed to achieve precise positioning and/or obstacle avoidance .
  • Another object of the present invention is to provide a vehicle that can determine a control strategy based on ambient light, which can avoid the adverse effects of ambient light on positioning and/or obstacle avoidance, and achieve accurate full-course positioning and/or obstacle avoidance.
  • a vehicle including the vehicle-mounted control device described above.
  • FIG. 1 is a schematic structural diagram of a vehicle control device provided by an embodiment of the present invention
  • 2A is a control flow chart of a scene with too dark or too bright light provided by an embodiment of the present invention
  • 2B is a schematic diagram of a continuous turning scene provided by an embodiment of the present invention.
  • 2C is a control flowchart of a continuous turning scene provided by an embodiment of the present invention.
  • 2D is a schematic diagram of a scene with insufficient feature points provided by an embodiment of the present invention.
  • 2E is a control flowchart of a scenario with insufficient feature points provided by an embodiment of the present invention.
  • FIG. 2F is a control flow chart for setting a region according to an embodiment of the present invention.
  • 3A is a schematic structural diagram of a vehicle positioning unit provided by an embodiment of the present invention.
  • 3B is a schematic diagram of the installation position of a vehicle-mounted camera provided by an embodiment of the present invention.
  • FIGS. 4A-4B are schematic diagrams of obstacle avoidance scenarios provided by an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a field end positioning device provided by an embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of a vehicle control system provided by an embodiment of the present invention.
  • Fig. 7 is an interactive schematic diagram of a vehicle control system provided by an embodiment of the present invention.
  • Fig. 1 is a schematic structural diagram of a vehicle control device provided by an embodiment of the present invention.
  • the vehicle-mounted positioning unit and the main control unit wherein the vehicle-mounted positioning unit 1 is used to collect current scene images or generate and output vehicle-side positioning information; the main control unit 2 is used to: When the scene image or the vehicle-side positioning information meets a preset condition, a field-side positioning information acquisition request is sent, where the field-side positioning information includes the position coordinates of the vehicle and/or the position coordinates of obstacles; receiving the field-side Positioning information; and using the field end positioning information for positioning and/or obstacle avoidance.
  • the preset conditions can include the following:
  • the pixel grayscale value of the current scene image is not within the preset range
  • the size of the drivable area determined according to the current scene image is changed alternately;
  • the deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to a preset value, wherein the expected positioning information is obtained according to the vehicle's direction, vehicle speed, and initial positioning information;
  • the update frequency of the vehicle end positioning information within a predetermined time is less than or equal to a preset frequency
  • the distance between the vehicle and the set area determined according to the vehicle end positioning information is less than or equal to the set distance
  • the embodiment of the present invention also aims at several scenarios corresponding to the above several preset conditions to switch between on-board positioning and field-side positioning, as follows:
  • FIG. 2A is a control flow chart of a scene with too dark or too bright light provided by an embodiment of the present invention.
  • the vehicle-mounted positioning unit 1 is used to collect current scene images; the main control unit 2 is used to: send field end positioning information when the pixel gray value of the current scene image is not within a preset range The acquisition request, wherein the field end positioning information includes the position coordinates of the vehicle and/or the position coordinates of the obstacle; receiving the field end positioning information; and using the field end positioning information for positioning and/or obstacle avoidance.
  • the camera 31 installed on the vehicle will affect the feature recognition due to overexposure. If the confidence judgment is set, the positioning confidence of the vehicle positioning unit 1 will be reduced (that is, the positioning is not accurate).
  • the ROI pixel gray value of the collected scene For example, the ROI pixel gray value is not in the preset range (the end point a or b of the preset range is obtained by actual calibration, preferably a is between 180-255, b (Between 0-70) It can be determined that the confidence level of the positioning result of the on-board positioning unit 1 here is low. At this time, it can request to obtain the field end positioning information, and use the field end positioning information for positioning and/or obstacle avoidance.
  • the current scene image is first collected, and then it is judged whether the pixel gray value of the current scene image is within the preset range.
  • the pixel gray value of the current scene image is within the preset range, use the The vehicle-side positioning information obtained by the vehicle-mounted positioning unit 1 performs positioning and/or obstacle avoidance; when the pixel gray value of the current scene image is not within the preset range, a field-side positioning information acquisition request is sent; when the field-side image is received After the positioning information, the field end positioning information is used for positioning and/or obstacle avoidance.
  • Fig. 2B is a schematic diagram of a continuous turning scene provided by an embodiment of the present invention. As shown in FIG. 2B, for a turning scene, especially a continuous turning scene.
  • the on-vehicle positioning unit 1 is used to collect current scene images; the main control unit 2 is used to: determine the drivable area according to the current scene images; during the driving of the vehicle, the drivable When the size of the area changes alternately, send a field-side positioning information acquisition request, where the field-side positioning information includes the position coordinates of the vehicle and/or the position coordinates of obstacles; receive the field-side positioning information; and use the field Terminal positioning information for positioning and/or obstacle avoidance.
  • the current scene image is first collected, and then the drivable area is determined according to the current scene image; during the driving of the vehicle, it is determined whether the drivable area undergoes alternate changes in size; in the drivable area
  • send field-side positioning information then receive the field-side positioning information, use the field-side positioning information for positioning and/or obstacle avoidance; when the drivable area does not change in size alternately, use pass
  • the vehicle terminal positioning information is used for positioning and/or obstacle avoidance.
  • the continuous turning scene may also be a spiral staircase.
  • the vehicle is driving on a spiral staircase, wherein the preset The value can be 30 cm, and the preset number of times is for example 1, but the present invention does not limit this.
  • the preset The value can be 30 cm, and the preset number of times is for example 1, but the present invention does not limit this.
  • the vehicle can be driven to the left to perform obstacle avoidance maneuvers to avoid danger.
  • obstacle avoidance methods will be detailed below.
  • FIG. 2D is a schematic diagram of a scene with insufficient feature points provided by an embodiment of the present invention. As shown in Figure 2D, for the scene with insufficient feature points.
  • the vehicle-mounted positioning unit 1 is used to generate and output vehicle-side positioning information;
  • the main control unit 2 is used to: perform one of the following steps: 1) According to the direction, speed and initial positioning of the vehicle Information to obtain expected positioning information; in the process of driving the vehicle, when the deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to a preset value, a field-side positioning information acquisition request is sent; 2) when the vehicle is driving In the process, when the update frequency of the vehicle-side positioning information within a predetermined time is less than or equal to the preset frequency, send a field-side positioning information acquisition request; then, receive the field-side positioning information; and use the field-side positioning information for positioning And/or obstacle avoidance.
  • the field end positioning information includes the position coordinates of the vehicle and/or the position coordinates of the obstacle;
  • the vehicle-mounted positioning unit 1 generates and outputs vehicle-side positioning information, and then the main control unit 2 can make two judgments:
  • the first one is: during the running of the vehicle, determine whether the update frequency of the vehicle-side positioning information within a predetermined time is less than or equal to a preset frequency; within the predetermined time, the update frequency of the vehicle-end positioning information is less than or equal to the preset frequency In case of frequency, send a field-side positioning information acquisition request, receive the field-side positioning information, and use the field-side positioning information for positioning and/or obstacle avoidance; within a predetermined time, the update frequency of the vehicle positioning information is greater than the preset value When using the vehicle terminal positioning information for positioning and/or obstacle avoidance.
  • the car-side positioning unit generally depends on the feature points in the environment. If the feature points are insufficient, the car-side positioning unit may not output the car-side positioning information within a predetermined time (for example, 1 second, but not limited to this). Unable to update the vehicle positioning information. Therefore, it can be judged whether the vehicle enters a scene with insufficient feature points based on the condition of whether to output vehicle-end positioning information at a predetermined time.
  • a predetermined time for example, 1 second, but not limited to this. Unable to update the vehicle positioning information. Therefore, it can be judged whether the vehicle enters a scene with insufficient feature points based on the condition of whether to output vehicle-end positioning information at a predetermined time.
  • the second is: first obtain the expected positioning information according to the vehicle's direction, vehicle speed, and initial positioning information; then, during the driving of the vehicle, determine whether the deviation between the vehicle end positioning information and the expected positioning information is greater than or equal to The preset value, when the deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to the preset value, send a field-side positioning information acquisition request, receive the field-side positioning information, and use the field-side positioning information to perform Positioning and/or obstacle avoidance; when the deviation between the vehicle positioning information and the expected positioning information is less than a preset value, the vehicle end positioning information is used for positioning and/or obstacle avoidance.
  • the expected position of the vehicle can be obtained according to the initial position, combined with information such as vehicle speed, direction, and driving time, which is more commonly used and will not be repeated here.
  • the deviation of the car-side positioning information from the expected positioning information may be greater than or equal to the preset value.
  • the car-side positioning information output by the car-side positioning unit may be very inaccurate, or the output car
  • the terminal positioning information is a set of random coordinates.
  • the confidence level of the vehicle-side positioning information output by the vehicle-side positioning unit may also be low (for example, less than 80%), essentially because the deviation between the vehicle-side positioning information and the expected positioning information is large . Therefore, when the deviation between the vehicle-end positioning information and the expected positioning information is greater than or equal to the preset value, it can be determined whether the vehicle has entered a scene with insufficient feature points.
  • the areas of the above three scenes (that is, the light is too bright or too dark, turning, and the feature points are insufficient) can also be set in advance, and the on-board positioning and field-side positioning can be switched according to whether the vehicle enters the set area.
  • the vehicle-mounted positioning unit 1 is used to generate and output vehicle-side positioning information
  • the main control unit 2 is used to: determine the position of the vehicle according to the vehicle-side positioning information; determine the position of the vehicle The distance between the vehicle and the set area; when the distance between the vehicle and the set area is less than or equal to the set distance, send a field end positioning information acquisition request; receive the field end positioning information; and use the field Terminal positioning information for positioning and/or obstacle avoidance, wherein the field terminal positioning information includes the position coordinates of the vehicle and/or the position coordinates of the obstacle;
  • the vehicle-mounted positioning unit 1 generates and outputs vehicle-side positioning information; then determines the position of the vehicle according to the vehicle-side positioning information; determines the distance between the vehicle and the set area; Whether the distance of the set area is less than or equal to the set distance; when the distance between the vehicle and the set area is less than or equal to the set distance, send a field end positioning information acquisition request, receive the field end positioning information, and use all
  • the field end positioning information is used for positioning and/or obstacle avoidance; when the distance of the vehicle from the set area is greater than the set distance, the vehicle end positioning information is used for positioning and/or obstacle avoidance.
  • the size of the setting area and the setting distance can be selected according to actual conditions, and the present invention does not limit it.
  • the vehicle-mounted positioning unit 1 that obtains vehicle-side positioning information will be described below.
  • Fig. 3A is a schematic structural diagram of a vehicle-mounted positioning unit provided by an embodiment of the present invention.
  • the vehicle-mounted positioning unit 1 mainly includes at least one of a camera 31, a laser radar 32, a millimeter wave radar 33, an ultrasonic radar 34, a vehicle speed sensor 35, a wheel angular velocity sensor 36 and an inertial sensor 37.
  • the millimeter wave radar 33 is mainly used for obstacle avoidance, and the ultrasonic radar 34 is mainly realized by the cooperation of parking and visual positioning solutions.
  • the vehicle speed sensor 35, the wheel angular velocity sensor 36, and the inertial sensor 37 can obtain various states of the vehicle, such as vehicle speed, wheel speed, acceleration, tilt, shock, vibration, rotation, and multi-degree-of-freedom motion.
  • Fig. 3B is a schematic diagram of an installation position of a vehicle-mounted camera provided by an embodiment of the present invention.
  • the vehicle-mounted camera 31 may mainly include a surround-view camera 311 and a front-view camera 312, etc., to comprehensively capture images around the vehicle.
  • the main control unit 2 uses high-precision maps and/or semantic maps and surround-view cameras collected by vehicle sensors. 311.
  • the front-view camera 312, the visual positioning scheme uses the vision-based synchronous positioning and map construction (VSLAM) to generate a semantic map and a high-precision map.
  • VSLAM vision-based synchronous positioning and map construction
  • the vehicle-mounted camera 31 recognizes and collects the VSLAM feature points for matching, and combines the inertial sensor 37 (IMU ) Information to realize vehicle positioning and obtain vehicle-end positioning information.
  • SLAM simultaneous localization and mapping, SLAM refers to the process of constructing an environmental map while calculating its own position based on the information of the sensor, to solve the problem of positioning and map construction when moving in an unknown environment.
  • VSLAM stands for Vision SLAM (Vision SLAM), which is more advanced and is based on visual positioning and mapping, which is more accurate and rapid.
  • FIGS. 4A-4B are schematic diagrams of obstacle avoidance scenarios provided by an embodiment of the present invention.
  • FIG. 4A for example, at a turn, you may encounter a vehicle coming from another direction, and obstacle avoidance is required at this time. Since the vehicle traveling in the other direction is blocked, the on-board camera 31 cannot be detected in time. Therefore, it is necessary to use the field-side positioning information provided by the field-side positioning unit 4 to avoid obstacles.
  • the obstacle avoidance process is: according to the position coordinates of the obstacle (here, a vehicle traveling in another direction), determine the obstacle's position The area formed by the preset distance around the position coordinates is a dangerous area; the vehicle is controlled to avoid the dangerous area.
  • the dangerous area and the early warning area formed by the obstacle can be delineated first.
  • the preset distance around the position coordinates of the obstacle (which can be set according to the actual situation) is the dangerous area, and the distance from the dangerous area
  • the area formed by a certain distance (also can be set according to the actual situation, such as 0-50m) is the early warning area.
  • vehicle B is the own vehicle, combined with high-precision map and positioning result information, when the vehicle is outside the warning area, the vehicle realizes obstacle recognition and positioning through the on-board positioning unit 1, and when the vehicle enters the warning area, it will pass
  • the Internet of Vehicles system receives information about all obstacles (vehicle A and pedestrian/animal C) in the early warning area.
  • vehicle B avoids the dangerous area formed by the obstacle (that is, stays away from the obstacle).
  • the field end positioning unit 4 is the main one, and the coordinates of the early warning area match the coordinates of the high-precision map.
  • the size of the area is finally determined according to the actual test results. It can be switched to be based on the vehicle positioning unit 1.
  • the field end positioning device is mainly used to provide field end positioning information.
  • Fig. 5 is a schematic structural diagram of a field end positioning device provided by an embodiment of the present invention.
  • the field-side positioning device includes: a plurality of field-side positioning units 4 and a field-side server 5, wherein the plurality of field-side positioning units 4 are used to collect information related to the position of the vehicle and/ Or information related to the position of the obstacle; the field-side server 5 is used to: receive a field-side positioning information acquisition request from the vehicle; in response to the field-side positioning information acquisition request, according to the position of the vehicle Related information and/or information related to the location of the obstacle obtains field end positioning information; and sends the field end positioning information to the vehicle.
  • the field end positioning unit 4 may be a laser radar 32 or an infrared camera 31, and the field end laser radar 32 may be columnar, so as to be embedded in a wall or fixed on a building through a structure.
  • the field-side positioning unit 4 can only be installed at a basic fixed position (that is, a position where the vehicle-mounted positioning unit 1 cannot accurately locate and avoid obstacles), instead of having to install it in every part of the parking lot, for example, it is only installed around the turn The area, the area around the corner, the area around the transparent glass, or the feature point is not enough for the vehicle-mounted positioning device to correctly locate the vehicle.
  • the field-side server 5 After receiving the field-side positioning information acquisition request from the vehicle, the field-side server 5 obtains the coordinates of multiple field-side positioning units 4 according to the IDs of the field-side positioning units 4 in response to the field-side positioning information acquisition request; The coordinates of each field end positioning unit 4 and the information related to the position of the vehicle and/or the information related to the position of the obstacle obtain the position coordinates of the vehicle and/or the position coordinates of the obstacle as field end positioning information.
  • the field-side server 5 can process the information related to the position of the vehicle and/or the information related to the position of the obstacle as described above, and can also be divided into a plurality of grouping servers 51 and a total server corresponding to the plurality of field-side positioning units 4 52, as shown in Figure 4B, still taking a turn as an example (the light is too bright or too dark, etc.), it is difficult for the visual solution of the scene at the turn to identify the oncoming cars, pedestrians or small animals on the way.
  • the field end positioning unit 4 installed at the field end can predict the danger well.
  • the field end positioning unit 4 installed at the field end transmits the collected image information to the packet server 51 at a certain frame rate.
  • the field end positioning unit 4 The coordinates are debugged and fixed at the beginning of installation. The coordinates are fixed.
  • the grouping server 51 obtains the distance between the vehicle and the field-side positioning unit 4 according to the results of the previous calibration, and calculates the relative coordinates between the vehicle and the field-side positioning unit 4 , Complete the absolute coordinate conversion through a certain algorithm, and send it to the background server 52.
  • the field end is preferably ⁇ 3 field end positioning units 4 to achieve precise positioning. When there is a field end positioning unit 4 obscured, other field end positioning units can be obtained 4 coordinate information, positioning is achieved through algorithms.
  • Obstacle information (pedestrians, vehicles, small animals, etc.) at the corner can be obtained through the field-side positioning unit 4, processed by the grouping server 51, and transmitted to the back-end server 52, which processes and outputs the type and size of the obstacle
  • the field-end positioning information such as coordinates, driving trajectory, etc. is transmitted to the vehicle end through wireless transmission, and the main control unit 2 of the vehicle end makes control decisions, that is, positioning and/or obstacle avoidance.
  • Fig. 6 is a schematic structural diagram of a vehicle control system provided by an embodiment of the present invention. As shown in FIG. 6, the vehicle control system includes the vehicle control device described above and the field end positioning device described above.
  • the field end lidar 32 can form a group of 5-10, and each group of data is transmitted to the corresponding grouping server 51 of each group, and the grouping server 51 of each group is transmitted to the total server 52 in a wired or wireless manner.
  • Carrying out data processing to realize vehicle positioning, the positioning of obstacles (people, cars, etc.) in the entire parking lot or more complex road sections, and then the processed results can be transmitted to the autonomous vehicle controller through Wifi/4G/5G communication methods, Fusion with the sensor information of the body itself and IMU processing information, and finally output the vehicle self-positioning and obstacle information in the parking lot or more complex road sections, and finally realize the self-positioning, obstacle avoidance and path planning functions of the vehicle.
  • On-site server 5 has stronger processing capacity, lower cost, and does not require vehicle regulations, so it is more feasible for mass production, and is suitable for the parking of unmanned vehicles and manned vehicles. field.
  • Fig. 7 is an interactive schematic diagram of a vehicle control system provided by an embodiment of the present invention.
  • the main control unit 2 on the vehicle side receives vehicle-side positioning information from the vehicle-mounted positioning unit 1, and when it needs field-side positioning information, it sends a field-side positioning information acquisition request, and the field-side server 5 receives field-side positioning information.
  • the field-side server 5 receives field-side positioning information.
  • the embodiment of the present invention adopts a positioning solution of the field end positioning unit 4 (for example, a lidar 32 or a special camera 31).
  • the field end positioning unit 4 is used as a global perspective, which can predict danger in advance and achieve a vehicle-yard coordination effect.
  • the field-side positioning unit 4 arranged at the field-side can only be arranged in places with extremely poor light and/or turning, etc., for small animals, children, or emergency intruders in the parking lot, the vehicle-mounted positioning unit 1
  • the field-side positioning unit 4 can be supplemented, and the vehicle can predict the danger in advance through field-side and vehicle-side communication, and avoid accidents.
  • the final realization method is determined by the field end and the realization effect, based on the principles of safety, reliability, simple installation and excellent realization effect.
  • This solution uses a low-cost vehicle end combined with a low-cost field end solution, by increasing the field end in the area around the turn, the area around the corner, the area around the transparent glass, and the feature points that are not enough for the vehicle positioning device to correctly locate the vehicle.
  • the device predicts what is about to happen (person or car) and feeds it back to the car end, which is equivalent to enhancing the vehicle's perception ability, realizing the effect of vehicle external information exchange (V2X), and improving system security.
  • V2X vehicle external information exchange
  • This solution can only add field-end equipment at necessary intersections or scenes, reducing system costs.
  • An embodiment of the present invention also provides a vehicle, which includes the vehicle control device described above.

Abstract

A vehicle-mounted control device, a field end positioning device, and a vehicle. The vehicle-mounted control device comprises: a vehicle-mounted positioning unit (1) and a master control unit (2). The vehicle-mounted positioning unit (1) is configured to acquire a current scene image or to generate and output vehicle end positioning information. The master control unit (2) is configured to: send a request of obtaining field end positioning information when the current scene image or the vehicle end positioning information satisfies a preset condition, wherein the field end positioning information comprises location coordinates of a vehicle and/or location coordinates of an obstacle; receive the field end positioning information; and perform positioning and/or obstacle avoidance using the field end positioning information.

Description

车载控制装置、场端定位装置及车辆Vehicle-mounted control device, field-side positioning device and vehicle 技术领域Technical field
本发明涉及自动控制技术领域,特别涉及一种车载控制装置、场端定位装置及车辆。The present invention relates to the technical field of automatic control, in particular to a vehicle-mounted control device, a field-end positioning device and a vehicle.
背景技术Background technique
目前阶段在车场中控制车辆的方案有:At the current stage, the solutions for controlling vehicles in the parking lot are:
1、重场端、轻车端,场端方案采用多种采集技术,车端不需要感知功能,此方案缺点是需要对停车场进行改造,场端的多种采集需要一直进行,成本及设备的后期维护成本很高,推广难度比较大,车辆已经具备了一定的感知传感器,如果不用也造成一种浪费。1. The heavy-duty, light-vehicle, and field-side solutions use a variety of acquisition technologies, and the vehicle side does not require sensing functions. The disadvantage of this solution is that the parking lot needs to be transformed, and multiple collections at the field side need to be carried out all the time, cost and equipment The maintenance cost is very high in the later period, and the promotion is difficult. The vehicle already has a certain perception sensor, which will cause a waste if not used.
2、重车端、轻场端,在车端配备多种采集技术,在一些特殊场景,例如光线过亮或过暗、转弯以及特征点较少等,基于车端采集技术的定位方式不能一直准确工作。2. The heavy vehicle end and the light field end are equipped with a variety of acquisition technologies at the vehicle end. In some special scenes, such as too bright or dark light, turning and fewer feature points, etc., the positioning method based on the vehicle end acquisition technology cannot always Work accurately.
发明内容Summary of the invention
有鉴于此,本发明旨在提出一种车载控制装置,避免车端采集技术的定位方式不能一直准确工作的问题,实现精准的全程定位和/或避障。In view of this, the present invention aims to propose a vehicle-mounted control device to avoid the problem that the positioning method of the vehicle-end acquisition technology cannot always work accurately, and to achieve accurate full-course positioning and/or obstacle avoidance.
为达到上述目的,本发明的技术方案是这样实现的:In order to achieve the above objective, the technical solution of the present invention is achieved as follows:
一种车载控制装置,该车载控制装置包括:车载定位单元以及主控单元,其中,所述车载定位单元用于采集当前场景图像或生成并输出车端定位信息;所述主控单元用于:在所述当前场景图像或所述车端定位信息满足预设条件时,发送场端定位信息获取请求,其中,所述场端定位信息包括车辆的位置坐标和/或障碍物的位置坐标;接收所述场端定位信息;以及使用所述场端定位信息进行定位和/或避障。A vehicle-mounted control device comprising: a vehicle-mounted positioning unit and a main control unit, wherein the vehicle-mounted positioning unit is used for collecting current scene images or generating and outputting vehicle-side positioning information; the main control unit is used for: When the current scene image or the vehicle-side positioning information meets a preset condition, send a field-side positioning information acquisition request, where the field-side positioning information includes the position coordinates of the vehicle and/or the position coordinates of the obstacle; receive The field end positioning information; and using the field end positioning information for positioning and/or obstacle avoidance.
进一步的,所述预设条件包括所述当前场景图像的像素灰阶值不在预设范围内。Further, the preset condition includes that the pixel grayscale value of the current scene image is not within a preset range.
进一步的,所述预设条件包括在车辆行驶过程中,根据所述当前的场景图像确定的可行驶区域进行大小交替变化。Further, the preset condition includes alternately changing the size of the drivable area determined according to the current scene image during the driving of the vehicle.
进一步的,所述预设条件包括:在所述车辆行驶过程中,所述车端定位信息与预期定位信息的偏差大于等于预设值,其中所述预期定位信息根据车辆的方向、车速以及初始定位信息得到;或在所述车辆行驶过程中,预定时间内所述车端定位信息的更新频 率小于等于预设频率。Further, the preset condition includes: during the running of the vehicle, the deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to a preset value, wherein the expected positioning information is based on the vehicle's direction, speed, and initial The positioning information is obtained; or during the driving of the vehicle, the update frequency of the vehicle-side positioning information within a predetermined time is less than or equal to a preset frequency.
进一步的,所述预设条件包括根据所述车端定位信息确定的车辆距设定区域的距离小于等于设定距离。Further, the preset condition includes that the distance between the vehicle and the set area determined according to the vehicle-end positioning information is less than or equal to the set distance.
进一步的,所述主控单元还用于:在所述当前场景图像的像素灰度值处于所述预设范围时,使用通过所述车载定位单元得到的车端定位信息进行定位和/或避障。Further, the main control unit is further configured to: when the pixel gray value of the current scene image is in the preset range, use the vehicle-side positioning information obtained by the vehicle-mounted positioning unit to perform positioning and/or avoidance. barrier.
进一步的,所述主控单元还用于:在所述车辆行驶过程中,所述可行驶区域未进行大小交替变化时,使用通过所示车载定位单元得到的车端定位信息进行定位和/或避障。Further, the main control unit is also used to: during the driving process of the vehicle, when the drivable area does not change in size, use the vehicle-side positioning information obtained by the vehicle-mounted positioning unit to perform positioning and/or Avoidance.
进一步的,所述主控单元还用于:在所述可行驶区域进行大小交替变化的一个周期内,当所述可行驶区域的地面起伏变化大于等于预设值的次数大于等于预设次数时,根据所述场端定位信息,判断所述前后方车辆是否发生溜车;在所述前后方车辆发生溜车时,使用所述场端定位信息进行避障以避开发生溜车的车辆。Further, the main control unit is further configured to: in a period in which the drivable area is alternately changed in size, when the number of times the ground undulation of the drivable area is greater than or equal to a preset value is greater than or equal to a preset number of times , Determining whether the front and rear vehicles are slipping according to the field end positioning information; when the front and rear vehicles slipping, the field end positioning information is used to avoid obstacles to avoid the slipping vehicle.
进一步的,所述主控单元还用于:在所述车辆行驶过程中,所述车辆定位信息与所述预期定位信息的偏差小于预设值或预定时间内所述车辆定位信息的更新频率大于预设值时,使用所述车端定位信息进行定位和/或避障。Further, the main control unit is further configured to: during the running of the vehicle, the deviation between the vehicle positioning information and the expected positioning information is less than a preset value or the update frequency of the vehicle positioning information within a predetermined time is greater than When the preset value is set, the vehicle terminal positioning information is used for positioning and/or obstacle avoidance.
进一步的,所述主控单元还用于:在所述车辆距设定区域大于设定距离时,使用通过所述车载定位单元得到的车端定位信息进行定位和/或避障。Further, the main control unit is also used for positioning and/or avoiding obstacles by using vehicle-side positioning information obtained by the vehicle-mounted positioning unit when the vehicle is greater than a set distance from the set area.
本发明所述的车载控制装置,使用车载定位单元采集当前场景图像或生成并输出车端定位信息,并根据当前场景图像或车端定位信息是否满足预设条件,请求场端定位信息,以根据场端定位信息进行定位和/或避障。根据当前场景图像或车端定位信息是否满足预设条件,可以避免车端采集技术的定位方式不能一直准确工作的问题,实现精准的全程定位和/或避障。The vehicle-mounted control device of the present invention uses the vehicle-mounted positioning unit to collect current scene images or generate and output vehicle-side positioning information, and according to whether the current scene image or vehicle-side positioning information meets preset conditions, request the field-side positioning information according to Positioning and/or obstacle avoidance based on field end positioning information. According to whether the current scene image or vehicle-side positioning information meets the preset conditions, the problem that the positioning method of the vehicle-side collection technology cannot always work accurately can be avoided, and accurate full-course positioning and/or obstacle avoidance can be achieved.
本发明的另一目的在于提出一种场端定位装置,以在需要时提供精确的场端定位信息以便实现精准定位和/或避障。Another object of the present invention is to provide a field end positioning device to provide accurate field end positioning information when needed to achieve accurate positioning and/or obstacle avoidance.
为达到上述目的,本发明的技术方案是这样实现的:In order to achieve the above objective, the technical solution of the present invention is achieved as follows:
一种场端定位装置,所述场端定位装置包括:多个场端定位单元以及场端服务器,其中,所述多个场端定位单元用于采集与车辆的位置相关的信息和/或与障碍物的位置相关的信息;所述场端服务器用于:接收来自所述车辆的场端定位信息获取请求;响应于所述场端定位信息获取请求,根据所述与车辆的位置相关的信息和/或与障碍物的位置相关的信息得到场端定位信息;以及发送所述场端定位信息至所述车辆。A field-side positioning device, the field-side positioning device comprising: a plurality of field-side positioning units and a field-side server, wherein the plurality of field-side positioning units are used to collect information related to the position of a vehicle and/or Information related to the location of the obstacle; the field-side server is used to: receive a field-side positioning information acquisition request from the vehicle; in response to the field-side positioning information acquisition request, according to the information related to the position of the vehicle And/or information related to the location of the obstacle obtains field end positioning information; and sends the field end positioning information to the vehicle.
进一步的,所述多个场端定位单元设置于角落周围区域和/或透明玻璃周围区域。Further, the multiple field end positioning units are arranged in the area around the corner and/or the area around the transparent glass.
进一步的,所述多个场端定位单元设置于连续转弯区域。Further, the plurality of field end positioning units are arranged in the continuous turning area.
进一步的,所述多个场端定位单元设置于特征点不足以供所述车载定位装置正确进行定位的区域。Further, the multiple field end positioning units are arranged in areas where the characteristic points are insufficient for the on-board positioning device to correctly perform positioning.
相对于现有技术,本发明所述的场端定位装置具有以下优势:Compared with the prior art, the field end positioning device of the present invention has the following advantages:
本发明所述的场端定位装置,使用多个场端定位单元采集与车辆的位置相关的信息和/或与障碍物的位置相关的信息,在收到车辆的场端定位信息获取请求时,场端服务器发送根据与车辆的位置相关的信息和/或与障碍物的位置相关的信息得到的场端定位信息,可以在需要时提供精确的场端定位信息以便实现精准定位和/或避障。The field-side positioning device of the present invention uses multiple field-side positioning units to collect information related to the position of the vehicle and/or information related to the location of obstacles, and upon receiving the field-side positioning information acquisition request of the vehicle, The field-side server sends field-side positioning information obtained based on information related to the location of the vehicle and/or information related to the location of obstacles, and can provide accurate field-side positioning information when needed to achieve precise positioning and/or obstacle avoidance .
本发明的另一目的在于提出一种车辆,以根据环境光线进决定控制策略,可以避免环境光线对定位和/或避障造成的不良影响,实现精准的全程定位和/或避障。Another object of the present invention is to provide a vehicle that can determine a control strategy based on ambient light, which can avoid the adverse effects of ambient light on positioning and/or obstacle avoidance, and achieve accurate full-course positioning and/or obstacle avoidance.
为达到上述目的,本发明的技术方案是这样实现的:In order to achieve the above objective, the technical solution of the present invention is achieved as follows:
一种车辆,所述车辆包括上文所述的车载控制装置。A vehicle including the vehicle-mounted control device described above.
所述车辆与上述车载控制装置相对于现有技术所具有的优势相同,在此不再赘述。The advantages of the vehicle and the above-mentioned on-board control device over the prior art are the same, and will not be repeated here.
本发明的其它特征和优点将在随后的具体实施方式部分予以详细说明。Other features and advantages of the present invention will be described in detail in the following specific embodiments.
附图说明Description of the drawings
构成本发明的一部分的附图用来提供对本发明的进一步理解,本发明的示意性实施方式及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The drawings constituting a part of the present invention are used to provide a further understanding of the present invention, and the exemplary embodiments and descriptions of the present invention are used to explain the present invention, and do not constitute an improper limitation of the present invention. In the attached picture:
图1是本发明一实施例提供的车载控制装置的结构示意图;FIG. 1 is a schematic structural diagram of a vehicle control device provided by an embodiment of the present invention;
图2A是本发明一实施例提供的光线过暗或过亮场景的控制流程图;2A is a control flow chart of a scene with too dark or too bright light provided by an embodiment of the present invention;
图2B是本发明一实施例提供的连续转弯场景的示意图;2B is a schematic diagram of a continuous turning scene provided by an embodiment of the present invention;
图2C是本发明一实施例提供的连续转弯场景的控制流程图;2C is a control flowchart of a continuous turning scene provided by an embodiment of the present invention;
图2D是本发明一实施例提供的特征点不足的场景的示意图;2D is a schematic diagram of a scene with insufficient feature points provided by an embodiment of the present invention;
图2E是本发明一实施例提供的特征点不足的场景的控制流程图;2E is a control flowchart of a scenario with insufficient feature points provided by an embodiment of the present invention;
图2F是本发明一实施例提供的关于设定区域的控制流程图;FIG. 2F is a control flow chart for setting a region according to an embodiment of the present invention;
图3A是本发明一实施例提供的车载定位单元的结构示意图;3A is a schematic structural diagram of a vehicle positioning unit provided by an embodiment of the present invention;
图3B是本发明一实施例提供的车载的摄像头的安装位置示意图;3B is a schematic diagram of the installation position of a vehicle-mounted camera provided by an embodiment of the present invention;
图4A-4B是本发明一实施例提供的避障情景示意图;4A-4B are schematic diagrams of obstacle avoidance scenarios provided by an embodiment of the present invention;
图5是本发明一实施例提供的场端定位装置的结构示意图;FIG. 5 is a schematic structural diagram of a field end positioning device provided by an embodiment of the present invention;
图6是本发明一实施例提供的车辆控制系统的结构示意图;FIG. 6 is a schematic structural diagram of a vehicle control system provided by an embodiment of the present invention;
图7是本发明一实施例提供的车辆控制系统的交互示意图。Fig. 7 is an interactive schematic diagram of a vehicle control system provided by an embodiment of the present invention.
附图标记说明Description of reference signs
1    车载定位单元          2   主控单元1 Vehicle positioning unit 2 Main control unit
31   摄像头                32  激光雷达31 Cameras 32 Lidar
33   毫米波雷达            34  超声波雷达33 Millimeter wave radar 34 Ultrasonic radar
35   车速传感器            36  轮转角速度传感器35 Vehicle speed sensor 36 Wheel angle speed sensor
37   惯性传感器            311 环视摄像头37 Inertial sensor 311 Surround view camera
312  前视摄像头            4   场端定位单元312 Front-view camera 4 Field end positioning unit
5    场端服务器            51  分组服务器5 Field-side server 51 Group server
52   总服务器52 Total server
具体实施方式detailed description
需要说明的是,在不冲突的情况下,本发明中的实施方式及实施方式中的特征可以相互组合。It should be noted that the embodiments of the present invention and the characteristics of the embodiments can be combined with each other if there is no conflict.
下面将参考附图并结合实施方式来详细说明本发明。Hereinafter, the present invention will be described in detail with reference to the drawings and in conjunction with the embodiments.
图1是本发明一实施例提供的车载控制装置的结构示意图。如图1所示,车载定位单元以及主控单元,其中,所述车载定位单元1用于采集当前场景图像或生成并输出车端定位信息;所述主控单元2用于:在所述当前场景图像或所述车端定位信息满足预设条件时,发送场端定位信息获取请求,其中,所述场端定位信息包括车辆的位置坐标和/或障碍物的位置坐标;接收所述场端定位信息;以及使用所述场端定位信息进行定位和/或避障。Fig. 1 is a schematic structural diagram of a vehicle control device provided by an embodiment of the present invention. As shown in Figure 1, the vehicle-mounted positioning unit and the main control unit, wherein the vehicle-mounted positioning unit 1 is used to collect current scene images or generate and output vehicle-side positioning information; the main control unit 2 is used to: When the scene image or the vehicle-side positioning information meets a preset condition, a field-side positioning information acquisition request is sent, where the field-side positioning information includes the position coordinates of the vehicle and/or the position coordinates of obstacles; receiving the field-side Positioning information; and using the field end positioning information for positioning and/or obstacle avoidance.
其中,例如预设条件可以包括以下几种:Among them, for example, the preset conditions can include the following:
当前场景图像的像素灰阶值不在预设范围内;The pixel grayscale value of the current scene image is not within the preset range;
在车辆行驶过程中,根据所述当前的场景图像确定的可行驶区域进行大小交替变化;During the driving of the vehicle, the size of the drivable area determined according to the current scene image is changed alternately;
在所述车辆行驶过程中,所述车端定位信息与预期定位信息的偏差大于等于预设值,其中所述预期定位信息根据车辆的方向、车速以及初始定位信息得到;During the running of the vehicle, the deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to a preset value, wherein the expected positioning information is obtained according to the vehicle's direction, vehicle speed, and initial positioning information;
在所述车辆行驶过程中,预定时间内所述车端定位信息的更新频率小于等于预设频率;During the running of the vehicle, the update frequency of the vehicle end positioning information within a predetermined time is less than or equal to a preset frequency;
根据所述车端定位信息确定的车辆距设定区域的距离小于等于设定距离;The distance between the vehicle and the set area determined according to the vehicle end positioning information is less than or equal to the set distance;
本发明实施例还针对以上几种预设条件对应的几种场景,以进行车载定位和场端定位的切换,具体如下:The embodiment of the present invention also aims at several scenarios corresponding to the above several preset conditions to switch between on-board positioning and field-side positioning, as follows:
图2A是本发明一实施例提供的光线过暗或过亮场景的控制流程图。FIG. 2A is a control flow chart of a scene with too dark or too bright light provided by an embodiment of the present invention.
在本实施例中,所述车载定位单元1用于采集当前场景图像;所述主控单元2用于:在所述当前场景图像的像素灰度值不在预设范围时,发送场端定位信息获取请求,其中,所述场端定位信息包括车辆的位置坐标和/或障碍物的位置坐标;接收所述场端定位信息;以及使用所述场端定位信息进行定位和/或避障。In this embodiment, the vehicle-mounted positioning unit 1 is used to collect current scene images; the main control unit 2 is used to: send field end positioning information when the pixel gray value of the current scene image is not within a preset range The acquisition request, wherein the field end positioning information includes the position coordinates of the vehicle and/or the position coordinates of the obstacle; receiving the field end positioning information; and using the field end positioning information for positioning and/or obstacle avoidance.
针对光线太亮或太暗场景,车辆上安装的摄像头31因为过度曝光对特征识别会受影响,如果设置有置信度判断,车载定位单元1进行定位的置信度会降低(即定位不准),针对此种场景,根据采集场景的ROI像素灰度值进行判定,如ROI像素灰度值不在预设范围(预设范围的端点a或b由实际标定获取,优选地a介于180-255,b介于0-70之间)可认定此处车载定位单元1定位结果的置信度低,这时可以请求获取场端定位信息,并使用场端定位信息进行定位和/或避障。For scenes where the light is too bright or too dark, the camera 31 installed on the vehicle will affect the feature recognition due to overexposure. If the confidence judgment is set, the positioning confidence of the vehicle positioning unit 1 will be reduced (that is, the positioning is not accurate). For this kind of scene, it is judged according to the ROI pixel gray value of the collected scene. For example, the ROI pixel gray value is not in the preset range (the end point a or b of the preset range is obtained by actual calibration, preferably a is between 180-255, b (Between 0-70) It can be determined that the confidence level of the positioning result of the on-board positioning unit 1 here is low. At this time, it can request to obtain the field end positioning information, and use the field end positioning information for positioning and/or obstacle avoidance.
如图2A所示,首先采集当前场景图像,接着判断当前场景图像的像素灰度值是否在预设范围,在所述当前场景图像的像素灰度值处于所述预设范围时,使用通过所述车载定位单元1得到的车端定位信息进行定位和/或避障;在所述当前场景图像的像素灰度值不在预设范围时,发送场端定位信息获取请求;在接收所述场端定位信息之后,使用所述场端定位信息进行定位和/或避障。As shown in Figure 2A, the current scene image is first collected, and then it is judged whether the pixel gray value of the current scene image is within the preset range. When the pixel gray value of the current scene image is within the preset range, use the The vehicle-side positioning information obtained by the vehicle-mounted positioning unit 1 performs positioning and/or obstacle avoidance; when the pixel gray value of the current scene image is not within the preset range, a field-side positioning information acquisition request is sent; when the field-side image is received After the positioning information, the field end positioning information is used for positioning and/or obstacle avoidance.
图2B是本发明一实施例提供的连续转弯场景的示意图。如图2B所示,针对转弯的场景,尤其是连续转弯的场景。Fig. 2B is a schematic diagram of a continuous turning scene provided by an embodiment of the present invention. As shown in FIG. 2B, for a turning scene, especially a continuous turning scene.
在本实施例中,所述车载定位单元1用于采集当前场景图像;所述主控单元2用于:根据所述当前的场景图像确定可行驶区域;在车辆行驶过程中,所述可行驶区域进行大小交替变化时,发送场端定位信息获取请求,其中,所述场端定位信息包括车辆的位置坐标和/或障碍物的位置坐标;接收所述场端定位信息;以及使用所述场端定位信息进行定位和/或避障。In this embodiment, the on-vehicle positioning unit 1 is used to collect current scene images; the main control unit 2 is used to: determine the drivable area according to the current scene images; during the driving of the vehicle, the drivable When the size of the area changes alternately, send a field-side positioning information acquisition request, where the field-side positioning information includes the position coordinates of the vehicle and/or the position coordinates of obstacles; receive the field-side positioning information; and use the field Terminal positioning information for positioning and/or obstacle avoidance.
如图2C所示,首先采集当前场景图像,接着根据所述当前的场景图像确定可行驶区域;在车辆行驶过程中,判断所述可行驶区域是否进行大小交替变化;在所述可行驶区域进行大小交替变化时,发送场端定位信息,然后接收所述场端定位信息,使用所述场端定位信息进行定位和/或避障;在所述可行驶区域未进行大小交替变化时,使用通过 所述车端定位信息进行定位和/或避障。As shown in Figure 2C, the current scene image is first collected, and then the drivable area is determined according to the current scene image; during the driving of the vehicle, it is determined whether the drivable area undergoes alternate changes in size; in the drivable area When the size changes alternately, send field-side positioning information, then receive the field-side positioning information, use the field-side positioning information for positioning and/or obstacle avoidance; when the drivable area does not change in size alternately, use pass The vehicle terminal positioning information is used for positioning and/or obstacle avoidance.
另外,连续转弯场景也可能是旋转楼梯。In addition, the continuous turning scene may also be a spiral staircase.
在所述可行驶区域进行大小交替变化的一个周期内,当所述可行驶区域的地面起伏变化大于等于预设值的次数大于等于预设次数时,判断车辆正在旋转楼梯行驶,其中,预设值可以是30cm,预设次数例如为1,但是本发明对此不做限定。此时,根据所述场端定位信息,判断所述前后方车辆是否发生溜车,如果前后方车辆向自身车辆靠近时,则前后方车辆发生溜车。在所述前后方车辆发生溜车时,使用所述场端定位信息进行避障以避开发生溜车的车辆。例如,判断左侧(如果车辆靠右行驶)没有对向来车或对向来车距离较远,则可以向左行驶执行避障操控,避免危险。具体避障方法将在下文详述。In a cycle in which the size of the drivable area alternately changes, when the number of times the ground undulation of the drivable area is greater than or equal to a preset value is greater than or equal to a preset number of times, it is determined that the vehicle is driving on a spiral staircase, wherein the preset The value can be 30 cm, and the preset number of times is for example 1, but the present invention does not limit this. At this time, it is determined whether the front and rear vehicles have slipped according to the field end positioning information. If the front and rear vehicles are approaching the own vehicle, the front and rear vehicles have slipped. When the front and rear vehicles slip, use the field end positioning information to avoid obstacles to avoid the slipping vehicle. For example, if it is judged that there is no oncoming vehicle on the left side (if the vehicle is driving on the right) or the oncoming vehicle is far away, the vehicle can be driven to the left to perform obstacle avoidance maneuvers to avoid danger. Specific obstacle avoidance methods will be detailed below.
图2D是本发明一实施例提供的特征点不足的场景的示意图。如图2D所示,针对特征点不足的场景。FIG. 2D is a schematic diagram of a scene with insufficient feature points provided by an embodiment of the present invention. As shown in Figure 2D, for the scene with insufficient feature points.
在本实施例中,所述车载定位单元1用于生成并输出车端定位信息;所述主控单元2用于:执行以下步骤中的一者:1)根据车辆的方向、车速以及初始定位信息得到预期定位信息;在所述车辆行驶过程中,所述车端定位信息与所述预期定位信息的偏差大于等于预设值时,发送场端定位信息获取请求;2)在所述车辆行驶过程中,预定时间内所述车端定位信息的更新频率小于等于预设频率时,发送场端定位信息获取请求;然后,接收所述场端定位信息;以及使用所述场端定位信息进行定位和/或避障。其中,所述场端定位信息包括所述车辆的位置坐标和/或障碍物的位置坐标;In this embodiment, the vehicle-mounted positioning unit 1 is used to generate and output vehicle-side positioning information; the main control unit 2 is used to: perform one of the following steps: 1) According to the direction, speed and initial positioning of the vehicle Information to obtain expected positioning information; in the process of driving the vehicle, when the deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to a preset value, a field-side positioning information acquisition request is sent; 2) when the vehicle is driving In the process, when the update frequency of the vehicle-side positioning information within a predetermined time is less than or equal to the preset frequency, send a field-side positioning information acquisition request; then, receive the field-side positioning information; and use the field-side positioning information for positioning And/or obstacle avoidance. Wherein, the field end positioning information includes the position coordinates of the vehicle and/or the position coordinates of the obstacle;
如图2E所示,首先车载定位单元1生成并输出车端定位信息,接着,所述主控单元2可以进行两种判断:As shown in Figure 2E, first the vehicle-mounted positioning unit 1 generates and outputs vehicle-side positioning information, and then the main control unit 2 can make two judgments:
第一种为:在所述车辆行驶过程中,判断预定时间内所述车端定位信息的更新频率是否小于等于预设频率;在预定时间内所述车端定位信息的更新频率小于等于预设频率时,发送场端定位信息获取请求,接收所述场端定位信息,使用所述场端定位信息进行定位和/或避障;在预定时间内所述车辆定位信息的更新频率大于预设值时,使用所述车端定位信息进行定位和/或避障。The first one is: during the running of the vehicle, determine whether the update frequency of the vehicle-side positioning information within a predetermined time is less than or equal to a preset frequency; within the predetermined time, the update frequency of the vehicle-end positioning information is less than or equal to the preset frequency In case of frequency, send a field-side positioning information acquisition request, receive the field-side positioning information, and use the field-side positioning information for positioning and/or obstacle avoidance; within a predetermined time, the update frequency of the vehicle positioning information is greater than the preset value When using the vehicle terminal positioning information for positioning and/or obstacle avoidance.
其中,车端定位单元进行定位一般依靠环境中的特征点,如果特征点不足,车端定位单元可能会在预定时间(例如1秒,但不限于此)内不输出车端定位信息,到时无法更新车端定位信息。因此,由预定时间是否输出车端定位信息这个条件可以判断车辆是否驶入特征点不足的场景。Among them, the car-side positioning unit generally depends on the feature points in the environment. If the feature points are insufficient, the car-side positioning unit may not output the car-side positioning information within a predetermined time (for example, 1 second, but not limited to this). Unable to update the vehicle positioning information. Therefore, it can be judged whether the vehicle enters a scene with insufficient feature points based on the condition of whether to output vehicle-end positioning information at a predetermined time.
第二种为:先根据车辆的方向、车速以及初始定位信息得到预期定位信息;再接 着,在所述车辆行驶过程中,判断所述车端定位信息与所述预期定位信息的偏差是否大于等于预设值,在所述车端定位信息与所述预期定位信息的偏差大于等于预设值时,发送场端定位信息获取请求,接收所述场端定位信息,使用所述场端定位信息进行定位和/或避障;在所述车辆定位信息与所述预期定位信息的偏差小于预设值时,使用所述车端定位信息进行定位和/或避障。The second is: first obtain the expected positioning information according to the vehicle's direction, vehicle speed, and initial positioning information; then, during the driving of the vehicle, determine whether the deviation between the vehicle end positioning information and the expected positioning information is greater than or equal to The preset value, when the deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to the preset value, send a field-side positioning information acquisition request, receive the field-side positioning information, and use the field-side positioning information to perform Positioning and/or obstacle avoidance; when the deviation between the vehicle positioning information and the expected positioning information is less than a preset value, the vehicle end positioning information is used for positioning and/or obstacle avoidance.
其中,根据初始位置,结合车速、方向以及行驶时间等信息,可以得到车辆的预期位置,此较为常用在此不进行赘述。造成车端定位信息与预期定位信息的偏差大于等于预设值的原因可能会有几种可能,例如根据内置算法不同,车端定位单元输出的车端定位信息可能非常不准,或者输出的车端定位信息是一组随机的坐标。另外,如果车辆设置有置信度判断,车端定位单元输出的车端定位信息的置信度也可能较低(例如小于80%),本质上也是因为车端定位信息与预期定位信息的偏差较大。因此,在车端定位信息与预期定位信息的偏差大于等于预设值时,可以判断车辆是否驶入特征点不足的场景。Among them, the expected position of the vehicle can be obtained according to the initial position, combined with information such as vehicle speed, direction, and driving time, which is more commonly used and will not be repeated here. There may be several reasons for the deviation of the car-side positioning information from the expected positioning information to be greater than or equal to the preset value. For example, depending on the built-in algorithm, the car-side positioning information output by the car-side positioning unit may be very inaccurate, or the output car The terminal positioning information is a set of random coordinates. In addition, if the vehicle is equipped with a confidence level judgment, the confidence level of the vehicle-side positioning information output by the vehicle-side positioning unit may also be low (for example, less than 80%), essentially because the deviation between the vehicle-side positioning information and the expected positioning information is large . Therefore, when the deviation between the vehicle-end positioning information and the expected positioning information is greater than or equal to the preset value, it can be determined whether the vehicle has entered a scene with insufficient feature points.
另外,以上三种场景(即光线过亮或过暗、转弯以及特征点不足)的区域也可以事先设置,根据车辆是否进入设定区域来进行车载定位和场端定位的切换。In addition, the areas of the above three scenes (that is, the light is too bright or too dark, turning, and the feature points are insufficient) can also be set in advance, and the on-board positioning and field-side positioning can be switched according to whether the vehicle enters the set area.
在本实施例中,所述车载定位单元1用于生成并输出车端定位信息;所述主控单元2用于:根据所述车端定位信息确定车辆的位置;根据所述车辆的位置确定所述车辆距设定区域的距离;在所述车辆距所述设定区域的距离小于等于设定距离时,发送场端定位信息获取请求;接收所述场端定位信息;以及使用所述场端定位信息进行定位和/或避障,其中,所述场端定位信息包括车辆的位置坐标和/或障碍物的位置坐标;In this embodiment, the vehicle-mounted positioning unit 1 is used to generate and output vehicle-side positioning information; the main control unit 2 is used to: determine the position of the vehicle according to the vehicle-side positioning information; determine the position of the vehicle The distance between the vehicle and the set area; when the distance between the vehicle and the set area is less than or equal to the set distance, send a field end positioning information acquisition request; receive the field end positioning information; and use the field Terminal positioning information for positioning and/or obstacle avoidance, wherein the field terminal positioning information includes the position coordinates of the vehicle and/or the position coordinates of the obstacle;
如图2F所示,首先,车载定位单元1生成并输出车端定位信息;接着根据所述车端定位信息确定车辆的位置;确定所述车辆距设定区域的距离;判断所述车辆距所述设定区域的距离是否小于等于设定距离;在所述车辆距所述设定区域的距离小于等于设定距离时,发送场端定位信息获取请求,接收所述场端定位信息,使用所述场端定位信息进行定位和/或避障;在所述车辆距所述设定区域的距离大于设定距离时,使用所述车端定位信息进行定位和/或避障。其中,设定区域的大小和设定距离都可以根据实际情况进行选取,本发明不做限定。As shown in FIG. 2F, first, the vehicle-mounted positioning unit 1 generates and outputs vehicle-side positioning information; then determines the position of the vehicle according to the vehicle-side positioning information; determines the distance between the vehicle and the set area; Whether the distance of the set area is less than or equal to the set distance; when the distance between the vehicle and the set area is less than or equal to the set distance, send a field end positioning information acquisition request, receive the field end positioning information, and use all The field end positioning information is used for positioning and/or obstacle avoidance; when the distance of the vehicle from the set area is greater than the set distance, the vehicle end positioning information is used for positioning and/or obstacle avoidance. Wherein, the size of the setting area and the setting distance can be selected according to actual conditions, and the present invention does not limit it.
得到车端定位信息的车载定位单元1将在下文描述。The vehicle-mounted positioning unit 1 that obtains vehicle-side positioning information will be described below.
图3A是本发明一实施例提供的车载定位单元的结构示意图。如图3A所示,所述车载定位单元1主要包括:摄像头31、激光雷达32、毫米波雷达33、超声波雷达34、 车速传感器35、轮转角速度传感器36和惯性传感器37中的至少一者。毫米波雷达33主要用于避障,超声波雷达34主要用泊车与视觉定位方案配合实现。车速传感器35、轮转角速度传感器36和惯性传感器37可以得到车辆的各种状态,例如车速、轮速、加速度、倾斜、冲击、振动、旋转和多自由度运动等。Fig. 3A is a schematic structural diagram of a vehicle-mounted positioning unit provided by an embodiment of the present invention. As shown in FIG. 3A, the vehicle-mounted positioning unit 1 mainly includes at least one of a camera 31, a laser radar 32, a millimeter wave radar 33, an ultrasonic radar 34, a vehicle speed sensor 35, a wheel angular velocity sensor 36 and an inertial sensor 37. The millimeter wave radar 33 is mainly used for obstacle avoidance, and the ultrasonic radar 34 is mainly realized by the cooperation of parking and visual positioning solutions. The vehicle speed sensor 35, the wheel angular velocity sensor 36, and the inertial sensor 37 can obtain various states of the vehicle, such as vehicle speed, wheel speed, acceleration, tilt, shock, vibration, rotation, and multi-degree-of-freedom motion.
图3B是本发明一实施例提供的车载摄像头的安装位置示意图。如图3B所示,车载摄像头31主要可以包括环视摄像头311和前视摄像头312等,以全面拍摄车辆周边的图像,主控单元2应用高精度地图和/或由车辆传感器采集语义地图、环视摄像头311、前视摄像头312,视觉定位方案采用基于视觉的同步定位与地图构建(VSLAM)生成语义地图与高精度地图结合,通过车载摄像头31识别采集的VSLAM特征点进行匹配,结合惯性传感器37(IMU)的信息,实现车辆的定位,得到车端定位信息。其中,SLAM(simultaneous localization and mapping,SLAM)是指根据传感器的信息,一边计算自身位置,一边构建环境地图的过程,解决在未知环境下运动时的定位与地图构建问题。VSLAM即视觉SLAM(Vision SLAM),更为高级,是基于视觉的定位与建图,更加精准和迅速。Fig. 3B is a schematic diagram of an installation position of a vehicle-mounted camera provided by an embodiment of the present invention. As shown in FIG. 3B, the vehicle-mounted camera 31 may mainly include a surround-view camera 311 and a front-view camera 312, etc., to comprehensively capture images around the vehicle. The main control unit 2 uses high-precision maps and/or semantic maps and surround-view cameras collected by vehicle sensors. 311. The front-view camera 312, the visual positioning scheme uses the vision-based synchronous positioning and map construction (VSLAM) to generate a semantic map and a high-precision map. The vehicle-mounted camera 31 recognizes and collects the VSLAM feature points for matching, and combines the inertial sensor 37 (IMU ) Information to realize vehicle positioning and obtain vehicle-end positioning information. Among them, SLAM (simultaneous localization and mapping, SLAM) refers to the process of constructing an environmental map while calculating its own position based on the information of the sensor, to solve the problem of positioning and map construction when moving in an unknown environment. VSLAM stands for Vision SLAM (Vision SLAM), which is more advanced and is based on visual positioning and mapping, which is more accurate and rapid.
另外,在车辆自动行驶过程中,有可能会有遇到障碍物的情况。图4A-4B是本发明一实施例提供的避障情景示意图。如图4A所示,例如在转弯处,可能会碰到另一方向行驶过来的车辆,此时需要进行避障。由于另一方向行驶过来的车辆被遮挡,因此车载摄像头31并不能及时发现。于是需要使用场端定位单元4提供的场端定位信息进行避障,避障过程为:根据所述障碍物(在此为另一方向行驶过来的车辆)的位置坐标,确定所述障碍物的位置坐标周围预设距离形成区域为危险区域;控制所述车辆避开所述危险区域。In addition, there may be obstacles encountered during the automatic driving of the vehicle. 4A-4B are schematic diagrams of obstacle avoidance scenarios provided by an embodiment of the present invention. As shown in Figure 4A, for example, at a turn, you may encounter a vehicle coming from another direction, and obstacle avoidance is required at this time. Since the vehicle traveling in the other direction is blocked, the on-board camera 31 cannot be detected in time. Therefore, it is necessary to use the field-side positioning information provided by the field-side positioning unit 4 to avoid obstacles. The obstacle avoidance process is: according to the position coordinates of the obstacle (here, a vehicle traveling in another direction), determine the obstacle's position The area formed by the preset distance around the position coordinates is a dangerous area; the vehicle is controlled to avoid the dangerous area.
如图4B所示,首先可以先划定障碍物形成的危险区域和预警区域,例如,障碍物的位置坐标周围预设距离(可以根据实际情况进行设定)形成区域为危险区域,距离危险区域一定距离(同样可以根据实际情况进行设定,例如0-50m)形成的区域为预警区域。假设车辆B为本车辆,结合高精度地图及定位结果信息,当车辆处于预警区域之外时,车辆通过车载定位单元1实现障碍物的识别及定位,当车辆行驶进入预警区域时,则会通过车联网系统接收到预警区域内的所有障碍物(车辆A和行人/动物C)的信息,为了保证安全,车辆B避开障碍物形成的危险区域(即远离障碍物)。在预警区域内,在场端定位单元4没有故障前提下,以场端定位单元4为主,预警区域坐标与高精度地图坐标匹配,同时区域大小根据实际测试结果最终确定,行驶出预警区域时,可以切换 为以车载定位单元1为主。As shown in Figure 4B, the dangerous area and the early warning area formed by the obstacle can be delineated first. For example, the preset distance around the position coordinates of the obstacle (which can be set according to the actual situation) is the dangerous area, and the distance from the dangerous area The area formed by a certain distance (also can be set according to the actual situation, such as 0-50m) is the early warning area. Assuming that vehicle B is the own vehicle, combined with high-precision map and positioning result information, when the vehicle is outside the warning area, the vehicle realizes obstacle recognition and positioning through the on-board positioning unit 1, and when the vehicle enters the warning area, it will pass The Internet of Vehicles system receives information about all obstacles (vehicle A and pedestrian/animal C) in the early warning area. To ensure safety, vehicle B avoids the dangerous area formed by the obstacle (that is, stays away from the obstacle). In the early warning area, under the premise that the field end positioning unit 4 is not faulty, the field end positioning unit 4 is the main one, and the coordinates of the early warning area match the coordinates of the high-precision map. At the same time, the size of the area is finally determined according to the actual test results. It can be switched to be based on the vehicle positioning unit 1.
以下将详细说明可以配合车载控制装置的场端定位装置,场端定位装置主要用于提供场端定位信息。The following will describe in detail the field end positioning device that can cooperate with the vehicle control device. The field end positioning device is mainly used to provide field end positioning information.
图5是本发明一实施例提供的场端定位装置的结构示意图。如图5所示,所述场端定位装置包括:多个场端定位单元4以及场端服务器5,其中,所述多个场端定位单元4用于采集与车辆的位置相关的信息和/或与障碍物的位置相关的信息;所述场端服务器5用于:接收来自所述车辆的场端定位信息获取请求;响应于所述场端定位信息获取请求,根据所述与车辆的位置相关的信息和/或与障碍物的位置相关的信息得到场端定位信息;以及发送所述场端定位信息至所述车辆。Fig. 5 is a schematic structural diagram of a field end positioning device provided by an embodiment of the present invention. As shown in Figure 5, the field-side positioning device includes: a plurality of field-side positioning units 4 and a field-side server 5, wherein the plurality of field-side positioning units 4 are used to collect information related to the position of the vehicle and/ Or information related to the position of the obstacle; the field-side server 5 is used to: receive a field-side positioning information acquisition request from the vehicle; in response to the field-side positioning information acquisition request, according to the position of the vehicle Related information and/or information related to the location of the obstacle obtains field end positioning information; and sends the field end positioning information to the vehicle.
所述场端定位单元4可以为激光雷达32或红外摄像头31,场端激光雷达32形态可以为柱状,从而嵌入墙内或通过结构固定于建筑物上。为了节省费用,场端定位单元4可以仅设置在基本固定位置(即车载定位单元1无法准确进行定位和避障的位置),而不必在停车场每个地方都设置,例如只设置于转弯周围区域、角落周围区域、透明玻璃周围区域或特征点不足以供所述车载定位装置正确进行所述车辆定位的区域。The field end positioning unit 4 may be a laser radar 32 or an infrared camera 31, and the field end laser radar 32 may be columnar, so as to be embedded in a wall or fixed on a building through a structure. In order to save costs, the field-side positioning unit 4 can only be installed at a basic fixed position (that is, a position where the vehicle-mounted positioning unit 1 cannot accurately locate and avoid obstacles), instead of having to install it in every part of the parking lot, for example, it is only installed around the turn The area, the area around the corner, the area around the transparent glass, or the feature point is not enough for the vehicle-mounted positioning device to correctly locate the vehicle.
场端定位信息的具体获得方式如下:The specific method of obtaining the field-side positioning information is as follows:
场端服务器5在接收到来自车辆的场端定位信息获取请求之后,响应于场端定位信息获取请求,根据多个场端定位单元4的ID得到多个场端定位单元4的坐标;根据多个场端定位单元4的坐标以及与车辆的位置相关的信息和/或与障碍物的位置相关的信息,得到车辆的位置坐标和/或障碍物的位置坐标,以作为场端定位信息。After receiving the field-side positioning information acquisition request from the vehicle, the field-side server 5 obtains the coordinates of multiple field-side positioning units 4 according to the IDs of the field-side positioning units 4 in response to the field-side positioning information acquisition request; The coordinates of each field end positioning unit 4 and the information related to the position of the vehicle and/or the information related to the position of the obstacle obtain the position coordinates of the vehicle and/or the position coordinates of the obstacle as field end positioning information.
场端服务器5可以如上述对与车辆的位置相关的信息和/或与障碍物的位置相关的信息进行处理,也可以划分为对应多个场端定位单元4的多个分组服务器51和总服务器52,如图4B所示,还是以转弯处为例(光线过亮或过暗的区域等类似),针对转弯处场景视觉方案很难识别到途中的来车、行人或小动物,很可能会发生危险,通过场端安装的场端定位单元4能很好的预知危险,场端安装的场端定位单元4将采集到的图像信息以一定帧率传输给分组服务器51,场端定位单元4坐标在安装初期进行调试及固定,坐标是一定的,分组服务器51根据前期标定的结果,获得车辆相对于场端定位单元4之间的距离,计算出车辆与场端定位单元4间的相对坐标,通过一定算法完成绝对坐标转换,发送给后台的总服务器52,场端优选由≥3台场端定位单元4实现精确定位,当有场端定位单元4出现遮挡时可以获取其它场端定位单元4的坐标信息,通过算法实现定位。The field-side server 5 can process the information related to the position of the vehicle and/or the information related to the position of the obstacle as described above, and can also be divided into a plurality of grouping servers 51 and a total server corresponding to the plurality of field-side positioning units 4 52, as shown in Figure 4B, still taking a turn as an example (the light is too bright or too dark, etc.), it is difficult for the visual solution of the scene at the turn to identify the oncoming cars, pedestrians or small animals on the way. In the event of danger, the field end positioning unit 4 installed at the field end can predict the danger well. The field end positioning unit 4 installed at the field end transmits the collected image information to the packet server 51 at a certain frame rate. The field end positioning unit 4 The coordinates are debugged and fixed at the beginning of installation. The coordinates are fixed. The grouping server 51 obtains the distance between the vehicle and the field-side positioning unit 4 according to the results of the previous calibration, and calculates the relative coordinates between the vehicle and the field-side positioning unit 4 , Complete the absolute coordinate conversion through a certain algorithm, and send it to the background server 52. The field end is preferably ≥3 field end positioning units 4 to achieve precise positioning. When there is a field end positioning unit 4 obscured, other field end positioning units can be obtained 4 coordinate information, positioning is achieved through algorithms.
通过场端定位单元4可以获取转角处障碍物(行人、车辆、小动物等)信息,经过分组服务器51的处理,并传输给后台的总服务器52,总服务器52处理输出障碍物的类型、尺寸、坐标、行驶轨迹等场端定位信息,通过无线传输方式传输给车辆端,由车辆端的主控单元2做出控制决策,即进行定位和/或避障。Obstacle information (pedestrians, vehicles, small animals, etc.) at the corner can be obtained through the field-side positioning unit 4, processed by the grouping server 51, and transmitted to the back-end server 52, which processes and outputs the type and size of the obstacle The field-end positioning information such as coordinates, driving trajectory, etc. is transmitted to the vehicle end through wireless transmission, and the main control unit 2 of the vehicle end makes control decisions, that is, positioning and/or obstacle avoidance.
本发明还提供一种车辆控制系统。图6是本发明一实施例提供的车辆控制系统的结构示意图。如图6所示,所述车辆控制系统包括上文所述的车载控制装置以及上文所述的场端定位装置。The invention also provides a vehicle control system. Fig. 6 is a schematic structural diagram of a vehicle control system provided by an embodiment of the present invention. As shown in FIG. 6, the vehicle control system includes the vehicle control device described above and the field end positioning device described above.
在车辆控制系统中场端激光雷达32可以每5-10个组成一组,把每组数据传输给各组对应的分组服务器51,每组的分组服务器51通过有线或无线方式传输给总服务器52进行数据处理实现车辆定位、整个停车场或比较复杂路段内障碍物(人、车等)的定位,然后可以将处理后的结果通过Wifi/4G/5G等通讯方式传输给自动驾驶车辆控制器,与车身本身传感器信息及IMU处理信息进行融合最终输出车辆自定位及停车场内或比较复杂路段的障碍物信息,最终实现车辆的自定位、避障及路径规划功能,本方案将大量计算能力放在场端服务器5,场端服务器5相比车载自动驾驶系统处理能力强,成本低,且不需要车规,因而更具有量产可行性,且适合无人驾驶车辆与有人驾驶车辆混行的停车场。In the vehicle control system, the field end lidar 32 can form a group of 5-10, and each group of data is transmitted to the corresponding grouping server 51 of each group, and the grouping server 51 of each group is transmitted to the total server 52 in a wired or wireless manner. Carrying out data processing to realize vehicle positioning, the positioning of obstacles (people, cars, etc.) in the entire parking lot or more complex road sections, and then the processed results can be transmitted to the autonomous vehicle controller through Wifi/4G/5G communication methods, Fusion with the sensor information of the body itself and IMU processing information, and finally output the vehicle self-positioning and obstacle information in the parking lot or more complex road sections, and finally realize the self-positioning, obstacle avoidance and path planning functions of the vehicle. This solution puts a lot of computing power on On-site server 5, compared with the on-board automatic driving system, the on-site server 5 has stronger processing capacity, lower cost, and does not require vehicle regulations, so it is more feasible for mass production, and is suitable for the parking of unmanned vehicles and manned vehicles. field.
下面整体描述车辆控制系统的交互过程。The following describes the overall interaction process of the vehicle control system.
图7是本发明一实施例提供的车辆控制系统的交互示意图。如图7所示,首先,车端的主控单元2从车载定位单元1接收车端定位信息,在需要场端定位信息时,发送场端定位信息获取请求,场端服务器5接收场端定位信息获取请求,并从场端定位单元4接收与车辆的位置相关的信息和/或与障碍物的位置相关的信息,响应于场端定位信息获取请求,处理得到场端定位信息之后,发送场端定位信息到车端的主控单元2。Fig. 7 is an interactive schematic diagram of a vehicle control system provided by an embodiment of the present invention. As shown in Figure 7, first, the main control unit 2 on the vehicle side receives vehicle-side positioning information from the vehicle-mounted positioning unit 1, and when it needs field-side positioning information, it sends a field-side positioning information acquisition request, and the field-side server 5 receives field-side positioning information. Obtain the request, and receive information related to the location of the vehicle and/or information related to the location of the obstacle from the field-side positioning unit 4, and after processing the field-side positioning information acquisition request, send field-side positioning information Position the information to the main control unit 2 on the car side.
本发明实施例采用场端定位单元4(例如激光雷达32或特殊摄像头31)定位的方案,场端定位单元4作为全局视角,可提前预知危险,起到车场协同效果。考虑系统成本,场端布置的场端定位单元4可以只布置在光线极其不好和/或转弯等的地方,针对停车场内出现的小动物、儿童、或紧急闯入的人,车载定位单元1无法应对的场景,场端定位单元4可进行补充,通过场端与车端通讯实现车辆对危险的提前预知,避免事故发生。最终实现方式由场端及实现效果决定,以安全、可靠、安装简单、实现效果优为原则。本方案应用低成本车端结合低成本场端方案,通过在转弯周围区域、角落周围区域、透明玻璃周围区域以及特征点不足以供所述车载定位装置正确进行所述车辆定位的区 域增加场端设备,预知即将发生的事情(人或车)反馈给车端,相当于增强了车辆的感知能力,实现了车对外信息交换(V2X)的效果,提升系统安全性。本方案可以只在必要的路口或场景增加场端设备,降低了系统成本。The embodiment of the present invention adopts a positioning solution of the field end positioning unit 4 (for example, a lidar 32 or a special camera 31). The field end positioning unit 4 is used as a global perspective, which can predict danger in advance and achieve a vehicle-yard coordination effect. Considering the cost of the system, the field-side positioning unit 4 arranged at the field-side can only be arranged in places with extremely poor light and/or turning, etc., for small animals, children, or emergency intruders in the parking lot, the vehicle-mounted positioning unit 1 For scenes that cannot be dealt with, the field-side positioning unit 4 can be supplemented, and the vehicle can predict the danger in advance through field-side and vehicle-side communication, and avoid accidents. The final realization method is determined by the field end and the realization effect, based on the principles of safety, reliability, simple installation and excellent realization effect. This solution uses a low-cost vehicle end combined with a low-cost field end solution, by increasing the field end in the area around the turn, the area around the corner, the area around the transparent glass, and the feature points that are not enough for the vehicle positioning device to correctly locate the vehicle. The device predicts what is about to happen (person or car) and feeds it back to the car end, which is equivalent to enhancing the vehicle's perception ability, realizing the effect of vehicle external information exchange (V2X), and improving system security. This solution can only add field-end equipment at necessary intersections or scenes, reducing system costs.
本发明实施例还提供一种车辆,所述车辆包括上文所述的车载控制装置。An embodiment of the present invention also provides a vehicle, which includes the vehicle control device described above.
以上所述仅为本发明的较佳实施方式而已,并不用以限制本发明,凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above are only the preferred embodiments of the present invention and are not intended to limit the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the present invention. Within the scope of protection.

Claims (15)

  1. 一种车载控制装置,其特征在于,所述车载控制装置包括:A vehicle-mounted control device, characterized in that, the vehicle-mounted control device includes:
    车载定位单元以及主控单元,其中,Vehicle positioning unit and main control unit, of which,
    所述车载定位单元用于采集当前场景图像或生成并输出车端定位信息;The vehicle-mounted positioning unit is used to collect current scene images or generate and output vehicle-side positioning information;
    所述主控单元用于:The main control unit is used for:
    在所述当前场景图像或所述车端定位信息满足预设条件时,发送场端定位信息获取请求,其中,所述场端定位信息包括车辆的位置坐标和/或障碍物的位置坐标;When the current scene image or the vehicle-side positioning information meets a preset condition, sending a field-side positioning information acquisition request, where the field-side positioning information includes the position coordinates of the vehicle and/or the position coordinates of the obstacle;
    接收所述场端定位信息;以及Receiving the field end positioning information; and
    使用所述场端定位信息进行定位和/或避障。Use the field end positioning information for positioning and/or obstacle avoidance.
  2. 根据权利要求1所述的车载控制装置,其特征在于,所述预设条件包括所述当前场景图像的像素灰阶值不在预设范围内。The vehicle-mounted control device according to claim 1, wherein the preset condition includes that the pixel grayscale value of the current scene image is not within a preset range.
  3. 根据权利要求1所述的车载控制装置,其特征在于,所述预设条件包括在车辆行驶过程中,根据所述当前的场景图像确定的可行驶区域进行大小交替变化。The vehicle-mounted control device according to claim 1, wherein the preset condition comprises alternately changing the size of the drivable area determined according to the current scene image during the running of the vehicle.
  4. 根据权利要求1所述的车载控制装置,其特征在于,所述预设条件包括:The vehicle control device according to claim 1, wherein the preset condition includes:
    在所述车辆行驶过程中,所述车端定位信息与预期定位信息的偏差大于等于预设值,其中所述预期定位信息根据车辆的方向、车速以及初始定位信息得到;或During the driving of the vehicle, the deviation between the vehicle-side positioning information and the expected positioning information is greater than or equal to a preset value, wherein the expected positioning information is obtained according to the direction, speed and initial positioning information of the vehicle; or
    在所述车辆行驶过程中,预定时间内所述车端定位信息的更新频率小于等于预设频率。During the running of the vehicle, the update frequency of the vehicle terminal positioning information within a predetermined time is less than or equal to a preset frequency.
  5. 根据权利要求1所述的车载控制装置,其特征在于,所述预设条件包括根据所述车端定位信息确定的车辆距设定区域的距离小于等于设定距离。The vehicle-mounted control device according to claim 1, wherein the preset condition includes that the distance of the vehicle from the set area determined according to the vehicle-end positioning information is less than or equal to the set distance.
  6. 根据权利要求2所述的车载控制装置,其特征在于,所述主控单元还用于:The vehicle control device according to claim 2, wherein the main control unit is further used for:
    在所述当前场景图像的像素灰度值处于所述预设范围时,使用通过所述车载定位单元得到的车端定位信息进行定位和/或避障。When the pixel gray value of the current scene image is in the preset range, positioning and/or obstacle avoidance are performed using vehicle-side positioning information obtained by the vehicle-mounted positioning unit.
  7. 根据权利要求3所述的车载控制装置,其特征在于,所述主控单元还用于:The vehicle control device according to claim 3, wherein the main control unit is further used for:
    在所述车辆行驶过程中,所述可行驶区域未进行大小交替变化时,使用通过所示车载定位单元得到的车端定位信息进行定位和/或避障。During the running of the vehicle, when the size of the drivable area is not changed alternately, the vehicle-end positioning information obtained by the vehicle-mounted positioning unit is used for positioning and/or obstacle avoidance.
  8. 根据权利要求3所述的车载控制装置,其特征在于,所述主控单元还用于:The vehicle control device according to claim 3, wherein the main control unit is further used for:
    在所述可行驶区域进行大小交替变化的一个周期内,当所述可行驶区域的地面起伏变化大于等于预设值的次数大于等于预设次数时,根据所述场端定位信息,判断所述前后方车辆是否发生溜车;In a period in which the size of the drivable area changes alternately, when the number of times that the ground undulation of the drivable area is greater than or equal to a preset value is greater than or equal to a preset number of times, it is determined according to the field end positioning information Whether the vehicles in front and behind have slipped;
    在所述前后方车辆发生溜车时,使用所述场端定位信息进行避障以避开发生溜车的车辆。When the front and rear vehicles slip, use the field end positioning information to avoid obstacles to avoid the slipping vehicle.
  9. 根据权利要求4所述的车载控制装置,其特征在于,所述主控单元还用于:The vehicle control device according to claim 4, wherein the main control unit is further used for:
    在所述车辆行驶过程中,所述车辆定位信息与所述预期定位信息的偏差小于预设值或预定时间内所述车辆定位信息的更新频率大于预设值时,使用所述车端定位信息进行定位和/或避障。During the running of the vehicle, when the deviation between the vehicle positioning information and the expected positioning information is less than a preset value or the update frequency of the vehicle positioning information within a predetermined time is greater than a preset value, the vehicle-side positioning information is used Perform positioning and/or obstacle avoidance.
  10. 根据权利要求5所述的车载控制装置,其特征在于,所述主控单元还用于:The vehicle control device according to claim 5, wherein the main control unit is further used for:
    在所述车辆距设定区域大于设定距离时,使用通过所述车载定位单元得到的车端定位信息进行定位和/或避障。When the vehicle is greater than the set distance from the set area, positioning and/or obstacle avoidance are performed using the vehicle-side positioning information obtained by the on-board positioning unit.
  11. 一种场端定位装置,其特征在于,所述场端定位装置包括:A field end positioning device, characterized in that the field end positioning device comprises:
    多个场端定位单元以及场端服务器,其中,Multiple field-side positioning units and field-side servers, among which,
    所述多个场端定位单元用于采集与车辆的位置相关的信息和/或与障碍物的位置相关的信息;The multiple field end positioning units are used to collect information related to the position of the vehicle and/or information related to the position of the obstacle;
    所述场端服务器用于:The farm-side server is used to:
    接收来自所述车辆的场端定位信息获取请求;Receiving a field-side positioning information acquisition request from the vehicle;
    响应于所述场端定位信息获取请求,根据所述与车辆的位置相关的信息和/或与障碍物的位置相关的信息得到场端定位信息;以及In response to the field end positioning information acquisition request, obtain field end positioning information according to the information related to the position of the vehicle and/or the information related to the location of the obstacle; and
    发送所述场端定位信息至所述车辆。Sending the field end positioning information to the vehicle.
  12. 根据权利要求11所述的场端定位装置,其特征在于,所述多个场端定位单元 设置于角落周围区域和/或透明玻璃周围区域。The field end positioning device according to claim 11, wherein the plurality of field end positioning units are arranged in the area around the corner and/or the area around the transparent glass.
  13. 根据权利要求11所述的场端定位装置,其特征在于,所述多个场端定位单元设置于连续转弯区域。The field end positioning device according to claim 11, wherein the plurality of field end positioning units are arranged in a continuous turning area.
  14. 根据权利要求11所述的场端定位装置,其特征在于,所述多个场端定位单元设置于特征点不足以供所述车载定位装置正确进行定位的区域。The field end positioning device according to claim 11, wherein the plurality of field end positioning units are arranged in areas where the characteristic points are insufficient for the on-board positioning device to correctly perform positioning.
  15. 一种车辆,其特征在于,所述车辆包括权利要求1-10中任一项权利要求所述的车载控制装置。A vehicle, characterized in that the vehicle includes the vehicle-mounted control device according to any one of claims 1-10.
PCT/CN2020/073247 2019-01-25 2020-01-20 Vehicle-mounted control device, field end positioning device, and vehicle WO2020151664A1 (en)

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
CN201910075294.7A CN110775054B (en) 2019-01-25 2019-01-25 Vehicle-mounted control device, field end positioning device, vehicle control system and vehicle
CN201910073984.9 2019-01-25
CN201910073984.9A CN110794821B (en) 2019-01-25 2019-01-25 Vehicle-mounted control device, field end positioning device, vehicle control system and vehicle
CN201910075542.8 2019-01-25
CN201910074340.1A CN110794822A (en) 2019-01-25 2019-01-25 Vehicle-mounted control device, field end positioning device, vehicle control system and vehicle
CN201910075542.8A CN110775055B (en) 2019-01-25 2019-01-25 Vehicle-mounted control device, field end positioning device, vehicle control system and vehicle
CN201910074340.1 2019-01-25
CN201910075294.7 2019-01-25

Publications (1)

Publication Number Publication Date
WO2020151664A1 true WO2020151664A1 (en) 2020-07-30

Family

ID=71735651

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/073247 WO2020151664A1 (en) 2019-01-25 2020-01-20 Vehicle-mounted control device, field end positioning device, and vehicle

Country Status (1)

Country Link
WO (1) WO2020151664A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012091804A2 (en) * 2010-12-30 2012-07-05 Irobot Corporation Operating a mobile robot
WO2014168666A2 (en) * 2013-01-29 2014-10-16 QinetiQ North America, Inc. Tactical robot controller
CN105005302A (en) * 2015-05-29 2015-10-28 李祥榕 System and method for automatically controlling vehicle based on GPS and RFID
CN106020204A (en) * 2016-07-21 2016-10-12 触景无限科技(北京)有限公司 Obstacle detection device, robot and obstacle avoidance system
WO2018094272A1 (en) * 2016-11-18 2018-05-24 Robert Bosch Start-Up Platform North America, LLC, Series 1 Robotic creature and method of operation
CN108646731A (en) * 2018-04-17 2018-10-12 上海创昂智能技术有限公司 Automatic driving vehicle field end control system and its control method
CN108958263A (en) * 2018-08-03 2018-12-07 江苏木盟智能科技有限公司 A kind of Obstacle Avoidance and robot

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012091804A2 (en) * 2010-12-30 2012-07-05 Irobot Corporation Operating a mobile robot
WO2014168666A2 (en) * 2013-01-29 2014-10-16 QinetiQ North America, Inc. Tactical robot controller
CN105005302A (en) * 2015-05-29 2015-10-28 李祥榕 System and method for automatically controlling vehicle based on GPS and RFID
CN106020204A (en) * 2016-07-21 2016-10-12 触景无限科技(北京)有限公司 Obstacle detection device, robot and obstacle avoidance system
WO2018094272A1 (en) * 2016-11-18 2018-05-24 Robert Bosch Start-Up Platform North America, LLC, Series 1 Robotic creature and method of operation
CN108646731A (en) * 2018-04-17 2018-10-12 上海创昂智能技术有限公司 Automatic driving vehicle field end control system and its control method
CN108958263A (en) * 2018-08-03 2018-12-07 江苏木盟智能科技有限公司 A kind of Obstacle Avoidance and robot

Similar Documents

Publication Publication Date Title
US11854212B2 (en) Traffic light detection system for vehicle
US20200276973A1 (en) Operation of a vehicle in the event of an emergency
EP3644294B1 (en) Vehicle information storage method, vehicle travel control method, and vehicle information storage device
US11333762B2 (en) Merging data from multiple LiDAR devices
EP3647734A1 (en) Automatic generation of dimensionally reduced maps and spatiotemporal localization for navigation of a vehicle
US10239539B2 (en) Vehicle travel control method and vehicle travel control device
CN110281941B (en) Vehicle control device, vehicle control method, and storage medium
WO2016199496A1 (en) Parking lot mapping system
KR20210050925A (en) Vehicle collision avoidance apparatus and method
US11834045B2 (en) Navigating multi-way stop intersections with an autonomous vehicle
US11529955B2 (en) Traffic light estimation
CN108986510A (en) A kind of local dynamic map of intelligence towards crossing realizes system and implementation method
WO2019181284A1 (en) Information processing device, movement device, method, and program
US11938965B2 (en) Information service method for vehicle dispatch system, vehicle dispatch system, and information service device
CN115375770A (en) Computer-implemented method, vehicle, camera and storage medium
CN110962744A (en) Vehicle blind area detection method and vehicle blind area detection system
US20210078593A1 (en) Operation of an autonomous vehicle based on availability of navigational information
CN106840177A (en) Vehicle synchronous build figure and obstacle identification method
CN110794821B (en) Vehicle-mounted control device, field end positioning device, vehicle control system and vehicle
US20210264783A1 (en) Communication method for vehicle dispatch system, vehicle dispatch system, and communication device
WO2021153176A1 (en) Autonomous movement device, autonomous movement control method, and program
GB2616739A (en) Traffic light estimation
WO2020151664A1 (en) Vehicle-mounted control device, field end positioning device, and vehicle
CN110775054B (en) Vehicle-mounted control device, field end positioning device, vehicle control system and vehicle
US20230088398A1 (en) Calibration courses and targets

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20745672

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20745672

Country of ref document: EP

Kind code of ref document: A1