WO2020133451A1 - Vehicle information sharing system and method, and self-driving vehicle - Google Patents

Vehicle information sharing system and method, and self-driving vehicle Download PDF

Info

Publication number
WO2020133451A1
WO2020133451A1 PCT/CN2018/125725 CN2018125725W WO2020133451A1 WO 2020133451 A1 WO2020133451 A1 WO 2020133451A1 CN 2018125725 W CN2018125725 W CN 2018125725W WO 2020133451 A1 WO2020133451 A1 WO 2020133451A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
vehicle
information sharing
vehicles
image
Prior art date
Application number
PCT/CN2018/125725
Other languages
French (fr)
Chinese (zh)
Inventor
张宇
石磊
林伟
冯威
刘晓彤
Original Assignee
驭势科技(北京)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 驭势科技(北京)有限公司 filed Critical 驭势科技(北京)有限公司
Priority to PCT/CN2018/125725 priority Critical patent/WO2020133451A1/en
Priority to CN201910007979.8A priority patent/CN109747660A/en
Publication of WO2020133451A1 publication Critical patent/WO2020133451A1/en

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00Registering or indicating the working of vehicles

Definitions

  • the present disclosure relates to, but not limited to, the technical field of vehicles, and specifically relates to a vehicle information sharing system and method, and an autonomous driving vehicle.
  • the present disclosure provides a vehicle information sharing system and method, and an autonomous driving vehicle loaded with the system and method.
  • the system and method can know the distance road condition information and the surrounding vehicle state information through sharing to avoid traffic accidents.
  • An aspect of the present disclosure provides a vehicle information sharing system, including: a sensor data processing module that collects first data related to the external environment of the vehicle; a communication data processing module that directly communicates with other vehicles around and receives the other The second data sent by the vehicle; the shared information generation module that processes the first data and the second data to generate a data packet; and the communication data processing module that directly communicates with the other vehicle The data packet is shared with the other vehicles as second data.
  • the first data includes at least image data of the environment outside the vehicle; the second data includes at least image data of the environment outside the vehicle.
  • the image data in the first data and the image data in the second data are image feature points, and the image feature points include geographic location information.
  • the shared information generation module stitches the image data in the first data with the image data in the second data to form composite image data, and adds the composite image data to In the data packet.
  • the sensor data processing module may also collect own vehicle state data related to the own vehicle state, and the own vehicle state data is included in the first data.
  • the own vehicle state data includes at least one of own vehicle speed, acceleration, and front wheel rotation angle; the second data includes other vehicle state data, and the other vehicle state data includes other At least one of the vehicle's speed, acceleration, and rotation angle of the front wheels.
  • the data packet includes only the own vehicle state data.
  • the data packet includes the own vehicle state data and the other vehicle state data.
  • the shared information generation module may filter the collected first data and the received second data, and process the filtered first data and second data to generate a data packet.
  • the communication data processing module communicates directly with other vehicles in the vicinity through a broadcasting system.
  • Another aspect of the present disclosure provides a vehicle information sharing method, including: collecting first data related to a vehicle's external environment; directly communicating with other vehicles in the vicinity, and receiving second data sent by the other vehicles; Processing the first data and the second data to generate a data packet; and directly communicating with the other vehicle, and sharing the data packet as second data to the other vehicle.
  • the image data in the first data and the image data in the second data are stitched to form composite image data, and the composite image data is added to the data packet.
  • self-vehicle state data related to the self-vehicle state is collected, and the self-vehicle state data is included in the first data.
  • the collected first data and the received second data are filtered, and the filtered first data and second data are processed to generate a data packet.
  • Yet another aspect of the present disclosure provides an autonomous driving vehicle to which the above-mentioned vehicle information sharing system is applied.
  • FIG. 1 is a schematic diagram showing the configuration of a vehicle information sharing system according to an exemplary embodiment of the present disclosure.
  • FIG. 2 is a schematic diagram illustrating the division of a vehicle information sharing system according to an exemplary embodiment of the present disclosure by function
  • FIG. 3 is a flowchart illustrating a vehicle information sharing method according to an exemplary embodiment of the present disclosure.
  • the present disclosure provides a vehicle information sharing system, method, and autonomous driving vehicle loaded with the system and method.
  • the vehicle information sharing system first collects vehicle external environment image data, and receives vehicle external environment image data sent by the other vehicles. Then, the information sharing system stitches the external environment image data of the own vehicle and the external environment data of the other vehicles to form composite image data, and then sends the composite data as its own external environment image data, Share with other vehicles.
  • a vehicle may have a long-distance image after stitching or superimposing image data collected by itself and image data collected by multiple other vehicles (which includes a long-distance image in front of the own vehicle or a long-distance image behind the own vehicle) That is, a vehicle has a "distant vision" function, in other words, the driver or the driving system can see the image beyond the visual distance of the naked eye.
  • the automatic driving system can obtain long-distance road condition information (such as traffic lights, road pits, congestion, water, snow, etc.), so that it can make driving route planning or driving operations (such as Braking, acceleration, etc.), making it possible to greatly improve driving efficiency while ensuring safety.
  • autonomous vehicles can also share their own driving status with other vehicles, so that the driving strategy between vehicles can be coordinated in real time. Because data sharing requires high network delay and data transmission speed.
  • the technology disclosed in the present invention can be applied to a 4G network environment, but is more suitable for a 5G network environment.
  • FIG. 1 is a schematic diagram showing the configuration of a vehicle information sharing system according to an exemplary embodiment of the present disclosure.
  • the vehicle information sharing system includes: a sensor module 110, a processor 130, and a communication module 140.
  • the communication module 140 may be an independent hardware module, a hardware module included in the processor 130, or may be included in the processor 130 as a software module.
  • the vehicle information sharing system may be loaded on the self-driving car 100.
  • the self-driving car may also include a command component 150 and an actuator 160.
  • the sensor module 110 can collect first data related to the external environment of the vehicle; the communication module 140 directly communicates with other vehicles in the vicinity and receives second data sent by other vehicles; The first data and the second data are processed to generate a data packet; then the communication module 140 shares the data packet as second data to other vehicles.
  • the sensor module 110 may include various internal and external sensors that provide data to the vehicle 100.
  • the plurality of sensors may include vehicle component sensors and environment sensors.
  • the vehicle component sensor is connected to the actuator 160 of the vehicle 100, and can detect the operating status and parameters of various components of the actuator.
  • vehicle component sensors can detect operating parameters of actuators such as throttle, engine, braking, steering, wipers, and lights.
  • the sensor module 110 may also include multiple sensors that collect the environment outside the vehicle. Such as position sensors, external object sensors, etc.
  • the external object sensor may include a laser sensor, a radar, a visual sensor (such as a camera), a sonar, and so on.
  • the sensor module 110 collects first data related to the environment outside the vehicle.
  • the sensor module 110 may include a camera that can capture visual images around the vehicle and extract content therefrom.
  • the camera can capture the signs on both sides of the road and recognize the meaning of these signs through the control module.
  • the sensor module 110 can use the camera to determine the speed limit of the road.
  • the vehicle can also calculate the distance of surrounding objects from the vehicle through the parallax of different images taken by multiple cameras.
  • the sensor module 110 may also include a radar sensor or sonar.
  • the radar sensor or sonar can detect the distance between the vehicle and the surrounding obstacles, and can also be used to determine information such as the depth of snow on the road.
  • examples of the sensor module 110 are not limited to cameras, radar sensors, and sonar, but may also be any suitable sensing devices capable of collecting data on the environment outside the vehicle.
  • the first data includes information collected through these sensing devices.
  • the processor 130 may include one or more central processors (eg, single-core processors or multi-core processors) and one or more local memories.
  • the processor 130 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), an application-specific instruction-set processor (ASIP), Graphics Processing Unit (GPU), Physical Processing Unit (PPU), Digital Signal Processor (DSP), Field Programmable Gate Array (FPGA), programmable Logic device (programmable logic device, PLD), controller, microcontroller unit, reduced instruction-set computer (RISC), microprocessor (microprocessor), etc., or any combination thereof.
  • CPU central processing unit
  • ASIC application-specific integrated circuit
  • ASIP application-specific instruction-set processor
  • GPU Graphics Processing Unit
  • PPU Physical Processing Unit
  • DSP Digital Signal Processor
  • FPGA Field Programmable Gate Array
  • RISC reduced instruction-set computer
  • microprocessor microprocessor
  • the memory may store data and/or instructions.
  • the memory may store data obtained from autonomous vehicle sensors.
  • the memory may store data and/or instructions that the processor 130 may execute or use to perform the exemplary methods described in this disclosure.
  • the memory may include mass storage, removable memory, volatile read-and-write memory, read-only memory (ROM), etc., or any combination thereof.
  • mass storage may include magnetic disks, optical disks, solid-state drives, etc.; for example, removable storage may include flash drives, floppy disks, optical disks, memory cards, zipper disks, magnetic tape; for example, volatile read-write memory may include random access Memory (RAM); for example, RAM can include dynamic RAM (DRAM), double data rate synchronous dynamic RAM (DDR SDRAM), static RAM (SRAM), thyristor RAM (T-RAM) and zero capacitor RAM (Z-RAM );
  • ROM may include mask ROM (MROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), compact disc ROM (CD-ROM), and Digital universal disk ROM, etc.
  • storage can be implemented on a cloud platform.
  • the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud cloud, a multi-cloud cloud, etc., or any combination thereof.
  • the instruction module 150 receives the information from the processor 130 and converts it into an instruction to drive the actuator to the controller area network (Controller Area Network) CAN bus.
  • the processor 130 sends the driving strategy (acceleration, deceleration, turning, etc.) of the autonomous vehicle 100 to the instruction module 150.
  • the instruction module receives the driving strategy and converts it into a driving instruction to the actuator 160 (to the accelerator) , Brake mechanism, steering mechanism drive instructions).
  • the instruction module 150 sends the finger to the actuator 160 via the CAN bus.
  • the execution of the instruction by the actuator 160 is then detected by the vehicle sensor module 110 and fed back to the processor 130, thereby completing the closed-loop control and driving of the autonomous vehicle 100.
  • the communication module 140 directly communicates with other vehicles.
  • the communication module 140 may be implemented by a DSP chip or an embedded chip.
  • the communication module 140 of the present disclosure is not limited to this, and may be any other device or communication circuit capable of implementing information exchange.
  • the communication module 140 may be an independent hardware module, a hardware module included in the processor 130, or may be stored as a software module in the form of instructions in the local memory of the processor 130, and then run by the central The processor is called to execute.
  • FIG. 2 is a schematic diagram illustrating the division of functions of a vehicle information sharing system according to an exemplary embodiment of the present disclosure.
  • the schematic diagram may be one or more sets of instructions stored in the local memory of the processor 130.
  • the central processor of its processor 130 will connect to access the local memory, and call and execute the set or sets of instructions.
  • the vehicle information sharing system is divided into a sensor data processing module, a planning control module, a shared information generating module, and a communication data processing module.
  • the sensor data processing module receives the sensor data from the sensor module 110 and pre-processes the sensor data. For example, the image transmitted from the visual sensor is analyzed and processed to generate image data of the external environment reflecting the characteristics of the surrounding environment.
  • the planning control module performs planning decision information and vehicle control information of autonomous driving based on the external environment image data, combined with maps and other information sensed and received by the autonomous vehicle 100.
  • the planning decision information and control information may include planning control information such as vehicle path, lane change information, acceleration and deceleration information, and turn information. Then the planning control module sends the control information to the instruction module 150 again.
  • the planning control module may also share the planning decision information with other vehicles through the communication data processing module.
  • the shared information generation module synthesizes a data packet based on the image data of the external environment of the autonomous vehicle 100 and the received image data of the external environment of other vehicles, and then sends the data packet as shared data to the communication through the communication data processing module Module 140.
  • the communication module 140 shares it with other vehicles nearby.
  • the main body of the following operations are described from the perspective of the processor 130; when the sensor module 110 is mentioned below to perform certain tasks, those skilled in the art should understand that it refers to the data transmitted by the sensor module 110 It needs to be processed by the sensor data processing module in FIG. 2 before the processed data can be received by the planning control module and/or the shared information generating module.
  • the processor 130 processes the first data and the second data to generate the data packet.
  • the processing of the first data and the second data by the processor 130 includes, but is not limited to, screening and splicing the first data and the second data.
  • the second data received by the third vehicle is a data packet sent by the second vehicle
  • the data packet sent by the second vehicle includes the data collected by the second vehicle and the first
  • a data packet sent by a vehicle that is, a data packet of one vehicle serves as second data of another vehicle, thereby forming an iteration so that one vehicle can grasp the information observed by other vehicles at a certain distance from it.
  • the communication module 140 directly communicates with other vehicles, and shares the data packet as second data to other vehicles, and also receives second data of other vehicles sent by other vehicles.
  • the first data includes at least image data of the environment outside the vehicle
  • the second data includes at least image data of the environment outside the vehicle.
  • the image data of the external environment may be real image data of the external environment, or may be data that can be recognized by the machine after the external environment is processed by machine vision.
  • the sensor module 110 may process the original image of the surrounding environment of the self-driving car 100 through a convolutional neural network or neural network-like algorithm, extract feature points, feature values, and/or feature vectors corresponding to things in the image, and use This is the image data of the external environment.
  • the sensor module 110 may include a camera that can capture visual images around the vehicle.
  • the sensor data processing module receives the visual image and extracts content from it. Specifically, the camera captures the external environment image, and then the sensor data processing module performs image processing on the captured image (for example, performing one-fold or multiple convolution calculations through a neural network) to obtain image data of the external environment of the vehicle (such as the captured image) Feature vectors, feature values, etc.), so that the first data may include image data of the environment outside the own vehicle. Similarly, the second data may include image data of other environments outside the vehicle.
  • the image data in the first data and the image data in the second data may be image feature points, feature values, and/or feature vectors that can be machine recognized, image feature points, feature values And/or feature vectors contain geographic location information.
  • the image data collected by each vehicle has specific positioning information, such as the positioning information of each vehicle, so that each image data can be arranged in an orderly manner on the map.
  • the image data in the second data may have a certain range. For example, for a self-driving car 100, if the sight distance of its sensor module 110 (such as a camera) is 100 meters, the corresponding image data may also be only 100 meters away.
  • the processor 130 stitches the image data in the first data with the image data in the second data to form composite image data, and adds the composite image data to the data packet.
  • the processor 130 may receive the second data from a third-party sending vehicle, and the second data includes position information (coordinate information) of the sending vehicle.
  • the processor may retrieve a map pre-stored in the local memory, and then based on the location information and the map, the processor 130 may stitch the image data corresponding to the second data (send maps/image information around the vehicle) to the map on.
  • the image data acquired from the surrounding environment is stitched to the map according to its own position.
  • the data after splicing the first data and the second data forms the data packet.
  • the data packet becomes the second data of the other vehicles, and then joins the other vehicles themselves.
  • the first data is spliced to form a new data packet.
  • one vehicle may have the image data collected by itself and the image data collected by multiple other vehicles after splicing or superimposing
  • the long-distance image (which includes the long-distance image in front of the own vehicle or the long-distance image behind the own vehicle), that is, a vehicle has a "distant vision" function, in other words, the driver or the automatic driving system can see the self-view Images outside the distance.
  • the driver or the automatic driving system can timely obtain long-distance road condition information (such as traffic lights, road pits, congestion, water accumulation, snow accumulation, etc.), so that driving can be made as soon as possible Route planning or driving operations (such as braking, acceleration, etc.) make it possible to greatly improve driving efficiency while ensuring safety.
  • road condition information such as traffic lights, road pits, congestion, water accumulation, snow accumulation, etc.
  • the second data received by the self-driving vehicle 100 may be external environment image data after multiple stitching by other vehicles. If the second data after multiple stitching has never been cut, the second data may be so large that the network transmission is no longer suitable for the requirements of automatic driving communication.
  • the image processor 130 can tailor the coverage of the stitched image to the range required by the vehicle 100 according to the needs of its own vehicle.
  • the sensor in the sensor module 110 may also collect own vehicle state data related to the own vehicle state, which is included in the first data.
  • Vehicle internal actuators may include, but are not limited to, throttle, engine, braking system, and steering system (including steering of tires and/or operation of turn signals).
  • the sensor module 110 is connected to the vehicle's actuator, so it can detect the operating status and parameters of various components of the actuator. These operating states and parameters form part of the first data.
  • the own vehicle state data includes at least one of the own vehicle's speed, acceleration, and rotation angle of the front wheels; the second data includes other vehicle state data, and the other vehicle state data includes other vehicle's At least one of speed, acceleration, and rotation angle of the front wheel.
  • the shared information generation module can directly obtain planning control information such as vehicle lane change information, acceleration and deceleration information, and turn information from the own vehicle planning control module.
  • the vehicle chassis control information is obtained from the sensor module 110 through the sensor data processing module, such as the wheel speedometer to obtain information including steering and speed.
  • the shared information generation module can extract the speed of the vehicle from the bus of the vehicle through the sensor module 110 and the sensor data processing module.
  • the sensor module 110 may include an accelerometer for acquiring acceleration of the vehicle, whereby acceleration and deceleration information of the vehicle may be acquired.
  • the sensor module 110 may also include an angle measuring instrument disposed near the rotation axis of the front wheel. The angle measuring instrument measures the rotation angle of the front wheel. For example, when the rotation angle is greater than a preset angle, the vehicle may change lane information.
  • examples of the sensor module 110 are not limited to accelerometers and angle measuring instruments, but may also be any suitable sensing devices capable of collecting own vehicle state data.
  • the first data includes information collected through these sensing devices.
  • the own vehicle status data also contains relevant geographic location information to identify the corresponding vehicle.
  • the data packet may only include own vehicle state data and not include surrounding environment images and vehicle states of other vehicles.
  • the communication module 140 (or communication data processing module) of one vehicle does not receive the vehicle state data of other vehicles.
  • the data packet includes only the vehicle state data of itself, and the communication module 140 (or communication data processing module) Only the own vehicle status data is sent to other vehicles in real time. For example, the acceleration, deceleration, and lane change of the own vehicle are sent to surrounding vehicles.
  • the driver or controller of the surrounding vehicle can obtain the real-time driving operation of the own vehicle in real time, thereby making driving planning as early as possible to ensure safety.
  • the data packet may also include the own vehicle state and the vehicle state of other vehicles.
  • the shared information generation module retains the state data of the other vehicles in the second data and removes the surrounding environment of the other vehicles
  • the image is then processed with its own vehicle status data to generate packaged data.
  • the packaged data includes both the vehicle status of the own vehicle and the driving status of the surrounding vehicles.
  • the data packet includes not only own vehicle state data, but also other vehicle state data.
  • the communication module 140 (or the communication data processing module) will send the status data of multiple vehicles to other vehicles when sending the second data (for example, the data packet).
  • the second data for example, the data packet.
  • the acceleration, deceleration, and lane change of multiple vehicles are sent to surrounding vehicles in real time.
  • the driver or controller of the surrounding vehicle can acquire the driving operations to be performed by multiple vehicles earlier or in real time, thereby making driving planning earlier to ensure safety.
  • the drivers or controllers of multiple vehicles can plan driving operations of multiple vehicles in a unified manner, or make driving operations independently but synchronously.
  • the processor may filter the collected first data and the received second data, and process the filtered first data and second data to generate a data packet.
  • some of the data may not need to be shared, so the required data is selected according to the screening rules or manual intervention to generate the data to be shared package. In this way, it is possible to provide practical information only to other vehicles and reduce the amount of data transmission.
  • the communication module directly communicates with other vehicles in the vicinity through the broadcasting system. Specifically, multiple vehicles communicate through a broadcast system within a certain distance, thereby achieving V2V (vehicle-to-vehicle) communication between multiple vehicles.
  • V2V vehicle-to-vehicle
  • examples of the broadcast system used by the communication module 140 (or communication data processing module) to directly communicate with other vehicles include radio frequency circuits, such as a 433M radio frequency circuit, through which the first data and the second data can be combined Broadcasting of data packets.
  • any communication environment of 2G to 4G can be used.
  • the 5G network environment is more suitable for the communication between the vehicles.
  • the data transmission rate of 4G is on the order of 100Mbps
  • the delay is 30-50ms
  • the maximum number of connections per square kilometer is on the order of 10,000
  • the mobility is about 350KM/h
  • the transmission rate of 5G is on the order of 10Gbps
  • the delay is 1ms
  • the maximum number of connections per square kilometer is on the order of millions
  • the mobility is about 500km/h.
  • 5G has higher transmission rates, shorter delays, more connections per square kilometer, and higher speed tolerance. Another change in 5G is the change in transmission paths.
  • the communication module 140 (or communication data processing module) of the vehicle information sharing system of the present disclosure
  • the data package can be shared only if certain preset conditions for information sharing are met.
  • the information sharing preset conditions include at least one of the following: the start of the vehicle; the stop of the vehicle; the change value of the vehicle speed is greater than the preset value; the change value of the rotation angle of the front wheels is greater than the preset value; and the neighboring vehicle The distance change value is greater than the preset value. That is, the data package is shared with other vehicles only when the vehicle's own vehicle state data or the collected own vehicle external environment data (ie, the first data) changes or changes significantly. It should be understood that the examples of the information sharing preset conditions are not limited to the above listed conditions, and may also be any other suitable conditions.
  • the vehicle information sharing system further includes a reminder module that can remind other vehicles when a vehicle meets a preset condition for information sharing.
  • the reminder module may be a voice broadcaster, which broadcasts the information contained in the data packet to the driver, such as acceleration, deceleration, and lane change information. It should be understood that the example of the reminder module is not limited to the voice broadcaster, but may also be a display device, which displays related information through the display.
  • the data packet includes the distribution data of multiple vehicles, and the communication module 140 (or the communication data processing module) may set according to the distribution data not to send the data packet (for example, a composite external environment image) to other vehicles.
  • Data transmission blocking conditions to limit the sharing range of data packets.
  • the data transmission blocking condition includes at least one of the number of times of sharing and the vehicle distribution length in the distribution data.
  • data transmission blocking conditions are not limited to the above listed conditions, but may be any other suitable conditions.
  • the vehicle information sharing system provided by the embodiments of the present disclosure is suitable for V2V working scenarios, and can integrate vehicle external environment data and own vehicle state data within a certain range, so the vehicle information sharing system provided by the embodiments of the present disclosure can enable vehicles to drive
  • the operator or controller knows the remote road condition information and the surrounding vehicle status information to avoid traffic accidents.
  • FIG. 3 is a flowchart 200 illustrating a vehicle information sharing method according to an exemplary embodiment of the present disclosure. As shown in FIG. 3, the vehicle information sharing method includes:
  • Step S210 Collect first data related to at least one of the external environment of the vehicle and the state of the own vehicle.
  • the sensor data processing module collects the first data related to the external environment of the vehicle through the sensor module 110.
  • the sensor module 110 may include a camera that can capture visual images around the vehicle and extract content therefrom.
  • the sensor module 110 may also include a radar sensor or sonar to detect the distance between the vehicle and surrounding obstacles.
  • the first data includes information received through the sensor module 110.
  • the sensor data processing module collects own vehicle state data related to the own vehicle state through the sensor module 110, and the own vehicle state data is included in the first data.
  • the own vehicle state data includes at least one of the speed, acceleration, and rotation angle of the front wheel of the own vehicle.
  • the sensor data processing module extracts the speed of the vehicle from the bus of the vehicle through the sensor module 110.
  • the sensor module 110 may include an accelerometer for acquiring acceleration of the vehicle, whereby acceleration and deceleration information of the vehicle may be acquired.
  • the sensor module 110 may include an angle measuring instrument disposed near the rotation axis of the front wheel. The angle measuring instrument measures the rotation angle of the front wheel. For example, when the rotation angle is greater than the preset angle, the vehicle may change lane information.
  • Step S20 Receive second data sent by other vehicles.
  • the communication data processing module directly communicates with other vehicles in the vicinity through the communication module 140, and receives second data sent by other vehicles. Similar to the first data, the second data is also data related to at least one of the external environment of the vehicle and the state of the own vehicle.
  • Step S30 processing the first data and the second data to generate a data packet.
  • the first data and the second data are processed into a data packet by the shared information generating module in the processor 130.
  • the processing of the first data and the second data by the shared information generation module includes, but is not limited to, screening and splicing the first data and the second data. It should be understood that, for example, for three vehicles, the second data received by the third vehicle is a data packet sent by the second vehicle, and the data packet sent by the second vehicle includes the data collected by the second vehicle and the first A data packet sent by a vehicle.
  • step S40 the data packet is shared with other vehicles as second data.
  • the communication data processing module directly communicates with other vehicles through the communication module 140, and shares the data packet as the second data to the other vehicles.
  • the data packet of one vehicle is used as the second data of another vehicle, thereby forming an iteration, so that one vehicle can grasp the information observed by other vehicles at a certain distance from it.
  • the image data in the first data and the image data in the second data are stitched to form composite image data, and the composite image data is added to the data packet.
  • the sensor module 110 may include a camera that captures an external environment image and performs image processing (eg, convolution) on the captured image to obtain image data of the external environment of the vehicle, so that the first data may include itself Image data of the environment outside the vehicle.
  • the second data may include image data of other environments outside the vehicle.
  • the image data in the first data and the image data in the second data are image feature points, and the image feature points include geographic location information. Since the image data collected by each vehicle has specific positioning information, this can enable each image data to be arranged in an orderly manner on the map.
  • a vehicle can have a long-distance image after the image data collected by itself and the image data collected by multiple other vehicles are stitched or superimposed , That is, a vehicle has a "distant vision" function, in other words, the driver can see the image beyond the visual distance of his naked eye through the display.
  • the driver can obtain long-distance road condition information (such as traffic lights, road pits, congestion, water accumulation, snow, etc.) in time while the vehicle is driving, so that it can make driving route planning or driving operations (such as braking) as soon as possible. , Acceleration, etc.), making it possible to greatly improve driving efficiency while ensuring safety.
  • the collected first data and the received second data are filtered, and the filtered first data and second data are processed to generate a data packet.
  • some of the data may not need to be shared, so the required data is selected according to the screening rules or manual intervention to generate the data to be shared data pack. In this way, it is possible to provide practical information only to other vehicles and reduce the amount of data transmission.
  • the vehicle information sharing method provided by the embodiments of the present disclosure is suitable for V2V working scenarios, and can integrate vehicle external environment data and own vehicle state data within a certain range, so the vehicle information sharing method provided by the embodiments of the present disclosure can enable vehicles to drive The operator or controller knows the remote road condition information and the surrounding vehicle status information to avoid traffic accidents.
  • an autonomous driving vehicle that applies the vehicle information sharing system described above.
  • the self-driving vehicle provided by the embodiment of the present disclosure is suitable for V2V working scenarios, and can integrate vehicle external environment data and own vehicle state data within a certain range, so the self-driving vehicle provided by the embodiment of the present disclosure can know the distance road condition information and Surrounding vehicle status information to avoid traffic accidents.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Theoretical Computer Science (AREA)
  • Traffic Control Systems (AREA)

Abstract

A vehicle information sharing system and method, and a self-driving vehicle. The vehicle information sharing system comprises: a sensor module (110), for collecting first data related to the external environment of a vehicle; a communication module (140), for directly communicating with other vehicles in the vicinity and receiving second data transmitted by the other vehicles; a shared information generating module, for processing the first data and the second data to generate a data packet, the communication module (140) directly communicating with the other vehicles and sharing the data packet as second data with the other vehicles. Because of increased requirements on network latency and data transmission rate when data is being shared, the system is applicable in a 4G network environment but is more suitable in a 5G network environment.

Description

车辆信息共享系统及方法、自动驾驶车辆Vehicle information sharing system and method, automatic driving vehicle 技术领域Technical field
本公开涉及但不限于车辆技术领域,并且具体涉及一种车辆信息共享系统及方法、自动驾驶车辆。The present disclosure relates to, but not limited to, the technical field of vehicles, and specifically relates to a vehicle information sharing system and method, and an autonomous driving vehicle.
背景技术Background technique
在公路上行车时,驾驶员通常难以知晓离自身车辆一定距离以外的路况信息,特别是在恶劣天气(例如雨雪天气、大雾天气)的情况下,驾驶员更难以察觉远距离的路况信息,从而极大地影响了行车效率。另外,道路上经常出现因不能及时了解其它车辆的驾驶操作信息而在行驶过程中出现追尾、刮蹭等交通事故。When driving on a highway, it is often difficult for the driver to know the road condition information beyond a certain distance from his vehicle, especially in the case of severe weather (such as rain, snow and foggy weather), it is more difficult for the driver to perceive the road condition information at a long distance , Which greatly affects driving efficiency. In addition, road accidents such as rear-end collisions and scratches often occur during driving due to inability to understand the driving operation information of other vehicles in time.
因此,亟需一种车辆信息共享方案以解决上述技术问题。Therefore, a vehicle information sharing solution is urgently needed to solve the above technical problems.
发明内容Summary of the invention
为了至少部分解决现有技术中存在的技术问题,本公开提供了一种车辆信息共享系统及方法,以及装载了该系统和方法的自动驾驶车辆。所述系统和方法能够通过共享来知晓远方路况信息和周边车辆状态信息以避免交通事故。In order to at least partially solve the technical problems existing in the prior art, the present disclosure provides a vehicle information sharing system and method, and an autonomous driving vehicle loaded with the system and method. The system and method can know the distance road condition information and the surrounding vehicle state information through sharing to avoid traffic accidents.
本公开的一个方面提供了一种车辆信息共享系统,包括:传感器数据处理模块,采集与车辆外部环境相关的第一数据;通讯数据处理模块,与周边的其它车辆直接通信,并且接收所述其它车辆发送的第二数据;共享信息生成模块,将所述第一数据和所述第二数据进行处理生成为数据包;以及所述通讯数据处理模块,与所述其它车辆直接通信,并将所述数据包作为第二数据共享给所述其它车辆。An aspect of the present disclosure provides a vehicle information sharing system, including: a sensor data processing module that collects first data related to the external environment of the vehicle; a communication data processing module that directly communicates with other vehicles around and receives the other The second data sent by the vehicle; the shared information generation module that processes the first data and the second data to generate a data packet; and the communication data processing module that directly communicates with the other vehicle The data packet is shared with the other vehicles as second data.
在一些实施例中,所述第一数据至少包括自身车辆外部环境的图像 数据;所述第二数据至少包括其它车辆外部环境的图像数据。In some embodiments, the first data includes at least image data of the environment outside the vehicle; the second data includes at least image data of the environment outside the vehicle.
在一些实施例中,所述第一数据中的图像数据和所述第二数据中的图像数据是图像特征点,所述图像特征点包含地理位置信息。In some embodiments, the image data in the first data and the image data in the second data are image feature points, and the image feature points include geographic location information.
在一些实施例中,所述共享信息生成模块将所述第一数据中的图像数据与所述第二数据中的图像数据进行拼接,以形成合成图像数据,并且将所述合成图像数据添加到所述数据包中。In some embodiments, the shared information generation module stitches the image data in the first data with the image data in the second data to form composite image data, and adds the composite image data to In the data packet.
在一些实施例中,传感器数据处理模块还可以采集与自身车辆状态相关的自身车辆状态数据,所述自身车辆状态数据包括在所述第一数据中。In some embodiments, the sensor data processing module may also collect own vehicle state data related to the own vehicle state, and the own vehicle state data is included in the first data.
在一些实施例中,所述自身车辆状态数据包括自身车辆的速度、加速度、前轮的转动角度中的至少一者;所述第二数据包括其他车辆状态数据,所述其他车辆状态数据包括其他车辆的速度、加速度、前轮的转动角度中的至少一者。In some embodiments, the own vehicle state data includes at least one of own vehicle speed, acceleration, and front wheel rotation angle; the second data includes other vehicle state data, and the other vehicle state data includes other At least one of the vehicle's speed, acceleration, and rotation angle of the front wheels.
在一些实施例中,所述数据包仅包括所述自身车辆状态数据。In some embodiments, the data packet includes only the own vehicle state data.
在一些实施例中,所述数据包包括所述自身车辆状态数据和所述其他车辆状态数据。In some embodiments, the data packet includes the own vehicle state data and the other vehicle state data.
在一些实施例中,所述共享信息生成模块可以对所采集的第一数据和所接收到的第二数据进行筛选,并且对筛选后的第一数据和第二数据进行处理生成为数据包。In some embodiments, the shared information generation module may filter the collected first data and the received second data, and process the filtered first data and second data to generate a data packet.
在一些实施例中,所述通讯数据处理模块通过广播系统与周边的其它车辆直接通信。In some embodiments, the communication data processing module communicates directly with other vehicles in the vicinity through a broadcasting system.
本公开的另一个方面提供了一种车辆信息共享方法,包括:采集与车辆外部环境相关的第一数据;与周边的其它车辆直接通信,并且接收所述其它车辆发送的第二数据;将所述第一数据和所述第二数据进行处理生成为数据包;以及与所述其它车辆直接通信,并将所述数据包作为第二数据共享给所述其它车辆。Another aspect of the present disclosure provides a vehicle information sharing method, including: collecting first data related to a vehicle's external environment; directly communicating with other vehicles in the vicinity, and receiving second data sent by the other vehicles; Processing the first data and the second data to generate a data packet; and directly communicating with the other vehicle, and sharing the data packet as second data to the other vehicle.
在一些实施例中,将所述第一数据中的图像数据与所述第二数据中的图像数据进行拼接,以形成合成图像数据,并且将所述合成图像数据添加到所述数据包中。In some embodiments, the image data in the first data and the image data in the second data are stitched to form composite image data, and the composite image data is added to the data packet.
在一些实施例中,采集与自身车辆状态相关的自身车辆状态数据, 所述自身车辆状态数据包括在所述第一数据中。In some embodiments, self-vehicle state data related to the self-vehicle state is collected, and the self-vehicle state data is included in the first data.
在一些实施例中,对所采集的第一数据和所接收到的第二数据进行筛选,并且对筛选后的第一数据和第二数据进行处理生成为数据包。In some embodiments, the collected first data and the received second data are filtered, and the filtered first data and second data are processed to generate a data packet.
本公开的又一个方面提供了一种自动驾驶车辆,其应用了上述车辆信息共享系统。Yet another aspect of the present disclosure provides an autonomous driving vehicle to which the above-mentioned vehicle information sharing system is applied.
附图说明BRIEF DESCRIPTION
图1是示出根据本公开的示例性实施例的车辆信息共享系统的构造示意图;以及1 is a schematic diagram showing the configuration of a vehicle information sharing system according to an exemplary embodiment of the present disclosure; and
图2是示出根据本公开的示例性实施例的车辆信息共享系统按功能划分的示意图;2 is a schematic diagram illustrating the division of a vehicle information sharing system according to an exemplary embodiment of the present disclosure by function;
图3是示出根据本公开的示例性实施例的车辆信息共享方法的流程图。FIG. 3 is a flowchart illustrating a vehicle information sharing method according to an exemplary embodiment of the present disclosure.
具体实施方式detailed description
本公开提供一种车辆信息共享系统、方法以及装载该系统和方法的自动驾驶车辆。该车辆信息共享系统首先采集车辆外部环境图像数据,并且接收所述其它车辆发送的车辆外部环境图像数据。然后,所述信息共享系统将所述自身车辆的外部环境图像数据和所述其他车辆的外部环境数据进行拼接,以形成合成图像数据,再将合成数据当作自身的外部环境图像数据发送出去,跟其他车辆分享。因此,一个车辆可以具有由自身采集到的图像数据和多个其它车辆采集到的图像数据拼接或叠加之后的远距离图像(其包括自身车辆前方的远距离图像或者自身车辆后方的远距离图像),即一个车辆具有“远视”功能,换言之,驾驶员或者驾驶系统可以看到其肉眼视距之外的图像。这样,在车辆行驶过程中,自动驾驶系统可以及时获取到远距离的路况信息(如红绿灯、路坑、拥堵、积水、积雪等),从而可以尽早做出行车路线规划或驾驶操作(如刹车、加速等),使得可以在确保安全的情况下极大地提高行车效率。另一方面,自动驾驶车辆也可以同其他车辆分享自身的行车状态,使得车与车之间的行驶策略可以实时协调。由于数据共享的时候对网络时延和数据的传输速度要求较高。比 如,本发明中披露的技术可以应用在4G网络环境,但是更适合5G网络环境。The present disclosure provides a vehicle information sharing system, method, and autonomous driving vehicle loaded with the system and method. The vehicle information sharing system first collects vehicle external environment image data, and receives vehicle external environment image data sent by the other vehicles. Then, the information sharing system stitches the external environment image data of the own vehicle and the external environment data of the other vehicles to form composite image data, and then sends the composite data as its own external environment image data, Share with other vehicles. Therefore, a vehicle may have a long-distance image after stitching or superimposing image data collected by itself and image data collected by multiple other vehicles (which includes a long-distance image in front of the own vehicle or a long-distance image behind the own vehicle) That is, a vehicle has a "distant vision" function, in other words, the driver or the driving system can see the image beyond the visual distance of the naked eye. In this way, during the driving process of the vehicle, the automatic driving system can obtain long-distance road condition information (such as traffic lights, road pits, congestion, water, snow, etc.), so that it can make driving route planning or driving operations (such as Braking, acceleration, etc.), making it possible to greatly improve driving efficiency while ensuring safety. On the other hand, autonomous vehicles can also share their own driving status with other vehicles, so that the driving strategy between vehicles can be coordinated in real time. Because data sharing requires high network delay and data transmission speed. For example, the technology disclosed in the present invention can be applied to a 4G network environment, but is more suitable for a 5G network environment.
下面本公开将结合附图对本公开的示例性实施例对本发明进行清楚、完整的描述,显然,本公开所描述的示例性实施例是本公开的一部分实施例,而不是全部的实施例。基于本公开中的示例性实施例,本领域普通技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例,都属于本公开保护的范围。In the following, the present disclosure will make a clear and complete description of the present invention with reference to the exemplary embodiments of the present disclosure. Obviously, the exemplary embodiments described in the present disclosure are a part of the embodiments of the present disclosure, but not all the embodiments. Based on the exemplary embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the protection scope of the present disclosure.
根据本公开的一个方面,提供了一种车辆信息共享系统。图1是示出根据本公开的示例性实施例的车辆信息共享系统的构造的示意图。如图1所示,该车辆信息共享系统包括:传感器模块110、处理器130以及通讯模块140。通讯模块140可以是独立的硬件模块,也可以是包含在处理器130的硬件模块,也可以作为一个软件模块包含在处理器130中。所述车辆信息共享系统可以装载在自动驾驶汽车100上。此外,自动驾驶汽车还可以包括指令部件150以及执行机构160。According to an aspect of the present disclosure, a vehicle information sharing system is provided. FIG. 1 is a schematic diagram showing the configuration of a vehicle information sharing system according to an exemplary embodiment of the present disclosure. As shown in FIG. 1, the vehicle information sharing system includes: a sensor module 110, a processor 130, and a communication module 140. The communication module 140 may be an independent hardware module, a hardware module included in the processor 130, or may be included in the processor 130 as a software module. The vehicle information sharing system may be loaded on the self-driving car 100. In addition, the self-driving car may also include a command component 150 and an actuator 160.
在正常运行的时候,传感器模块110,可以采集与车辆外部环境相关的第一数据;通讯模块140,与周边的其它车辆直接通信,并且接收其它车辆发送的第二数据;处理器130,将第一数据和第二数据进行处理生成为数据包;然后通讯模块140再将数据包作为第二数据共享给其它车辆。During normal operation, the sensor module 110 can collect first data related to the external environment of the vehicle; the communication module 140 directly communicates with other vehicles in the vicinity and receives second data sent by other vehicles; The first data and the second data are processed to generate a data packet; then the communication module 140 shares the data packet as second data to other vehicles.
具体而言,传感器模块110可以包括向车辆100提供数据的各种内部和外部传感器。比如图1中所示,所述多个传感器可以包括车辆部件传感器和环境传感器。车辆部件传感器连接着车辆100的执行机构160,可以检测到所述执行机构各个部件的运行状态和参数。比如车辆部件传感器可以检测油门、引擎、制动、转向、雨刷、车灯等等执行机构的运行参数。Specifically, the sensor module 110 may include various internal and external sensors that provide data to the vehicle 100. For example, as shown in FIG. 1, the plurality of sensors may include vehicle component sensors and environment sensors. The vehicle component sensor is connected to the actuator 160 of the vehicle 100, and can detect the operating status and parameters of various components of the actuator. For example, vehicle component sensors can detect operating parameters of actuators such as throttle, engine, braking, steering, wipers, and lights.
传感器模块110还可以包括采集车辆外部环境的多个传感器。比如位置传感器、外部对象传感器等等。所述外部对象传感器又可以包括激光传感器、雷达、视觉传感器(例如摄像头)和声纳等等。The sensor module 110 may also include multiple sensors that collect the environment outside the vehicle. Such as position sensors, external object sensors, etc. The external object sensor may include a laser sensor, a radar, a visual sensor (such as a camera), a sonar, and so on.
传感器模块110采集与车辆外部环境相关的第一数据。在本公开的示例性实施例中,传感器模块110可以包括摄像头,该摄像头可以捕获车辆周围的视觉图像并从中提取内容。例如,摄像头可以拍摄道路两边的路牌标识,并通过控制模块识别这些标识的意义。比如,传感器模块110可 以利用相机来判断道路的速限。车辆还可以通过多个摄像头拍摄的不同图像的视差计算周围物体离车辆的距离。传感器模块110也可以包括雷达传感器或声纳,比如该雷达传感器或声纳可以探测车辆同周围障碍物之间的距离,也可以用于确定道路上的积雪深度等信息。应当理解的是,传感器模块110的实例不限于摄像头、雷达传感器、声纳,也可以为能够采集车辆外部环境数据的任何合适的感知设备。第一数据包括通过这些感知设备采集到的信息。The sensor module 110 collects first data related to the environment outside the vehicle. In an exemplary embodiment of the present disclosure, the sensor module 110 may include a camera that can capture visual images around the vehicle and extract content therefrom. For example, the camera can capture the signs on both sides of the road and recognize the meaning of these signs through the control module. For example, the sensor module 110 can use the camera to determine the speed limit of the road. The vehicle can also calculate the distance of surrounding objects from the vehicle through the parallax of different images taken by multiple cameras. The sensor module 110 may also include a radar sensor or sonar. For example, the radar sensor or sonar can detect the distance between the vehicle and the surrounding obstacles, and can also be used to determine information such as the depth of snow on the road. It should be understood that examples of the sensor module 110 are not limited to cameras, radar sensors, and sonar, but may also be any suitable sensing devices capable of collecting data on the environment outside the vehicle. The first data includes information collected through these sensing devices.
处理器130可以包括一个或多个中央处理器(例如,单核处理器或多核处理器)以及一个或多个本地存储器。仅作为示例,处理器130可以包括中央处理单元(central processing unit,CPU),专用集成电路(application-specific integrated circuit,ASIC),专用指令集处理器(application-specific instruction-set processor,ASIP),图形处理单元(graphics processing unit,GPU),物理处理单元(physics processing unit,PPU),数字信号处理器(digital signal processor,DSP),场可编程门阵列(field programmable gate array,FPGA),可编程逻辑器件(programmable logic device,PLD),控制器,微控制器单元,精简指令集计算机(reduced instruction-set computer,RISC),微处理器(microprocessor)等,或其任何组合。The processor 130 may include one or more central processors (eg, single-core processors or multi-core processors) and one or more local memories. For example only, the processor 130 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), an application-specific instruction-set processor (ASIP), Graphics Processing Unit (GPU), Physical Processing Unit (PPU), Digital Signal Processor (DSP), Field Programmable Gate Array (FPGA), programmable Logic device (programmable logic device, PLD), controller, microcontroller unit, reduced instruction-set computer (RISC), microprocessor (microprocessor), etc., or any combination thereof.
存储器可以存储数据和/或指令。在一些实施例中,存储器可以存储从自动驾驶车辆传感器获得的数据。在一些实施例中,存储器可以存储处理器130可以执行或使用的数据和/或指令,以执行本公开中描述的示例性方法。在一些实施例中,存储器可以包括大容量存储器,可移动存储器,易失性读写存储器(volatile read-and-write memory),只读存储器(ROM)等,或其任何组合。作为示例,比如大容量存储器可以包括磁盘,光盘,固态驱动器等;比如可移动存储器可以包括闪存驱动器,软盘,光盘,存储卡,拉链盘,磁带;比如易失性读写存储器可以包括随机存取存储器(RAM);比如RAM可以包括动态RAM(DRAM),双倍数据速率同步动态RAM(DDR SDRAM),静态RAM(SRAM),可控硅RAM(T-RAM)和零电容器RAM(Z-RAM);比如ROM可以包括掩模ROM(MROM),可编程ROM(PROM),可擦除可编程ROM(EPROM),电可擦除可编程ROM(EEPROM),光盘ROM (CD-ROM),以及数字通用磁盘ROM等。在一些实施例中,存储可以在云平台上实现。仅作为示例,云平台可以包括私有云,公共云,混合云,社区云,分布式云,云间云,多云等,或其任何组合。The memory may store data and/or instructions. In some embodiments, the memory may store data obtained from autonomous vehicle sensors. In some embodiments, the memory may store data and/or instructions that the processor 130 may execute or use to perform the exemplary methods described in this disclosure. In some embodiments, the memory may include mass storage, removable memory, volatile read-and-write memory, read-only memory (ROM), etc., or any combination thereof. As an example, for example, mass storage may include magnetic disks, optical disks, solid-state drives, etc.; for example, removable storage may include flash drives, floppy disks, optical disks, memory cards, zipper disks, magnetic tape; for example, volatile read-write memory may include random access Memory (RAM); for example, RAM can include dynamic RAM (DRAM), double data rate synchronous dynamic RAM (DDR SDRAM), static RAM (SRAM), thyristor RAM (T-RAM) and zero capacitor RAM (Z-RAM ); For example, ROM may include mask ROM (MROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), compact disc ROM (CD-ROM), and Digital universal disk ROM, etc. In some embodiments, storage can be implemented on a cloud platform. For example only, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud cloud, a multi-cloud cloud, etc., or any combination thereof.
指令模块150接收处理器130传来的信息,并将之转换成驱动执行机构的指令传给控制器区域网络(Controller Area Network)CAN总线。比如,处理器130向指令模块150发送自动驾驶车辆100的行驶策略(加速、减速、转弯等等),指令模块接收所述行驶策略,并将之转换成对执行机构160的驱动指令(对油门、制动机构、转向机构的驱动指令)。同时,指令模块150再将所述指通过CAN总线下发到所述执行机构160去。执行机构160对所述指令的执行情况再由车辆传感器模块110检测并反馈到处理器130,从而完成对自动驾驶车辆100到闭环控制和驱动。The instruction module 150 receives the information from the processor 130 and converts it into an instruction to drive the actuator to the controller area network (Controller Area Network) CAN bus. For example, the processor 130 sends the driving strategy (acceleration, deceleration, turning, etc.) of the autonomous vehicle 100 to the instruction module 150. The instruction module receives the driving strategy and converts it into a driving instruction to the actuator 160 (to the accelerator) , Brake mechanism, steering mechanism drive instructions). At the same time, the instruction module 150 sends the finger to the actuator 160 via the CAN bus. The execution of the instruction by the actuator 160 is then detected by the vehicle sensor module 110 and fed back to the processor 130, thereby completing the closed-loop control and driving of the autonomous vehicle 100.
通讯模块140与其它车辆直接通信。在本公开的示例性实施例中,通讯模块140可以由DSP芯片或嵌入式芯片实现。然而,本公开的通讯模块140不限于此,也可以是能够实现信息交互的任何其它装置或通信电路。比如通讯模块140可以是独立的硬件模块,也可以是包含在处理器130的硬件模块,也可以作为一个软件模块以指令的形式存储在处理器130的本地存储器中,然后在运行的时候由中央处理器调取进行执行。The communication module 140 directly communicates with other vehicles. In the exemplary embodiment of the present disclosure, the communication module 140 may be implemented by a DSP chip or an embedded chip. However, the communication module 140 of the present disclosure is not limited to this, and may be any other device or communication circuit capable of implementing information exchange. For example, the communication module 140 may be an independent hardware module, a hardware module included in the processor 130, or may be stored as a software module in the form of instructions in the local memory of the processor 130, and then run by the central The processor is called to execute.
图2是示出根据本公开的示例性实施例的车辆信息共享系统按功能划分的示意图。所述示意图可以是存储于处理器130的本地存储器的一组或者多组指令。当自动驾驶汽车100运行的时候,其处理器130的中央处理器会连接访问所述本地存储器,并调用和执行所述一组或者多组指令。所述车辆信息共享系统分为传感器数据处理模块、规划控制模块、共享信息生成模块和通讯数据处理模块。FIG. 2 is a schematic diagram illustrating the division of functions of a vehicle information sharing system according to an exemplary embodiment of the present disclosure. The schematic diagram may be one or more sets of instructions stored in the local memory of the processor 130. When the autonomous vehicle 100 is running, the central processor of its processor 130 will connect to access the local memory, and call and execute the set or sets of instructions. The vehicle information sharing system is divided into a sensor data processing module, a planning control module, a shared information generating module, and a communication data processing module.
所述传感器数据处理模块接收传感器模块110传来的传感器数据,并且对传感器数据进行预处理。比如对视觉传感器传来的图像进行分析处理,生成反映周边环境特征的外部环境的图像数据。The sensor data processing module receives the sensor data from the sensor module 110 and pre-processes the sensor data. For example, the image transmitted from the visual sensor is analyzed and processed to generate image data of the external environment reflecting the characteristics of the surrounding environment.
所述规划控制模块根据所述外部环境图像数据,并结合地图以及其他自动驾驶车辆100感知和接收到的信息进行自动驾驶的规划决策信息和车辆控制信息。比如所述规划决策信息和控制信息可以包括车辆形式路径、变道信息、加减速信息、转弯信息等规划控制信息。然后所述规划控 制模块再将所述控制信息发送给指令模块150。所述规划控制模块还可以将所述规划决策信息通过通讯数据处理模块分享给其他车辆。The planning control module performs planning decision information and vehicle control information of autonomous driving based on the external environment image data, combined with maps and other information sensed and received by the autonomous vehicle 100. For example, the planning decision information and control information may include planning control information such as vehicle path, lane change information, acceleration and deceleration information, and turn information. Then the planning control module sends the control information to the instruction module 150 again. The planning control module may also share the planning decision information with other vehicles through the communication data processing module.
所述共享信息生成模块根据自动驾驶车辆100的外部环境的图像数据以及接收到的其他车辆的外部环境的图像数据合成数据包,然后通过通讯数据处理模块将所述数据包作为共享数据发送给通讯模块140。再由通讯模块140分享给附近其他车辆。The shared information generation module synthesizes a data packet based on the image data of the external environment of the autonomous vehicle 100 and the received image data of the external environment of other vehicles, and then sends the data packet as shared data to the communication through the communication data processing module Module 140. The communication module 140 shares it with other vehicles nearby.
下面具体介绍中央处理器执行所述信息共享模块的时候进行的信息共享操作。为了方便描述,下述操作的主体均以处理器130的角度描述;当下文提及传感器模块110执行某些任务时,本领域技术人员应当理解其所指为所述传感器模块110传出的数据需要经过图2中的传感器数据处理模块处理,处理后的数据才能被所述规划控制模块和/或共享信息生成模块接收。The following specifically describes the information sharing operation performed by the central processor when the information sharing module is executed. For convenience of description, the main body of the following operations are described from the perspective of the processor 130; when the sensor module 110 is mentioned below to perform certain tasks, those skilled in the art should understand that it refers to the data transmitted by the sensor module 110 It needs to be processed by the sensor data processing module in FIG. 2 before the processed data can be received by the planning control module and/or the shared information generating module.
处理器130将第一数据和第二数据进行处理生成为所述数据包。处理器130对第一数据和第二数据的处理包括但不限于对第一数据和第二数据进行筛选、拼接等。应当理解的是,例如对于三辆车而言,第三车辆接收到的第二数据是第二车辆发送的数据包,该第二车辆发送的数据包包括由第二车辆采集到的数据和第一车辆发送的数据包,即一个车辆的数据包作为另一车辆的第二数据,由此形成迭代,使得一个车辆可以掌握与其相距一定距离的其它车辆所观测到的信息。The processor 130 processes the first data and the second data to generate the data packet. The processing of the first data and the second data by the processor 130 includes, but is not limited to, screening and splicing the first data and the second data. It should be understood that, for example, for three vehicles, the second data received by the third vehicle is a data packet sent by the second vehicle, and the data packet sent by the second vehicle includes the data collected by the second vehicle and the first A data packet sent by a vehicle, that is, a data packet of one vehicle serves as second data of another vehicle, thereby forming an iteration so that one vehicle can grasp the information observed by other vehicles at a certain distance from it.
通讯模块140与其它车辆直接通信,并将数据包作为第二数据共享给其它车辆,同时也接收其它车辆发送的其他车辆的第二数据。The communication module 140 directly communicates with other vehicles, and shares the data packet as second data to other vehicles, and also receives second data of other vehicles sent by other vehicles.
在本公开的示例性实施例中,第一数据至少包括自身车辆外部环境的图像数据,第二数据至少包括其它车辆外部环境的图像数据。所述外部环境的图像数据可以是外部环境的真实图像数据,也可以是外部环境经过机器视觉处理后机器可以识别的数据。比如,所述传感器模块110可以将自动驾驶汽车100周围环境的原始图像经过卷积神经网络或者神经网络类算法处理后,抽取图像中事物对应的特征点、特征值和/或特征向量,并以此作为外部环境的图像数据。In an exemplary embodiment of the present disclosure, the first data includes at least image data of the environment outside the vehicle, and the second data includes at least image data of the environment outside the vehicle. The image data of the external environment may be real image data of the external environment, or may be data that can be recognized by the machine after the external environment is processed by machine vision. For example, the sensor module 110 may process the original image of the surrounding environment of the self-driving car 100 through a convolutional neural network or neural network-like algorithm, extract feature points, feature values, and/or feature vectors corresponding to things in the image, and use This is the image data of the external environment.
如上所述,传感器模块110可以包括摄像头,该摄像头可以捕获车辆周围的视觉图像。传感器数据处理模块接收所述视觉图像,并从中提取 内容。具体地,摄像头拍摄外部环境图像,然后传感器数据处理模块对所拍摄的图像进行图像处理(例如,通过神经网络进行一重或者多重卷积计算)来获取车辆外部环境的图像数据(比如所拍摄图像的特征向量、特征值等等),这样,第一数据可以包括自身车辆外部环境的图像数据。同样,第二数据可以包括其它车辆外部环境的图像数据。As described above, the sensor module 110 may include a camera that can capture visual images around the vehicle. The sensor data processing module receives the visual image and extracts content from it. Specifically, the camera captures the external environment image, and then the sensor data processing module performs image processing on the captured image (for example, performing one-fold or multiple convolution calculations through a neural network) to obtain image data of the external environment of the vehicle (such as the captured image) Feature vectors, feature values, etc.), so that the first data may include image data of the environment outside the own vehicle. Similarly, the second data may include image data of other environments outside the vehicle.
在本公开的示例性实施例中,第一数据中的图像数据和第二数据中的图像数据可以是可以进行机器识别的图像特征点、特征值和/或特征向量,图像特征点、特征值和/或特征向量包含地理位置信息。具体地,各个车辆所采集的图像数据具有具体的定位信息,比如各个车辆的定位信息,这样可以使得各个图像数据能够在地图上按位置有序排列。此外,第二数据中的图像数据也可以具有一定的范围。比如,对于一辆自动驾驶汽车100,如果其传感器模块110(比如摄像头)的视线距离为100米,则对应的图像数据也可以只有100米的距离。In an exemplary embodiment of the present disclosure, the image data in the first data and the image data in the second data may be image feature points, feature values, and/or feature vectors that can be machine recognized, image feature points, feature values And/or feature vectors contain geographic location information. Specifically, the image data collected by each vehicle has specific positioning information, such as the positioning information of each vehicle, so that each image data can be arranged in an orderly manner on the map. In addition, the image data in the second data may have a certain range. For example, for a self-driving car 100, if the sight distance of its sensor module 110 (such as a camera) is 100 meters, the corresponding image data may also be only 100 meters away.
在本公开的示例性实施例中,处理器130将第一数据中的图像数据与第二数据中的图像数据进行拼接,以形成合成图像数据,并且将合成图像数据添加到数据包中。比如,处理器130可以从第三方发送车辆处接收所述第二数据,第二数据中包含所述发送车辆的位置信息(坐标信息)。处理器可以调取预存在本地存储器中的地图,然后根据该位置信息和地图,处理器130可以将所述第二数据对应的图像数据(发送车辆周边的地图/图像信息)拼接到所述地图上。同时将自身从周边环境获取的图像数据根据自身的位置也拼接到该地图上。将所述第一数据和第二数据拼接之后的数据便形成所述数据包,处理器130传送给其他车辆后,所述数据包便成为其他车辆的第二数据,又会同所述其他车辆自己的第一数据进行拼接形成新的数据包。In an exemplary embodiment of the present disclosure, the processor 130 stitches the image data in the first data with the image data in the second data to form composite image data, and adds the composite image data to the data packet. For example, the processor 130 may receive the second data from a third-party sending vehicle, and the second data includes position information (coordinate information) of the sending vehicle. The processor may retrieve a map pre-stored in the local memory, and then based on the location information and the map, the processor 130 may stitch the image data corresponding to the second data (send maps/image information around the vehicle) to the map on. At the same time, the image data acquired from the surrounding environment is stitched to the map according to its own position. The data after splicing the first data and the second data forms the data packet. After the processor 130 transmits the data to other vehicles, the data packet becomes the second data of the other vehicles, and then joins the other vehicles themselves. The first data is spliced to form a new data packet.
如上所述,由于第二数据具有迭代效果,并且各个图像数据在地图上有序排列,因此,一个车辆可以具有由自身采集到的图像数据和多个其它车辆采集到的图像数据拼接或叠加之后的远距离图像(其包括自身车辆前方的远距离图像或者自身车辆后方的远距离图像),即一个车辆具有“远视”功能,换言之,所述驾驶员或者所述自动驾驶系统可以看到自身视距之外的图像。这样,在车辆行驶过程中,所述驾驶员或者所述自动驾驶系 统可以及时获取到远距离的路况信息(如红绿灯、路坑、拥堵、积水、积雪等),从而可以尽早做出行车路线规划或驾驶操作(如刹车、加速等),使得可以在确保安全的情况下极大地提高行车效率。As described above, since the second data has an iterative effect, and each image data is arranged in an order on the map, one vehicle may have the image data collected by itself and the image data collected by multiple other vehicles after splicing or superimposing The long-distance image (which includes the long-distance image in front of the own vehicle or the long-distance image behind the own vehicle), that is, a vehicle has a "distant vision" function, in other words, the driver or the automatic driving system can see the self-view Images outside the distance. In this way, during driving of the vehicle, the driver or the automatic driving system can timely obtain long-distance road condition information (such as traffic lights, road pits, congestion, water accumulation, snow accumulation, etc.), so that driving can be made as soon as possible Route planning or driving operations (such as braking, acceleration, etc.) make it possible to greatly improve driving efficiency while ensuring safety.
在本公开的示例性实施例中,一方面自动驾驶车辆100接收到的第二数据有可能是经过其他车辆多次拼接后的外部环境图像数据。经过多次拼接后的第二数据如果从未经过裁剪,所述第二数据可能会大到网络传输不再适合自动驾驶通讯的要求。另一方面,将第一数据中的图像数据与第二数据中的图像数据进行拼接后,拼接后的图像可能覆盖了超出自动驾驶车辆100需要的范围。因此,图像处理器130可以根据自身车辆的需要,将所述拼接后的图像的覆盖范围裁剪至车辆100需要的范围。In an exemplary embodiment of the present disclosure, on the one hand, the second data received by the self-driving vehicle 100 may be external environment image data after multiple stitching by other vehicles. If the second data after multiple stitching has never been cut, the second data may be so large that the network transmission is no longer suitable for the requirements of automatic driving communication. On the other hand, after the image data in the first data and the image data in the second data are stitched together, the stitched image may cover a range beyond that required by the autonomous vehicle 100. Therefore, the image processor 130 can tailor the coverage of the stitched image to the range required by the vehicle 100 according to the needs of its own vehicle.
在本公开的示例性实施例中,传感器模块110中的传感器还可以采集与自身车辆状态相关的自身车辆状态数据,该自身车辆状态数据包括在第一数据中。车辆内部执行机构可以包括但不限于油门、引擎、制动系统和转向系统(包括轮胎的转向和/或转向灯的操作)。传感器模块110连接到车辆的执行机构,因此可以检测到执行机构各个部件的运行状态和参数。这些运行状态和参数构成了第一数据的一部分。In an exemplary embodiment of the present disclosure, the sensor in the sensor module 110 may also collect own vehicle state data related to the own vehicle state, which is included in the first data. Vehicle internal actuators may include, but are not limited to, throttle, engine, braking system, and steering system (including steering of tires and/or operation of turn signals). The sensor module 110 is connected to the vehicle's actuator, so it can detect the operating status and parameters of various components of the actuator. These operating states and parameters form part of the first data.
在本公开的示例性实施例中,自身车辆状态数据包括自身车辆的速度、加速度、前轮的转动角度中的至少一者;第二数据包括其他车辆状态数据,其他车辆状态数据包括其他车辆的速度、加速度、前轮的转动角度中的至少一者。比如,共享信息生成模块可以直接从本车规划控制模块中获得车辆变道信息、加减速信息、转弯信息等规划控制信息。或者,从传感器模块110处通过传感器数据处理模块获取车辆底盘控制信息,比如通过轮速计来获取包括转向和速度等信息。比如共享信息生成模块通过传感器模块110和传感器数据处理模块可以从车辆的总线提取车辆的速度。传感器模块110可以包括用于获取车辆加速度的加速度计,由此可以获取车辆的加速和减速信息。传感器模块110也可以包括设置在前轮转轴附近的角度测量仪,角度测量仪测量前轮的转动角度,例如在转动角度大于预设角度时,可以获取车辆变道的信息。应当理解的是,传感器模块110的实例不限于加速度计、角度测量仪,也可以为能够采集自身车辆状态数据的任何合适的感知设备。第一数据包括通过这些感知设备采集到的信息。还 应该理解的是,自身车辆状态数据同样包含相关的地理位置信息来标识相应的车辆。In an exemplary embodiment of the present disclosure, the own vehicle state data includes at least one of the own vehicle's speed, acceleration, and rotation angle of the front wheels; the second data includes other vehicle state data, and the other vehicle state data includes other vehicle's At least one of speed, acceleration, and rotation angle of the front wheel. For example, the shared information generation module can directly obtain planning control information such as vehicle lane change information, acceleration and deceleration information, and turn information from the own vehicle planning control module. Alternatively, the vehicle chassis control information is obtained from the sensor module 110 through the sensor data processing module, such as the wheel speedometer to obtain information including steering and speed. For example, the shared information generation module can extract the speed of the vehicle from the bus of the vehicle through the sensor module 110 and the sensor data processing module. The sensor module 110 may include an accelerometer for acquiring acceleration of the vehicle, whereby acceleration and deceleration information of the vehicle may be acquired. The sensor module 110 may also include an angle measuring instrument disposed near the rotation axis of the front wheel. The angle measuring instrument measures the rotation angle of the front wheel. For example, when the rotation angle is greater than a preset angle, the vehicle may change lane information. It should be understood that examples of the sensor module 110 are not limited to accelerometers and angle measuring instruments, but may also be any suitable sensing devices capable of collecting own vehicle state data. The first data includes information collected through these sensing devices. It should also be understood that the own vehicle status data also contains relevant geographic location information to identify the corresponding vehicle.
在本公开的示例性实施例中,数据包可以仅包括自身车辆状态数据而不包括周边环境图像和其他车辆的车辆状态。具体地,一个车辆的通讯模块140(或者通讯数据处理模块)不接收其它车辆的车辆状态数据,这种情况下,该数据包仅包括自身车辆状态数据,通讯模块140(或者通讯数据处理模块)仅将自身车辆状态数据实时发送给其它车辆。例如,将自身车辆的加速、减速、变道发送给周边车辆。这种情况下,周边车辆的驾驶员或控制器可以实时获取自身车辆将要实时进行的驾驶操作,由此尽早做出行车规划,以确保安全。In an exemplary embodiment of the present disclosure, the data packet may only include own vehicle state data and not include surrounding environment images and vehicle states of other vehicles. Specifically, the communication module 140 (or communication data processing module) of one vehicle does not receive the vehicle state data of other vehicles. In this case, the data packet includes only the vehicle state data of itself, and the communication module 140 (or communication data processing module) Only the own vehicle status data is sent to other vehicles in real time. For example, the acceleration, deceleration, and lane change of the own vehicle are sent to surrounding vehicles. In this case, the driver or controller of the surrounding vehicle can obtain the real-time driving operation of the own vehicle in real time, thereby making driving planning as early as possible to ensure safety.
在本公开的示例性实施例中,数据包也可以同时包括自身车辆状态和其他车辆的车辆状态。具体地,所述车辆的通讯模块140(或者通讯数据处理模块)在接收到其他车辆的第二数据后,共享信息生成模块保留该第二数据中其他车辆的状态数据而去除其他车辆的周边环境图像,然后再同自身的车辆状态数据一起处理,生成打包数据。这样,该打包数据中就同时包含了自身车辆的车辆状态以及周边车辆的行车状态。如上所述,由于第二数据具有迭代效果,因此这种情况下,数据包不仅包括自身车辆状态数据,还包括其他车辆状态数据。因此,通讯模块140(或者通讯数据处理模块)在发送第二数据(比如,所述数据包)的时候会将多个车辆的状态数据发送给其它车辆。例如,将多个车辆的加速、减速、变道实时发送给周边车辆。这种情况下,周边车辆的驾驶员或控制器可以较早地或者实时地获取多个车辆将要进行的驾驶操作,由此更早做出行车规划,以确保安全。另外,由于多个车辆均能够及时知晓彼此之间的行车状态,因此多个车辆的驾驶员或控制器可以统一规划多个车辆的驾驶操作,或者独立地但是同步地做出驾驶操作。例如,红灯变绿灯时,排在同一个车道上等待的多个车辆可以同时知道其他车辆将要启动以及将要达到什么样的速度。尤其是一辆车可以知道排在它前面的车将要何时启动以及用什么速度启动,进而做出同步反应。因此多个车辆可以实现同步启动,甚至是同速度的启动。这样可以在确保安全的情况下极大地提高行车效率。In the exemplary embodiment of the present disclosure, the data packet may also include the own vehicle state and the vehicle state of other vehicles. Specifically, after the communication module 140 (or communication data processing module) of the vehicle receives the second data of other vehicles, the shared information generation module retains the state data of the other vehicles in the second data and removes the surrounding environment of the other vehicles The image is then processed with its own vehicle status data to generate packaged data. In this way, the packaged data includes both the vehicle status of the own vehicle and the driving status of the surrounding vehicles. As described above, since the second data has an iterative effect, in this case, the data packet includes not only own vehicle state data, but also other vehicle state data. Therefore, the communication module 140 (or the communication data processing module) will send the status data of multiple vehicles to other vehicles when sending the second data (for example, the data packet). For example, the acceleration, deceleration, and lane change of multiple vehicles are sent to surrounding vehicles in real time. In this case, the driver or controller of the surrounding vehicle can acquire the driving operations to be performed by multiple vehicles earlier or in real time, thereby making driving planning earlier to ensure safety. In addition, since multiple vehicles are able to know the driving status of each other in time, the drivers or controllers of multiple vehicles can plan driving operations of multiple vehicles in a unified manner, or make driving operations independently but synchronously. For example, when a red light turns green, multiple vehicles waiting in the same lane can know at the same time what other vehicles are going to start and what speed they will reach. Especially a car can know when the car in front of it will start and at what speed to start, and then make a synchronous response. Therefore, multiple vehicles can be started synchronously, even at the same speed. This can greatly improve driving efficiency while ensuring safety.
在本公开的示例性实施例中,处理器可以对所采集的第一数据和所 接收到的第二数据进行筛选,并且对筛选后的第一数据和第二数据进行处理生成为数据包。具体地,对于自身车辆所采集的第一数据和所接收到的第二数据,可能其中的有些数据是不需要分享的,因此根据筛选规则或人工干预筛选出需要的数据来生成待分享的数据包。这样,可以仅向其它车辆提供实用的信息并且减少数据传输量。In an exemplary embodiment of the present disclosure, the processor may filter the collected first data and the received second data, and process the filtered first data and second data to generate a data packet. Specifically, for the first data collected by the own vehicle and the received second data, some of the data may not need to be shared, so the required data is selected according to the screening rules or manual intervention to generate the data to be shared package. In this way, it is possible to provide practical information only to other vehicles and reduce the amount of data transmission.
在本公开的示例性实施例中,通讯模块通过广播系统与周边的其它车辆直接通信。具体地,多个车辆通过广播系统在一定距离范围内进行通信,由此实现多个车辆之间的V2V(vehicle-to-vehicle)通信。应当理解的是,通讯模块140(或者通讯数据处理模块)与其它车辆直接通信所使用的广播系统的实例包括射频电路,例如433M射频电路,通过该射频电路可以将结合了第一数据和第二数据的数据包广播发送。In the exemplary embodiment of the present disclosure, the communication module directly communicates with other vehicles in the vicinity through the broadcasting system. Specifically, multiple vehicles communicate through a broadcast system within a certain distance, thereby achieving V2V (vehicle-to-vehicle) communication between multiple vehicles. It should be understood that examples of the broadcast system used by the communication module 140 (or communication data processing module) to directly communicate with other vehicles include radio frequency circuits, such as a 433M radio frequency circuit, through which the first data and the second data can be combined Broadcasting of data packets.
通讯模块140(或者通讯数据处理模块)与其它车辆直接通信时可以使用2G~4G的任何一种通讯环境。不过因为所述通讯对网络时延和数据的传输速度要求较高,5G网络环境更适所述车辆之间的通信。4G的数据传输速率是100Mbps量级,时延是30-50ms,每平方千米的最大连接数1万量级,移动性350KM/h左右,而5G的传输速率是10Gbps量级,时延是1ms,每平方千米的最大连接数是百万量级,移动性是500km/h左右。5G具有更高的传输速率,更短的时延,更多的平方千米连接数,以及更高的速度容忍度。5G还有一个变化,就是传输路径的变化。以往我们打电话或者传照片,信号都要通过基站进行中转,但是5G之后,设备和设备之间就可以直接进行传输,不需要再通过基站。因此,本发明虽然也适用于4G环境,但是5G环境下运行会得到更好的技术表现,体现更高的商业价值。When the communication module 140 (or communication data processing module) directly communicates with other vehicles, any communication environment of 2G to 4G can be used. However, because the communication requires high network delay and data transmission speed, the 5G network environment is more suitable for the communication between the vehicles. The data transmission rate of 4G is on the order of 100Mbps, the delay is 30-50ms, the maximum number of connections per square kilometer is on the order of 10,000, the mobility is about 350KM/h, and the transmission rate of 5G is on the order of 10Gbps, the delay is 1ms, the maximum number of connections per square kilometer is on the order of millions, and the mobility is about 500km/h. 5G has higher transmission rates, shorter delays, more connections per square kilometer, and higher speed tolerance. Another change in 5G is the change in transmission paths. In the past, when we called or transmitted photos, the signal had to be transferred through the base station, but after 5G, the device could be directly transmitted between devices, without the need to pass through the base station. Therefore, although the present invention is also applicable to the 4G environment, running in the 5G environment will obtain better technical performance and reflect higher commercial value.
在本公开的示例性实施例中,为了减少多个车辆之间的数据传输量以及减少驾驶员对共享信息的关注度,本公开的车辆信息共享系统的通讯模块140(或者通讯数据处理模块)可以只在满足一定信息共享预设条件才分享数据包。信息共享预设条件包括以下情况中的至少一者:车辆的启动;车辆的停止;车辆速度的变化值大于预设值;前轮的转动角度的变化值大于预设值;以及与相邻车辆的距离的变化值大于预设值。即,只有在车辆的自身车辆状态数据或所采集到的自身车辆外部环境数据(即,第一数据)发生变化或较大变化时,才与其它车辆分享数据包。应当理解的是, 信息共享预设条件的实例不限于上文列出的几个条件,也可以是任何其它合适的条件。In an exemplary embodiment of the present disclosure, in order to reduce the amount of data transmission between multiple vehicles and reduce the driver's attention to shared information, the communication module 140 (or communication data processing module) of the vehicle information sharing system of the present disclosure The data package can be shared only if certain preset conditions for information sharing are met. The information sharing preset conditions include at least one of the following: the start of the vehicle; the stop of the vehicle; the change value of the vehicle speed is greater than the preset value; the change value of the rotation angle of the front wheels is greater than the preset value; and the neighboring vehicle The distance change value is greater than the preset value. That is, the data package is shared with other vehicles only when the vehicle's own vehicle state data or the collected own vehicle external environment data (ie, the first data) changes or changes significantly. It should be understood that the examples of the information sharing preset conditions are not limited to the above listed conditions, and may also be any other suitable conditions.
在本公开的示例性实施例中,车辆信息共享系统还包括提醒模块,提醒模块可以在一个车辆满足信息共享预设条件时,提醒其它车辆。提醒模块可以是语音播报器,其向驾驶员语音播报数据包所包含的信息,例如加速、减速、变道信息。应当理解的是,提醒模块的实例不限于语音播报器,也可以是显示装置,通过显示器显示相关信息。In an exemplary embodiment of the present disclosure, the vehicle information sharing system further includes a reminder module that can remind other vehicles when a vehicle meets a preset condition for information sharing. The reminder module may be a voice broadcaster, which broadcasts the information contained in the data packet to the driver, such as acceleration, deceleration, and lane change information. It should be understood that the example of the reminder module is not limited to the voice broadcaster, but may also be a display device, which displays related information through the display.
在本公开的示例性实施例中,如上所述,由于第二数据具有迭代效果,并且各个车辆因自身的地理信息而在地图上有序排列,因此一个车辆可以清楚地知晓其它车辆的位置信息。在这种情况下,数据包包括多个车辆的分布数据,通讯模块140(或者通讯数据处理模块)可以根据该分布数据设定不将数据包(例如,合成外部环境图像)发送给其它车辆的数据传送阻断条件,以限定数据包的共享范围。例如,数据传送阻断条件包括共享次数和分布数据中的车辆分布长度中的至少一者。具体地,在某个数据包被共享了预设次数之后,或者在某个数据包被共享到了预定长度处的车辆之后,该数据包被自动删除或忽略。以这种方式,控制数据包的共享范围。应当理解的是,数据传送阻断条件的实例不限于上文列出的几个条件,也可以是任何其它合适的条件。In the exemplary embodiment of the present disclosure, as described above, since the second data has an iterative effect, and each vehicle is arranged in an order on the map due to its own geographic information, one vehicle can clearly know the location information of other vehicles . In this case, the data packet includes the distribution data of multiple vehicles, and the communication module 140 (or the communication data processing module) may set according to the distribution data not to send the data packet (for example, a composite external environment image) to other vehicles. Data transmission blocking conditions to limit the sharing range of data packets. For example, the data transmission blocking condition includes at least one of the number of times of sharing and the vehicle distribution length in the distribution data. Specifically, after a certain data packet is shared a preset number of times, or after a certain data packet is shared with a vehicle at a predetermined length, the data packet is automatically deleted or ignored. In this way, the sharing range of data packets is controlled. It should be understood that examples of data transmission blocking conditions are not limited to the above listed conditions, but may be any other suitable conditions.
本公开的实施例提供的车辆信息共享系统适用于V2V工作场景,并且能够整合一定范围内的车辆外部环境数据和自身车辆状态数据,因此本公开的实施例提供的车辆信息共享系统能够让车辆驾驶员或控制器知晓远方路况信息和周边车辆状态信息以避免交通事故。The vehicle information sharing system provided by the embodiments of the present disclosure is suitable for V2V working scenarios, and can integrate vehicle external environment data and own vehicle state data within a certain range, so the vehicle information sharing system provided by the embodiments of the present disclosure can enable vehicles to drive The operator or controller knows the remote road condition information and the surrounding vehicle status information to avoid traffic accidents.
根据本公开的另一个方面,提供了一种车辆信息共享方法。图3是示出根据本公开的示例性实施例的车辆信息共享方法的流程图200。如图3所示,该车辆信息共享方法包括:According to another aspect of the present disclosure, a vehicle information sharing method is provided. FIG. 3 is a flowchart 200 illustrating a vehicle information sharing method according to an exemplary embodiment of the present disclosure. As shown in FIG. 3, the vehicle information sharing method includes:
步骤S210,采集与车辆外部环境和自身车辆状态中的至少一者相关的第一数据。Step S210: Collect first data related to at least one of the external environment of the vehicle and the state of the own vehicle.
具体地,传感器数据处理模块通过传感器模块110采集与车辆外部环境相关的第一数据。如上所述,传感器模块110可以包括摄像头,该摄像头可以捕获车辆周围的视觉图像并从中提取内容。传感器模块110还可 以包括雷达传感器或声纳,以探测车辆同周围障碍物之间的距离等。第一数据包括通过传感器模块110到的信息。Specifically, the sensor data processing module collects the first data related to the external environment of the vehicle through the sensor module 110. As described above, the sensor module 110 may include a camera that can capture visual images around the vehicle and extract content therefrom. The sensor module 110 may also include a radar sensor or sonar to detect the distance between the vehicle and surrounding obstacles. The first data includes information received through the sensor module 110.
传感器数据处理模块通过传感器模块110采集与自身车辆状态相关的自身车辆状态数据,该自身车辆状态数据包括在第一数据中。如上所述,该自身车辆状态数据包括自身车辆的速度、加速度、前轮的转动角度中的至少一者。例如,传感器数据处理模块通过传感器模块110从车辆的总线提取车辆的速度。传感器模块110可以包括用于获取车辆加速度的加速度计,由此可以获取车辆的加速和减速信息。传感器模块110可以包括设置在前轮转轴附近的角度测量仪,角度测量仪测量前轮的转动角度,例如在转动角度大于预设角度时,可以获取车辆变道的信息。The sensor data processing module collects own vehicle state data related to the own vehicle state through the sensor module 110, and the own vehicle state data is included in the first data. As described above, the own vehicle state data includes at least one of the speed, acceleration, and rotation angle of the front wheel of the own vehicle. For example, the sensor data processing module extracts the speed of the vehicle from the bus of the vehicle through the sensor module 110. The sensor module 110 may include an accelerometer for acquiring acceleration of the vehicle, whereby acceleration and deceleration information of the vehicle may be acquired. The sensor module 110 may include an angle measuring instrument disposed near the rotation axis of the front wheel. The angle measuring instrument measures the rotation angle of the front wheel. For example, when the rotation angle is greater than the preset angle, the vehicle may change lane information.
步骤S20,接收其它车辆发送的第二数据。Step S20: Receive second data sent by other vehicles.
具体地,通讯数据处理模块通过通讯模块140与周边的其它车辆直接通信,并且接收其它车辆发送的第二数据。与第一数据类似,第二数据也是与车辆外部环境和自身车辆状态中的至少一者相关的数据。Specifically, the communication data processing module directly communicates with other vehicles in the vicinity through the communication module 140, and receives second data sent by other vehicles. Similar to the first data, the second data is also data related to at least one of the external environment of the vehicle and the state of the own vehicle.
步骤S30,将第一数据和第二数据进行处理生成为数据包。Step S30, processing the first data and the second data to generate a data packet.
具体地,通过处理器130中的共享信息生成模块将第一数据和第二数据进行处理生成为数据包。共享信息生成模块对第一数据和第二数据的处理包括但不限于对第一数据和第二数据进行筛选、拼接等。应当理解的是,例如对于三辆车而言,第三车辆接收到的第二数据是第二车辆发送的数据包,该第二车辆发送的数据包包括由第二车辆采集到的数据和第一车辆发送的数据包。Specifically, the first data and the second data are processed into a data packet by the shared information generating module in the processor 130. The processing of the first data and the second data by the shared information generation module includes, but is not limited to, screening and splicing the first data and the second data. It should be understood that, for example, for three vehicles, the second data received by the third vehicle is a data packet sent by the second vehicle, and the data packet sent by the second vehicle includes the data collected by the second vehicle and the first A data packet sent by a vehicle.
步骤S40,将数据包作为第二数据共享给其它车辆。In step S40, the data packet is shared with other vehicles as second data.
具体地,通讯数据处理模块通过通讯模块140与其它车辆直接通信,并将数据包作为第二数据共享给所述其它车辆。一个车辆的数据包作为另一车辆的第二数据,由此形成迭代,使得一个车辆可以掌握与其相距一定距离的其它车辆所观测到的信息。Specifically, the communication data processing module directly communicates with other vehicles through the communication module 140, and shares the data packet as the second data to the other vehicles. The data packet of one vehicle is used as the second data of another vehicle, thereby forming an iteration, so that one vehicle can grasp the information observed by other vehicles at a certain distance from it.
在本公开的示例性实施例中,将第一数据中的图像数据与第二数据中的图像数据进行拼接,以形成合成图像数据,并且将合成图像数据添加到数据包中。如上所述,传感器模块110可以包括摄像头,该摄像头拍摄外部环境图像,并且对所拍摄的图像进行图像处理(例如,卷积)来获取 车辆外部环境的图像数据,这样,第一数据可以包括自身车辆外部环境的图像数据。同样,第二数据可以包括其它车辆外部环境的图像数据。其中,第一数据中的图像数据和第二数据中的图像数据是图像特征点,图像特征点包含地理位置信息。由于各个车辆所采集的图像数据具有具体的定位信息,这样可以使得各个图像数据能够在地图上按位置有序排列。由于第二数据具有迭代效果,并且各个图像数据在地图上有序排列,因此,一个车辆可以具有由自身采集到的图像数据和多个其它车辆采集到的图像数据拼接或叠加之后的远距离图像,即一个车辆具有“远视”功能,换言之,驾驶员可以通过显示器看到其肉眼视距之外的图像。这样,在车辆行驶过程中,驾驶员可以及时获取到远距离的路况信息(如红绿灯、路坑、拥堵、积水、积雪等),从而可以尽早做出行车路线规划或驾驶操作(如刹车、加速等),使得可以在确保安全的情况下极大地提高行车效率。In an exemplary embodiment of the present disclosure, the image data in the first data and the image data in the second data are stitched to form composite image data, and the composite image data is added to the data packet. As described above, the sensor module 110 may include a camera that captures an external environment image and performs image processing (eg, convolution) on the captured image to obtain image data of the external environment of the vehicle, so that the first data may include itself Image data of the environment outside the vehicle. Similarly, the second data may include image data of other environments outside the vehicle. The image data in the first data and the image data in the second data are image feature points, and the image feature points include geographic location information. Since the image data collected by each vehicle has specific positioning information, this can enable each image data to be arranged in an orderly manner on the map. Because the second data has an iterative effect, and each image data is arranged in an order on the map, a vehicle can have a long-distance image after the image data collected by itself and the image data collected by multiple other vehicles are stitched or superimposed , That is, a vehicle has a "distant vision" function, in other words, the driver can see the image beyond the visual distance of his naked eye through the display. In this way, the driver can obtain long-distance road condition information (such as traffic lights, road pits, congestion, water accumulation, snow, etc.) in time while the vehicle is driving, so that it can make driving route planning or driving operations (such as braking) as soon as possible. , Acceleration, etc.), making it possible to greatly improve driving efficiency while ensuring safety.
在本公开的示例性实施例中,对所采集的第一数据和所接收到的第二数据进行筛选,并且对筛选后的第一数据和第二数据进行处理生成为数据包。如上所述,对于自身车辆所采集的第一数据和所接收到的第二数据,可能其中的有些数据是不需要分享的,因此根据筛选规则或人工干预筛选出需要的数据来生成待分享的数据包。这样,可以仅向其它车辆提供实用的信息并且减少数据传输量。In an exemplary embodiment of the present disclosure, the collected first data and the received second data are filtered, and the filtered first data and second data are processed to generate a data packet. As mentioned above, for the first data collected by the own vehicle and the received second data, some of the data may not need to be shared, so the required data is selected according to the screening rules or manual intervention to generate the data to be shared data pack. In this way, it is possible to provide practical information only to other vehicles and reduce the amount of data transmission.
本公开的实施例提供的车辆信息共享方法适用于V2V工作场景,并且能够整合一定范围内的车辆外部环境数据和自身车辆状态数据,因此本公开的实施例提供的车辆信息共享方法能够让车辆驾驶员或控制器知晓远方路况信息和周边车辆状态信息以避免交通事故。The vehicle information sharing method provided by the embodiments of the present disclosure is suitable for V2V working scenarios, and can integrate vehicle external environment data and own vehicle state data within a certain range, so the vehicle information sharing method provided by the embodiments of the present disclosure can enable vehicles to drive The operator or controller knows the remote road condition information and the surrounding vehicle status information to avoid traffic accidents.
根据本公开的又一个方面,提供了一种自动驾驶车辆,该自动驾驶车辆应用了上文所述的车辆信息共享系统。本公开的实施例提供的自动驾驶车辆适用于V2V工作场景,并且能够整合一定范围内的车辆外部环境数据和自身车辆状态数据,因此本公开的实施例提供的自动驾驶车辆能够知晓远方路况信息和周边车辆状态信息以避免交通事故。According to yet another aspect of the present disclosure, there is provided an autonomous driving vehicle that applies the vehicle information sharing system described above. The self-driving vehicle provided by the embodiment of the present disclosure is suitable for V2V working scenarios, and can integrate vehicle external environment data and own vehicle state data within a certain range, so the self-driving vehicle provided by the embodiment of the present disclosure can know the distance road condition information and Surrounding vehicle status information to avoid traffic accidents.
可以理解的是,以上实施方式仅仅是为了说明本公开的原理而采用的示例性实施方式,然而本公开并不局限于此。对于本领域内的普通技术人员而言,在不脱离本公开的精神和实质的情况下,可以做出各种变型和 改进,这些变型和改进也视为本公开的保护范围。It can be understood that the above embodiments are merely exemplary embodiments adopted to explain the principles of the present disclosure, but the present disclosure is not limited thereto. For those of ordinary skill in the art, various variations and improvements can be made without departing from the spirit and essence of the present disclosure, and these variations and improvements are also considered to be within the protection scope of the present disclosure.

Claims (20)

  1. 一种车辆信息共享系统,包括:A vehicle information sharing system, including:
    传感器数据处理模块,采集与车辆外部环境相关的第一数据;The sensor data processing module collects the first data related to the external environment of the vehicle;
    通讯数据处理模块,与周边的其它车辆直接通信,并且接收所述其它车辆发送的第二数据;The communication data processing module directly communicates with other vehicles in the vicinity, and receives second data sent by the other vehicles;
    共享信息生成模块,将所述第一数据和所述第二数据进行处理生成为数据包;以及感知定位,信息共享,规划决策A shared information generation module, which processes the first data and the second data to generate a data packet; and perception positioning, information sharing, and planning decision
    所述通讯数据处理模块,与所述其它车辆直接通信,并将所述数据包作为第二数据共享给所述其它车辆。The communication data processing module directly communicates with the other vehicle, and shares the data packet as the second data to the other vehicle.
  2. 根据权利要求1所述的车辆信息共享系统,其中,The vehicle information sharing system according to claim 1, wherein
    所述第一数据至少包括自身车辆外部环境的图像数据;The first data includes at least image data of the environment outside the vehicle;
    所述第二数据至少包括其它车辆外部环境的图像数据。The second data includes at least image data of the environment outside the vehicle.
  3. 根据权利要求2所述的车辆信息共享系统,其中,The vehicle information sharing system according to claim 2, wherein:
    所述第一数据中的图像数据和所述第二数据中的图像数据是图像特征点,所述图像特征点包含地理位置信息。The image data in the first data and the image data in the second data are image feature points, and the image feature points contain geographic location information.
  4. 根据权利要求3所述的车辆信息共享系统,其中,The vehicle information sharing system according to claim 3, wherein
    所述共享信息生成模块将所述第一数据中的图像数据与所述第二数据中的图像数据进行拼接,以形成合成图像数据,并且将所述合成图像数据添加到所述数据包中。The shared information generating module stitches the image data in the first data with the image data in the second data to form composite image data, and adds the composite image data to the data packet.
  5. 根据权利要求1所述的车辆信息共享系统,其中,The vehicle information sharing system according to claim 1, wherein
    传感器数据处理模块采集与自身车辆状态相关的自身车辆状态数据,所述自身车辆状态数据包括在所述第一数据中。The sensor data processing module collects own vehicle state data related to the own vehicle state, and the own vehicle state data is included in the first data.
  6. 根据权利要求5所述的车辆信息共享系统,其中,The vehicle information sharing system according to claim 5, wherein
    所述自身车辆状态数据包括自身车辆的速度、加速度、前轮的转动 角度中的至少一者;The self-vehicle state data includes at least one of the speed, acceleration, and rotation angle of the front wheel of the self-vehicle;
    所述第二数据包括其他车辆状态数据,所述其他车辆状态数据包括其他车辆的速度、加速度、前轮的转动角度中的至少一者。The second data includes other vehicle state data, and the other vehicle state data includes at least one of speed, acceleration, and rotation angle of the front wheel of the other vehicle.
  7. 根据权利要求6所述的车辆信息共享系统,其中,The vehicle information sharing system according to claim 6, wherein:
    所述数据包仅包括所述自身车辆状态数据。The data packet includes only the own vehicle state data.
  8. 根据权利要求6所述的车辆信息共享系统,其中,The vehicle information sharing system according to claim 6, wherein:
    所述数据包包括所述自身车辆状态数据和所述其他车辆状态数据。The data packet includes the own vehicle state data and the other vehicle state data.
  9. 根据权利要求1所述的车辆信息共享系统,其中,The vehicle information sharing system according to claim 1, wherein
    所述共享信息生成模块对所采集的第一数据和所接收到的第二数据进行筛选,并且对筛选后的第一数据和第二数据进行处理生成为数据包。The shared information generating module filters the collected first data and the received second data, and processes the filtered first data and second data to generate a data packet.
  10. 根据权利要求1所述的车辆信息共享系统,其中,The vehicle information sharing system according to claim 1, wherein
    所述通讯数据处理模块通过广播系统与周边的其它车辆直接通信。The communication data processing module communicates directly with other vehicles in the vicinity through a broadcasting system.
  11. 一种车辆信息共享方法,包括:A vehicle information sharing method, including:
    采集与车辆外部环境相关的第一数据;Collect the first data related to the external environment of the vehicle;
    与周边的其它车辆直接通信,并且接收所述其它车辆发送的第二数据;Communicate directly with other vehicles in the vicinity, and receive second data sent by the other vehicles;
    将所述第一数据和所述第二数据进行处理生成为数据包;以及Processing the first data and the second data to generate a data packet; and
    与所述其它车辆直接通信,并将所述数据包作为第二数据共享给所述其它车辆。Communicate directly with the other vehicle, and share the data packet with the other vehicle as second data.
  12. 根据权利要求11所述的车辆信息共享方法,其中,The vehicle information sharing method according to claim 11, wherein
    所述第一数据至少包括自身车辆外部环境的图像数据;The first data includes at least image data of the environment outside the vehicle;
    所述第二数据至少包括其它车辆外部环境的图像数据。The second data includes at least image data of the environment outside the vehicle.
  13. 根据权利要求12所述的车辆信息共享方法,其中,The vehicle information sharing method according to claim 12, wherein
    所述第一数据中的图像数据和所述第二数据中的图像数据是图像特征点,所述图像特征点包含地理位置信息。The image data in the first data and the image data in the second data are image feature points, and the image feature points contain geographic location information.
  14. 根据权利要求13所述的车辆信息共享方法,其中,The vehicle information sharing method according to claim 13, wherein:
    将所述第一数据中的图像数据与所述第二数据中的图像数据进行拼接,以形成合成图像数据,并且将所述合成图像数据添加到所述数据包中。The image data in the first data and the image data in the second data are stitched to form composite image data, and the composite image data is added to the data packet.
  15. 根据权利要求11所述的车辆信息共享方法,其中,The vehicle information sharing method according to claim 11, wherein
    采集与自身车辆状态相关的自身车辆状态数据,所述自身车辆状态数据包括在所述第一数据中。Collect own vehicle state data related to the own vehicle state, and the own vehicle state data is included in the first data.
  16. 根据权利要求15所述的车辆信息共享方法,其中,The vehicle information sharing method according to claim 15, wherein
    所述自身车辆状态数据包括自身车辆的速度、加速度、前轮的转动角度中的至少一者;The self-vehicle state data includes at least one of the speed, acceleration, and rotation angle of the front wheel of the self-vehicle;
    所述第二数据包括其他车辆状态数据,所述其他车辆状态数据包括其他车辆的速度、加速度、前轮的转动角度中的至少一者。The second data includes other vehicle state data, and the other vehicle state data includes at least one of speed, acceleration, and rotation angle of the front wheel of the other vehicle.
  17. 根据权利要求16所述的车辆信息共享方法,其中,The vehicle information sharing method according to claim 16, wherein
    所述数据包仅包括所述自身车辆状态数据。The data packet includes only the own vehicle state data.
  18. 根据权利要求16所述的车辆信息共享方法,其中,The vehicle information sharing method according to claim 16, wherein
    所述数据包包括所述自身车辆状态数据和所述其他车辆状态数据。The data packet includes the own vehicle state data and the other vehicle state data.
  19. 根据权利要求11所述的车辆信息共享方法,其中,The vehicle information sharing method according to claim 11, wherein
    对所采集的第一数据和所接收到的第二数据进行筛选,并且对筛选后的第一数据和第二数据进行处理生成为数据包。Filter the collected first data and the received second data, and process the filtered first data and second data to generate a data packet.
  20. 一种自动驾驶车辆,其应用了根据权利要求1所述的车辆信息共享系统。An autonomous driving vehicle to which the vehicle information sharing system according to claim 1 is applied.
PCT/CN2018/125725 2018-12-29 2018-12-29 Vehicle information sharing system and method, and self-driving vehicle WO2020133451A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2018/125725 WO2020133451A1 (en) 2018-12-29 2018-12-29 Vehicle information sharing system and method, and self-driving vehicle
CN201910007979.8A CN109747660A (en) 2018-12-29 2019-01-04 Information of vehicles shared system and method, automatic driving vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/125725 WO2020133451A1 (en) 2018-12-29 2018-12-29 Vehicle information sharing system and method, and self-driving vehicle

Publications (1)

Publication Number Publication Date
WO2020133451A1 true WO2020133451A1 (en) 2020-07-02

Family

ID=66405175

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/125725 WO2020133451A1 (en) 2018-12-29 2018-12-29 Vehicle information sharing system and method, and self-driving vehicle

Country Status (2)

Country Link
CN (1) CN109747660A (en)
WO (1) WO2020133451A1 (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110138485B (en) * 2019-05-17 2021-01-12 爱驰汽车(上海)有限公司 Vehicle-mounted information broadcasting system, method, device and storage medium
US11315427B2 (en) * 2019-06-11 2022-04-26 Toyota Motor North America, Inc. Vehicle-to-vehicle sensor data sharing
CN110225124B (en) * 2019-06-13 2023-04-07 广州小鹏汽车科技有限公司 Vehicle data sharing processing method and device, vehicle and medium
CN112700658B (en) * 2019-10-22 2023-02-03 奥迪股份公司 System for image sharing of a vehicle, corresponding method and storage medium
CN111918461B (en) * 2020-08-12 2023-08-08 上海仙塔智能科技有限公司 Road condition sharing method, system, server and storage medium
CN112644501B (en) * 2020-11-20 2023-01-13 西人马帝言(北京)科技有限公司 Vehicle control method, device and equipment and computer storage medium
CN113065517A (en) * 2021-04-23 2021-07-02 上海寅家电子科技股份有限公司 Safety obstacle avoidance method, vehicle and computer storage medium
CN113593224B (en) * 2021-07-14 2022-10-14 广州小鹏汽车科技有限公司 Road condition sharing method and device, vehicle-mounted terminal and storage medium
CN113613194A (en) * 2021-08-02 2021-11-05 腾讯科技(深圳)有限公司 Data sharing method, device and medium applied to vehicles and electronic equipment
CN113590359A (en) * 2021-08-02 2021-11-02 腾讯科技(深圳)有限公司 Data sharing method, device and medium applied to vehicle formation and electronic equipment
CN114125749A (en) * 2021-09-28 2022-03-01 南京交通职业技术学院 Transmission method and device based on detection signals between automatic driving automobiles

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102354449A (en) * 2011-10-09 2012-02-15 昆山市工业技术研究院有限责任公司 Internet of vehicles-based method for realizing image information sharing and device and system thereof
CN102737509A (en) * 2012-06-29 2012-10-17 惠州天缘电子有限公司 Method and system for realizing image information sharing based on internet of vehicles
US20140324247A1 (en) * 2013-04-29 2014-10-30 Intellectual Discovery Co., Ltd. Vehicular image processing apparatus and method of sharing data using the same
CN106971583A (en) * 2017-03-27 2017-07-21 宁波吉利汽车研究开发有限公司 A kind of traffic information shared system and sharing method based on vehicle-mounted networking equipment
CN108280898A (en) * 2018-03-08 2018-07-13 域通全球成都科技有限责任公司 It is a kind of can shared information automobile data recorder

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103366603B (en) * 2013-06-20 2017-02-08 上海市城市建设设计研究总院 Surface parking lot parking space guidance system
CN103985270A (en) * 2014-04-17 2014-08-13 北京汉王智通科技有限公司 Parking lot control system
US20160063332A1 (en) * 2014-08-27 2016-03-03 Toyota Jidosha Kabushiki Kaisha Communication of external sourced information to a driver
DE102017203838B4 (en) * 2017-03-08 2022-03-17 Audi Ag Process and system for detecting the surroundings
CN106683485B (en) * 2017-03-22 2019-03-15 盐城工学院 Parking stall recommended method and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102354449A (en) * 2011-10-09 2012-02-15 昆山市工业技术研究院有限责任公司 Internet of vehicles-based method for realizing image information sharing and device and system thereof
CN102737509A (en) * 2012-06-29 2012-10-17 惠州天缘电子有限公司 Method and system for realizing image information sharing based on internet of vehicles
US20140324247A1 (en) * 2013-04-29 2014-10-30 Intellectual Discovery Co., Ltd. Vehicular image processing apparatus and method of sharing data using the same
CN106971583A (en) * 2017-03-27 2017-07-21 宁波吉利汽车研究开发有限公司 A kind of traffic information shared system and sharing method based on vehicle-mounted networking equipment
CN108280898A (en) * 2018-03-08 2018-07-13 域通全球成都科技有限责任公司 It is a kind of can shared information automobile data recorder

Also Published As

Publication number Publication date
CN109747660A (en) 2019-05-14

Similar Documents

Publication Publication Date Title
WO2020133451A1 (en) Vehicle information sharing system and method, and self-driving vehicle
WO2020187254A1 (en) Longitudinal control method and system for automatic driving vehicle
CN108227703B (en) Information processing apparatus and method, operated vehicle, and recording medium having program recorded thereon
US10049499B2 (en) Method of ground adjustment for in-vehicle augmented reality systems
EP3477338A1 (en) 3d lidar system using dichroic mirror for autonomous driving vehicles
CN113228135B (en) Blind area image acquisition method and related terminal device
CN114779790B (en) Obstacle recognition method and device, vehicle, server, storage medium and chip
JP2017004265A (en) Display device
WO2022075133A1 (en) Imaging device, information processing device, imaging system, and imaging method
CN115205311B (en) Image processing method, device, vehicle, medium and chip
CN115330923A (en) Point cloud data rendering method and device, vehicle, readable storage medium and chip
WO2022153896A1 (en) Imaging device, image processing method, and image processing program
CN115100377A (en) Map construction method and device, vehicle, readable storage medium and chip
CN115205365A (en) Vehicle distance detection method and device, vehicle, readable storage medium and chip
JP6595647B2 (en) Travel control device, vehicle, and travel control method
WO2024024148A1 (en) On-vehicle monitoring device, information processing device, and on-vehicle monitoring system
CN115334111A (en) System architecture, transmission method, vehicle, medium and chip for lane recognition
WO2023050058A1 (en) Method and apparatus for controlling angle of view of vehicle-mounted camera, and vehicle
CN114937351A (en) Motorcade control method and device, storage medium, chip, electronic equipment and vehicle
WO2021020033A1 (en) Display control device, display control method, and display control program
CN115082573B (en) Parameter calibration method and device, vehicle and storage medium
JP7312856B2 (en) Method and apparatus for processing sensor data
CN114822216B (en) Method and device for generating parking space map, vehicle, storage medium and chip
CN108447290A (en) Intelligent avoidance system based on car networking
JP2020109561A (en) Vehicle control device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18945062

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18945062

Country of ref document: EP

Kind code of ref document: A1