WO2023207624A1 - Procédé de traitement de données, dispositif, support, et dispositif et système collaboratifs routiers - Google Patents

Procédé de traitement de données, dispositif, support, et dispositif et système collaboratifs routiers Download PDF

Info

Publication number
WO2023207624A1
WO2023207624A1 PCT/CN2023/088250 CN2023088250W WO2023207624A1 WO 2023207624 A1 WO2023207624 A1 WO 2023207624A1 CN 2023088250 W CN2023088250 W CN 2023088250W WO 2023207624 A1 WO2023207624 A1 WO 2023207624A1
Authority
WO
WIPO (PCT)
Prior art keywords
roadside
data
edge computing
collaborative
perform
Prior art date
Application number
PCT/CN2023/088250
Other languages
English (en)
Chinese (zh)
Inventor
刘彦斌
高玉涛
Original Assignee
阿里云计算有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里云计算有限公司 filed Critical 阿里云计算有限公司
Publication of WO2023207624A1 publication Critical patent/WO2023207624A1/fr

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
    • G08G1/0108—Measuring and analyzing of parameters relative to traffic conditions based on the source of data
    • G08G1/0116—Measuring and analyzing of parameters relative to traffic conditions based on the source of data from roadside infrastructure, e.g. beacons
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
    • G08G1/0125—Traffic data processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network

Definitions

  • This application relates to the field of computer technology, and in particular to data processing methods, equipment, media, and roadside collaborative equipment and systems.
  • roadside devices In the existing technology, in order to enable roadside collaborative equipment to obtain rich and diverse data information, various roadside devices are usually configured, such as cameras for video image collection, high-resolution vehicle sensing LiDAR with rate information and so on. In practical applications, roadside devices usually use devices with certain complete functions. These roadside devices collect a large amount of roadside data to be processed. Generally, roadside devices do not have the ability to process large amounts of data, so these roadside devices are usually The side data is sent to the cloud server for data processing. However, the roadside device needs to encode and transmit the roadside data over the network before it can be received by the cloud server. The cloud server also needs to decode the roadside data before it can further process the roadside data. Each of the above links takes a certain amount of time, data processing is slow, and the real-time effect is poor. Therefore, a solution that can improve data processing efficiency is needed.
  • each embodiment of the present application provides data processing methods, equipment, media, and roadside collaborative equipment and systems.
  • a data processing method includes:
  • Edge computing processing is performed based on the collaborative data to perform collaborative tasks based on edge computing processing results.
  • a roadside collaboration device in an embodiment of the present application, includes integrated: an edge computing module, and the edge computing module Modular connection of multiple roadside devices;
  • the edge computing module is used to control multiple roadside devices to perform collection operations, preprocess data provided to the roadside through multiple roadside devices to obtain collaborative data, and perform edge computing processing on the collaborative data to facilitate edge computing based on edge computing. Process the results and perform collaborative tasks;
  • the plurality of roadside devices are used to collect roadside data according to the collection instructions issued by the edge computing module, and send the roadside data to the edge computing module.
  • a roadside collaboration system in one embodiment of the present application, includes:
  • At least one roadside collaboration device and cloud server wherein,
  • the roadside collaboration equipment includes integrated: an edge computing module, and multiple roadside devices connected to the edge computing module; used to control multiple roadside devices to perform roadside data collection operations; to the Perform data preprocessing on roadside data provided by multiple roadside devices to obtain collaborative data; perform edge computing processing based on the collaborative data to perform collaborative tasks based on the edge computing processing results;
  • the cloud server is configured to receive edge computing processing results provided by the roadside collaboration device, so as to collaborate on tasks based on the edge computing processing results.
  • an electronic device including a memory and a processor; wherein,
  • the memory is used to store programs
  • the processor is coupled to the memory and is used to execute the program stored in the memory to implement a data processing method described in the first aspect.
  • a non-transitory machine-readable storage medium stores executable code, and when the executable code is When the processor of the electronic device executes, the processor is caused to execute a data processing method as described in the first aspect.
  • an edge computing module with large computing power and multiple roadside devices are integrated into an integrated structure, and the edge computing module can control the working status of multiple roadside devices.
  • a large amount of roadside data collected by multiple roadside devices can also be directly transferred to the edge computing module, and then the edge computing module performs edge computing processing of a large amount of roadside data, without the need to go through encoding, decoding, network transmission, etc. It saves some data processing and data transmission time, can effectively improve data processing efficiency, and thus can effectively improve the response speed of roadside collaborative equipment.
  • Figure 1 is a schematic structural diagram illustrating a conventional roadside system according to an embodiment of the present application
  • Figure 2 is a schematic structural diagram of a roadside collaboration device provided by an embodiment of the present application.
  • Figure 3 is a schematic diagram of video data processing illustrating an embodiment of the present application
  • Figure 4 is a schematic flow chart of the data processing method provided by the embodiment of the present application.
  • Figure 5 is a schematic structural diagram of a latch timing provided by an embodiment of the present application.
  • Figure 6 is a schematic diagram of the triggering and image alignment process illustrating an embodiment of the present application.
  • Figure 7 is a schematic structural diagram of a data processing device provided by an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • FIG 1 is a schematic structural diagram illustrating a conventional roadside system according to an embodiment of the present application.
  • a camera millimeter wave radar, lidar, infrared sensor, etc.
  • a large amount of roadside data can be obtained.
  • FIG. 2 is a schematic structural diagram of a roadside collaboration device provided by an embodiment of the present application. From Figure 2 It can be seen that the roadside collaboration equipment includes integrated: an edge computing module 1 and a plurality of roadside devices 2 connected to the edge computing module 1 .
  • the edge computing module 1 is used to control multiple roadside devices 2 to perform collection operations, preprocess data provided to the roadside through the multiple roadside devices 2 to obtain collaborative data, and perform edge computing processing on the collaborative data, so as to Execute collaborative tasks based on edge computing processing results.
  • a plurality of roadside devices 2 are configured to collect roadside data according to collection instructions issued by the edge computing module 1 and send the roadside data to the edge computing module 1 .
  • the roadside collaborative equipment includes a housing 3.
  • the edge computing module 1 is integrated in the housing 3.
  • the multiple roadside devices 2 are integrated on the housing 3 and located in the housing 1. different positions, so that the plurality of roadside devices 2 have different perception angles and/or different perception capabilities.
  • the edge computing module mentioned here can be understood as an edge computing chip and memory with large computing power, which can bear the computing and processing capabilities of a large amount of roadside data.
  • the edge computing module can also directly control roadside equipment (such as traffic lights) based on the edge computing results, or generate a control strategy based on the edge computing results. It can also send the edge computing results or control strategies to nearby vehicles, and also It can be sent to the cloud server so that the cloud server can perform corresponding collaborative tasks based on the received edge computing results or corresponding control policies.
  • the edge computing module 1 is connected to multiple roadside devices 2 through data transmission ports (such as mipi interfaces).
  • the roadside device 2 may be a radar, a camera, an infrared sensor, etc.
  • the roadside device is a camera as an example for description.
  • FIG. 3 is a schematic diagram of video data processing illustrating an embodiment of the present application.
  • Multiple cameras are arranged at different positions of the housing 3 and face in different directions.
  • Multiple cameras with different sensing capabilities can also be arranged in the same direction at the same time.
  • a wide-angle camera and a large depth-of-field camera can be arranged, or an RGB camera and a depth camera can be arranged to collect data in the same direction. Different image data are obtained to meet the subsequent edge computing processing needs based on the collected image data.
  • multiple cameras are directly connected to the edge computing module and integrated into the roadside collaboration device shown in Figure 3, becoming an edge computing module with large computing power integrated with multiple roadside devices. structure.
  • the edge computing module issues corresponding collection instructions (for example, exposure instructions) to control multiple cameras for image collection. Since the work of multiple cameras is controlled by the same edge computing module, multiple cameras have a unified collection frequency. This means that multiple cameras collect images at the same time. In the subsequent image alignment and fusion processing, it is no longer necessary to perform tedious operations such as filtering noise images from different cameras and finding matching timestamps before performing alignment. Simplifying the image data processing process can effectively improve data processing efficiency.
  • the camera is directly controlled by the edge computing module, and the image data collected by the camera is also directly processed by the edge computing module, there is no need to encode or decode the image data, nor does it need to encode the encoded image.
  • Data is transmitted from the camera to the edge computing module. Saves encoding, decoding and transmission time, especially in roadside collaborative application scenarios When rapid response is required and large amounts of image data are processed frequently, it can significantly improve data processing speed and efficiency.
  • the same roadside collaborative equipment integrates multiple roadside devices at the same time. These roadside devices are used to collect images from different perspectives in different directions, so that current road condition information can be obtained more comprehensively.
  • These multiple cameras may have exactly the same sensing capabilities, or they may have different sensing capabilities.
  • the perceptual capabilities mentioned here can be understood as the parameters of the camera, such as wide-angle size, depth of field size, focal length range, etc. Different cameras have different image collection capabilities and are suitable for different collection scenarios.
  • multiple cameras with the same sensing capabilities can be arranged at different viewing angles, and multiple cameras with different sensing capabilities can be arranged at the same viewing angle.
  • This enables the acquisition of large-scale, multi-type image data.
  • These image data will directly send edge computing information without the need for cumbersome operations such as encoding and decoding, which facilitates accurate image recognition by subsequent edge computing modules.
  • edge computing module Although there are many cameras in number and type, because these cameras are all uniformly controlled by the edge computing module, there is no need to perform cumbersome operations such as image data alignment, which can effectively improve the processing efficiency of large amounts of image data.
  • the layout and positional relationship of multiple cameras in the roadside collaboration equipment mentioned here is only an example and does not constitute a limitation on the technical solution of this application. Users can make corresponding adjustments according to their actual application needs.
  • the device further includes: a radar device.
  • the edge computing module is used to generate collection instructions according to the preset collection frequency or the acquired trigger signal, so as to perform the roadside data collection operation through the radar device; based on the radar data collected through the radar device and the The image data is aligned and fused and edge computing is performed.
  • roadside devices can be integrated into the roadside collaborative equipment as needed, such as radar roadside devices (for example, laser radar, ultrasonic radar, millimeter wave radar, etc.), infrared roadside devices, etc.
  • radar roadside devices for example, laser radar, ultrasonic radar, millimeter wave radar, etc.
  • infrared roadside devices etc.
  • these other integrated roadside devices are also controlled by the edge computing module.
  • the edge computing module sends a trigger command
  • these roadside devices will perform sensing operations and collect corresponding roadside data (such as radar data).
  • the collected roadside data will be directly provided to the edge computing module together with the image data, and then the edge computing device will perform corresponding alignment and fusion processing and perform edge computing.
  • roadside devices such as cameras, radars, etc.
  • These different types of roadside devices perform collection operations uniformly under the control of the edge computing module, thereby ensuring that all All kinds of roadside data collected are roadside data with the same timestamp.
  • the roadside data since the roadside data here are all based on the data collected by the same collection instruction, these roadside data have good time consistency, and there is no need to analyze these collected data. Cumbersome operations such as denoising roadside data and finding corresponding timestamps for roadside data alignment. While meeting the needs of diversified roadside data collection, it can effectively improve the data processing efficiency of large and diverse roadside data.
  • local edge computing processing can reduce network bandwidth usage. It can also improve the safety effect of roadside data processing.
  • FIG. 4 is a schematic flowchart of the data processing method provided by the embodiment of the present application.
  • the execution subject of the data processing method may be a roadside collaborative device.
  • the data processing method includes the following steps:
  • 402 Perform data preprocessing on the roadside data provided by the multiple roadside devices to obtain collaborative data.
  • the edge computing module can directly control the collection operations of multiple roadside devices. For example, taking the roadside device as a camera, the edge computing module can send collection instructions to multiple roadside cameras, and then the multiple roadside cameras perform roadside data collection based on the collection instructions. Different from the existing technology, each camera independently performs image collection operations according to its own set shooting parameters (such as image collection frequency). In the embodiment of the present application, each camera is controlled by the edge computing module, so that all cameras Execute the collection operation at the same time to obtain roadside data with the same timestamp.
  • each roadside device has the same standard time, or whether it has the same image acquisition frequency, etc., and there is no need to perform cumbersome encoding, decoding, and denoising of image data (the denoising mentioned here).
  • each camera works independently and has its own collection frequency and cycle. This means that the time consistency of the images obtained by each camera is not good, and some images may not be found with the same time. This part of the image is a noisy image and needs to be denoised) and other complex image processing work. Instead, the roadside data collected by different cameras can be directly fused, which can effectively improve the data processing efficiency.
  • roadside data no longer needs to be sent to the cloud server through the network, but is processed by a local edge computing module, the security protection effect of roadside data processing can be effectively improved.
  • the roadside data collected by the camera mentioned here can be understood as the original audio and video data collected by the camera. These data are also called audio and video naked data, which are collected directly from the data source (camera, microphone, etc.) and are not processed. .
  • image signal processing Image Signal Process, ISP.
  • ISP Image Signal Process
  • image sensor core image sensor core
  • the sensor the photosensitive component sensor behind the camera
  • a processor such as an edge computing module
  • the analog-to-digital conversion of the roadside data is completed.
  • the digital signals are further optimized and processed, including: linear correction, noise removal, black level correction, bad pixel removal, color interpolation, Gamma correction, RGB2YUV conversion, and active white balance. processing, active exposure control and more.
  • image data in YUV format may be converted into BGR format, and edge computing processing may be performed on the image data after the format conversion is completed.
  • controlling multiple roadside devices to perform roadside data collection operations includes: generating a method for controlling the multiple roadside devices based on a preset collection frequency or an acquired trigger signal.
  • a collection instruction for a side device collection operation includes controlling the plurality of roadside devices to perform a roadside data collection operation based on the control parameters included in the collection instruction.
  • the collection frequency can be preset for the edge computing module, and collection instructions are periodically sent to multiple roadside devices according to the predetermined frequency. Furthermore, multiple roadside devices simultaneously perform roadside data collection operations. The time stamp consistency of the roadside data obtained in this way is better. For example, image data is collected through a camera. There is no redundant frame of image data. There is no need to perform tedious denoising, filtering, etc., and the image data can be completed quickly. Alignment work provides a high-quality data foundation for subsequent edge computing.
  • the edge computing module can also respond to the trigger signal provided by other devices (such as vehicle induction coil equipment buried underground on the highway), and then the edge computing device responds to the trigger signal and sends it to multiple roadside devices to control multiple roadside devices.
  • the roadside device collects roadside data.
  • the multiple roadside devices are controlled by the edge computing module. Therefore, relevant parameters for the roadside device to perform sensing operations (such as exposure parameters, etc.) are provided by the edge computing module. For example, when the edge computing module senses that the light at the current moment is good through weather data and/or light sensors, it will make adaptive adjustments to the exposure parameters based on the camera performance, such as reducing the exposure time. For another example, if the image data obtained at the last moment is not good and the content in the image cannot be accurately identified, the edge computing module can adjust the exposure parameters according to the needs, and control multiple roadside devices based on the adjusted exposure parameters. Resume image acquisition.
  • the edge computing module when performing supplementary collection of roadside data, the edge computing module will control multiple roadside devices to perform supplementary collection of roadside data at the same time, which can effectively simplify the later alignment of roadside data.
  • the calculation amount and calculation time are reduced, thereby improving the efficiency of roadside data processing.
  • performing data preprocessing on roadside data provided by the multiple roadside devices to obtain collaborative data includes: determining the collection timestamp of the collection instruction; based on the same The collection timestamp is used to fuse the roadside data to obtain the collaborative data. If the roadside device is a camera, the method of processing the roadside data provided by the camera to obtain collaborative data includes: determining the exposure timestamp of the exposure instruction; and performing fusion processing on the original roadside data based on the same exposure timestamp. , obtain the image data.
  • multiple roadside devices are controlled by the same edge computing module. This means that the collection instructions received by multiple roadside devices have the same collection time stamp, and the roadside data collected based on the same collection time stamp has good time consistency, and there is no need to perform tedious processing. Filter alignment operations.
  • the collection timestamp can be used to achieve roadside data alignment, and the roadside data corresponding to the same collection timestamp can be directly fused.
  • the roadside collaboration device includes: a first camera facing the left, a second camera facing the right, and a third camera facing the front, where the third camera is used to complement the first camera and the second camera. The camera's blind spot. After using the first camera, the second camera and the third camera to collect images, the first original roadside data, the second original roadside data and the third original roadside data are obtained respectively. Furthermore, the first original roadside data, the second original roadside data and the third original roadside data are optimized respectively.
  • the second original roadside data will be abandoned altogether.
  • the image data corresponding to the timestamp of the camera and the third camera are then fused with the optimized roadside data to obtain collaborative data.
  • FIG. 5 is a schematic structural diagram of a latch timing provided by an embodiment of the present application.
  • the edge computing module and the Complex Programmable Logic Device (CPLD) chip are connected through the GPIO (or S232, RS485) interface in addition to the communication serial port and chip transparent serial port. Clock synchronization can be performed using the GPIO interface.
  • GPIO or S232, RS485
  • the time synchronization between the CPU and the device is performed by the CPU sensing and recording the latch time of the CPLD trigger signal GPIO, which is not affected by the GPS signal.
  • the CPU can also be timed through a custom clock source.
  • Complete time synchronization between CPU and multiple roadside devices This is so that after the CPU (that is, the edge computing module mentioned in the above embodiment) sends collection instructions to multiple roadside devices, the obtained roadside data corresponding to the multiple roadside devices have the same standard time. It should be noted that since the roadside data collected by each roadside device has the same collection time stamp and the execution time stamp when the collection action is performed, there is no need to update the images collected by each roadside device.
  • roadside data can be aligned and fused directly based on execution timestamps.
  • unified control of triggers through edge computing modules can effectively improve the processing efficiency of roadside data.
  • FIG. 6 is a schematic diagram illustrating the triggering and image alignment process according to an embodiment of the present application.
  • the edge computing module collects images at t1, t2, t3... according to the preset collection frequency.
  • device 1 and device 2 trigger and collect roadside data (for example, image data) synchronously.
  • roadside data for example, image data
  • device 1 and device 2 each collect images according to their own acquisition frequency, and then eliminate redundant image data (for example, find Alignment of image data can be performed only after other image data with the same timestamp is obtained). Therefore, by adopting the technical solution of the present application, roadside data with better consistency can be obtained, and the alignment processing of image data can also be simpler, more accurate and more efficient.
  • performing edge computing processing based on the collaborative data to perform collaborative tasks based on edge computing processing results includes: performing data analysis on the collaborative data, and determining the data analysis result as The edge computing processing result; controlling the roadside device to perform collaborative tasks based on the edge computing processing result.
  • the collaborative data mentioned here is obtained after data preprocessing by the edge computing module. Then, the collaborative data is further analyzed by the edge computing module. This analysis process usually requires a large amount of calculations. For example, a trained machine learning model will be used for analysis to obtain accurate data analysis results, which are the edge computing processing results. . The edge computing module will control the roadside devices accordingly based on the edge computing processing results, for example, controlling the status and time of traffic lights.
  • a special vehicle needs to pass through an intersection with traffic lights.
  • the roadside device captures the special vehicle information (for example, the license plate number or vehicle image is recognized through a camera)
  • the characteristic vehicle is identified through the edge computing module, and the vehicle is identified based on the radar
  • the data tests vehicle speed to estimate the time a vehicle will arrive at a traffic light based on vehicle speed.
  • the special vehicle arrives at the location of the signal light
  • the corresponding traffic light is controlled to be green (for example, the green light display time can be extended, or the red light can be controlled to switch to green), achieving no stopping or slowing down. pass.
  • the processing speed of roadside data is faster and the response is more timely.
  • performing edge computing processing based on the collaborative data to perform collaborative tasks based on edge computing processing results includes: performing data analysis on the collaborative data, and determining the data analysis result as The edge computing processing result; sending the edge computing processing result to the vehicle device that performs the collaborative task.
  • roadside collaboration equipment is close to data collection terminals (such as cameras, radars, etc.) and also close to audience terminals (such as traffic lights, vehicles).
  • data collection terminals such as cameras, radars, etc.
  • audience terminals such as traffic lights, vehicles.
  • data collection, data analysis, and edge computing are all It is completed in the local device, which can ensure that the audience terminal can obtain the edge computing processing results in time, so as to accurately and quickly perform collaborative tasks.
  • the roadside collaborative equipment proposed in this application can be used to collect real-time data.
  • the edge computing module performs local calculations based on the real-time location of pedestrians and the status of signal lights provided by the roadside device in real time, and sends information about pedestrians at red lights or approaching lanes to relevant vehicles. , to assist the driver in making deceleration decisions.
  • data collection, processing, analysis, and calculation are all completed in the local roadside collaborative equipment. There is no need to perform time-consuming operations such as tedious data encoding and decoding, data network transmission, etc., which can effectively improve the roadside collaborative equipment Response speed meets the need for rapid response in vehicle-road collaboration application scenarios.
  • the method further includes: sending the edge computing processing results to the cloud server.
  • the roadside collaboration device can send the edge computing processing results (specific information such as the time and place of the accident, the affected lanes, etc.) to the cloud, so that the cloud can promptly notify vehicles that are about to go to the accident site to change lanes, routes, or slow down. stroll.
  • the roadside device further includes: a camera and/or a radar.
  • Performing data preprocessing on the roadside data provided by the plurality of roadside devices to obtain collaborative data includes: obtaining camera roadside data provided by a plurality of the cameras; obtaining radar roadside data provided by a plurality of the radars. Data; performing alignment and fusion processing on the camera roadside data and the radar roadside data to obtain the collaborative data.
  • the edge computing processing based on the image data includes: performing data analysis on the image data to determine the key frames and/or image content contained in the image data; The key frames and/or the image content are sent to the cloud server.
  • edge computing modules have strong data computing and processing capabilities, in order to improve data processing efficiency and shorten data processing time.
  • the above solution is used to enable roadside equipment to provide users with the required data processing results in a timely and rapid manner.
  • the edge computing module can be used to perform data analysis on the image data after the alignment operation is completed. For example, the edge computing module determines key frames from the image data or identifies a certain image content after a large amount of calculations.
  • the edge computing processing results (the found key frames and/or the recognized image content) are sent to the cloud server. In this way, the cloud server only needs to make global decisions based on the received results. This can improve the efficiency of roadside data collection, transmission, and processing from roadside devices.
  • the amount of transmission of edge computing processing results is less, which can effectively reduce the occupation of network bandwidth and thereby improve data transmission efficiency.
  • the roadside device can also be a radar device, such as a laser radar device, an ultrasonic radar device, etc. It should be noted that these roadside devices are directly connected to the edge computing module. They do not need to perform complex processing processes such as encoding, decoding, and network transmission of the collected roadside data, but can be processed directly by the edge computing module. . In addition, a variety of roadside devices are controlled by the same edge computing module and collect roadside data. The roadside data of various roadside devices have good consistency, which facilitates the alignment of roadside data and can effectively improve the data processing speed.
  • FIG. 7 is a schematic structural diagram of a data processing device provided by an embodiment of the present application.
  • the data processing device includes:
  • the control module 71 is used to control multiple roadside devices to perform roadside data collection operations.
  • the processing module 72 is used to perform data preprocessing on the roadside data provided by the multiple roadside devices to obtain collaborative data.
  • the execution module 73 is configured to execute edge computing processing based on the collaborative data, so as to execute collaborative tasks based on edge computing processing results.
  • control module 71 is also configured to generate collection instructions for controlling the collection operations of the multiple roadside devices according to the preset collection frequency or the acquired trigger signal;
  • processing module 72 is also used to determine the collection timestamp of the collection instruction
  • the roadside data is fused based on the same collection timestamp to obtain the collaborative data.
  • processing module 72 is also used to determine the execution timestamp of the roadside data
  • the roadside data provided by the multiple roadside devices are fused based on the execution timestamp corresponding to the roadside data to obtain the collaborative data.
  • the execution module 73 is also configured to perform data analysis on the collaborative data and determine the data analysis result as the edge computing processing result;
  • the execution module 73 is also configured to perform data analysis on the collaborative data and determine the data analysis result as the edge computing processing result;
  • the edge computing processing results are sent to vehicle devices that perform collaborative tasks.
  • a sending module 74 is also included for sending the edge computing processing results to the cloud server.
  • the roadside device includes: a camera.
  • the processing module 72 is also used to obtain camera roadside data provided by multiple cameras;
  • the camera roadside data provided by multiple cameras are aligned and fused to obtain the collaborative data.
  • the roadside device further includes: radar.
  • the processing module 72 is also used to obtain radar roadside data provided by multiple radars;
  • the camera roadside data and the radar roadside data are aligned and fused to obtain the collaborative data.
  • An embodiment of the present application also provides an electronic device.
  • the electronic device is the main node electronic device in the computing unit.
  • Figure 8 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • the electronic device includes a memory 801, a processor 802 and a communication component 803; wherein,
  • the memory 801 is used to store programs
  • the processor 802 is coupled to the memory and configured to execute the program stored in the memory for:
  • Edge computing processing is performed based on the collaborative data to perform collaborative tasks based on edge computing processing results.
  • the above-mentioned memory 801 may be configured to store various other data to support operations on the electronic device. Examples of such data include instructions for any application or method operating on the electronic device.
  • Memory may consist of any type of volatile or non-volatile storage device or their Combination implementations such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EPROM erasable programmable read-only memory
  • PROM programmable read-only memory
  • ROM read-only memory
  • magnetic memory flash memory
  • flash memory magnetic disk or optical disk.
  • the processor 802 in this embodiment may be specifically: a programmable switching processing chip.
  • the programmable switching processing chip is configured with a data copy engine and can copy the received data.
  • the electronic device also includes: a power supply component 804 and other components.
  • Embodiments of the present application also provide a non-transitory machine-readable storage medium.
  • the non-transitory machine-readable storage medium stores executable code.
  • the executable code is executed by a processor of an electronic device, the The processor executes the method described in the corresponding embodiment of FIG. 4 .
  • An embodiment of the present application also provides a computer program product, which includes a computer program/instruction.
  • the processor can implement the method described in the corresponding embodiment of FIG. 4 .
  • an edge computing module with large computing power and multiple roadside devices are integrated into an integrated structure, and the edge computing module can control the working status of multiple roadside devices.
  • a large amount of roadside data collected by multiple roadside devices can also be directly transferred to the edge computing module, and then the edge computing module performs edge computing processing of a large amount of roadside data, without the need to go through encoding, decoding, network transmission, etc. It saves some data processing and data transmission time, can effectively improve data processing efficiency, and thus can effectively improve the response speed of roadside collaborative equipment.
  • the device embodiments described above are only illustrative.
  • the units described as separate components may or may not be physically separated.
  • the components shown as units may or may not be physical units, that is, they may be located in One location, or it can be distributed across multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Persons of ordinary skill in the art can understand and implement the method without any creative effort.
  • each embodiment can be implemented by software plus a necessary general hardware platform, and of course, it can also be implemented by hardware.
  • the computer software product can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disc, optical disk, etc., including a number of instructions to cause a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or certain parts of the embodiments.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Traffic Control Systems (AREA)

Abstract

Les modes de réalisation de la présente demande concernent un procédé de traitement de données, un dispositif, un support, ainsi qu'un dispositif et un système de collaboration routiers. Le procédé consiste : à commander une pluralité d'appareils routiers pour exécuter des opérations d'acquisition de données routières ; à effectuer un prétraitement de données sur des données routières fournies par la pluralité d'appareils routiers, de façon à obtenir des données collaboratives ; et, sur la base des données collaboratives, à effectuer un traitement informatique en périphérie, de façon à exécuter une tâche collaborative sur la base d'un résultat de traitement informatique en périphérie. Dans la présente demande, la pluralité d'appareils routiers et un module informatique en périphérie sont intégrés dans un ensemble, et une grande quantité de données routières acquises par la pluralité d'appareils routiers peut également être directement transmise au module informatique en périphérie, de telle sorte que le module informatique en périphérie effectue un traitement informatique en périphérie sur la grande quantité de données routières. Par conséquent, des procédures de codage, de décodage, de transmission réseau, etc., ne sont plus nécessaires, d'où un gain d'une partie du temps destiné au traitement de données et à la transmission de données, ce qui permet d'améliorer efficacement l'efficacité de traitement de données, et d'augmenter ainsi efficacement la vitesse de réponse du dispositif collaboratif routier.
PCT/CN2023/088250 2022-04-26 2023-04-14 Procédé de traitement de données, dispositif, support, et dispositif et système collaboratifs routiers WO2023207624A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210451931.8A CN115063969A (zh) 2022-04-26 2022-04-26 数据处理方法、设备、介质及路侧协同设备、系统
CN202210451931.8 2022-04-26

Publications (1)

Publication Number Publication Date
WO2023207624A1 true WO2023207624A1 (fr) 2023-11-02

Family

ID=83196627

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/088250 WO2023207624A1 (fr) 2022-04-26 2023-04-14 Procédé de traitement de données, dispositif, support, et dispositif et système collaboratifs routiers

Country Status (2)

Country Link
CN (1) CN115063969A (fr)
WO (1) WO2023207624A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115063969A (zh) * 2022-04-26 2022-09-16 阿里云计算有限公司 数据处理方法、设备、介质及路侧协同设备、系统

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112071063A (zh) * 2020-09-15 2020-12-11 苏州映赛智能科技有限公司 一种路侧感知系统
CN112562405A (zh) * 2020-11-27 2021-03-26 山东高速建设管理集团有限公司 一种雷达视频智能融合与预警方法及系统
CN112687113A (zh) * 2020-12-31 2021-04-20 北京星云互联科技有限公司 一种路侧信息感知设备
CN112767475A (zh) * 2020-12-30 2021-05-07 重庆邮电大学 一种基于c-v2x、雷达与视觉的智能路侧感知系统
US20210297336A1 (en) * 2020-03-19 2021-09-23 Vinay B. RAMAKRISHNAIAH System and method for determining one or more actions according to input sensor data
CN113727304A (zh) * 2021-11-04 2021-11-30 深圳市城市交通规划设计研究中心股份有限公司 一种基于5g通信架构的紧急车辆预警系统及其预警方法
CN114065876A (zh) * 2022-01-11 2022-02-18 华砺智行(武汉)科技有限公司 基于路侧多传感器的数据融合方法、装置、系统及介质
CN115063969A (zh) * 2022-04-26 2022-09-16 阿里云计算有限公司 数据处理方法、设备、介质及路侧协同设备、系统

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112712697B (zh) * 2020-12-30 2022-04-12 上海智能交通有限公司 面向车路协同应用的车道级交通状态判别方法
CN113808389A (zh) * 2021-08-11 2021-12-17 深圳市金溢科技股份有限公司 车路协同系统、边缘计算单元、中心云平台及信息处理方法
CN114333306A (zh) * 2021-12-23 2022-04-12 大陆投资(中国)有限公司 路侧系统
CN114333330B (zh) * 2022-01-27 2023-04-25 浙江嘉兴数字城市实验室有限公司 一种基于路侧边缘全息感知的交叉口事件检测系统

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210297336A1 (en) * 2020-03-19 2021-09-23 Vinay B. RAMAKRISHNAIAH System and method for determining one or more actions according to input sensor data
CN112071063A (zh) * 2020-09-15 2020-12-11 苏州映赛智能科技有限公司 一种路侧感知系统
CN112562405A (zh) * 2020-11-27 2021-03-26 山东高速建设管理集团有限公司 一种雷达视频智能融合与预警方法及系统
CN112767475A (zh) * 2020-12-30 2021-05-07 重庆邮电大学 一种基于c-v2x、雷达与视觉的智能路侧感知系统
CN112687113A (zh) * 2020-12-31 2021-04-20 北京星云互联科技有限公司 一种路侧信息感知设备
CN113727304A (zh) * 2021-11-04 2021-11-30 深圳市城市交通规划设计研究中心股份有限公司 一种基于5g通信架构的紧急车辆预警系统及其预警方法
CN114065876A (zh) * 2022-01-11 2022-02-18 华砺智行(武汉)科技有限公司 基于路侧多传感器的数据融合方法、装置、系统及介质
CN115063969A (zh) * 2022-04-26 2022-09-16 阿里云计算有限公司 数据处理方法、设备、介质及路侧协同设备、系统

Also Published As

Publication number Publication date
CN115063969A (zh) 2022-09-16

Similar Documents

Publication Publication Date Title
US11790504B2 (en) Monitoring method and apparatus
CN104506804B (zh) 一种快速道路上的机动车异常行为监测装置及其方法
WO2023207624A1 (fr) Procédé de traitement de données, dispositif, support, et dispositif et système collaboratifs routiers
SG191954A1 (en) An integrated intelligent server based system and method/systems adapted to facilitate fail-safe integration and /or optimized utilization of various sensory inputs
CN112990162B (zh) 目标检测方法、装置、终端设备及存储介质
KR100820952B1 (ko) 단일 카메라를 이용한 불법 주정차 무인 자동 단속방법 및그 시스템
CN101923784A (zh) 交通信号灯调整系统及方法
CN112991742A (zh) 一种实时交通数据的可视化仿真方法及系统
CN110796580B (zh) 智能交通系统管理方法及相关产品
CN112291477B (zh) 多媒体信息处理方法、装置、存储介质及电子装置
WO2022198897A1 (fr) Procédé et dispositif de gestion de stationnement dans une rue
CN104363426A (zh) 一种多摄像机目标关联的交通视频监控系统和监控方法
Nagaraj et al. Traffic jam detection using image processing
CN106710253B (zh) 一种高可靠性智能路口交通控制系统及控制方法
CN116205069A (zh) 基于智能驾驶域控制器的场景注入方法、系统及装置
CN111191607A (zh) 确定车辆的转向信息的方法、设备和存储介质
CN107808529B (zh) 基于本地路口视频监控的红绿灯控制方法及系统
CN108010344B (zh) 一种十字路口绿灯时间调整方法及系统
Zhang et al. Multi-modal virtual-real fusion based transformer for collaborative perception
CN112001266B (zh) 一种大型无人运输车监控方法及系统
CN114666591A (zh) 产生图像帧流的方法和系统
CN113581202B (zh) 确定自动驾驶车辆环境信息的方法、设备、程序产品
CN115421122A (zh) 目标对象检测方法、装置、电子设备和可读存储介质
CN105574499B (zh) 一种基于soc的人数检测统计方法及系统
CN114937367A (zh) 一种用于车路协同监测的智能相机系统及控制方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23795057

Country of ref document: EP

Kind code of ref document: A1