CN108900272B - Sensor data acquisition method and system and packet loss judgment method - Google Patents
Sensor data acquisition method and system and packet loss judgment method Download PDFInfo
- Publication number
- CN108900272B CN108900272B CN201810732148.2A CN201810732148A CN108900272B CN 108900272 B CN108900272 B CN 108900272B CN 201810732148 A CN201810732148 A CN 201810732148A CN 108900272 B CN108900272 B CN 108900272B
- Authority
- CN
- China
- Prior art keywords
- sensor
- data
- sspu
- serial number
- timestamp
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J3/00—Time-division multiplex systems
- H04J3/02—Details
- H04J3/06—Synchronising arrangements
- H04J3/0635—Clock or time synchronisation in a network
- H04J3/0638—Clock or time synchronisation among nodes; Internode synchronisation
- H04J3/0658—Clock or time synchronisation among packet nodes
- H04J3/0661—Clock or time synchronisation among packet nodes using timestamps
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Synchronisation In Digital Transmission Systems (AREA)
- Arrangements For Transmission Of Measured Signals (AREA)
- Optical Radar Systems And Details Thereof (AREA)
Abstract
The invention discloses a sensor data acquisition method, a system and a packet loss judgment method, wherein the method comprises a Signal Synchronization Processing Unit (SSPU), a plurality of sensors and a logic calculation unit, wherein the sensors generate initial data and message serial numbers thereof when sending or receiving trigger pulses; the signal synchronous processing unit SSPU reads a system time generation timestamp and a pulse serial number thereof when receiving or sending a pulse of data collected by the sensor; the method comprises the following specific steps: 1) reading initial data of a sensor and a message serial number thereof; 2) acquiring a timestamp and a pulse sequence number of a Signal Synchronous Processing Unit (SSPU); 3) and matching the message serial number with the pulse serial number in a one-to-one correspondence manner, and combining the initial data and the timestamp data which are successfully matched to generate a sensor data packet. According to the scheme, the message serial number and the pulse serial number are set for matching, packet loss judgment is increased when initial data of the sensor is matched with the timestamp, and data accuracy of the sensor is improved.
Description
Technical Field
The invention relates to the technical field of data acquisition and processing, in particular to a sensor data acquisition method, a sensor data acquisition system and a packet loss judgment method.
Background
When a plurality of and/or a plurality of sensors collect data, the collecting time of different sensors is managed by respective internal time systems, or the internal time systems of the sensors and the internal time systems of the microcontroller/logic computing unit are combined to manage. However, timing between multiple time systems often deviates, and therefore, it is necessary to unify acquisition times of multiple and/or multiple sensors.
The time synchronization means that the acquisition time of each sensor is managed by the same clock system, so that the acquisition time of each sensor can be unified to the same time coordinate system in a low-time-lag manner. The existing time synchronization methods include software synchronization through a clock system inside a logic calculation unit, hardware synchronization through a clock system inside a microcontroller, GPS time synchronization, NTP time synchronization, SNTP time synchronization, IEEE 1588 time synchronization and the like.
Due to the fact that timing deviation exists between timing systems of the sensors, the acquisition time of the sensors is not in the same time coordinate system, and the result of data application is deviated. For example, when data is applied to time sensitive applications, the accuracy of the application is low. Moreover, the internal time system of the sensor can automatically count again after working for a period of time, and the requirement of long-time acquisition cannot be met.
The software synchronization mode is influenced by the time slice of the logic calculation unit, and the precision is lower. The GPS time synchronization mode has the defects of high cost (each node needs to be provided with a GPS device), limited installation (needing no outdoor shielding), poor usability (influenced by weather and environment), use risk (the U.S. does not provide guarantee for civil GPS) and the like. The NTP time synchronization precision and the SNTP time synchronization precision are lower, and the IEEE 1588 time synchronization compatibility is low (each node needs to have an IEEE 1588 protocol). It is costly to customize a highly configured sensor/microcontroller/logic computation unit that can meet the acquisition requirements.
Patent document No. CN105940390A discloses a method performed by a device having an application processor and a co-processor, the application processor being configured to run based on an operating system and the co-processor being configured to receive data from a plurality of sensors of the device, the method comprising: determining an interrupt generated by a given sensor of the plurality of sensors of the device, wherein the interrupt indicates that the given sensor has data for output; providing, by the co-processor, a timestamp of the interrupt generated by the given sensor indicating a time that the given sensor has the data for output; receiving, by the co-processor, the data for output from the given sensor; associating the timestamp of the interrupt generated by the given sensor with the received data from the given sensor; associating the data received from the plurality of sensors together into a data structure based on timestamps of the data provided by the co-processor; and sequentially providing, by the co-processor, the data structures to the application processor based on the timestamps of the data. However, since data transmission from the sensor to the coprocessor takes some time and there is a certain risk of packet loss in the process, in this scheme, the coprocessor directly associates the timestamp when data is collected by the sensor with the received data packet without distinction, and due to lack of packet loss judgment and identification, the data packet and the timestamp may be associated and matched incorrectly, resulting in data collection failure of the sensor. In addition, the device with the application processor unit and the coprocessor has no temperature compensation processing, and is easy to drift after working for a period of time, so that timing deviation occurs, and the requirement of long-time acquisition cannot be met.
Therefore, the prior art has yet to be developed.
Disclosure of Invention
In view of the defects of the prior art, the present invention aims to provide a sensor data acquisition method, a sensor data acquisition system and a packet loss judgment method, and aims to improve the accuracy of data obtained by a sensor.
In order to achieve the purpose, the invention adopts the following technical scheme:
a sensor data acquisition method comprises a Signal Synchronous Processing Unit (SSPU), a plurality of sensors and a logic calculation unit, wherein the sensors generate initial data and message serial numbers thereof when sending or receiving trigger pulses; the signal synchronous processing unit SSPU reads a system time generation timestamp and a pulse serial number thereof when receiving or sending a pulse of data collected by the sensor; the method also comprises the following specific steps:
1) reading initial data of a sensor and a message serial number thereof;
2) acquiring a timestamp and a pulse sequence number of a Signal Synchronous Processing Unit (SSPU);
3) and matching the message serial number with the pulse serial number in a one-to-one correspondence manner, and combining the initial data and the timestamp data which are successfully matched to generate a sensor data packet.
Preferably, the steps 1) to 3) are performed by a logic computation unit.
Preferably, the logic calculation unit records packet loss information in real time, calculates a packet loss rate, and takes an action if the packet loss rate exceeds a preset threshold; and if the packet loss rate does not exceed the threshold value, continuing to execute.
Preferably, the sensor data packet includes a final sequence number, a timestamp uploaded by the signal synchronization processing unit SSPU, and data uploaded by the sensor, where the final sequence number may be a pulse sequence number or a packet sequence number.
Preferably, the logic computation unit includes a data acquisition thread for acquiring sensor data, a synchronization timestamp management thread for accepting timestamps and pulse sequence numbers from the signal synchronization processing unit SSPU, and a memory.
Preferably, the signal synchronization processing unit SSPU includes a microcontroller and a crystal oscillator providing a synchronization clock, the signal synchronization processing unit SSPU is connected to the sensor through a sensor interface, the signal synchronization processing unit SSPU is connected to the logic computing unit through a communication interface, and the sensor is connected to the computer through a communication interface.
Preferably, the microcontroller generates the system time of the signal synchronization processing unit SSPU by using a crystal oscillator as a clock source.
A sensor data acquisition system adopts the sensor data acquisition method.
A sensor data acquisition packet loss judgment method comprises a Signal Synchronous Processing Unit (SSPU), a plurality of sensors and a logic calculation unit, wherein the Signal Synchronous Processing Unit (SSPU) comprises a microcontroller and a crystal oscillator for providing a synchronous clock, the Signal Synchronous Processing Unit (SSPU) is connected with the sensors through a sensor interface, the Signal Synchronous Processing Unit (SSPU) is connected with the logic calculation unit through a communication interface, and the sensors are connected with a computer through the communication interface; when the sensor sends or receives a trigger pulse, generating initial data and a message serial number thereof; the signal synchronous processing unit SSPU reads a system time generation timestamp and a pulse serial number thereof when receiving or sending a pulse of data collected by the sensor; the method also comprises the following specific steps:
1) a logic calculation unit reads initial data of a sensor and a message serial number thereof; judging whether the initial data stream of the single sensor loses packets or not according to the message serial number information, and if the packets are lost, recording packet loss information into a log;
2) the logic calculation unit acquires a timestamp and a pulse serial number of the signal synchronous processing unit SSPU; judging whether the timestamp data stream loses packets or not according to the pulse serial number information, if so, completing the current timestamp data information according to the timestamp data corresponding to the last pulse serial number and the acquisition frequency, and recording packet loss information into a log;
3) the logic calculation unit carries out one-to-one corresponding matching on the message serial number and the pulse serial number, and initial data and timestamp data which are successfully matched are combined together to generate a sensor data packet; and when the matching of the message serial number and the pulse serial number fails, waiting for the next matching.
Preferably, the packet loss information includes a lost sequence number, a collection frequency, and a current lost number.
According to the scheme provided by the invention, the acquisition time of the sensors is managed by the signal synchronization processing unit SSPU, so that the acquisition time of each sensor is unified to the same time coordinate system, the time synchronization mode of the system is hardware synchronization, and the time synchronization precision is high. And the message serial number and the pulse serial number are set for matching, so that packet loss judgment is increased when initial data of the sensor is matched and associated with the timestamp, the data accuracy of the sensor is greatly improved, later-stage data application is more accurate, and the sensor is higher in precision and low in cost when applied to time-sensitive application. The multi-modal sensors can be flexibly configured to form different combinations, and data synchronization of any sensor combination in the system is realized.
Drawings
FIG. 1 is a hardware diagram of a multi-sensor synchronous time synchronization system according to an embodiment of the present invention;
FIG. 2 is a system block diagram of a multi-sensor synchronous time tick system according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of signal and data transmission according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a laser radar according to an embodiment of the present invention;
FIG. 5 is a schematic view of a camera according to an embodiment of the present invention;
FIG. 6 is a flow chart of data and timestamp matching according to an embodiment of the present invention.
Detailed Description
The invention provides a multi-sensor synchronous time synchronization system. In order to make the objects, technical solutions and effects of the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The time synchronization means that the acquisition time of each sensor is managed by the same clock system, so that the acquisition time of each sensor can be unified to the same time coordinate system in a low-time-lag manner.
Fig. 1 and fig. 2 show a multi-sensor synchronous time synchronization system according to an embodiment of the present invention. As shown in fig. 1 and 2, the system includes: a signal Synchronization processing unit sspu (signal Synchronization processing unit), a plurality of sensors, and a logic calculation unit 140.
The signal synchronization processing unit SSPU includes: a microcontroller 110, several sensor interfaces, a communication interface (e.g., USB)111, and a crystal 118 to provide a synchronous clock. Specifically, the crystal oscillator is a temperature compensated crystal oscillator.
As shown in fig. 3, the signal synchronization processing unit SSPU is connected to the sensor through the sensor interface, and is connected to the logic computation unit 140 through the communication interface (e.g., USB) 111. The sensor is connected with the computer through the communication interface.
The sensor mainly comprises a board-level sensor, a sensor with a GPS interface and an independent sensor:
(1) a plate-level sensor: the sensor data throughput is low, the data interface is generally a serial port, I2C, SPI, CAN and the like, and the sensor data CAN be processed by the microcontroller, namely the SSPU CAN receive the sensor data and add timestamp information. Such as: inertial component, encoder.
(2) Take GPS interface sensor: the sensor is provided with a standard GPS signal interface (such as a 3D laser radar), and the self time system can be corrected by receiving external time information so as to achieve the purpose of being unified with the external time system. Such as: 3D laser radar.
(3) Independent sensors: the sensor generally has high data throughput, a microcontroller-level processor cannot process data of the sensor, the data need to be directly uploaded to a logic computing unit, and a timestamp of the sensor can be added and uploaded by an SSPU (secure Shell) in a signal triggering or signal capturing mode. Such as: industrial cameras, 2D lidar, thermal infrared imagers.
Specifically, the sensor may include: one or more of a camera, a 2D lidar, a 3D lidar, an encoder, a thermal infrared imager, an inertial element, and the like. Optionally, the camera is a fisheye camera, a general camera, a depth camera, an industrial camera, or other imaging technology. Accordingly, the sensor interface in the signal synchronization processing unit SSPU comprises: an encoder interface, an inertial element interface; a 3D laser radar interface; the system comprises a visible light camera interface, a 2D laser radar interface and a thermal infrared imager interface; a GPS interface; USB to serial.
In this embodiment, as shown in fig. 1, in the signal synchronization processing unit SSPU, the microcontroller 110 is connected to a camera synchronization signal interface 112, a laser radar synchronization signal interface 113, an inertial component interface 114, and an encoder interface 115.
In some embodiments, the microcontroller may further be connected with other suitable functional interfaces, such as a digital input output interface 116 and other external synchronization interfaces 117.
Fig. 2 is a system block diagram according to an embodiment of the present invention. In this embodiment, the logic calculating unit 140 includes: a data acquisition thread 141 for acquiring data packets of the sensor, a synchronization timestamp management thread 142 for accepting timestamps and pulse sequence numbers from the signal synchronization processing unit SSPU, and a memory 143. The logic calculating unit 140 may be any suitable hardware device with certain logic calculating capability, such as a computer host or an embedded unit, and only needs to be able to execute the thread 141 and the thread 142.
The time stamp and pulse sequence number are determined by the microcontroller. In the present embodiment, the signal synchronization processing unit SSPU is used to represent a functional module for managing and implementing high-precision time synchronization between different sensors based on the clock provided by the crystal oscillator. The timestamp of the SSPU is the clock of the crystal oscillator, and the pulse sequence number is the sensor trigger signal count.
In some embodiments, the microcontroller of the signal synchronization processing unit SSPU is connected with a first camera interface and a second camera interface having different operating frequencies. The first camera interface has a higher operating frequency than the second camera interface.
The first camera interface and the second camera interface are respectively connected with a camera array, and the camera array comprises at least one master camera and a plurality of slave cameras. The master camera and the slave camera, which belong to the same camera array and are connected to the same camera interface, have the same operating frequency.
The multi-sensor synchronous time setting method of the system comprises a Signal Synchronous Processing Unit (SSPU), a plurality of sensors and a logic calculation unit (140), wherein the Signal Synchronous Processing Unit (SSPU) comprises a microcontroller (110) and a crystal oscillator (118) for providing a synchronous clock, the Signal Synchronous Processing Unit (SSPU) is connected with the sensors through a sensor interface, the Signal Synchronous Processing Unit (SSPU) is connected with the logic calculation unit (140) through a communication interface, the sensors are connected with a computer through a communication interface, and the sensors are one or more of a board level sensor, a sensor with a Global Positioning System (GPS) interface or an independent sensor; the method comprises the following steps:
1) the microcontroller takes the crystal oscillator as a clock source to generate the system time of the signal synchronous processing unit SSPU, and the system time is taken as the reference time;
2) before the sensor starts data acquisition, the time of the signal synchronous processing unit SSPU and the time of the logic calculation unit are subjected to meter alignment, and the corresponding relation between the system time of the signal synchronous processing unit SSPU and the clock of the computer unit is obtained;
3) data acquisition and verification;
when the sensor is a board level sensor, performing the following steps: the board level sensor collects data in real time after being started, and sends a pulse signal to the signal synchronous processing unit SSPU in a timing mode; after the SSPU receives the pulse signal, the signal synchronous processing unit generates a pulse serial number, reads a system clock to generate a timestamp of the board-level sensor, and simultaneously reads data of the board-level sensor; then, the signal synchronous processing unit SSPU correlates the read data and the time stamp to form a board-level sensor data packet and uploads the board-level sensor data packet to the logic calculation unit in real time; and the logic calculation unit judges whether the packet of the board-level sensor data stream is lost or not according to the pulse sequence number in the board-level sensor data packet. If the packet is lost, the lost packet information (such as the lost serial number, the collection frequency, the current lost number and the like) is logged.
When the sensor is a sensor with a GPS interface, executing the following steps: firstly, the signal synchronous processing unit SSPU outputs a pulse signal at the whole second of the system time and records the system time at the moment; secondly, after the signal triggering task is completed, the signal synchronization processing unit SSPU sends system time information to the sensor with the GPS interface (e.g., 3D lidar), that is, the system time of the sensor with the GPS interface (e.g., 3D lidar) is synchronized with the system time of the signal synchronization processing unit SSPU, and the output data of the sensor with the GPS interface (e.g., 3D lidar) contains timestamp information of the signal synchronization processing unit SSPU.
When the sensor is a stand-alone type sensor, the following steps are performed: each time the independent sensor is triggered, the logic calculation unit reads the initial data of the independent sensor and the message serial number of the independent sensor to form the initial data of the independent sensor; when the independent sensor is triggered to collect data, the signal synchronous processing unit SSPU reads a system time generation timestamp and a pulse serial number thereof; then the signal synchronous processing unit SSPU uploads the timestamp and the pulse serial number thereof to the logic calculation unit; the logic calculation unit judges whether the data stream of the independent sensor loses packets according to the message serial number information of the independent sensor, and if the data stream of the independent sensor loses packets, the packet loss information (such as a lost serial number, acquisition frequency and the current lost number) is recorded into a log; and the logic calculation unit judges whether the timestamp data stream loses packets or not through the pulse serial number information, if the timestamp data stream loses packets, the current timestamp data information is supplemented according to the timestamp data corresponding to the last pulse serial number and the acquisition frequency, and the packet loss information (such as the lost serial number, the acquisition frequency and the current lost number) is recorded into a log. And the logic calculation unit records the packet loss information in real time and calculates the packet loss rate. If the packet loss rate exceeds a preset threshold, taking an action (such as resetting a sensor or reporting an error); and if the packet loss rate does not exceed the threshold value, continuing to execute. And the logic calculation unit performs one-to-one corresponding matching on the message serial number and the pulse serial number, and the successfully matched independent sensor initial data and the timestamp data are fused together to generate an independent sensor data packet. The final sequence number, the timestamp uploaded by the signal synchronization processing unit SSPU, and the data uploaded by the independent sensor are included in the data packet. The final sequence number may be a burst sequence number or a packet sequence number, preferably a packet sequence number. And when the matching of the message serial number and the pulse serial number fails, the data uploaded by the independent sensor and the message serial number wait for the next matching.
Taking each sensor as an example, the following specifically explains the time setting workflow of the sensor:
before the sensor works, the synchronous timestamp management thread is also used for sending a time setting request to the signal synchronous processing unit SSPU. And the signal synchronization processing unit SSPU returns confirmation information to the synchronous timestamp management thread according to the time synchronization request to generate complete system time.
In some embodiments, as shown in fig. 5, the workflow of the camera in the system is: firstly, the signal synchronization processing unit SSPU sends out pulses at regular time to trigger the camera to acquire data, and at the same time, the signal synchronization processing unit SSPU uses the crystal oscillator clock time as the timestamp of the camera, uses the pulse count as the pulse sequence number of the corresponding timestamp, and uploads the timestamp and the corresponding pulse sequence number to the synchronization timestamp management thread 142.
The camera starts and acquires an image, generates a data packet with a message serial number (the data packet has acquisition time and image characteristic data), and uploads the data packet to the data acquisition thread 141.
After receiving the timestamp and the pulse sequence number corresponding to the timestamp, the synchronous timestamp management thread 142 may determine whether to lose the packet according to the pulse sequence number of the timestamp. If packet loss occurs, completing the information of the current timestamp according to the timestamp and the acquisition frequency corresponding to the last pulse serial number, and recording the packet loss information (the lost pulse serial number, the acquisition frequency and the current lost number) into a log.
The data acquisition thread 141 receives the data packet of the camera and judges whether the data packet is lost or not according to the message serial number attached in the data packet. If packet loss occurs, log the packet loss information (lost message sequence number, acquisition frequency and current lost number).
Finally, the data acquisition thread 141 requests the synchronous timestamp management thread 142 for a corresponding timestamp according to the message sequence number. The synchronous timestamp management thread 142 requests the corresponding timestamp, and returns the timestamp to the request according to the request. The data acquisition thread 141 combines the obtained time stamp and the data packet into a complete data packet and stores the complete data packet in the memory. The memory may specifically be any suitable type of readable logic computing unit storage medium, such as flash memory, a mechanical hard drive, and the like.
In some embodiments, a packet loss rate may also be calculated. And when the packet loss rate exceeds a preset threshold value, stopping the data acquisition of the sensor and resetting or reporting errors. And if the packet loss rate does not exceed the threshold value, allowing to enter the next acquisition. The data may be applied to time sensitive applications.
In some embodiments, as shown in fig. 4, the work flow of the lidar in the system is as follows: firstly, the data acquisition thread 141 controls the laser radar to start, the laser radar regularly emits laser and sends a pulse to the signal synchronization processing unit SSPU to trigger the signal synchronization processing unit SSPU, and the laser radar generates a data packet with a message serial number and directly uploads the data packet to the data acquisition thread 141. Wherein the data packet has a transmission time and lidar data.
The signal synchronization processing unit SSPU receives pulses sent by the laser radar, uses the clock time of the crystal oscillator as the timestamp of the laser radar, uses the pulse count as the pulse sequence number of the corresponding timestamp, and uploads the pulse sequence number and the corresponding timestamp to the synchronization timestamp management thread 142.
The data acquisition thread 141 receives the data packet of the laser radar and judges whether the data is lost or not according to the packet serial number attached in the data packet, and if the data is lost, the lost packet information (the lost packet serial number, the acquisition frequency and the current lost number) is recorded into a log.
Finally, the data acquisition thread 141 requests the synchronous timestamp management thread 142 for a corresponding timestamp according to the message sequence number. The synchronous timestamp management thread 142 requests the corresponding timestamp, and returns the timestamp to the request according to the request. The data acquisition thread 141 combines the obtained time stamp and the data packet into a complete data packet and stores the complete data packet in the memory. The memory may specifically be any suitable type of readable logic computing unit storage medium, such as flash memory, a mechanical hard drive, and the like.
In some embodiments, a packet loss rate may also be calculated. And when the packet loss rate exceeds a preset threshold value, stopping the sensor from working. And if the packet loss rate does not exceed the threshold value, allowing to enter the next acquisition. The data may be applied to time sensitive applications.
In other embodiments, the signal synchronization processing unit SSPU may further record the laser radar timestamp by capturing the trigger signal, and determine whether the signal is an interference signal according to the acquisition frequency.
For the workflow of the inertial element in the system: firstly, the data acquisition thread 141 controls the inertial element to be started, the inertial element acquires motion information in real time, and sends a pulse to the signal synchronization processing unit SSPU at regular time to trigger the signal synchronization processing unit SSPU.
The signal synchronization processing unit SSPU receives the pulse sent by the inertial element, the system time of the microcontroller is used as the time stamp of the inertial element, the pulse count is used as the pulse serial number of the corresponding time stamp, and the data of the inertial element is read. The pulse sequence number, corresponding timestamp, and inertial element data are then uploaded to the synchronous timestamp management thread 142.
The synchronous timestamp management thread 142 receives the data of the inertial element and stores the data in a memory. The memory may specifically be any suitable type of readable logic computing unit storage medium, such as flash memory, a mechanical hard drive, and the like. The data may be applied to time sensitive applications.
For the encoder workflow: first, the data collection thread 141 controls the encoder to start, and the encoder collects motion information in real time. The microcontroller reads the encoder data at regular time, takes the microcontroller system time as the time stamp of the encoder, takes the pulse count as the pulse sequence number of the corresponding time stamp, and uploads the pulse sequence number, the corresponding time stamp and the encoder data to the synchronous time stamp management thread 142.
The synchronized timestamp management thread 142 receives the time information integrated encoder data and stores it in memory. The memory may specifically be any suitable type of readable logic computing unit storage medium, such as flash memory, a mechanical hard drive, and the like. The data may be applied to time sensitive applications.
Of course, the time stamp of the encoder may coincide with the time stamp of the inertial element, the camera or the lidar. For example, when the encoder timestamp is consistent with the inertia element timestamp, the signal synchronization processing unit SSPU receives a pulse sent by the inertia element, uses the clock time of the crystal oscillator as the timestamps of the inertia element and the encoder, uses the pulse count as the serial number of the corresponding timestamp, reads the data of the inertia element and the encoder, and uploads the serial number, the corresponding timestamp, the data of the inertia element, and the data of the encoder to the synchronization timestamp management thread 142.
As shown in fig. 6, the sensor data acquisition method (or packet loss judgment method) of the system includes a signal synchronization processing unit SSPU, a plurality of sensors, and a logic calculation unit, where the signal synchronization processing unit SSPU includes a microcontroller and a crystal oscillator providing a synchronization clock, the signal synchronization processing unit SSPU is connected to the sensors through sensor interfaces, the signal synchronization processing unit SSPU is connected to the logic calculation unit through communication interfaces, and the sensors are connected to a computer through communication interfaces; when the sensor sends or receives a trigger pulse, generating initial data and a message serial number thereof; the signal synchronous processing unit SSPU reads a system time generation timestamp and a pulse serial number thereof when receiving or sending a sensor acquisition data pulse; the method also comprises the following specific steps:
1) a logic calculation unit reads initial data of a sensor and a message serial number thereof; judging whether the data stream of the sensor loses packets or not according to the message serial number information, and if the data stream of the sensor loses packets, recording packet loss information (such as lost serial numbers, acquisition frequency and current lost numbers) into a log;
2) the logic calculation unit acquires a timestamp and a pulse serial number of the signal synchronous processing unit SSPU; and judging whether the timestamp data stream loses packets according to the pulse serial number information, if so, complementing the current timestamp data information according to the timestamp data corresponding to the last pulse serial number and the acquisition frequency, and recording packet loss information (such as the lost serial number, the acquisition frequency and the current lost number) into a log.
3) The logic calculation unit carries out one-to-one corresponding matching on the message serial number and the pulse serial number, and initial data and timestamp data which are successfully matched are combined together to generate a sensor data packet; and when the matching of the message serial number and the pulse serial number fails, waiting for the next matching.
In this embodiment, the logic calculation unit records packet loss information in real time, and calculates a packet loss rate. If the packet loss rate exceeds a preset threshold, taking an action (such as resetting a sensor or reporting an error); and if the packet loss rate does not exceed the threshold value, continuing to execute.
The sensor data packet includes a final sequence number, a timestamp uploaded by the signal synchronization processing unit SSPU, and data uploaded by the independent sensor. The final sequence number may be a burst sequence number or a packet sequence number, preferably a packet sequence number.
In this embodiment, the format of each frame of initial data uploaded by the sensor is as follows:
| message sequence number | Data of |
The message serial number of the current frame and the message serial number of the previous frame present an increasing relationship with an interval of 1.
The format of each frame of data uploaded by the signal synchronization processing unit SSPU is:
| pulse sequence number | Time stamp |
The pulse sequence number of the current frame and the pulse sequence number of the previous frame are in an increasing relationship, and the interval is 1.
In this embodiment, the packet loss determination process includes a data loss determination process, a timestamp loss determination process, and a matching process.
When data loss is judged, the interval of the message serial numbers in the initial data of the sensor is 1, if the message serial number of the current frame is found to be larger than that of the previous frame by 1, packet loss is judged, and the number of the packet loss is the difference value of the message serial numbers minus 1. If the packet is lost, the lost packet information (lost message serial number, collection frequency and current lost number) is recorded into a log as a diagnosis basis.
When the timestamp loss is judged, the interval of the pulse sequence numbers in the timestamp information is 1, if the pulse sequence number of the current frame is found to be more than 1 than that of the previous frame, the packet loss is judged, and the packet loss number is the difference value of the message sequence numbers minus 1. And the packet loss information (the lost pulse sequence number and the current lost number) is recorded into a log as the basis for subsequent diagnosis.
Matching: firstly, a data acquisition thread of a logic computing unit acquires data uploaded by a sensor and a corresponding message serial number, then, time stamp information is requested from a time stamp management thread of a signal synchronous processing unit SSPU, and matching combination is carried out through the one-to-one correspondence relationship between the message serial number and a pulse serial number. And finally combining the data into a complete data packet, wherein the data format is as follows:
| time stamp | Message sequence number | Data of |
The message serial number is the serial number of each frame after combination, and one is added for successful matching.
And (3) matching failure treatment: and when the message serial number in the sensor data cannot correspond to the currently retrieved pulse serial number in a one-to-one manner in the matching process, terminating the matching process and waiting for next matching.
The multi-sensor data acquisition method for the above system is further described as follows:
one, having GPS mode
GPS data acquisition
And the SSPU acquires GPS clock information through serial port communication and is used as a time system reference of the SSPU, and error compensation is carried out on the crystal oscillator of the SSPU according to the GPS clock information. And location information of the device can be acquired through GPS as needed.
Two, no GPS mode
The SSPU adopts a self time system as a reference to time.
1.GPS data acquisition
The SSPU obtains GPS clock information through serial port communication and is used as a time system reference of the SSPU, error compensation is carried out on a crystal oscillator of the SSPU according to the GPS clock information, and when the environment where the equipment is located does not have a GPS signal, the SSPU adopts a time system of the SSPU to carry out timing.
And location information of the device can be acquired through GPS as needed.
2. Visible light camera acquisition
The method comprises the steps that a PC (logic computing unit) end carries out data acquisition on a visible light camera, a timestamp of the visible light camera is uniformly managed by an SSPU (single strand processing unit), an SSPU module triggers the camera through a pulse signal and takes the triggering moment as the timestamp of an image frame, the pulse signal is counted and taken as a data serial number, and finally the timestamp and the data serial number are uploaded to the PC together.
Once the PC (logic computation unit) receives the time stamp information of the image frame, it acquires the image data to the visible light camera and combines the time stamp information and the image data into a frame of complete data.
3. Thermographic analyzer acquisition
The PC end (logic calculation unit) carries out data acquisition to thermal imaging analysis appearance, and its timestamp is managed by SSPU in unison, and the SSPU module triggers thermal imaging analysis appearance and regard this moment of triggering as the timestamp of this image frame through pulse signal, counts pulse signal simultaneously and regards as the data serial number, uploads to the PC together with timestamp, data serial number at last.
Once the PC (logic computation unit) receives the timestamp information of the image frame, it acquires the image data from the thermography analyzer and combines the timestamp information and the image data into a frame of complete data.
4. 2D lidar acquisition
The data acquisition is carried out on the radar by a PC (logic computing unit), the time stamp of the data acquisition is uniformly managed by an SSPU (single strand processing unit), the moment of capturing the edge of a radar pulse signal is taken as the time stamp of the radar by an SSPU (single strand processing unit), the pulse count is taken as a data serial number, and the time stamp and the data serial number are uploaded to the PC together.
Meanwhile, the PC end (logic calculation unit) reads the laser radar uploading data, adds a data serial number in front of each frame of data to serve as a data identifier, corresponds the time stamps and the data one by one according to the serial number in the time stamps and the serial number in the data, and finally combines the time stamps and the data into a frame of complete data.
5. 3D lidar acquisition
The SSPU transmits the system time per se to the 3D laser radar according to the UNIX format through serial port communication and outputs 1 pulse signal with the frequency of 1Hz to the laser radar in the whole second, namely, the clock of the laser radar is synchronous with the SSPU. And SSPU timestamp information is contained in the output data of the laser radar.
6. IMU Collection
The IMU data and the time stamp are read and managed by the SSPU, and the complete data is uploaded to the PC side (logical computation unit).
7. Encoder acquisition
The two encoder data and the timestamp are read and managed by the SSPU, and the complete data is uploaded to the PC (logical computation unit).
In the system and/or method provided by the embodiment of the invention, the workflow of a plurality of different sensors is provided. Specifically, one or more combinations of various sensors such as a camera, inertial navigation, laser radar, and an encoder may be selected and used according to the requirements of the actual situation.
In summary, in the multi-sensor time setting system provided in the embodiment of the present invention, the signal synchronization processing unit SSPU manages the acquisition time of each sensor, so that the acquisition time of each sensor can be managed in the same clock system, and the acquisition time of each sensor is unified in the same time coordinate system in a low-skew manner. Moreover, the SSPU time synchronization mode is hardware synchronization, the crystal oscillator is subjected to temperature compensation supplementary processing, and the time synchronization precision is high.
Finally, the accuracy of data obtained by a plurality of sensors is higher, the data are more accurate when being applied to time-sensitive occasions, and the time setting cost is lower. Different sensors can be flexibly configured to form different combinations, and the method is suitable for different use scenes.
It should be understood that the technical solutions and concepts of the present invention may be equally replaced or changed by those skilled in the art, and all such changes or substitutions should fall within the protection scope of the appended claims.
It should be understood that the arrangements described herein are for example purposes only. Thus, those skilled in the art will appreciate that other arrangements and other elements (e.g., machines, interfaces, functions, orders, and groupings of functions, etc.) can be used instead, and that some elements may be omitted entirely, depending upon the desired results. Further, many of the described elements are functional entities that may be implemented as discrete or distributed components in any suitable combination or location, or in conjunction with other components, or may combine other structured components described as separate structures.
While various aspects and embodiments have been disclosed herein, other aspects and embodiments will be apparent to those skilled in the art. The various aspects and embodiments disclosed herein are for illustrative purposes and are not intended to be limiting, with the true scope being indicated by the following claims, along with the full scope of equivalents to which such claims are entitled. It is also to be understood that the terminology used herein is for the purpose of describing particular embodiments only, and is not intended to be limiting.
Claims (7)
1. A sensor data acquisition method is characterized in that a system applying the sensor data acquisition method comprises a Signal Synchronous Processing Unit (SSPU), a plurality of sensors and a logic calculation unit, wherein the SSPU comprises a microcontroller and a crystal oscillator for providing a synchronous clock, the microcontroller takes the crystal oscillator as a clock source to generate the system time of the SSPU, and the time of the SSPU and the logic calculation unit is subjected to meter alignment before the sensors start data acquisition; when the sensor sends or receives a trigger pulse, generating initial data and a message serial number thereof; the signal synchronous processing unit SSPU reads a system time generation timestamp and a pulse serial number thereof when receiving or sending a pulse of data collected by the sensor; the logic calculation unit executes the following specific steps:
1) reading initial data of a sensor and a message serial number thereof;
2) acquiring a timestamp and a pulse sequence number of a Signal Synchronous Processing Unit (SSPU);
3) matching the message serial number and the pulse serial number in a one-to-one correspondence manner, and combining initial data and timestamp data which are successfully matched to generate a sensor data packet; the sensor data packet includes a final sequence number, a timestamp uploaded by the signal synchronization processing unit SSPU, and data uploaded by the sensor, and the final sequence number may be a pulse sequence number or a packet sequence number.
2. The sensor data acquisition method according to claim 1, wherein the logic calculation unit records packet loss information in real time, calculates a packet loss rate, and takes an action if the packet loss rate exceeds a preset threshold; and if the packet loss rate does not exceed the threshold value, continuing to execute.
3. The sensor data acquisition method according to claim 1, wherein the logic computation unit comprises a data acquisition thread for acquiring sensor data, a synchronous timestamp management thread for accepting a timestamp and a pulse sequence number from the Signal Synchronous Processing Unit (SSPU), and a memory.
4. The sensor data acquisition method of claim 1, wherein the signal synchronization processing unit SSPU is connected to the sensor through a sensor interface, the signal synchronization processing unit SSPU is connected to the logic computation unit through a communication interface, and the sensor is connected to the computer through a communication interface.
5. A sensor data acquisition system, which comprises a Signal Synchronization Processing Unit (SSPU), a plurality of sensors and a logic calculation unit, wherein the Signal Synchronization Processing Unit (SSPU) comprises a microcontroller and a crystal oscillator for providing a synchronous clock, and the data acquisition is carried out by applying the sensor data acquisition method as claimed in any one of claims 1 to 4.
6. A sensor data acquisition packet loss judgment method is characterized in that a system applying the sensor data acquisition packet loss judgment method comprises a Signal Synchronization Processing Unit (SSPU), a plurality of sensors and a logic calculation unit, wherein the SSPU comprises a microcontroller and a crystal oscillator for providing a synchronous clock, the microcontroller takes the crystal oscillator as a clock source to generate the system time of the SSPU, and the SSPU and the logic calculation unit perform time alignment before the sensors start data acquisition; the signal synchronous processing unit SSPU is connected with the sensor through a sensor interface, the signal synchronous processing unit SSPU is connected with the logic calculation unit through a communication interface, and the sensor is connected with a computer through a communication interface; when the sensor sends or receives a trigger pulse, generating initial data and a message serial number thereof; the signal synchronous processing unit SSPU reads a system time generation timestamp and a pulse serial number thereof when receiving or sending a pulse of data collected by the sensor; the method also comprises the following specific steps:
1) a logic calculation unit reads initial data of a sensor and a message serial number thereof; judging whether the initial data stream of the single sensor loses packets or not according to the message serial number information, and if the packets are lost, recording packet loss information into a log;
2) the logic calculation unit acquires a timestamp and a pulse serial number of the signal synchronous processing unit SSPU; judging whether the timestamp data stream loses packets or not according to the pulse serial number information, if so, completing the current timestamp data information according to the timestamp data corresponding to the last pulse serial number and the acquisition frequency, and recording packet loss information into a log;
3) the logic calculation unit carries out one-to-one corresponding matching on the message serial number and the pulse serial number, and initial data and timestamp data which are successfully matched are combined together to generate a sensor data packet; and when the matching of the message serial number and the pulse serial number fails, waiting for the next matching.
7. The method of claim 6, wherein the packet loss information includes a lost serial number, a collection frequency, and a current number of lost packets.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710740451.2A CN107743054A (en) | 2017-08-25 | 2017-08-25 | System during a kind of synchronous pair of multisensor |
| CN2017107404512 | 2017-08-25 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108900272A CN108900272A (en) | 2018-11-27 |
| CN108900272B true CN108900272B (en) | 2021-02-19 |
Family
ID=61235613
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710740451.2A Pending CN107743054A (en) | 2017-08-25 | 2017-08-25 | System during a kind of synchronous pair of multisensor |
| CN201810731560.2A Active CN109104259B (en) | 2017-08-25 | 2018-07-05 | Multi-sensor time synchronization system and method |
| CN201810732148.2A Active CN108900272B (en) | 2017-08-25 | 2018-07-05 | Sensor data acquisition method and system and packet loss judgment method |
Family Applications Before (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710740451.2A Pending CN107743054A (en) | 2017-08-25 | 2017-08-25 | System during a kind of synchronous pair of multisensor |
| CN201810731560.2A Active CN109104259B (en) | 2017-08-25 | 2018-07-05 | Multi-sensor time synchronization system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (3) | CN107743054A (en) |
Families Citing this family (38)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107743054A (en) * | 2017-08-25 | 2018-02-27 | 杭州德泽机器人科技有限公司 | System during a kind of synchronous pair of multisensor |
| EP3540428A1 (en) * | 2018-03-12 | 2019-09-18 | Sensirion AG | Sensor module |
| CN109239720A (en) * | 2018-10-18 | 2019-01-18 | 清华大学苏州汽车研究院（吴江） | A kind of Intelligent Laser radar installations, system and its data processing method |
| CN109634973A (en) * | 2018-11-12 | 2019-04-16 | 北京航空航天大学 | NC Machining Process collecting method, device and equipment |
| CN109547693A (en) * | 2018-11-29 | 2019-03-29 | 惠州市德赛西威智能交通技术研究院有限公司 | Multi-sensor data synchronization system and image data synchronous method |
| CN110892671B (en) * | 2018-12-03 | 2022-07-01 | 深圳市大疆创新科技有限公司 | Aircraft, data processing system and data processing method for aircraft |
| CN111348046B (en) * | 2018-12-24 | 2021-06-15 | 毫末智行科技有限公司 | Target data fusion method, system and machine-readable storage medium |
| CN109725572A (en) * | 2018-12-25 | 2019-05-07 | 初速度（苏州）科技有限公司 | A kind of multisensor accurate clock synchronization system and method |
| CN111600670B (en) * | 2019-02-20 | 2023-04-18 | 阿里巴巴集团控股有限公司 | Inductive data calculation control method and time service device |
| CN111856468A (en) * | 2019-04-16 | 2020-10-30 | 阿里巴巴集团控股有限公司 | Detection method, device, equipment, system and storage medium |
| CN110312056B (en) * | 2019-06-10 | 2021-09-14 | 青岛小鸟看看科技有限公司 | Synchronous exposure method and image acquisition equipment |
| CN110329273B (en) * | 2019-06-18 | 2020-12-22 | 浙江大学 | Method and device for synchronizing data acquired by unmanned vehicle |
| CN110286377B (en) * | 2019-06-19 | 2021-09-03 | 青海大学 | Dual-band weather radar observation control method and system |
| US11227194B2 (en) * | 2019-07-16 | 2022-01-18 | Baidu Usa Llc | Sensor synchronization offline lab validation system |
| CN112339768B (en) * | 2019-08-09 | 2021-12-17 | 顺丰科技有限公司 | Vehicle chassis control method, device and storage medium |
| CN110567453B (en) * | 2019-08-21 | 2021-05-25 | 北京理工大学 | Bionic eye multi-channel IMU and camera hardware time synchronization method and device |
| CN113022488A (en) * | 2019-12-25 | 2021-06-25 | 北京宝沃汽车股份有限公司 | Vehicle and control method and device thereof |
| CN111082897B (en) * | 2019-12-26 | 2021-05-18 | 深圳市瑞立视多媒体科技有限公司 | Method and related equipment for solving synchronous communication packet loss of coding type active optical capturing system |
| CN111309094A (en) * | 2020-02-06 | 2020-06-19 | 上海图趣信息科技有限公司 | Synchronous board card and method for data acquisition of sensor equipment |
| CN113333301B (en) * | 2020-03-03 | 2023-04-21 | 顺丰科技有限公司 | Cross-band control method, system, computer device, and storage medium |
| CN111447259B (en) * | 2020-03-12 | 2023-04-28 | 江西珉轩智能科技有限公司 | Self-adaptive data collaborative collection method and system |
| CN113496545B (en) * | 2020-04-08 | 2022-05-27 | 阿里巴巴集团控股有限公司 | Data processing system, method, sensor, mobile acquisition backpack and equipment |
| CN111641635B (en) * | 2020-05-28 | 2022-05-27 | 北京经纬恒润科技股份有限公司 | Method and device for lossless transmission of CAN data |
| CN111791232B (en) * | 2020-06-03 | 2021-02-05 | 中南民族大学 | Robot chassis control system and method based on time hard synchronization |
| CN111682918B (en) * | 2020-06-10 | 2022-06-10 | 杭州海康威视数字技术股份有限公司 | Synchronous control method, device and system of sensor and storage medium |
| JP2022019093A (en) | 2020-07-17 | 2022-01-27 | セイコーエプソン株式会社 | Overshoot amount detection method and robot system |
| CN111795702A (en) * | 2020-09-09 | 2020-10-20 | 蓝箭航天空间科技股份有限公司 | Inertial measurement information and starlight measurement information data synchronization method and system |
| CN112787740A (en) * | 2020-12-26 | 2021-05-11 | 武汉光庭信息技术股份有限公司 | Multi-sensor time synchronization device and method |
| CN113014812B (en) * | 2021-03-01 | 2022-04-15 | 中电海康集团有限公司 | Camera and laser radar time synchronization control system |
| CN113428096A (en) * | 2021-08-27 | 2021-09-24 | 武汉元丰汽车电控系统股份有限公司 | Data acquisition card, apparatus and method |
| CN113922910B (en) * | 2021-10-09 | 2023-09-19 | 广东汇天航空航天科技有限公司 | Sensor time synchronization processing method, device and system |
| CN114253211A (en) * | 2021-12-15 | 2022-03-29 | 意欧斯智能科技股份有限公司 | Method for mutual verification of PLC and upper computer WCS signals |
| US11822377B2 (en) | 2022-01-11 | 2023-11-21 | Waymo Llc | Timebase synchronization using pulsed signal injection |
| CN114374812B (en) * | 2022-01-20 | 2022-08-19 | 集睿致远(厦门)科技有限公司 | Communication information monitoring equipment, method and system of DP (data processing) interface auxiliary channel |
| CN114614910B (en) * | 2022-03-09 | 2024-05-28 | 江苏斯菲尔电气股份有限公司 | Pulse signal low-power-consumption wireless transmission system and method |
| CN114964175B (en) * | 2022-03-30 | 2023-05-23 | 华南理工大学 | Multi-sensor data synchronous acquisition device and acquisition method |
| CN115776366B (en) * | 2022-12-12 | 2024-03-15 | 北京自动化控制设备研究所 | High-precision synchronization method and device for visual multisensor |
| CN116032412B (en) * | 2023-03-28 | 2023-07-18 | 之江实验室 | Multi-camera cross-platform time synchronization method, device and system and electronic equipment |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106878326A (en) * | 2017-03-21 | 2017-06-20 | 中国人民解放军信息工程大学 | The guard method of IPv6 neighbor caches and its device based on inverse detection |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100479425C (en) * | 2005-07-12 | 2009-04-15 | 中兴通讯股份有限公司 | Method for protecting VOIP digital signal processing channel |
| US8559319B2 (en) * | 2007-10-19 | 2013-10-15 | Voxer Ip Llc | Method and system for real-time synchronization across a distributed services communication network |
| CN102377801B (en) * | 2010-08-19 | 2014-05-07 | 中国科学院计算技术研究所 | Sensor network for environmental monitoring and data transmission method |
| CN103209224B (en) * | 2013-04-28 | 2016-02-24 | 上海海事大学 | Based on underwater sound sensor network system and the data transmission method thereof of P2P |
| US20150185054A1 (en) * | 2013-12-30 | 2015-07-02 | Motorola Mobility Llc | Methods and Systems for Synchronizing Data Received from Multiple Sensors of a Device |
| CN105426121B (en) * | 2015-10-30 | 2018-01-16 | 山东科技大学 | Boat-carrying multisensor integrated measuring data real-time storage method |
| CN107743054A (en) * | 2017-08-25 | 2018-02-27 | 杭州德泽机器人科技有限公司 | System during a kind of synchronous pair of multisensor |
-
2017
- 2017-08-25 CN CN201710740451.2A patent/CN107743054A/en active Pending
-
2018
- 2018-07-05 CN CN201810731560.2A patent/CN109104259B/en active Active
- 2018-07-05 CN CN201810732148.2A patent/CN108900272B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106878326A (en) * | 2017-03-21 | 2017-06-20 | 中国人民解放军信息工程大学 | The guard method of IPv6 neighbor caches and its device based on inverse detection |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109104259B (en) | 2021-05-11 |
| CN109104259A (en) | 2018-12-28 |
| CN107743054A (en) | 2018-02-27 |
| CN108900272A (en) | 2018-11-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108900272B (en) | Sensor data acquisition method and system and packet loss judgment method | |
| WO2021031604A1 (en) | Method and device for hardware time synchronization between multi-channel imus and cameras of bionic eye | |
| CN112672415B (en) | Multi-sensor time synchronization method, device, system, electronic device and medium | |
| CN111381487B (en) | Multi-sensor synchronous time service system, method and device and electronic equipment | |
| KR101722068B1 (en) | Methods and systems for synchronizing data received from multiple sensors of a device | |
| CN107231533B (en) | synchronous exposure method and device and terminal equipment | |
| CN112383675B (en) | Time synchronization method and device and terminal equipment | |
| CN111309094A (en) | Synchronous board card and method for data acquisition of sensor equipment | |
| CN107277385B (en) | Multi-camera system synchronous exposure control method and device and terminal equipment | |
| WO2019119282A1 (en) | Method and device for associating image and location information, and movable platform | |
| WO2020258901A1 (en) | Method and apparatus for processing data of sensor, electronic device, and system | |
| CN104764442A (en) | Method and device for determining exposure time of aerial photogrammetric camera in light-small unmanned aerial vehicle | |
| CN112822480B (en) | VR system and positioning tracking method thereof | |
| CN111007554A (en) | Data acquisition time synchronization system and method | |
| CN104748730A (en) | Device and method for determining exposure moment of aerial survey camera in unmanned aerial vehicle | |
| CN112945228A (en) | Multi-sensor time synchronization method and synchronization device | |
| JP2024061721A (en) | Photographing instruction method and photographing instruction device | |
| WO2023165569A1 (en) | Multi-sensor simultaneous positioning method and apparatus, system, and storage medium | |
| CN112995524A (en) | High-precision acquisition vehicle, and photo exposure information generation system, method and synchronization device thereof | |
| CN102997898B (en) | Time synchronization control method and system | |
| CN110892671A (en) | Aircraft, data processing system and data processing method for aircraft | |
| JP7482291B2 (en) | Clock Synchronization | |
| US20180359405A1 (en) | Frame synchronization of multiple image capture devices | |
| TWI844380B (en) | Clock synchronisation | |
| CN117518770A (en) | Time management system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220622 Address after: Room 107-f, building 25, No. 1399, liangmu Road, Cangqian street, Yuhang District, Hangzhou, Zhejiang 311121 Patentee after: Smiles (Hangzhou) Technology Co.,Ltd. Address before: Room b1-605-2, 198 Qidi Road, Xiaoshan Economic and Technological Development Zone, Hangzhou, Zhejiang 311200 Patentee before: HANGZHOU DEZE ROBOT TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |