KR20240070238A - Synchronous communication system and method between multiple images and data - Google Patents

Abstract

The present invention relates to a system and method for synchronizing transmission and reception between multiple images and data, and more specifically, to multiple image data, object/object data, and sensing data captured from a device capable of TCP/IP-based socket communication. It relates to a system and method that synchronizes and transmits and receives various information data related to the video, and dynamically optimizes the communication flow by calculating communication weights for each client in real time.

Description

System and method for synchronizing transmission and reception between multiple images and data {SYNCHRONOUS COMMUNICATION SYSTEM AND METHOD BETWEEN MULTIPLE IMAGES AND DATA}

The present invention relates to a system and method for synchronizing transmission and reception between multiple images and data, and more specifically, to multiple image data, object/object data, and sensing data captured from a device capable of TCP/IP-based socket communication. It relates to a system and method that synchronizes and transmits and receives various information data related to the video, and dynamically optimizes the communication flow by calculating communication weights for each client in real time.

In general video streaming, RTSP (Real Time Streaming Protocol) has the upper hand by providing a protocol optimized for video transmission. However, as described above, it is optimized only for video transmission, so other data cannot be sent together with the video data being transmitted. When there are multiple video sources that need to be transmitted, resolution is required to synchronize and receive multiple video data from the server at once. ), the number of frames per second (Frames Per Second), and video format (Format) must all match the performance of the capture device.

In addition to single video data services such as general Internet broadcasting, multiple video data and sensing data with different resolutions, frames per second, and video formats must be collected simultaneously. In data service development, the existing RTSP Protocol inevitably has limitations. In other words, the RTSP Protocol has significant limitations in developing multiple video data transmission services where concurrency is important for public institutions and industries.

Accordingly, in order to solve the above problems, it is necessary to develop a synchronized transmission and reception system between multiple videos and data, equipped with multi-video data transmission technology with guaranteed concurrency.

The present invention synchronizes multiple image data captured from a device capable of TCP/IP-based Socket communication and various information data related to the image, such as object/object data and sensing data, thereby minimizing delay and error between the two data. The purpose is to provide a synchronized transmission and reception system and method between multiple images and data that transmits data to a server.

A synchronization transmission and reception system and method between multiple images and data according to an embodiment of the present invention includes a communication unit that receives data including at least one of video data, sensing data, and communication status data from a client device; and a synchronization control unit that synchronizes and receives the video data and the sensing data transmitted by the plurality of client devices.

In addition, the client device and the communication unit communicate using a defined communication standard based on the TCP/IP protocol, and the defined communication standard is at least one of a video packet (Packet), an information packet (Packet), and a communication priority packet (Packet). Includes more.

Additionally, the video data is image data collected by the client device through a camera, and is transmitted in a video packet.

Additionally, the sensing data is data collected by the client device through a sensor, and is transmitted in an information packet.

Additionally, the communication status data includes at least one of the client communication priority set in the client device and the total number of packets transmitted and received by the client device, and is transmitted in a communication priority packet.

Additionally, the video packet, the information packet, and the communication priority packet are:

START PACKET, which indicates the start of a packet to be transmitted and includes a packet ID that identifies the packet; A DATA PACKET containing at least one of the video data, the information data, and the communication status data; LENGTH PACKET including the size of the DATA PACKET; and CHECK PACKET to check whether the DATA PACKET is in a state to be received.

Additionally, communication between the client device and the communication unit includes at least one communication cycle, and the communication cycle includes at least one of the video packets, at least one of the information packets, and at least one of the communication priority packets. It includes the process of sending and receiving.

In addition, the synchronization transmission and reception system calculates the communication weight using one cycle completion time, which is the time taken to perform the communication cycle, the communication priority of the client device, and the total number of packets transmitted and received during the communication cycle. Includes more wealth.

Additionally, the synchronization control unit updates the communication priority of the client device by applying the communication weight each time the communication cycle ends and controls the communication flow according to the communication priority.

In addition, a synchronization method between multiple images and data implemented by a multiple image and data transmission/reception synchronization system includes a communication connection step of connecting a communication channel between a client device and a communication unit; Transmitting and receiving video packets on the communication channel; Transmitting and receiving information packets in the communication channel; Transmitting and receiving a communication priority packet in the communication channel; and a step of a communication weight calculation unit calculating a communication weight of the client device and updating the communication priority of the client device.

Since there is no need for separate processing for data synchronization after sending and receiving data, management of multiple images and data with guaranteed concurrency is possible even in low-performance servers or systems. In other words, it can be widely used in various devices that support TCP/IP-based socket communication.

Extraction and transmission of multiple video data and related sensing data in multiple ranges with guaranteed concurrency is possible within one communication cycle, simplifying the construction of a real-time multiple data collection system.

The server calculates the communication weight for each client in real time and dynamically optimizes the communication flow. This minimizes the bottleneck phenomenon in which data transmission and reception is focused on a specific client in a multi-client environment and the resulting data delay problem.

Figure 1 is a configuration diagram of a synchronization transmission and reception system 10 between multiple images and data according to an embodiment of the present invention.
Figure 2 is a configuration diagram of the server 200 in the synchronization transmission and reception system 10 between multiple images and data according to an embodiment of the present invention.
Figure 3 is a packet configuration diagram defining a communication protocol in the synchronization transmission and reception system 10 between multiple images and data according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating calculation of communication weight and communication priority of the client device 100 in the synchronized transmission and reception system 10 between multiple images and data according to an embodiment of the present invention.
Figure 5 is a flowchart showing a method for synchronizing transmission and reception between multiple images and data according to an embodiment of the present invention.
Figure 6 is a flowchart showing the flow of packet transmission and reception within one communication cycle in the synchronized transmission and reception method between multiple images and data according to an embodiment of the present invention.

Hereinafter, specific embodiments of the present invention will be described in detail with reference to the drawings. However, the spirit of the present invention is not limited to the presented embodiments, and a person skilled in the art who understands the spirit of the present invention may add, change, or delete other components within the scope of the same spirit, thereby creating other degenerative inventions or the present invention. Other embodiments that are included within the scope of the invention can be easily proposed, but this will also be said to be included within the scope of the invention of the present application.

In addition, the terms described below are terms set in consideration of the function in the present invention, and may vary depending on the inventor's intention or custom, so the definition should be made based on the content throughout the present specification, and in this specification related to the present invention. In cases where it is determined that detailed descriptions of well-known configurations or functions may obscure the gist of the present invention, detailed descriptions thereof will be omitted.

Hereinafter, a system and method for synchronizing transmission and reception between multiple images and data according to the present invention will be described with reference to the drawings.

Figure 1 is a configuration diagram of a synchronization transmission and reception system 10 between multiple images and data according to an embodiment of the present invention.

The synchronization transmission and reception system 10 between multiple images and data according to an embodiment of the present invention may be composed of at least one client device 100 and a server 200, and each device may be connected to a network and communicate with each other. there is.

In the present invention, the client device 100 may include a camera/photography device that shoots/captures and transmits images, sensors that collect various data, smart devices, etc.

The server 200 referred to in the present invention receives a connection request from the client device 100, creates a two-way communication channel, and receives video data transmitted by the client device 100 and sensing data associated with the transmitted video data. Or it refers to the object/object data of the video frame. Sensing data may include object information, surrounding environment information, weather information, distance information, etc. collected from sensors.

Additionally, the server 200 referred to in the present invention may be constructed as a server that functions as at least one of a type of web service server, database server, big data server, IoT server, media server, and application server.

Additionally, each of the roles listed above may be performed by one physical server, or may be configured and operated as a plurality of physically separated servers. However, it is not limited to this, and the type of server can be changed in various ways at a level that is obvious to a person skilled in the art.

Data transmitted and received between the client device 100 and the server 200 includes at least one of video data, sensing data, and communication status data.

More specifically, the client device 100 includes video data collected through cameras, sensing data other than images collected from various sensors, and communication status data that can measure the status of the communication flow of the client device 100. Includes.

For example, the client device 100 may include various sensors such as a camera that collects visual information for autonomous driving and a LiDAR or RADAR for recognizing various objects that appear while driving.

RiDAR is a radar device that measures the location coordinates of a reflector by shooting a laser pulse and measuring the time it takes for it to reflect and return.

The client device 100 analyzes signal data collected by RiDAR or RADAR, and based on this, senses data including object/object information analyzed and video data captured by the camera. It is transmitted to the server 200, and at this time, the two data must be transmitted in synchronization with each other in order to understand the driving environment.

Additionally, a plurality of client devices 100 can access and communicate with the server 200. In this case, a plurality of clients can transmit video images taken at different locations at the same time and collected sensing data. .

For example, when a plurality of client devices 100 including cameras and LiDAR/RADAR communicate with the server 200 for autonomous driving, the server 200 communicates with each client at the same time. Video data and sensing data transmitted by the device 100 must be received and managed in a synchronized state, and the driving environment must be analyzed in real time based on this.

In order to transmit and receive multiple images and sensing data with guaranteed concurrency, the communication status with each client device 100 is periodically checked to calculate the communication priority of the client device 100 and control the communication order, By dynamically optimizing communication flow, data bottlenecks and data transmission/reception delay problems are minimized.

At this time, the server 200 receives communication status data from the client device 100 to check the communication status with the client device 100.

The communication status data includes a client communication priority set in the client device 100 and at least one communication weight measurement factor among the total number of packets transmitted and received by the client device 100. The server 200 receives communication status data, calculates a communication weight, determines the communication flow using the communication weight, and controls the communication order with each client device 100.

The present invention synchronizes and transmits and transmits a plurality of video data at the same time as described above and sensing data or object/object data of an image frame, thereby eliminating the need for separate data synchronization processing in the server 200. This makes it possible to manage multiple video and information data with guaranteed concurrency even on low-performance servers.

Figure 2 is a configuration diagram of the server 200 in the synchronization transmission and reception system 10 between multiple images and data according to an embodiment of the present invention.

In the synchronization transmission and reception system 10 between multiple images and data according to an embodiment of the present invention, the server 200 includes a communication unit 210, a synchronization control unit 220, a communication weight calculation unit 230, and a client information management unit 240. and a data processing unit 250.

The communication unit 210 allows connection with at least one client device 100 and receives data including at least one of video data, sensing data, and communication status data through the created communication channel. At this time, communication between the client device 100 and the server 200 is transmitted and received using a defined communication protocol based on TCP/IP.

The defined communication protocol may be a TCP/IP packet-based protocol for synchronizing and transmitting and receiving a plurality of video data at the same time and sensing data associated with the video data or object/object data of the video frame.

The communication unit 210 receives packet data according to a communication protocol defined through a communication channel connected to the client device 100, parses it, transmits it to the synchronization control unit 220, and responds to the commands of the synchronization control unit 220. Packet data is configured and transmitted accordingly.

A detailed description of the defined communication protocol will be described later with reference to FIG. 3.

The synchronization control unit 220 synchronizes and receives video data transmitted by a plurality of client devices 100 and the sensing data.

More specifically, the synchronization control unit 220 controls data transmission and reception on a communication cycle basis for data synchronization.

A communication cycle includes the process of transmitting and receiving at least one video packet (VIDEO PACKET), at least one information packet (INFO PACKET), and at least one communication priority packet (CP PACKET).

Video data is image data collected by the client device 100 through a camera, and is transmitted in a video packet.

Sensing data is data collected by the client device 100 through a sensor, and is transmitted in an information packet.

Sensing data may further include object/object information within the image frame related to the video.

Communication status data includes at least one of the communication priority set in the client device 100 and the total number of packets transmitted and received while the client device 100 performs one communication cycle, and is included in a communication priority packet (Packet). included and transmitted.

At this time, the transmission and reception order of VIDEO PACKET, INFO PACKET, and CP PACKET can be applied in various ways depending on the embodiment of the present invention.

The client device 100 and the server 200 include at least one communication cycle when transmitting and receiving data, and are used to transmit and receive video data and sensing data that must be processed in synchronization from the time of communication connection to the end of the connection. Data is transmitted, received, and processed in units of communication cycles.

For example, the client device 100, which includes a camera and a LiDAR/RADAR installed for autonomous driving, includes video data collected from the camera in a VIDEO PACKET and transmits it to the server 200 ( Step 1). Next, after transmitting the video data, the information data collected from RiDAR/RADAR is included in the INFO PACKET and transmitted to the server 200 (step 2). Thereafter, communication status data including communication weight measurement factors (communication priority, total number of packets transmitted and received, etc.) of the client device 100 is transmitted (step 3). At this time, step 1, step 2, and step 3 mean one communication cycle.

In addition, the synchronization control unit 220 calls the communication weight calculation unit 230 at the end of one communication cycle to calculate the communication weight of the client device 100 and applies it to determine the communication priority of the client device 100. Update . Communication priorities are specified in order from lowest to highest weight value (ascending order).

Thereafter, data is transmitted and received with the client device 100 according to the updated communication priority, thereby minimizing transmission and reception delays and errors in video data and sensing data collected from multiple client devices 100.

The communication weight calculation unit 230 calculates the communication weight of the client device 100.

The communication weight is calculated to prioritize transmission and reception between the server 200 and the client device 100 in order to minimize the bottleneck phenomenon in which data transmission and reception is concentrated on a specific client in a multi-client environment and the resulting data delay problem.

As an example, the communication weight can be calculated using the formula below.

Communication_Priority

= Data_1Cycle_Send_Or_Receive_Time_Per_Client[ms] /

Administrator_Custom_Client_Level[1~10] /

Client_Communication_Packets_Count

The description of each communication factor is as follows.

Data_1Cycle_Send_Or_Receive_Time_Per_Client[ms] is a measurement of the time it takes to complete one communication cycle and uses the unit of ms.

Aministrator_Custom_Client_Level[1~10] is the communication priority of the client device 100 designated by the administrator of the client device 100 or the server 200 and is composed of levels 1 to 10.

Client_Communication_Packets_Count is the total number of subpackets transmitted and received by the client device 100 during one communication cycle.

The client information management unit 240 manages setting values of each client device 100 necessary for communication, such as the ID (identifier) of the client device 100, communication priority, and communication weight.

The data processing unit 250 performs data preprocessing/analysis, machine learning model learning, and artificial intelligence for big data utilization in order to utilize synchronized video data and sensing data transmitted from at least one client device 100 for various services. It performs data processing such as prediction/judgment using intelligence (AI), and can include various data processing functions in addition to the functions listed above.

The data processing unit 250 is a big data server connected to the server 200 by a network and configured independently for processing big data, artificial intelligence (AI) model learning, prediction/judgment using artificial intelligence (AI), etc. It may further include an interface unit that interfaces with at least one of an artificial intelligence (AI) processing server, an application server, a media server, and a web service server.

Figure 3 is a packet configuration diagram defining a communication protocol in the synchronization transmission and reception system 10 between multiple images and data according to an embodiment of the present invention, and the defined communication protocol is explained in detail with reference to Figure 3.

The client device 100 and the communication unit 210 communicate using communication standards defined based on the TCP/IP protocol, and the defined communication standards include video packet (Packet), information packet (Packet), and communication priority packet (Packet). Includes at least one of

More specifically, the defined communication protocol is a video packet (VIDEO PACKET) for sending and receiving video data, an information packet (INFO PACKET) and a client for sending and receiving object/object information or sensing data within the video frame related to the video. Includes a Communication Priority Packet (CP PACKET) for transmitting and receiving communication status data of the device 100, and additionally defines and includes packets to transmit various types of data as needed in addition to the packets described above. can do.

VIDEO PACKET, INFO PACKET, and CP PACKET are main packets defined according to the type of data, and each main packet includes at least one defined sub packet.

Subpackets include START PACKET, LENGTH PACKET, CHECK PACKET, and DATA PACKET, and may include additional packets defined to transmit various types of data as needed in addition to the packets described above.

START PACKET means the start of the packet to be transmitted and includes a packet ID that identifies the packet, the type of main packet (VIDEO PACKET, INFO PACKET, CP PACKET), and a data source ID.

The data source ID is an ID that identifies the data source such as video data transmitted from the client device 100, object/object information within an image frame related to the video, sensing data, or communication status data.

For example, in the case of video data collected from a first camera connected to the client device 100, it can be composed of the client device 100 number + 'VIDEO' + the first camera identification number.

START PACKET is transmitted from the server 200 to the client device 100.

LENGTH PACKET includes the size of the DATA PACKET and can be defined as a maximum size of 2^32 bytes.

The LENGTH PACKET is transmitted from the client device 100 to the server 200.

CHECK PACKET includes a Flag argument that checks whether the DATA PACKET is ready to be received, and the Flag argument can be defined as text or number.

CHECK PACKET is transmitted from the server 200 to the client device 100.

DATA PACKET includes packet ID, main packet type (VIDEO PACKET, INFO PACKET, CP PACKET), and data that the client device 100 wants to transmit. The data includes video data, video and It includes at least one of object/object information or sensing data within the associated video frame and the communication status data.

DATA PACKET is transmitted from the client device 100 to the server 200.

FIG. 4 is a diagram illustrating calculation of communication weight and communication priority of the client device 100 in the synchronized transmission and reception system 10 between multiple images and data according to an embodiment of the present invention.

A method of calculating a communication weight and controlling the communication order using the calculated communication weight will be described with reference to FIG. 4.

Communication_Priority

= Data_1Cycle_Send_Or_Receive_Time_Per_Client[ms] /

Administrator_Custom_Client_Level[1~10] /

Client_Communication_Packets_Count

D1CSRTPC: Data_1Cycle_Send_Or_Receive_Time_Per_Client[ms]

ACCL: Administrator_Custom_Client_Level[1~10]

CCPC: Client_Communication_Packets_Count

By applying the communication weight calculation formula above to calculate the communication weight from client device (Client) 1 to client device (Client) N, it is as follows.

Client1 Client2 Client3 Client4 3.8 1.916 6.125 4.1 Client5 Client6 Client7 Client8 0.66 1.85 7.25 11.1

If the calculated communication weights are sorted in ascending order, Client 5 with the lowest communication weight has communication priority 1, and Client 8 has communication priority 8.

The server 200 communicates with client device (Client) 5 first, and communicates with client device (Client) 8 last.

Figure 5 is a flowchart showing a method for synchronizing transmission and reception between multiple images and data according to an embodiment of the present invention.

A method of synchronizing transmission and reception between multiple images and data will be described with reference to FIG. 5.

In the synchronization method between multiple videos and data implemented by the multi-video and data transmission/reception synchronization system 10, a communication connection step (S310) of connecting a communication channel between a client device and a communication unit, and transmitting and receiving video packets in the communication channel. Step (S320), transmitting and receiving an information packet in the communication channel (S330), transmitting and receiving a communication priority packet in the communication channel (S340), and a communication weight calculation unit calculates the communication weight of the client device and It includes updating the communication priority of the device (S350).

The communication connection step (S310) is a step in which the communication unit 210 allows connection with at least one client device 100 and creates a TCP/IP-based communication channel.

The communication unit 210 checks the number and client ID of the client devices 100 managed by the client information management unit 240, waits for the connection of the corresponding client device 100, and communicates with each client device 100. Create a channel.

At this time, the communication unit 210 internally manages a plurality of client devices 100 that need to synchronize and transmit data, and can wait until all of the client devices 100 are connected.

The video packet transmission and reception step (S320) is a step of transmitting and receiving video data collected by the client device 100 through the communication channel created in S310.

In the case of the first video packet communication, communication with the client device 100 is attempted in the order of communication priorities set within the server 200.

The communication unit 210 receives video data collected by the client device 100 while transmitting and receiving video packets including START PACKET, LENGTH PACKET, CHECK PACKET, and DATA PACKAET with the client device 100.

In step S320, at least one video packet (VIDEO PACKET) can be transmitted and received, and if there are no more video packets to transmit, the information packet (INFO PACKET) transmitting and receiving step (S330) is performed.

The INFO PACKET transmission and reception step (S330) is a step of transmitting and receiving sensing data collected by the client device 100 or object/object information within the video frame through the communication channel created in S310.

The communication unit 210 transmits and receives information packets (INFO PACKET) including START PACKET, LENGTH PACKET, CHECK PACKET, and DATA PACKAET with the client device 100, and receives sensing data collected by the client device 100 or Receives object/object information within the video frame.

In step S330, at least one information packet (INFO PACKET) can be transmitted and received, and if there are no more information packets (INFO PACKET) to be transmitted, the communication priority packet (CP PACKET) transmission and reception step (S340) is performed.

The communication priority packet (CP PACKET) transmission and reception step (S340) is a step of transmitting and receiving communication status data of the client device 100 through the communication channel created in S310.

The communication weight measurement factor includes the client communication priority set in the client device 100 and the total number of packets transmitted and received by the client device 100.

The communication unit 210 transmits and receives communication priority packets (CP PACKETs) including START PACKET, LENGTH PACKET, CHECK PACKET, and DATA PACKAET with the client device 100, and receives communication status data of the client device 100. .

When transmission and reception of a communication priority packet (CP PACKET) is completed, one communication cycle is completed, and a communication priority update step (S350) is performed.

In the communication priority updating step (S350), the communication priority of the client device 100 is updated by calculating the communication weight of the client device 100.

The synchronization control unit 220 transmits and receives data to and from the client device 100 in that order by applying the updated communication priority.

Meanwhile, the method for synchronizing multiple images and data may further include a data processing step (S360).

The synchronization control unit 220 may transmit video data and sensing data received in synchronization from a plurality of client devices 100 or object/object information within the video frame to the data processing unit 250.

The data processing step (S360) involves data preprocessing/analysis, machine learning model learning, and Performs data processing such as prediction/judgment using artificial intelligence (AI).

Figure 6 is a flowchart showing the detailed flow of packets within one communication cycle in the synchronized transmission and reception method between multiple images and data according to an embodiment of the present invention.

Referring to FIG. 6, transmission and reception of packets for synchronized transmission and reception between multiple images and data between the client device 100 and the server 200 will be described.

When the client device 100 and the server 200 are connected and a communication channel is created, a video packet (VIDEO PACKET) transmission and reception step is performed as follows.

The server 200 transmits the START PACKET including the packet ID, main packet type (VIDEO PACKET), and data source ID to the client device 100 (S410). At this time, the data source ID may be a combination of the client device 100 number that can identify video data + 'VIDEO' + the first camera identification number, and is mutually defined and shared between the server 200 and the client device 100. It is an ID (identifier).

After receiving the START PACKET, the client device 100 checks the data source ID and then includes the packet ID, type of main packet (VIDEO PACKET), and size of video data corresponding to the data source ID in the LENGTH PACKET to the server 200. Transmit to (S420).

The server 200 checks the data size of the received LENGTH PACKET and, if reception is possible, transmits the CHECK PACKET including a flag indicating reception capability to the client device 100 (S430).

The client device 100 checks the flag included in the CHECK PACKET, and if the server 200 is capable of receiving data, it transmits video data corresponding to the data source ID as much as the data size previously transmitted through the LENGTH PACKET. (S440).

If there is video data to transmit, S410 to S440 are repeated, and if there is no more video data to transmit, an INFO PACKET is prepared to be transmitted.

The INFO PACKET transmission step is performed as follows.

The server 200 transmits the START PACKET including the packet ID, main packet type (INFO PACKET), and data source ID to the client device 100 (S510). At this time, the data source ID may be a combination of the client device 100 number that can identify sensing data + 'INFODATA' + the first sensor identification number, and the server 200 and the client device 100 It is an ID (identifier) that is mutually defined and shared between people.

After receiving the START PACKET, the client device 100 checks the data source ID and then includes the packet ID, the type of main packet (INFO PACKET), and the size of the sensing data corresponding to the data source ID in the LENGTH PACKET to the server. Send to (200) (S520).

The server 200 checks the data size of the received LENGTH PACKET and, if reception is possible, transmits the CHECK PACKET including a flag indicating reception capability to the client device 100 (S530).

The client device 100 checks the flag included in the CHECK PACKET, and if the server 200 is capable of receiving data, the size of the data previously transmitted through the LENGTH PACKET is the sensing data corresponding to the data source ID. Transmit as much (S540).

If there is video data to transmit, S510 to S540 are repeated, and if there is no more sensing data to transmit, a communication priority packet (CP PACKET) is prepared to be transmitted.

The communication priority packet (CP PACKET) transmission step is performed as follows.

The server 200 transmits the START PACKET including the packet ID, main packet type (CP PACKET), and data source ID to the client device 100 (S610). At this time, the data source ID may be a client ID that identifies the client device 100, and is an ID (identifier) mutually defined and shared between the server 200 and the client device 100.

After receiving the START PACKET, the client device 100 checks the data source ID and includes the packet ID, main packet type (CP PACKET), and size of communication status data corresponding to the data source ID in the LENGTH PACKET to the server (200). ) (S620).

The server 200 checks the data size of the received LENGTH PACKET and, if reception is possible, transmits the CHECK PACKET including a flag indicating reception capability to the client device 100 (S630).

The client device 100 checks the flag included in the CHECK PACKET, and if the server 200 is capable of receiving data, it transmits communication status data corresponding to the data source ID as much as the data size previously transmitted through the LENGTH PACKET. Do it (S640).

At this time, the communication status data includes the client communication priority set in the client device 100 and the total number of packets transmitted and received by the client device 100.

When the communication priority packet (CP PACKET) transmission step is completed, one communication cycle is completed, and steps from S410 to S640 are sequentially repeated.

In the above, the configuration and features of the present invention have been described based on the embodiments according to the present invention, but the present invention is not limited thereto, and various changes or modifications may be made within the spirit and scope of the present invention. It is obvious to those skilled in the art, and therefore, it is stated that such changes or modifications fall within the scope of the appended patent claims.

100: Client device
200: server
210: Department of Communications
220: Synchronization control unit
230: Communication weight calculation unit
240: Client information management department
250: data processing unit
S310: Communication connection step
S320: Video packet transmission and reception step
S330: Information packet transmission and reception step
S340: Communication priority packet transmission and reception phase
S350: Communication priority update step
S360: Data processing steps

Claims (10)

a communication unit that receives data including at least one of video data, sensing data, and communication status data from a client device; and
A synchronization control unit that synchronizes and receives the video data and the sensing data transmitted by a plurality of the client devices, comprising:
Synchronized transmission and reception system between multiple images and data.
In claim 1,
The client device and the communication unit communicate using a defined communication standard based on the TCP/IP protocol, and the defined communication standard includes at least one of a video packet, an information packet, and a communication priority packet. containing,
Synchronized transmission and reception system between multiple images and data.
In claim 2,
The video data is,
Image data collected by the client device through a camera and transmitted in a video packet,
Synchronized transmission and reception system between multiple images and data.
In claim 2,
The sensing data is,
Data collected by the client device through a sensor and transmitted in an information packet,
Synchronized transmission and reception system between multiple images and data.
In claim 2,
The communication status data is,
Contains at least one of the client communication priority set in the client device and the total number of packets transmitted and received by the client device, and is transmitted in a communication priority packet (Packet),
Synchronized transmission and reception system between multiple images and data.
In claim 2,
The video packet, the information packet and the communication priority packet are:
START PACKET, which indicates the start of a packet to be transmitted and includes a packet ID that identifies the packet;
A DATA PACKET containing at least one of the video data, the information data, and the communication status data;
LENGTH PACKET including the size of the DATA PACKET; and
Containing CHECK PACKET to check whether the DATA PACKET is in a state to be received,
Synchronized transmission and reception system between multiple images and data.
In claim 2,
Communication between the client device and the communication unit includes at least one communication cycle,
The communication cycle includes transmitting and receiving at least one video packet, at least one information packet, and at least one communication priority packet,
Synchronized transmission and reception system between multiple images and data.
In claim 7,
The synchronization transmission and reception system is,
Further comprising a communication weight calculation unit that calculates a communication weight using one cycle completion time, which is the time taken to perform the communication cycle, a communication priority of the client device, and the total number of packets transmitted and received during the communication cycle,
Synchronized transmission and reception system between multiple images and data.
In claim 8,
The synchronization control unit,
At the end of the communication cycle, applying the communication weight to update the communication priority of the client device and controlling the communication flow according to the communication priority,
Synchronized transmission and reception system between multiple images and data.
In the synchronization method between multiple images and data implemented by the multiple image and data transmission/reception synchronization system described in claim 1,
A communication connection step of connecting a communication channel between a client device and a communication unit;
Transmitting and receiving video packets on the communication channel;
Transmitting and receiving information packets in the communication channel;
Transmitting and receiving a communication priority packet in the communication channel; and
Comprising: a step of a communication weight calculation unit calculating a communication weight of the client device and updating the communication priority of the client device;
Synchronized transmission and reception method between multiple images and data.