KR101877927B1 - A packet structure for synchronizing video and sensor data, a packet wireless transmission apparatus and a packet wireless receiving apparatus - Google Patents

Abstract

The present invention relates to a technology which synchronizes data received from various sensors used in a camera image and a field so as to wirelessly transmit the data and to receive information of the data in a receiver, thereby realizing an environment of a transmitter in a receiving terminal as well as simply connecting to a server to use.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a packet structure, a packet radio transmission apparatus, and a packet radio receiving apparatus,

The present invention synchronizes camera images and data input from various sensors used in the field and wirelessly transmits them, and the information is received at a receiver to reproduce the environment of a transmitter at a receiver, and at the same time, It is a technology that makes it available.

The configuration of the data packet and the corresponding sensor data packet in the sensor data network such as a general industrial IoT or smart factory are shown in Fig. In addition, a configuration diagram of a packet used in general video data transmission is shown in FIG.

First, referring to FIG. 1 (a), details of each field of a data packet format used in conventional sensor data communication are as follows.

STX: Start of frame (1 byte), field indicating start

TGT-ID: Target ID (1 byte), destination address

SRC-ID: Source ID (1 byte), destination address

LEN: length of the data to be transmitted

CMD: Command, data type, control or confirmation

DATA: Data to be transmitted

BCC: Error bit

ETX: End of frame, field indicating the end of communication packet

Referring to FIG. 1 (b), when a temperature sensor measures 25.3 degrees Celsius (sensor data) and constructs a data packet to transmit the result, a total of 11 bytes is required to transmit 25.3 degrees Celsius (sensor data). Referring to FIG. 1 (c), when a humidity sensor measures 67.8% (sensor data) and constructs a data packet to transmit the result, a total of 11 bytes is required to transmit 67.8% (sensor data). Referring to FIG. 1 (d), when a door sensor is measured by a door sensor and a data packet is configured to transmit the door open status data, a total of 8 bytes is required to transmit the door open status data Do. As described above, there is no information necessary for synchronization in the data packet format which is frequently used in the conventional sensor data communication.

On the other hand, in the case of transmitting only an image, details of each field of the data packet format as shown in FIG. 2 are as follows.

STX: Start of frame (1 byte), field indicating start

VID: Manufacturer ID

PID: Product ID

VIDEO DATA: Compressed image data

BCC: Error bit

ETX: End of frame, field indicating the end of communication packet

System construction such as IoT, Smart Factory, Smart City, Smart Farm, and Industrial IoT (Conventional IoT) can be accomplished by using various sensors and various data received from them by wire And then the user can control and confirm the user remotely via the Internet or other wireless network through a terminal such as a PC or a smart phone. Such a configuration has the following problems.

1. Configuration is difficult or impossible in situations where the distance between the sensor and the server is too long or the line can not be connected. In addition, if the installation configuration is changed even if it is already installed, it is difficult to reinstall or the reinstallation is expensive.

2. When a wireless such as Wi-Fi is used, if a similar frequency is present around a single frequency, frequent communication errors may occur due to interference and crosstalk, and the transmission distance is shortened due to such a problem.

3. Conventional methods include, for example, various sensor data such as remote gas valve control by gas sensor interlock, valve status check, temperature and humidity alarm by humidity sensor interlock, smoke alarm by fire sensor interlocking It may cause a loss due to sensor malfunction. For example, in the case of steel mills, fire engine malfunctions often caused fire trucks to move. In addition, when the fire sensor detects an emergency situation (alarm alarm) and there is no image data synchronized with the sensor data at the time of attempting to establish measures such as the cause identification and prevention of the recurrence, the situation is insufficient. In addition to the sensor data, the image data in the actual situation is also required. That is, image data synchronized with the sensor data is required.

4. In digital communication, the structure of data packets transmitted and received at once is very important. Such a packet structure greatly affects the communication speed and reliability. Real-time information transmission is important in fields such as Smart Factory and Industrial IoT. However, if the transmission packet structure is erroneous, a real-time transmission due to retransmission may not be performed in case of an error, which may result in a fatal loss due to a missed time. Particularly, it is necessary to include several sensor data in a digital packet such as one image data while synchronizing the image with various sensor data. In this case, when the image and each sensor data are separately transmitted, there is a problem in that it is not synchronized but the transmission time is long and real-time transmission is not possible.

Published Japanese Patent Application No. 10-2013-0085479 (Publication date 2013.07.30)

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and it is an object of the present invention to provide a packet structure in which video and data are synchronized with each other to satisfy user's various needs (needs) And a packet radio receiving apparatus.

Further, the present invention avoids surrounding interference and confusion, can transmit wireless data packets farther than conventional methods, can guarantee high reliability and hacking from the outside, and can be applied and operated in an industrial field more conveniently and quickly A packet radio transmission apparatus, and a packet radio reception apparatus.

In order to achieve the above object, a packet structure in which video and data are synchronized according to the present invention includes a time information field including synchronization information for one frame of an image, an information field indicating a sequence of consecutive moving images, A field in which compressed image data is stored, a data field in which sensor data is stored, a frequency hopping control field, and an error bit field.

Also, a packet radio transmission apparatus according to the present invention includes: a radio communication unit; A storage unit for storing information necessary for communication; A compressed image and sensor data are received from each sensor, a time stamp is generated to synchronize with the image, a packet synchronized with the image and each sensor data is generated, and the generated packet is transmitted through the wireless communication unit A synchronization packet processing unit for transmitting the synchronization data packet to the packet radio receiving apparatus; And a communication frequency processor for determining the reception sensitivity of the packet radio receiving apparatus for each synchronization data packet to determine whether to continue to use the currently used frequency, and changing the used frequency according to a result of the determination.

Further, a packet radio receiving apparatus according to the present invention includes: a radio communication unit; A storage unit for storing information necessary for communication; A decompression processing unit for decompressing the image data included in the synchronization data packet transmitted from the packet radio transmission apparatus; Decompresses the compressed video data and converts it into an analog signal and stores information (F / N) and a time stamp (SN) including information (SN) indicating the order of consecutive moving images included in the synchronization data packet, A playback processor for synchronizing and reproducing the sensor data and the video data using the video data; And a communication frequency setting unit for determining a reception sensitivity of the packet radio receiving apparatus for each synchronization data packet to determine whether to continue using the currently used frequency and setting a communication frequency according to a result of the determination.

According to another aspect of the present invention, there is provided a packet radio transmission method comprising: converting a compressed image into digital data; Generating and recording a time stamp for receiving sensor data from each sensor and synchronizing with the image data; Increasing a time stamp, generating and transmitting a synchronization data packet including the image data and the sensor data; Receiving a response packet associated with reception sensitivity for the synchronization data packet from a packet radio reception device; Analyzing the response packet to determine whether the currently used frequency can be continuously used; And if it is determined that the currently used frequency can not be continuously used, deleting the currently used frequency from the frequency channel table and changing to the next available frequency.

According to another aspect of the present invention, there is provided a packet radio reception method comprising: decompressing image data included in a synchronization data packet transmitted from a packet radio transmission apparatus; Decompressing and decompressing the analog signal; Synchronizing the sensor data with the image data using the information (SN) indicating the order of the continuous moving images included in the synchronization data packet, the information (F / N) including the frame order of the image, and the time stamp ;

Determining reception sensitivity for the synchronization data packet; If it is determined that the error rate of the BCC is equal to or greater than the threshold value, it is determined that the currently used frequency is an interference or crosstalk, and a response packet including the currently used frequency use prohibition content is deleted from the frequency channel table Transmitting; And deleting the current used frequency from the frequency channel table and changing to the next available frequency.

According to the above description, the following effects are obtained.

First, when a video data and a sensor data are synchronized with each other and wirelessly transmitted from a transmitting device, the situation at that time can be reproduced when a sensor data error occurs, that is, when an alarm occurs, when a video data is recorded from a receiving device to a recording device.

Second, by adopting wireless in industrial IoT (Industrial IoT) system using existing wired and simple sensors, it is easy to install even when layout of transmitter and receiver is changed, and furthermore, it meets simple and various field requirements You can.

Third, there is an advantage of solving the obstacle of real time transmission by synchronizing multiple sensor data with one image data.

Fourth, it is possible to transmit wireless data packets far away from existing methods by avoiding interference and confusion around, and it is possible to guarantee high reliability and to prevent hacking from outside, and to apply and operate in industrial field more conveniently and quickly.

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is an illustration of a data packet structure in a sensor data network such as a general industrial IoT or smart factory and the resulting sensor data packet.
2 is a block diagram of a packet used in general video data transmission.
3 is an exemplary diagram illustrating a packet structure in which video and data are synchronized according to the present invention.
4 is a diagram for explaining a packet configuration method for synchronizing image data and sensor data according to the present invention.
5 is a packet structure for a frame configuration and a hopping control for selective hopping for the configuration of multiple sensor data packets used in the present invention.
6 is a configuration diagram of a packet radio transmission apparatus and a packet radio reception apparatus according to the present invention.
7 shows a packet radio transmission method according to the present invention.
8 shows a packet radio reception method according to the present invention.

In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.

In addition, the arrangement and order of each configuration shown in the drawings are arbitrarily shown for convenience of explanation, and the present invention is not necessarily limited to those shown in the drawings.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the present embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout.

FIG. 3 is an exemplary diagram illustrating a packet structure in which an image and data are synchronized according to the present invention, and FIG. 4 is an exemplary diagram illustrating a packet configuration method for synchronizing image data and sensor data according to the present invention.

The packet structure in which the image and data according to the present invention are synchronized generates a time stamp corresponding to each packet as shown in FIG. 3, and includes the image data and the sensor data in the same packet frame. In addition, the packet structure in which the image and the data are synchronized according to the present invention can construct an economical packet by including a plurality of sensor data at the same time in the same packet frame. For example, referring to FIG. 4, at time 1 of a time stamp, an image and each sensor data are synchronized to form one packet.

5 is a packet structure for a frame configuration and a hopping control for selective hopping for the configuration of multiple sensor data packets used in the present invention. Frequency hopping is a technique that communicates by changing the current frequency used for data communication in the transmitter and receiver in a wireless network, according to a certain function.

Referring to FIG. 5, the details of each field of the packet format are as follows.

STX: Start of frame (1 byte), field indicating start

VID: Manufacturer ID

PID: Product ID

TIME STAMP: Time information (4 bytes) including synchronization information for one video frame

SN: Information indicating sequence of consecutive videos

F / N: information including the frame order of the image

VIDEO DATA: Compressed image data

SENSOR DATA: Data to be transmitted

HOPPING CONTROL: Frequency hopping control

BCC: Error bit

ETX: End of frame, field indicating the end of communication packet

The amount of data that can be sent at one time to synchronize the sensor data with the image data and the various input and output forms in the wireless communication system affects the overall communication time when the retransmission occurs due to the error occurrence in the packet communication. Particularly, this is a problem in real time transmission. When the image data and the sensor data are combined, the amount of the sensor data is flexibly adjusted without using the fixed method, thereby contributing to optimizing the amount of the transmission packet. In other words, in wireless digital data communication, ID and CRC data in addition to the actual data to be sent and received, hopping frequency, hopping time and other various data such as hopping time occupy packets, so that image compression and efficient operation of sensor data are important Do.

6 is a configuration diagram of a packet radio transmission apparatus and a packet radio reception apparatus according to the present invention.

The packet radio transmission apparatus 610 synchronizes the data input from the camera and the sensors and transmits the data to the packet radio reception apparatus 620. The camera may be implemented as an HD camera, an IP camera, or an analog camera connected by a coaxial cable. Sensors can be used in various applications such as weather-related sensors, smoke detection sensors, flame detection sensors, temperature measurement sensors, humidity measurement sensors, CO2 measurement sensors, illuminance measurement sensors . ≪ / RTI >

6, the packet radio transmission apparatus 610 includes a first communication unit 611, a storage unit 612, a compression processing unit 613, a synchronization packet processing unit 614, and a communication frequency processing unit 615 .

The first communication unit 611 includes a LoRa communication module for performing wireless communication with the packet radio receiving apparatus 620 through a wireless repeater, Bluetooth, Zigbee, IrDA, Wi-Fi communication module.

The storage 612 may be embodied in a computer-readable medium of a type configured to store such data as computer-program material embodiments, including executable computer code, human-readable code, and the like. Other types of computer-readable media include floppy disks, removable hard disks, optical storage media such as CD-ROMs, DVDs, barcodes, semiconductor memories such as flash memories, read- Dedicated memories (ROMs), battery-backed volatile memories, networked storage devices, and the like. The storage unit 170 stores information (time stamp, packet counter, frequency channel table) necessary for communication.

The compression processing unit 613 compresses the image data transferred from the camera and converts the compressed image data into digital data. The synchronization packet processing unit 614 receives the compressed image and the sensor data from each sensor, generates a time stamp to synchronize with the image, generates a packet in which the image and each sensor data are synchronized, And transmits the generated packet to the packet radio receiving apparatus 620 through the first communication unit 611. [

The communication frequency processor 615 operates the multi-frequency channel and checks the receiving sensitivity of the receiving device 620 for each synchronization data packet to determine whether to continue to use the currently used frequency, thereby preventing interference and crosstalk due to wireless communication. The communication frequency processing unit 615 may, for example, send a synchronization data packet to the receiving device 620 and may receive a response packet for the synchronization data packet from the receiving device 620, continue to use the current frequency of use, And receives information on whether or not to change it. Upon receiving the response packet, the communication frequency processing unit 615 deletes the currently used frequency channel from the frequency channel table according to the contents of the response packet, and changes the frequency to the next available frequency.

The packet radio receiving apparatus 620 receives the information input from the packet radio transmitting apparatus 610 and reproduces the environment of the transmitting apparatus 610 and simultaneously connects the apparatus to a device such as a server, a DVR, an NVR To be used. The packet radio receiving apparatus 620 includes a second communication section 621, a storage section 622, a decompression processing section 623, a reproduction processing section 624, and a communication frequency setting section 625 as shown in Fig. 6 May be implemented.

The second communication unit 621 may be a LoRa communication module that performs wireless communication with the packet radio receiving apparatus 620 through a wireless repeater, a Bluetooth, a Zigbee, an infrared communication (IrDA) Wi-Fi communication module.

The storage 622 may be embodied in a computer-readable medium of a type configured to store such data as computer-program material embodiments, including executable computer code, human-readable code, and the like. Other types of computer-readable media include floppy disks, removable hard disks, optical storage media such as CD-ROMs, DVDs, barcodes, semiconductor memories such as flash memories, read- Dedicated memories (ROMs), battery-backed volatile memories, networked storage devices, and the like. The storage unit 622 stores information (time stamp, packet counter, frequency channel table, etc.) necessary for communication.

The decompression processing unit 623 decompresses the video data included in the synchronization data packet transmitted from the transmission apparatus 610. [ The reproduction processing unit 624 decompresses the analog signal and converts it into an analog signal, and reproduces the digital signal so that the user can check the image with a device such as a monitor. The reproduction processing unit 624 reproduces the image (S / N) using information (SN) indicating the order of consecutive moving images contained in the synchronization data packet transmitted from the transmission apparatus 610 and information (F / N) Lt; / RTI > The reproduction processing unit 624 synchronizes the sensor data and the image data by using a time stamp included in the synchronization data packet.

The communication frequency setting unit 625 analyzes the synchronization data packet transmitted from the transmission device 610 and determines that interference or cross talk has occurred when the reception sensitivity is degraded, that is, when the error rate of the BCC is equal to or greater than the threshold, Deletes the used frequency from the frequency channel table, and transmits a response packet including the currently used frequency use prohibition content to the transmitting device 610. [ The communication frequency setting unit 625 transmits a response packet to the transmitting apparatus 610, which includes a message indicating that the error frequency of the BCC is below the threshold, so that the currently used frequency can be continuously used.

FIG. 7 shows a packet radio transmission method according to the present invention, and FIG. 8 shows a packet radio reception method according to the present invention.

First, referring to FIG. 7, a wireless packet transmission method according to the present invention compresses image data input from a camera in a state in which information necessary for communication (time stamp, packet counter, etc.) is initialized S711). Thereafter, the compressed image is converted into digital data (S712). Then, sensor data is input from each sensor (S713), and a time stamp is generated and recorded in order to synchronize with the image data (S714). Thereafter, the time stamp is increased (S715), and the synchronization data packet is transmitted (S716).

In the packet radio transmission method according to the present invention, the reception sensitivity of the reception apparatus 620 is checked for each packet to determine whether to continue to use the currently used frequency. In the packet radio transmission method according to the present invention, upon receiving a response packet related to the reception sensitivity with respect to the synchronization data packet from the reception device 620 (S717), it analyzes the response packet to determine whether the currently used frequency can be continuously used S718).

If it is determined in step S718 that the currently used frequency is still available, it is determined in step S719 whether the packet transmitted in step S716 is the last packet. As a result of the determination in step S719, in the case of the last packet, information necessary for communication (time stamp, packet counter, etc.) is initialized (S720). If it is determined in step S719 that the packet is not the last packet, step S711 is repeated.

On the other hand, if it is determined in step S718 that the currently used frequency can not be used continuously, for example, if interference and cross talk occur due to a device using a frequency similar or equal to the current frequency of use, It is determined whether it is the last frequency channel included (S721). As a result of the determination in step S721, if it is the last frequency channel, a time stamp, a packet counter, and an error bit (BCC) are initialized (S722).

If it is determined in step S721 that the frequency channel is not the last frequency channel, the current frequency is deleted from the frequency channel table (step S723) and the frequency channel table is changed (updated) (step S724). Thereafter, the transmitting apparatus changes the frequency to be used next (S725).

Referring to FIG. 8, a packet radio reception method according to the present invention will be described. In a state in which information (time stamp, packet counter, etc.) necessary for communication is initialized, (S811), and decompresses the video data included in the synchronization data packet transmitted from the transmission device 610 (S812). After that, the receiving device decompresses the analog signal and converts the analog signal into an analog signal, and reproduces the analog signal so that the user can check the image with a device such as a monitor (S813). For example, the receiving apparatus receives the information (SN) indicating the order of consecutive moving images included in the synchronization data packet transmitted from the transmitting apparatus 610 and the information (F / N) And synchronizes the sensor data with the image data using a time stamp included in the synchronization data packet (S814).

The receiving apparatus generates and records a time stamp to synchronize the image data and the sensor data (S815). Thereafter, the time stamp is increased (S816). The receiving apparatus checks the BCC (error bit) field included in the synchronization data packet to calculate the error rate of the BCC (S817), and determines whether the reception sensitivity is low or the error rate of the BCC is equal to or greater than the threshold (S818).

If it is determined in step S818 that the reception sensitivity is good, that is, if the error rate of the BCC is less than or equal to the threshold value, a response packet including a content indicating that the currently used frequency can be continuously used is transmitted to the transmitting apparatus. In step S811, It is determined whether it is the last packet (S819). As a result of the determination in step S819, in the case of the last packet, information necessary for communication (time stamp, packet counter, etc.) is initialized (S820). If it is determined in step S819 that the packet is not the last packet, step S811 is repeated.

On the other hand, if it is determined in step S818 that the reception sensitivity is low, that is, if the error rate of the BCC is equal to or greater than the threshold value, it is determined that the currently used frequency is an interference or crosstalk. (S821), and changes (updates) the frequency channel table (S822). Thereafter, the receiving apparatus changes to the frequency to be used next (S823).

The present invention can be widely applied as core technology in fields such as industrial internet (IoT), smart factory, smart farm, and smart city. For example, if there is a suitable sensor in the field such as fire detection, temperature, humidity, dust sensor in the field, if there is only sensor data as in the conventional method, if the sensor is operated by a malfunction of the fire sensor, And dispatch may occur. However, the present invention can prevent such a loss if a final determination is made after confirming a scene image.

Recently, IoT-based technologies and products that are applied to various industrial fields are being developed, installed and required. Accordingly, when the existing companies develop new products for their own customers, applying the base product according to the present invention can meet various consumer demands within a short time and provide advanced services one step at a time.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention as defined by the appended claims. Accordingly, the true scope of the present invention should be determined only by the appended claims.

Claims (7)

delete A wireless communication unit;
A storage unit for storing information necessary for communication;
A compressed image and sensor data are received from each sensor, a time stamp is generated to synchronize with the image, a packet synchronized with the image and each sensor data is generated, and the generated packet is transmitted through the wireless communication unit A synchronization packet processing unit for transmitting the synchronization data packet to the packet radio receiving apparatus;
A communication frequency processing unit for operating a multi-frequency channel and checking reception sensitivity of the packet radio receiving apparatus for each synchronization data packet to determine whether to use the currently used frequency continuously, and changing the used frequency according to the result;
And a packet radio transmitter. The method of claim 2,
Wherein the communication frequency processing unit comprises:
Receive the response packet associated with the reception sensitivity for the synchronization data packet from the packet radio reception device, transmit the synchronization data packet to the packet radio reception device,
If the content included in the response packet is prohibited from the currently used frequency, deletes the currently used frequency channel from the frequency channel table,
Packet radio transmission apparatus. A wireless communication unit;
A storage unit for storing information necessary for communication;
A decompression processing unit for decompressing the image data included in the synchronization data packet transmitted from the packet radio transmission apparatus;
Decompresses the compressed video data and converts it into an analog signal and stores information (F / N) and a time stamp (SN) including information (SN) indicating the order of consecutive moving images included in the synchronization data packet, A playback processor for synchronizing and reproducing the sensor data and the video data using the video data;
A communication frequency setting unit for operating a multi-frequency channel and determining whether to use the currently used frequency by checking the reception sensitivity of the packet radio receiving apparatus for each synchronization data packet, and setting a communication frequency according to the result;
And transmitting the packet to the base station. The method of claim 4,
Wherein the communication frequency setting unit comprises:
If the error rate of the synchronization data packet is equal to or greater than the threshold value, it is determined that the currently used frequency is interference or crosstalk, and a response packet including the current use frequency use prohibition content is deleted from the frequency channel table Transmitting,
Packet radio receiving apparatus. Converting the compressed image into digital data;
Generating and recording a time stamp for receiving sensor data from each sensor and synchronizing with the image data;
Increasing a time stamp, generating and transmitting a synchronization data packet including the image data and the sensor data;
Receiving a response packet associated with reception sensitivity for the synchronization data packet from a packet radio reception device;
Analyzing the response packet to determine whether the currently used frequency can be continuously used; And
If it is determined that the currently used frequency can not be continuously used, deleting the currently used frequency from the frequency channel table and changing to the next frequency to be used;
Gt; Decompressing the image data included in the synchronization data packet transmitted from the packet radio transmission apparatus;
Decompressing and decompressing the analog signal;
Synchronizing the sensor data with the image data using the information (SN) indicating the order of the continuous moving images included in the synchronization data packet, the information (F / N) including the frame order of the image, and the time stamp ;
Determining reception sensitivity for the synchronization data packet;
If it is determined that the error rate of the BCC is equal to or greater than the threshold value, it is determined that the currently used frequency is an interference or crosstalk, and a response packet including the currently used frequency use prohibition content is deleted from the frequency channel table Transmitting; And
Deleting the currently used frequency from the frequency channel table and changing to the next available frequency;
And transmitting the packet.

Images