KR102426910B1 - Apparatus for 5G IoT device employing accident management vehicle - Google Patents

Abstract

An embodiment relates to a 5G-based IoT device for mounting an accident management vehicle. Specifically, the IoT device comprises a 5G device-based video system technology for two-way responds between a control center and a command vehicle to allow the control (command) center to identify and respond to a situation in real time in case of a disaster or catastrophic accident on a bridge or large bridge. Additionally, the IoT device comprises a deep learning-based video magnification technology for centralized control and an IP speaker control technology for establishing a response system for each section. Therefore, the embodiment provides a support technology that can prevent secondary collisions and minimize damage through recognition of a traffic accident and rapid judgment and response according to a type of the accident. In addition, in case of a collision accident, video support is available such that the control center can check the collision accident and cooperate with related organizations (fire department, police station, etc.). Additionally, accurate transfer of a situation and response to the collision are possible through the 5G new technology-based video sharing for an existing accident handling communication system between an accident management vehicle and the control center, such as walkie-talkies and wired/wireless phones. Furthermore, IP speakers are installed for each road facility section and support selective evacuation/announcement such as detour guidance by distance centering on an accident point, forward accident guidance, and warning announcement, to provide convenience and smooth measures.

Description

5G-based IoT device device for mounting accident management vehicle {Apparatus for 5G IoT device employing accident management vehicle}

The content disclosed in this specification relates to an IoT device for a vehicle, and more specifically, when operating a vehicle, by collecting images of the accident scene around the vehicle and providing it in connection with the control center, so that people around can be evacuated smoothly will do

Unless otherwise indicated herein, the material described in this section is not prior art to the claims of this application, and inclusion in this section is not an admission that it is prior art.

In general, in the case of the recent increase in urban infrastructure and multi-use facility disasters, it is difficult to rescue survivors due to risk detection and propagation delay, evacuation/response, etc., leading to large-scale damage.

Therefore, we develop technologies to reduce disasters and safety accidents in order to improve the efficiency of disaster prevention/preparation/response/recovery work.

And, for this purpose, various technologies such as CCTV image-based crime prevention and real-time traffic accident monitoring/response system construction have been developed as the level of demand for safety advancement for real-time response such as prevention, detection, and response from disasters/disasters is increasing. appeared.

However, the existing control system for road facilities has limitations in intensive monitoring of the accident site because it is impossible to enlarge or reduce the image in a general matrix method. In addition, the image can be checked on a large monitor, but there is also the fatigue of the control due to the resolution problem when the image is enlarged with a low-quality CCTV image.

In addition, due to the video export problem in the control center, the accident response until now has been handled through walkie-talkies and wired/wireless calls. Due to this, there are problems such as accident point search and the inability to accurately convey the situation, and even if a speaker is not installed or is installed, consistent broadcasting is transmitted.

The prior art literature in this background is the extent to which the following patent documents appear.

(Patent Document 1) KR101923494 Y1

For reference, the technology of Patent Document 1 relates to a disaster response system for a mobile vehicle using a directional speaker, and may be to the extent that a directional speaker is installed in a mobile vehicle to broadcast a disaster to enable evacuation.

The disclosed contents apply the concept of a wall system in the existing control system to enlarge/reduce analog/digital input images to 1:1, 1:N, N:N to check one image on multiple monitors and , and also applied the deep learning image magnification algorithm of the super-resolution concept to solve the resolution degradation problem caused by image magnification. In addition, it is intended to provide a 5G-based IoT device device mounted on an accident management vehicle that converts the image and transmits it to the management vehicle so that the accident management can be carried out effectively.

In addition, it is equipped with a 5G transmission/reception module to transmit video/text from the field to the control center in real time, or to receive video/text from the control center in real time and check it through the dashboard installed in the driver's seat.

In addition, IP speakers are installed in each area (approximately 500m expected) on bridges and bridges, and different evacuation/information broadcasts are transmitted by distance centered on the accident point. Allows communication and power input with only the IP line.

5G-based IoT device device for mounting an accident management vehicle according to an embodiment,

In the event of a disaster or disaster on a bridge or a bridge, it relates to a video system technology for a two-way response between a 5G device-based control center/commanding vehicle so that the control (command) center can understand and respond to the situation in real time. And, in addition to this in this case, it is characterized in that it includes a deep learning-based image magnification technology for centralized control and an IP speaker control technology for establishing a response system for each section.

According to the embodiments, it provides support technology that can prevent a secondary collision accident and minimize damage through recognition of a traffic accident and rapid judgment and response according to the accident type.

And, in the event of a collision, video support is possible so that the control center can confirm this and cooperate with related organizations (fire department, police department, etc.).

In addition, it is possible to accurately communicate the situation and cope with collision accidents through video sharing based on 5G new technology through the accident management communication system such as walkie-talkies and wired and wireless telephones between the existing accident management vehicle and the control center.

In addition, it is installed for each road facility section through an IP speaker and provides convenience and smooth measures through selective evacuation/information support such as detour road guidance by distance centered on the accident point, forward accident guidance, and warning broadcast guidance.

1 is a diagram for conceptually explaining a 5G-based IoT device device for mounting an accident management vehicle according to an embodiment;
2 is a view showing the overall system to which a 5G-based IoT device device for mounting an accident management vehicle according to an embodiment is applied;
3 is a block diagram showing the configuration of a 5G-based IoT device for mounting an accident management vehicle according to an embodiment;
4 is a flowchart sequentially illustrating the operation of a 5G-based IoT device for mounting an accident management vehicle according to an embodiment;
5 is a diagram for explaining a format for IoT control applied to a 5G-based IoT device device for mounting an accident management vehicle according to an embodiment;

1 is a diagram for conceptually explaining a 5G-based IoT device for mounting an accident management vehicle according to an embodiment.

As shown in Figure 1, the IoT device of an embodiment is a 5G device-based type so that when a disaster or disaster occurs on a bridge or a bridge, the control (command) center can grasp the situation in real time and respond to the situation. It is a two-way response video system technology between the control center and command vehicle. And, in addition to this, the IoT device includes a deep learning-based image magnification technology for centralized control and an IP speaker control technology for establishing a response system for each section.

So, through this, through the development of coping technologies for collision accidents on bridges and bridges, the establishment of a rapid response system for disaster and disaster accident management, the reinforcement of the accident response expertise and efficiency of the control (command) center and command vehicle, and accident management/recovery improve crisis management skills.

Specifically, these IoT device devices include a CCTV camera for accident scene video collection and an accident alarm (directional) IP speaker installed outside the vehicle, and an IoT device for control, a 5G video/text transmission/reception module, and a dash for driver confirmation in the vehicle. Includes board (monitor).

And, in this case, the CCTV camera is installed on the exterior of the vehicle to collect images of the accident scene.

In addition, the control IoT device device embeds a window-based IoT device control SW. In addition, it is equipped with 5G-based video/text transmission/reception and communication status monitoring functions. Then, the collected data storage DB is configured and video data can be streamed in real time. In addition, the IoT device for control has a user-defined data format and file format, and a user interface UI/UX. In addition, it includes a function to check the collected images of CCTV cameras. In addition, it has a control center video/text check and output function and a control center video/text check function. So, through this, the IP speaker-related accident information/evacuation broadcast transmission function is performed. And, in particular, when the CCTV image generally used on the road is enlarged with the Wall System, the image quality deteriorates.

The 5G video/text transmission/reception module is a vehicle ?? It is used to wirelessly transmit and receive real-time video and text messages between control centers.

And, the dashboard is installed in the vehicle and used for the user to check the status of the CCTV camera's collected image and the control center's received image.

In addition, the (directional) IP speaker is installed on the exterior of the vehicle and used to notify the accident status to people around the accident site. In this case, the IP speaker provides ambient noise cancellation and accurate sound quality transmission through the purchase of a directional speaker.

FIG. 2 is a view showing an overall system to which a 5G-based IoT device device for mounting an accident management vehicle according to an embodiment is applied.

As shown in FIG. 2 , the system according to one embodiment includes a 5G-based IoT device device 100 mounted on an accident management vehicle, a control center 200 , and a manager terminal 300 .

Additionally, the system according to an embodiment is a place for performing services in connection with the outside in conjunction with the control center 200, and includes a troubleshooting information processing device 400-1 and a hospital information processing device 400-2; and a police station information processing device 400-3.

In addition, at this time, the respective devices connect to each other via their own network. In this case, each unit in the 5G-based IoT device device 100 for the accident management vehicle is connected to either one of serial (RS232, RS485) or wireless (LoRA, RF, BT, BLE) through a network with each other. . And, as a self-network between each device, Wi-Fi or LTE is used as a wireless communication method.

The 5G-based IoT device device 100 for mounting the accident management vehicle is based on a 5G device so that when a disaster or disaster occurs on a bridge or a bridge, the control (command) center can understand and respond to the situation in real time. A two-way response video system between the brother control center/commanding vehicle is provided. Specifically, when the IoT device 100 is operating a vehicle, it is installed in the vehicle and transmits the image captured by the CCTV camera to the registration control center, and receives the image and text from the control center and outputs each. let it do In addition, deep learning-based image magnification technology for centralized control and IP speaker control technology for establishing a response system for each section are provided. In other words, this image enlargement technology causes a decrease in image quality when the CCTV image used on the road is enlarged by the wall system.

The control center 200 (or the manager terminal 300) transmits such an accident scene image in a wireless communication method (eg, a web-based service) through the 5G-based IoT device device 100 for mounting the accident management vehicle. If received, take action on the accident situation by providing monitoring images and information text from the wall system. For example, when the control center 200 receives such an accident scene image, it determines whether an accident has occurred and the degree from the corresponding image, and when confirming the occurrence of an accident, a 5G-based IoT device device mounted on an accident management vehicle ( 100) is notified. So, through this, the 5G-based IoT device device 100 for mounting the accident management vehicle can perform an evacuation broadcast through the IP speaker.

3 is a block diagram illustrating a configuration of a 5G-based IoT device for mounting an accident management vehicle according to an embodiment.

As shown in Fig. 3, the 5G-based IoT device device 100 for mounting an accident management vehicle according to an embodiment includes a CCTV camera 101 and an IoT device 102 for control, a 5G video/text transmission/reception module 103, and a monitor. (dashboard for driver confirmation) 104 and an IP speaker 105 .

Additionally, the 5G-based IoT device device 100 for mounting an accident management vehicle according to an embodiment performs the voice output operation of the key signal input unit 106 and the IP speaker 105 for receiving various setting information according to user key manipulation. and a sound control unit 107 which is driven differently according to the wishes of the administrator.

When the CCTV camera 101 operates a vehicle, it is installed outside the vehicle and captures and collects surrounding images.

The IoT device for control 102 is installed in the vehicle, transmits the image captured by the CCTV camera 101 to the registration control center, and receives the image and text from the control center 200 to output each. In this case, according to an embodiment, the IoT device for control 100 transmits a) an accident scene image from the CCTV camera 101 to the control center 200 when an accident occurs around the vehicle, A wall system image is received from the control center 200 , and the accident scene image and the wall system image are output to the monitor 104 . And, b) when a guide text is received when receiving a wall system image from the control center 200 , the guide text is combined and output to the monitor 104 . c) In addition, when an accident is confirmed through the accident scene image, the wall system image, or the guide text, an evacuation broadcast is output by controlling the audio output operation from the IP speaker 105 . d) And, in the case of delivering an accident scene image to the control center 200, a single image is created from the accident scene image in a set single image format, and after converting to a set single Mat format image, setting The control center 200 ) of the accident scene.

The 5G video/text transmission/reception module 103 is installed in the vehicle to receive images and texts between the IoT device for control 102 and the control center 200 . In this case, the 5G video/text transmission/reception module 103 is connected to the control center 200 to transmit and receive information, for example, an image of an accident site and an image/guide text of the wall system. For example, you may use Wi-Fi or LTE.

The monitor (dashboard for driver confirmation) 104 displays the combined image of the CCTV camera 101 and the image of the control center 200 by the IoT device 102 for control.

The IP speaker 105 outputs a voice by the IoT device 102 for control or the control center 200 .

4 is a flowchart sequentially illustrating operations of a 5G-based IoT device for mounting an accident management vehicle according to an embodiment (refer to FIG. 3 ).

As shown in FIG. 4 , the IoT device apparatus according to an embodiment basically captures and collects surrounding images from a CCTV camera installed outside the vehicle when driving a vehicle.

And, in this case, the IoT device for control is installed in the vehicle, transmits the image captured by the CCTV camera to the registration control center, and receives the image and text from the control center to output each.

In addition, in this case, the 5G video/text transmission/reception module is installed in the vehicle to receive images and texts between the IoT device for control and the control center.

And, on the monitor (dashboard for driver confirmation), the video of the CCTV camera and the video of the control center are combined and displayed by the IoT device for control.

In addition, in this case, the IP speaker outputs audio by the IoT device for control or the control center.

In this state, the IoT device for control performs the following operation according to an embodiment.

a) First, when an accident occurs around the vehicle (S401), the IoT device for control transmits the accident scene image from the CCTV camera to the control center (S402), and receives the wall system image from the control center (S403), the accident scene image and the wall system image are output to the monitor.

b) When the control center receives the image of the wall system, when a guide text is received (S404), the guide text is combined and output to the monitor (S405).

c) In addition, when an accident is confirmed through the accident scene image, the wall system image, or the guide text, an evacuation broadcast is output by controlling the audio output operation from the IP speaker (S406).

d) In particular, when delivering an accident scene image to the control center, a single image is created from the accident scene image in a set single image format, and after converting to a set single Mat format image, a set deep learning based image By converting to SI (super image) by the enlarged format, upscaling to a single image or an entire video format corresponding to a number of different CCTV image file formats and converting it into a high-definition image, the accident scene image is delivered to the control center do.

As described above, in one embodiment, when a disaster or disaster occurs on a bridge or a bridge, the control (command) center can understand and respond to the situation in real time in real time between the 5G device-based control center/commanding vehicle. Corresponding video system technology. And, in addition to this, the IoT device includes a deep learning-based image magnification technology for centralized control and an IP speaker control technology for establishing a response system for each section.

Therefore, through this, through the development of coping technologies for collision accidents on bridges and bridges, the establishment of a rapid response system for disaster and disaster management, strengthening of the accident response expertise and efficiency of the control (commanding) center and command vehicle, and accident management/recovery improve crisis management skills.

5 is a diagram for explaining a format (algorithm) for IoT control applied to a 5G-based IoT device for mounting an accident management vehicle according to an embodiment.

As shown in FIG. 5 , the format for IoT control according to an embodiment includes a window-based IoT device control SW. In addition, it is equipped with 5G-based video/text transmission/reception and communication status monitoring functions. Then, the collected data storage DB is configured and video data can be streamed in real time. In addition, the IoT device for control has a user-defined data format and file format, and a user interface UI/UX. In addition, it includes a function to check the collected images of CCTV cameras. In addition, it has a control center video/text check and output function and a control center video/text check function. So, through this, the IP speaker-related accident information/evacuation broadcast transmission function is performed. Additionally, according to this, the IoT device for control has a HW specification capable of transmitting large-capacity 5G video in real time, for example, Operating System and CPU, Graphics, I/O Ports, Memory, HDD (SDD) , wireless technology, RAN, etc. are taken into consideration when selecting an IoT device.

On the other hand, in addition to this, such an accident management vehicle-mounted 5G-based IoT device device provides a service quickly and conveniently by maintaining a database consistent with each other when transmitting and receiving various types of information.

To this end, the IoT device for control performs the following operations.

a) First, the control center and the table storing the device registration information and data are equally provided with each other, and a matching relationship for the table is set and registered in advance.

b) Therefore, when information in a table is mutually changed, the tables are synchronized according to the matching relationship.

c) And, when synchronizing the table, by diversifying the information per data type per device device type and per manager device type (class or device type) with a number of different equipment types, for example, the database can be match

In addition, in this case, the IoT device apparatus diversifies data through the interface unit and transmits it in connection with the DB matching method, so that information can be exchanged and exchanged efficiently and quickly.

a) To this end, first, an output port table is provided inside the interface unit, for example, in the gateway, and the output port table diversifies information for each equipment type and data type as above and inputs and outputs.

b) Therefore, when transmitting various types of data in this state, by diversifying the data from the output port table and transmitting it to the control center quickly and collectively, notification information is provided efficiently and quickly.

c) And, additionally, in this diversification method for data transmission, when information is transmitted in this way, when information in the table is changed in connection with the table, information on the output port table is also changed by synchronizing, for example, IoT device device information, etc. do. In this case, the matching relation also includes a format related to the output port table to operate in combination with each other. So, through this, it can be used efficiently in this diversification method.

On the other hand, in addition, when such an IoT device device provides an accident scene image, etc., it secures a connection to a manager terminal in the vicinity in real time, so that information can be delivered to the manager quickly and easily.

To this end, the IoT device for control performs the following operations.

a) First, when the IoT device for control communicates with the registration manager terminal, for example, by using the above diversification method, it first checks whether the registered local communication network is connected, and as a result of the check, the local communication network In the case of connection, it is connected as a setting administrator common account corresponding to each different management work location.

b) As a result of the check, if the local communication network is not connected, it is checked whether the registered wireless communication network is connected secondarily, and if the wireless communication network is connected as a result of the check, an individual IP address is connected.

c) As a result of the check, if the wireless communication network is not connected, the connection is made with the terminal identification number of the registered mobile communication network, so the connection with the manager terminal is secured

On the other hand, in the case of real-time connection with the administrator terminal in this way, for the security of the connection, the IP table is used to monitor the IP and manage the monitoring (or log) according to the connection of the unauthorized person (in this case, the IP table is the same method as the above table of diversification method). In addition, in this case, for example, the IP table uses the same method as a diversified table to diversify data for each manager terminal type or management task type to input/output.

a) Specifically, for this, an IP table in which an administrator public account of the local communication network and individual IP addresses of the wireless communication network are registered is configured in advance.

b) And, when an alarm is provided to the manager terminal in this way, the next hop switch IP address is extracted from the response result by sending a HELLO message of the corresponding communication network.

c) Next, check the switch IP address that is the same as the next hop switch IP address in the switch neighbor connection relationship list.

d) As a result of the check, if there is a switch IP address identical to the IP address of the next hop switch, it is checked whether the corresponding administrator public account or individual IP address is also in the IP table, so that access by an unauthorized person is checked.

e) As a result of the check, if the corresponding administrator public account or individual IP address is also present in the IP table, a JOIN/PRUNE message is sent, so it is connected to the corresponding communication network.

100: 5G-based IoT device device mounted on an accident management vehicle
200: control center
101: CCTV camera 102: IoT device for control
103: 5G video/text transmission/reception module 104: monitor (dashboard for driver confirmation)
105 : IP speaker

Claims (4)

When operating a vehicle, a CCTV camera installed outside the vehicle to capture and collect surrounding images;
an IoT device for control installed in the vehicle to transmit the image captured by the CCTV camera to a registration control center, and to receive and output images and text from the control center;
a 5G video/text transmission/reception module installed in the vehicle to receive images and texts between the control IoT device and the control center;
a monitor (dashboard for driver confirmation) displaying a combination of the video of the CCTV camera and the video of the control center by the IoT device for control; and
an IP speaker outputting voice by the IoT device for control or the control center; contains,

The control IoT device,
a) When an accident occurs around the vehicle, the accident scene image from the CCTV camera is transmitted to the control center, and a Wall System image is received from the control center, and the accident scene image and output the wall system image,
b) If a guide text is received when receiving a wall system image from the control center, the guide text is combined and output to the monitor;
c) When an accident is confirmed through the accident scene image, the wall system image, or the guide text, the operation of outputting the voice from the IP speaker is controlled to output an evacuation broadcast,
d) When delivering an accident scene image to the control center, a single image is created from the accident scene image in a set single image format, converted into a set single Mat format image, and then set deep learning-based image enlargement format By changing to SI (super image) and upscaling to a single image or full video format corresponding to a number of different CCTV image file formats by

The control IoT device,
a) The control center and the table storing the device registration information and data are equally provided with each other, and a matching relationship for the table is set and registered in advance;
b) When information in a table is mutually changed, each table is synchronized according to the matching relationship;
c) when synchronizing the table, by diversifying the information for each data type for a number of different equipment types and for each manager device type, to match the database;

The control IoT device,
a) In the interface unit (including 5G video/text transmission/reception module), an output port table is provided therein, and the output port table diversifies information for each equipment type and data type, and inputs and outputs;
b) When transmitting information, it provides notification information because data from the output port table is diversified and transmitted to the control center in a batch;
c) In the case of data transmission, when information is transmitted, when information in the table is changed in connection with the table, information including IoT device device information on the output port table is also synchronized and changed. In this case, the matching The relationship also includes a format for the output port table to operate in combination with each other; 5G-based IoT device device for accident management vehicle mounting. delete The method according to claim 1,
The IoT device for control is
a) In the case of communication with the registration manager terminal, it is first checked whether the registered local network is connected, and if the local network is connected as a result of the check, it is connected as a setting administrator common account corresponding to each different management work location, and ,
b) As a result of the above check, if the local communication network is not connected, it is checked whether the registered wireless communication network is connected secondarily, and if the wireless communication network is connected as a result of the check, an individual IP address is connected,
c) as a result of the check, if the wireless communication network is not connected, the connection is made to the terminal identification number of the registered mobile communication network, so that the connection with the manager terminal is secured; 5G-based IoT device device for accident management vehicle mounting. 4. The method of claim 3,
The IoT device for control is
a) preconfiguring an IP table in which an administrator public account of the local communication network and individual IP addresses of the wireless communication network are registered;
b) When an alarm is provided to the manager terminal, the HELLO message of the corresponding communication network is transmitted to extract the next hop switch IP address in the response result,
c) check the switch IP address identical to the next hop switch IP address in the switch neighbor connection relationship list;
d) As a result of the check, if there is a switch IP address that is the same as the next hop switch IP address, it is checked whether the corresponding administrator public account or individual IP address is also in the IP table, so that unauthorized access is checked;
e) As a result of the check, if the corresponding administrator public account or individual IP address is also in the IP table, the JOIN/PRUNE message is transmitted, so connecting to the corresponding communication network; 5G-based IoT device device for accident management vehicle mounting.

Images