KR102134799B1 - Management system based terminal device for car - Google Patents

Abstract

The present invention provides a terminal device for a vehicle, which is installed in a vehicle, operates under the control of a control server, and is configured to secure a surrounding image; A sensor module for measuring information related to the environment of the surrounding information; An information merging module that receives the surrounding information from the sensor module, converts the received surrounding information into an identifier and merges it into the image; A transmission/reception module that transmits the video to the control server and receives events from the control server and corresponding countermeasure information related to the event from the control server; It is possible to provide a terminal device for a vehicle using an integrated control system comprising a; display module for outputting the received countermeasure information.

Description

Vehicle terminal device using integrated control system {MANAGEMENT SYSTEM BASED TERMINAL DEVICE FOR CAR}

The present invention relates to a vehicle terminal device using an integrated control system.

In general, a national disaster/disaster management system that collects various disaster/disaster related information using sensors such as cameras, rain gauges, and weather vanes, or an intelligent traffic information system (ITS) that collects traffic related information using CCTV, etc. In the field of technology, using location information and video information obtained by applying a known geographic information system to quickly respond to disasters/disasters such as forest fires and floods, or to include traffic accidents and traffic congestion areas. It provides users with various information on road traffic conditions.

However, the conventional systems applied in the technical field such as the national disaster/disaster management system or the intelligent traffic information system (ITS) as described above collect video information only through CCTV installed in a specific place and automatically transmit it to a server. Because it collects various disaster/disaster related information in a way, there is a disadvantage in that it cannot provide sufficient location information and video information about the actual field situation in a surveillance-vulnerable area where CCTV is not installed or rare.

In fact, in the case of applying a conventional geographic information system to the national disaster/disaster management system, since the positions of the sensors such as the camera, rain gauge, and wind vane are fixed in a specific area, in the situation room, a picture of the surveillance vulnerable area or Video information could not be obtained in real time.

In addition, when a conventional geographic information system is applied to the intelligent traffic information system (ITS), the traffic situation is imaged only at a limited location where the CCTV is fixed, even though a location requiring predetermined image information is not limited to a road. There is a problem that information can be provided to the user.

In order to overcome these limitations, a method has been proposed in which information such as a disaster/disaster/traffic accident may be reported through a mobile phone, or a text message of SMS/MMS may be sent and received to quickly identify a disaster situation and perform recovery measures. .

However, since the above-described technical method was able to obtain only field information by providing information in the form of a simple telephone call or message, and situational awareness simply indicates the point or area of a specific disaster on the map, it is difficult and effective to quickly identify the situation. There are limitations in delivery, control, and command delivery.

1. Republic of Korea Patent Publication No. 2009-0001546 (2009.01.09.)

The present invention for solving such a problem, by effectively collecting and collecting the information provided by the informant and the government office information provided by the government office located near the informant to facilitate the identification of the specific situation on the accident site, accident-related information The object is to provide a terminal device for a vehicle using an integrated control system that efficiently collects them and enables a quick and smooth response to an accident site.

The objects of the present invention are not limited to those mentioned above, and other objects not mentioned will be clearly understood by those skilled in the art from the following description.

According to an embodiment of the present invention for achieving the above object, In a terminal device for a vehicle using an integrated control system, it is installed in the vehicle, operated under the control of the control server and formed to secure the surrounding image; A sensor module for measuring information related to the environment of the surrounding information; An information merging module that receives the surrounding information from the sensor module, converts the received surrounding information into an identifier and merges it into the image; A transmission/reception module that transmits the video to the control server and receives events from the control server and corresponding countermeasure information related to the event from the control server; It is possible to provide a terminal device for a vehicle using an integrated control system comprising a; display module for outputting the received countermeasure information.

In addition, the photographing module generates a subtitle that is read in any one language selected among a plurality of languages for the audio included in the image, and outputs the subtitle module by merging and outputting the subtitle into one region of the image. It is possible to provide a vehicle terminal device using an integrated control system characterized in that it comprises.

In addition, the photographing module provides a terminal device for a vehicle using an integrated control system, characterized in that it comprises a video call module that performs a video call connection to a government office terminal related to the countermeasure information under the control of the control server. Can.

In addition, the sensor module is a terminal device for a vehicle using an integrated control system, characterized in that it comprises an alarm module to perform an alarm through the lighting of the light or lighting, if the value of the surrounding information exceeds a preset value. Provides

의 식에 의해 산출되고,In addition, the vehicle terminal device receives the event and the result of the action for the event from the image acquisition device and the government server, and a calculation unit for calculating the occurrence value for each event in the corresponding region, and the category for each event among the occurrence values for each event. The countermeasure information is received by a control server composed of a control and communication unit that extracts and transmits countermeasure information for each category of previously stored events according to similarity, and transmits it through a network.

Is calculated by the equation

Here, n is the number of categories per event in the region, k is the number of elements constituting each event category, A is similarity according to the commonality of the kth element, B is the frequency value of the kth element, and C is the similarity factor. It provides a terminal device for a vehicle using an integrated control system characterized in that the weight.

According to the present invention, it is possible to efficiently collect and collect information provided by the informant and information provided by the government office located near the informant, thereby facilitating the identification of a specific situation on the accident site and efficiently collecting the accident-related information. This has the effect of enabling a quick and smooth response to the accident scene.

The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is an overall schematic diagram schematically showing the integrated control system of the present invention.
2 is a block diagram showing the detailed configuration of the image acquisition device of the present invention.
3 is a block diagram showing the detailed configuration of the control server of the present invention.
4 is a block diagram showing the detailed configuration of a vehicle terminal device of the present invention.
5 is a block diagram showing the detailed configuration of a user terminal device of the present invention.

The objectives and effects of the present invention, and technical configurations for achieving them, will be clarified by referring to embodiments described later in detail along with the accompanying drawings. In describing the present invention, when it is determined that a detailed description of known functions or configurations may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted. And the terms described later are terms defined in consideration of the structure, role and function in the present invention, which may vary depending on the intention or custom of the user or operator.

However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms. Only the present embodiments are provided to make the disclosure of the present invention complete, and to fully inform the person of ordinary skill in the art to which the invention pertains, the scope of the invention, and the present invention is only described in the claims. It is only defined by the scope of the claims. Therefore, the definition should be made based on the contents throughout this specification.

Throughout the specification, when a part “includes” a certain component, this means that other components may be further included rather than excluding other components unless otherwise specified.

In addition, terms such as “…unit” and “…unit” described in the specification mean a unit that processes at least one function or operation, and may be implemented by hardware or software or a combination of hardware and software.

On the other hand, in embodiments of the present invention, each component, functional blocks or means may be composed of one or more sub-components, the electrical, electronic, and mechanical functions performed by each component are electronic circuits, It may be implemented with various devices or mechanical elements known as an integrated circuit, an application specific integrated circuit (ASIC), or may be implemented separately, or two or more may be integrated into one.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is an overall schematic diagram schematically showing the integrated control system of the present invention, FIG. 2 is a block diagram showing the detailed configuration of the image acquisition device of the present invention, and FIG. 3 is a block diagram showing the detailed configuration of the control server of the present invention 4 is a block diagram showing the detailed configuration of a vehicle terminal device of the present invention, and FIG. 5 is a block diagram showing the detailed configuration of a user terminal device of the present invention.

1 to 5, the integrated control system 100 according to an embodiment of the present invention efficiently collects and collects information provided by the reporter and government office information provided by the government office located near the reporter to the accident site. It includes an image acquisition device 110, a control server 200, and uses a network to facilitate the identification of specific situations and to efficiently and quickly collect and respond to accidents. It is configured to further include a vehicle terminal device 300 and a user terminal device 400 and a government office server 500 to which mutual communication is possible.

Specifically, the integrated control system 100 is formed to secure an image of a corresponding region, and receives an image acquisition device 110 formed to extract and transmit an event from the image, and the event and the result of the action for the event. The calculating unit 210 calculates the occurrence value for each event in the corresponding region, and extracts the countermeasure information for each category of previously stored events according to the similarity of the category for each event among the occurrence values for each event, and then applies the countermeasure information to the vehicle terminal device. 300 and a control server 200 including a control communication unit 220 that transmits to the image acquisition device 110 related to the countermeasure information.

At this time, the occurrence value for each event in the corresponding region,

의 식에 의해 산출되는 것이고, 여기서 n은 해당지역의 이벤트별 카테고리의 개수, k는 이벤트별 카테고리를 구성하는 요소의 개수, A는 k번째 요소의 공통점에 따른 유사도, B는 k번째 요소의 빈도값, C는 상기 유사도에 따른 유사인자의 가중치인 것이다.

It is calculated by the equation, where n is the number of categories per event in the region, k is the number of elements constituting each event category, A is similarity according to the commonality of the kth element, and B is the frequency of the kth element. The value, C, is the weight of the similarity factor according to the similarity.

Here, the event is extracted from an image secured from the image acquisition device 110, for example, a plurality of events according to accident types, such as emergency, fire, theft, and traffic, are classified into categories according to the accident type. Thus, the image acquisition device 110 and the control server 200 are memory-related data previously stored in a plurality of memory, wherein the image acquisition device 110 is an object identified from the image being captured by the image acquisition device ( If it corresponds to a plurality of objects previously stored in 110), it may be configured to extract a predetermined event for the object and transmit it to the control server 200.

The elements constituting the event-specific categories are, for example, image objects identified from the video related to the event, and may be predetermined objects related to emergency, fire, theft, and traffic.

In addition, the result of the action means information taken in response to the event from the government office related to the event. For example, when the government office related to the event is a fire department, the government office (fire department) server 500 related to the event may It may be provided to receive the result of the action corresponding to the pre-stored countermeasures regarding the event.

Here, the countermeasure information is information on a countermeasure previously stored in relation to the event, and the countermeasure information relates to a countermeasure pre-stored in the government office server 500 by a person in charge of the government office related to the event. It can be information.

That is, as the image acquisition device 110 automatically detects and extracts the event from the captured image, it is possible to quickly classify an event related event and provide corresponding accident related information without additional information. As a result, whether an accident occurs by extracting countermeasure information for each category of the past event according to the similarity between the event extracted from the image and the pre-stored past event using the generated value calculated through the calculation unit 210 It can be automatically determined, and a countermeasure according to the occurrence of an accident can be provided to a corresponding terminal device or a government office related to the event to quickly respond to the accident.

The image acquisition device 110 as described above determines the event corresponding to the event from the image based on the event classified according to a predetermined object, and an event extraction unit 111 for extracting the corresponding event, and It may be configured to include a communication module 112 for transmitting the event extracted through the event extraction unit 111 to the control server 200, and to receive countermeasure information related to the event.

In addition, as the image acquisition device 110 is configured to include a tracking module 113 that tracks the target object of the event in a predetermined countermeasure according to the reception of the countermeasure information, the target object related to the event is configured. As it is provided to track in real time from the acquired image to track the movement line according to the movement of the object, it becomes easy to identify the object related to the event.

In addition, the image acquisition device 110 measures the environmental information about the object being tracked, and converts the measured environmental information into an identifier, and includes the environmental measurement module 114 to merge the information into the image. Through this, it is possible to obtain precise information about a region corresponding to the image, and as a result, it may be provided to enable a more efficient response.

In addition, the image acquisition device 110 generates subtitles that are read in any one selected language among a plurality of languages for a specific voice included in the image, and outputs the subtitles by merging them into a region of the image Since it is configured to include a caption merging module 115 to enable, it is possible to easily check various information about the event through the video, and as a result, a quick response to an accident can be achieved.

In addition, the image acquisition device 110 collects and transmits various necessary information scattered on a server connected to the vehicle terminal device 300 and the user terminal device 400 so as to be accessible through a network. It may be configured in the form of an access terminal device for performing, and preferably, the image acquisition device 110 may be formed in the form of a surveillance camera such as CCTV having the functions of the terminal devices 300 and 400.

Here, the terminal device (300, 400) may be, for example, a desktop PC, a notebook PC, or a computer, and may be provided as any type of wired or wireless communication device capable of using a two-way communication service by accessing a server through a predetermined network. And includes mobile terminals such as cellular phones, PCS phones (Personal Communications Services phone), and synchronous/asynchronous IMT-2000 (International Mobile Telecommunication-2000), which communicate through wireless or portable Internet. In addition to Palm PC (Palm Personal Computer), Personal Digital Assistant (PDA), Smartphone (Smart phone), Wap phone (WAP phone: Wireless application protocol phone), mobile game machine (mobile play-station), etc. All the wired/wireless home appliances/communication devices having a communication module, a display device, and a user interface for connection may be comprehensively meant.

In addition, the terminal device (300, 400) communicates with the server and can transmit and receive predetermined data with the server, and is directly connected to the server to transmit and receive data, but is not limited thereto and is connected through a predetermined intermediary server. It may be made of a configuration in which all data is transmitted and received through an intermediary server.

The server means a control server 200 or a public office (police station, fire department, etc.) server 500 related to the event, and the server may allow access to one or more terminal devices through a network. At this time, the network may be a wired or wireless Internet, in addition to a wired public network, a wireless mobile communication network, or a core network integrated with a portable Internet, etc., the TCP/IP protocol and various services existing in the upper layer, that is, HTTP (Hyper Text) It may refer to an open computer network structure worldwide that provides Transfer Protocol (Telnet), Telnet, File Transfer Protocol (FTP), Domain Name System (DNS), and Simple Mail Transfer Protocol (SMTP).

Hereinafter, as another embodiment of the present invention, the vehicle terminal device 300 using the integrated control system 100 will be described in detail.

The vehicle terminal device 300 according to another embodiment of the present invention is to improve the portability, and to enable a quick response to the accident site according to the occurrence of the event to the vehicle terminal device 300 using the integrated control system 100 In, the vehicle, installed under the control of the control server 200 and is formed to secure the surrounding image, the photographing module 310, the sensor module 320 for measuring surrounding information related to the surrounding environment, and Transmitting the surrounding information from the sensor module 320, converts the received surrounding information into an identifier and merges the information into the image, and transmits the image to the control server 200, and the control server 200 It comprises a transceiver module 340 for receiving the event and the corresponding countermeasure information related to the event from the 200, and a display module 350 for outputting the received countermeasure information.

Here, the surrounding information may be the same information as the environmental information, and preferably, more precise surrounding information may be provided by further including information on the distance between the object identified from the image and the vehicle terminal device 300. It can be acquired.

At this time, the photographing module 310 generates subtitles that are read in any one selected language among a plurality of languages for the audio included in the image, and outputs the subtitles by merging them into one region of the image. As the subtitle module 311 is configured, the audio can be read in various languages and output by being merged with the video, and as a result, information on the video can be easily and conveniently identified.

In addition, the photographing module 310 includes a video call module 312 that performs a video call connection to a government office terminal related to the countermeasure information under the control of the control server 200. It can be provided so that experts can help with how to respond to accidents related to the event.

In addition, when the value of the surrounding information exceeds a preset value, the sensor module 320 includes an alarm module 321 to perform an alarm through lighting of a voice output or lighting. It may be provided so that the official of the government holding 300 can easily recognize the risk for the event.

The vehicle terminal device 300 of the present invention is calculated by receiving an event and an action result for the event from the image acquisition device 110 and the control server 200 to calculate the occurrence value for each event in the region To the control server 200 consisting of a control unit 220 and a control communication unit 220 that extracts information on countermeasures for each category of past events that are pre-stored according to the similarity of each event category among the occurrence values for each event. By being configured to receive the countermeasure information, the reliability of the countermeasure information can be improved.

Hereinafter, as another embodiment of the present invention, the user terminal device 400 using the integrated control system 100 will be described in detail. Prior to the description, detailed description of the detailed configuration of the user terminal device 400 corresponding to the function of the components of the vehicle terminal device 300 will be omitted.

The terminal device 400 for a user using the integrated control system 100 according to another embodiment of the present invention allows the reporting of the user related to the event, that is, the reporter's report, in real time, and thus, the convenience of the accident report and the response to the occurrence of the accident In order to facilitate the operation, a photographing unit 410 formed to photograph surrounding images, and a report generating unit 420 that generates report information obtained by merging input information related to an event from a user through the user interface into the video. And a transmitting/receiving unit transmitting the tipping information to the control server 200 and receiving events extracted through the tipping information from the control server 200 and corresponding countermeasure information related to the event from the control server 200 ( 430) and the display unit 440 for outputting the received countermeasure information.

At this time, the photographing unit 410 generates subtitles that are read in any one selected language among a plurality of languages with respect to the audio included in the image, and merges the subtitles with one region of the image to display the unit. It is configured to include a caption unit 411 to be output through the (440).

In addition, the photographing unit 410 may be configured to include a video call unit 312 provided to enable a video call connection to a terminal device possessed by a person in charge of a government office related to the countermeasure information.

In addition, the transmitting and receiving unit 430 may be configured to include an alarm unit 431 for performing an alarm to enable the identification of the risk of an accident by lighting the voice output or lighting under the control of the control server 200. .

The terminal device 400 for the user receives the event extracted by the control server 200 through the tip information and the result of the action on the event, and the calculator 210 calculates an occurrence value for each event in the corresponding region 210 ), the control by the control server 200 consisting of a control and communication unit 220 for extracting the countermeasures for each category of the pre-stored past event according to the similarity of the category for each event among the occurrence values for each event and transmitting through the network It may be configured to receive the scheme information.

The present invention configured as described above efficiently collects and collects information provided by the informant and information provided by the government office located near the informant, thereby facilitating detailed identification of the accident site, and accident-related information, that is, events and It is an invention that has the effect of quickly and smoothly responding to an accident site by efficiently collecting information related to the event and quickly transmitting the collected information to each terminal device.

In the above description of the present invention, combinations of each block of the block diagram and each step of the flowchart may be performed by computer program instructions. These computer program instructions may be mounted on a processor of a general purpose computer, special purpose computer, or other programmable data processing equipment, so that instructions executed through a processor of a computer or other programmable data processing equipment may be used in each block or flowchart of the block diagram. In each step, means are created to perform the functions described. These computer program instructions can also be stored in computer readable or computer readable memory that can be oriented to a computer or other programmable data processing equipment to implement a function in a particular way, so that computer readable or computer readable memory The instructions stored in it are also possible to produce an article of manufacture containing instructions means for performing the functions described in each step of each block or flowchart of the block diagram. Computer program instructions can also be mounted on a computer or other programmable data processing equipment, so a series of operational steps are performed on a computer or other programmable data processing equipment to create a process that is executed by the computer to generate a computer or other programmable data. It is also possible for instructions to perform processing equipment to provide steps for executing the functions described in each block of the block diagram and in each step of the flowchart.

Further, each block or each step can represent a module, segment, or portion of code that includes one or more executable instructions for executing the specified logical function(s). For example, two blocks or steps shown in succession may in fact be executed substantially simultaneously or it is also possible that the blocks or steps are sometimes performed in reverse order depending on the corresponding function.

As described above, embodiments of the present invention have been described, but those skilled in the art can view the components by adding, changing, deleting or adding components, without departing from the invention described in the claims. It will be said that the invention can be variously modified and changed, and this is also included within the scope of the present invention.

100. Image acquisition device 110. Event extraction unit
120. Communication module 130. Tracking module
140. Environmental measurement module 150. Subtitle merge module
200. Control server 210. Calculation unit
220. Control and communication unit 300. Vehicle terminal device
310. Shooting module 311. Subtitle module
312. Video call module 320. Sensor module
321. Alarm module 330. Information merge module
340. Transceiver module 350. Display module

Claims (5)

In the vehicle terminal device using the integrated control system,
A photographing module installed in a vehicle, operated under control of a control server, and formed to secure surrounding images;
A sensor module for measuring surrounding information related to the surrounding environment of the object included in the image;
An information merging module that receives surrounding information from the sensor module, converts the received surrounding information into an identifier, and merges the surrounding information into the image;
A transmitting and receiving module that transmits the video to the control server, and receives an event extracted from the video from the control server and countermeasure information related to the event;
A terminal device for a vehicle using an integrated control system, characterized in that comprises a; display module for outputting the received countermeasure information.
According to claim 1,
The photographing module includes a subtitle module for generating a subtitle that is read in any one selected language among a plurality of languages with respect to the voice included in the image, and outputting the subtitle by merging and outputting the subtitle into a region of the image. Vehicle terminal device using an integrated control system, characterized in that.
According to claim 1,
The photographing module is a terminal device for a vehicle using an integrated control system, characterized in that it comprises a video call module for making a video call connection to a government office terminal related to the countermeasure information under the control of the control server.
According to claim 1,
The sensor module is a terminal device for a vehicle using an integrated control system, characterized in that it comprises an alarm module that triggers an alarm through a voice output or lighting of a light when the value of the surrounding information exceeds a preset value.
According to claim 1,
The vehicle terminal device is formed to secure an image of the corresponding region, and receives the event and the result of the action on the event from the image acquisition device and the control server, which is configured to extract and transmit the event from the image, and the corresponding region The control server consists of a control unit that calculates the occurrence value for each event of the event, and a control and communication unit that extracts information on countermeasures for each category of past events that are pre-stored according to the similarity of each event category among the event-specific occurrence values. By receiving the countermeasure information,
The occurrence value for each event in the area is

ego,
Where n is the corresponding The number of categories per event in the region, k is the number of elements constituting the event-specific categories, A is similarity according to the commonality of the kth element, B is the frequency value of the kth element, and C is the weight of the similarity factor. Vehicle terminal device using integrated control system.

Images