KR102539202B1 - System providing notification information and method thereof - Google Patents

Abstract

According to an embodiment, a notification information providing system includes a traffic information acquisition unit configured to acquire behavior information of an object analyzed through an image, a driving information acquisition unit configured to acquire driving information of a navigation unit corresponding to the object, and the behavior An information analyzer configured to detect a navigation unit corresponding to the behavior information using information and a location and time included in the driving information, and an information providing unit configured to provide a notification corresponding to the behavior information to the detected navigation unit. can include

Description

Notification information providing system and method {SYSTEM PROVIDING NOTIFICATION INFORMATION AND METHOD THEREOF}

Embodiments disclosed in this document relate to technology for providing notification information.

An agency performing traffic-related tasks may acquire an image using a photographing device installed in a specific area and analyze road conditions using the obtained image. For example, when a vehicle violating the speed limit is detected by a camera or speed sensor, the National Police Agency will check the number of the detected vehicle and information on the owner of the vehicle through a database, and send a notice indicating the speeding violation to the confirmed owner. can
(Patent Document 1) KR 10-2111363 B1

It takes about 2 to 3 weeks for the plate number and owner information of the vehicle violating traffic regulations to be confirmed and a notice to be sent to the owner. Therefore, it is not easy for the owner (or driver) of the vehicle to remember the situation at the time, and even if he goes to the same place, the act of violating traffic laws may be repeated. In addition, behaviors such as poor loading or violation of restrictions on the operation of old diesel vehicles continue to cause damage to an unspecified number of people while the vehicle is in operation, and if the administrative district of the road on which the vehicle is driven is different, the driver may be repeatedly caught. It is necessary to immediately notify the driver of such an act.

Various embodiments disclosed in this document are intended to provide a notification information providing system and method for solving the above problems.

A system for providing notification information according to an embodiment disclosed in this document includes a traffic information acquisition unit configured to obtain behavior information of an object analyzed through an image, and driving information acquisition configured to obtain driving information of a navigation unit corresponding to the object. an information analyzer configured to detect a navigation unit corresponding to the behavior information using the location and time respectively included in the behavior information and the driving information; and to provide a notification corresponding to the behavior information to the detected navigation unit. It may include a set information providing unit.

A navigation unit corresponding to an object according to an embodiment disclosed in this document is configured to transmit location information of the object to a service server, receive and output notification information corresponding to behavior information of the object from the service server, and , It can be detected by the service server using the location and time of each of the action information and the location information.

A service server according to an embodiment disclosed in this document obtains driving information of a navigation unit corresponding to an object, acquires behavior information of the object analyzed through an image from a public institution server, and obtains the behavior information and the driving It may be configured to detect a navigation unit corresponding to the action information using the location and time included in the information, and to provide a notification corresponding to the action information to the detected navigation unit.

An operation method of a system for providing notification information according to an embodiment disclosed in this document includes an operation of obtaining driving information through a navigation unit corresponding to an object in a service server, and behavior information of the object analyzed through an image in a server of a public institution. Obtaining, detecting a navigation unit corresponding to the behavior information by using the location and time respectively included in the behavior information and the driving information in the service server, and sending a notification corresponding to the behavior information to the detected navigation unit. An operation provided to the navigation unit may be included.

According to the embodiments disclosed in this document, the notification information providing system can immediately inform the driver of a vehicle violation or guidance matter, increasing the guidance effect and reducing continuous damage to unspecified people.

In addition, according to the embodiments disclosed in this document, the notification information providing system can more clearly specify the violating vehicle even in various environments.

In addition, according to the embodiments disclosed in this document, the notification information providing system can provide notification information in real time while minimizing exposure of personal information of a vehicle driver.

In addition, according to the embodiments disclosed in this document, the notification information providing system can provide various traffic-related services by collecting traffic information of vehicles and pedestrians, traffic law violation information, and crime prevention information.

In addition to this, various effects identified directly or indirectly through this document may be provided.

1 illustrates an environment of a notification information providing system according to various embodiments.
2 illustrates a detailed configuration of a travel information acquisition unit according to various embodiments.
3 illustrates a block diagram of a notification information providing system according to various embodiments.
4 is a flowchart illustrating an example of an operation of a notification information providing system.
5 describes an operation of detecting an identifier of a navigation unit according to various embodiments.
6 is a flowchart illustrating an operation of a notification information providing system according to various embodiments.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar elements.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. However, it should be understood that this is not intended to limit the present invention to the specific embodiments, and includes various modifications, equivalents, and/or alternatives of the embodiments of the present invention.

In this document, the singular form of a noun corresponding to an item may include one item or a plurality of items, unless the context clearly dictates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "A, Each of the phrases such as "at least one of B or C" may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited. A (e.g. first) component is said to be “coupled” or “connected” to another (e.g. second) component, with or without the terms “functionally” or “communicatively”. When mentioned, it means that the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.

Each component (eg, module or program) of the components described in this document may include singular or plural entities. According to various embodiments, one or more components or operations among corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by modules, programs, or other components are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations are executed in a different order, omitted, or , or one or more other operations may be added.

As used in this document, the term "module" or "...unit" may include a unit implemented in hardware, software, or firmware, and may include, for example, logic, logic block, component, or circuit. can be used interchangeably. A module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document may be implemented as software (eg, a program or application) including one or more instructions stored in a storage medium (eg, memory) readable by a machine. For example, the processor of the device may call at least one command among one or more commands stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.

FIG. 1 illustrates an environment of a notification information providing system 1 according to various embodiments, and FIG. 2 illustrates a detailed configuration of a passage information obtaining unit 20 .

Referring to FIG. 1 , the notification information providing system 1 uses a traffic information acquisition unit 20 for photographing and analyzing an image of an object 10, an image obtained from the traffic information acquisition unit 20, and an image analysis result. It may include a public institution server 30 that analyzes road conditions, a navigation unit 50 that obtains location information of the object 10, and a service server 40 that manages data of the navigation unit 50. The object 10 may mean a vehicle or a pedestrian.

The traffic information acquisition unit 20 and the public institution server 30 constitute the traffic information analysis system 5 and may be operated by local governments, road corporations, facilities corporations, or public institutions such as the National Police Agency. In this case, the traffic information analysis system 5 may further include an operating device 60 (eg, a control center).

The traffic information acquisition unit 20 may be installed in units of specific regions (eg, intersections, alleys, or highways) to capture and analyze images. For example, referring to FIG. 2 , the passage information acquisition unit 20 may include a photographing unit 121 , an object detection sensor unit 122 , and a data processing unit 130 .

The photographing unit 121 may include a camera capable of capturing images. The traffic information acquisition unit 20 may recognize at least one of vehicles (eg, 51 and 52) or pedestrians (eg, 61) by analyzing an image captured by the photographing unit 121. The object detection sensor unit 122 may be a sensor (e.g., radar (radio detection and ranging, RADAR), light detection and ranging (LIDAR), and laser detection and ranging (LADAR). According to embodiments, the passage information acquisition unit 20 may use the photographing unit 121 and the object detection sensor unit 122 cooperatively. For example, the traffic information acquisition unit 20 may preferentially use the object detection sensor unit 122 to more accurately detect the moving location, distance, direction, or speed of the object, and need to identify the shape of the object. When there is, the photographing unit 121 can be used. According to the embodiment, the photographing unit 121 and the object detection sensor unit 122 may be implemented as one integrated module.

The data processing unit 130 may obtain passage information through at least one of the photographing unit 121 and the object detection sensor unit 122 . 'Traffic information' includes, for example, at least one of a vehicle image, number of vehicles, driving speed, driving direction, driving lane, moving distance, traffic volume, waiting length, or occupancy rate, or includes a pedestrian image, number of pedestrians, walking It may include at least one of speed and walking direction. In addition, the traffic information may include identification information indicating the type, color, size, driving lane, license plate number, or appearance of a pedestrian. Additionally, the data processing unit 130 may obtain crime prevention information through the photographing unit 121, and the 'security information' may include at least one of life crime prevention information and traffic crime prevention information. In one embodiment, the data processing unit 130 at least among traffic information or crime prevention information by applying an artificial intelligence (AI) based image analysis/processing algorithm such as deep learning or machine learning. you can get one.

Referring back to FIG. 1 , the travel information acquisition unit 20 may obtain behavior information of the object 10 using the travel information. 'Behavior information' may indicate information about an action requiring notification. Actions that require notification include, for example, speeding violations, signal violations, driving in reverse, driving lane violations, cutting in, lane violations, stop line violations, old diesel vehicle operation restriction violations, heavy traffic restrictions, not wearing seat belts, illegal parking and stopping, and pedestrian signals. It may refer to an act that violates traffic laws, such as violation or jaywalking, or an act that requires guidance from the driver, such as misloading or violation of truck breaks. The action information may include the location and time of an image of the object in which the above action is detected. In addition, the action information may include the movement speed of the object at which the above action is detected. Also, the action information may include at least one of a driving direction and a driving lane of the object in which the above action is detected.

The traffic information acquisition unit 20 transfers the analysis result information (eg, at least one of traffic information, crime prevention information, and behavior information) to the public institution server 30 or operating device 60 connected through a network to the corresponding area. Traffic conditions can be provided.

The user of the public institution server 30 (eg, the National Police Agency server) may check the behavior (eg, speeding behavior) of the object 10 based on the behavior information received from the traffic information obtaining unit 20 . The public institution server 30 may request the service server 40 to provide notification information so that the driver of the object 10 can recognize the confirmed action in real time.

The navigation unit 50 and the service server 40 configure a system for providing a navigation or location tracking service to a user (eg, a driver or a pedestrian of a vehicle) of the object 10, and may be operated by a private company. .

The service server 40 matches information provided by the public institution server 30 with information managed by the service server 40 to detect an identifier of the navigation unit 50 corresponding to the object 10, and detects the identifier. Violation of the object 10 may be notified to the navigation unit 50 through .

The navigation unit 50 corresponds to the object 10. Here, 'corresponding' means that the navigation unit 50 moves together with the object 10 and provides the service server 40 with the location of the object 10. It can mean that you can do it. For example, the navigation unit 50 may be a navigation device physically installed in the object 10 or a program (eg, an application) executed by a terminal (eg, a smart phone). For another example, when the location of the object 10 is to be monitored in real time, such as a livestock vehicle or a quarantine vehicle, the navigation unit 50 provides location information (eg, global positioning system (GPS) information) of the object 10 . It may be a terminal device for continuously providing.

The operating device 60 stores and manages the information received from the traffic information acquisition unit 20 in a database, and uses the stored information to allow users (eg, control personnel) of the operating device 60 to monitor road conditions in real time. The controllable interface can be output. In addition, the operating device 60 may compensate for insufficient hardware performance of the data processing unit 130 . For example, the data processing unit of the operating device 60 may include hardware (eg, a GPU) capable of implementing higher-performance image processing than the data processing unit 130 . The data processing unit of the operating device 60 may perform the same functions as those of the data processing unit 130 including analyzing road conditions (eg, traffic information, violation information, or crime prevention information). In this case, the data processor 130 included in the traffic information acquisition unit 20 may be removed or deactivated. The operating device 60 may transmit a command to the data processing unit 130 to control a signal based on the analyzed road conditions or to provide a different route to the vehicle.

Since the entity (e.g., a public institution) that operates the traffic information acquisition unit 20 and the public institution server 30 and the entity that operates the service server 40 and the navigation unit 50 (e.g., a private company) are different, In order to reduce the time error between the information acquired by each operating entity, the traffic information acquisition unit 20, the public institution server 30, the service server 40, and the navigation unit 50 may synchronize time for each designated period. .

1 and the following description describe an embodiment in which the public institution server 30 and the service server 40 are operated separately, but according to other embodiments, based on the information received from the traffic information acquisition unit 20 A series of operations for confirming the behavior of the object 10 and providing notification information corresponding to the confirmed behavior to the navigation unit 50 of the object 10 is performed by either the public institution server 30 or the service server 40. Can be implemented by objects. According to other embodiments, a separate server (not shown) may exist instead of the public institution server 30 and the service server 40 to check behavior information and provide corresponding notification information to the navigation unit 50. there is.

3 illustrates a block diagram of a notification information providing system according to various embodiments. Each component shown in FIG. 3 may be a physical hardware device such as a server or a processor (eg, a central processing unit (CPU)), and may be a program, application, or instructions stored in a memory and executed through a processor. It may be software such as a set of

The traffic information acquisition unit 210 may correspond to the traffic information acquisition unit 20 of FIG. 1 . In addition, the traffic information acquisition unit 210 may be a device or program included in the public institution server 30 . The traffic information acquisition unit 210 may acquire behavior information of the object 10 by analyzing an image of the traffic information. Additionally, the passage information acquisition unit 210 may obtain identification information of the object 10 by analyzing an image of the passage information.

The driving information acquisition unit 220 may be included in, for example, the service server 40 . The driving information acquisition unit 220 may receive location information from a plurality of navigation units, and store and update driving information of the navigation units based on the received location information. The driving information may indicate at least one of the location, time, movement direction (or driving direction), driving lane (or driving lane), whether the vehicle is stopped, whether the vehicle is stopped, whether it has entered a rest area, and speed. The driving information acquisition unit 220 may store and update driving information for each identifier of the navigation units. In order to minimize the difference between the time indicated by the driving information and the time indicated by the behavior information, the driving information acquisition unit 220 may perform time synchronization with the travel information acquisition unit 210 at each designated period.

The information analysis unit 230 may be included in the service server 40 . The information analysis unit 230 may detect an identifier of the navigation unit 250 corresponding to the object detected by the traffic information obtaining unit 210 by matching the behavior information with the driving information. For example, the information analyzer 230 may match the location and time included in action information and the location and time included in driving information. For another example, the information analyzer 230 may match the speed included in the behavior information and the speed included in the driving information. For another example, the information analyzer 230 may match at least one of the driving lane and driving direction included in the action information with at least one of the driving lane and driving direction included in the driving information.

Due to an error in time or space, a plurality of identifiers may be matched to the time and location indicated by the action information. In this case, the information analyzer 230 may use vehicle information (eg, type, color, size, model, or license plate number) registered in the database of the service server 40 to increase detection accuracy. Vehicle information may be registered by a user using the navigation unit 250 . For example, the information analysis unit 230 specifies a vehicle in which the vehicle number or vehicle type obtained by the traffic information acquisition unit 210 matches vehicle information registered in the database, and navigation corresponding to the specified vehicle. The identifier of unit 250 may be detected.

The information provider 240 may be included in the service server 40 . The information providing unit 240 may provide notification information with the identifier detected by the information analyzing unit 230 in order to notify the user of the object of the behavior analyzed by the traffic information acquiring unit 210 . The notification information may indicate a user interface that can be output visually or audibly through the navigation unit 250, for example. The information providing unit 240 may include an image of an object in notification information. To protect personal information, the information providing unit 240 may mask a portion of notification information (eg, the last two digits of a license plate number or a portion of an image).

Like the navigation unit 50 of FIG. 1 , the navigation unit 250 may transmit object location information to the driving information acquisition unit 220 and may receive and output notification information from the information providing unit 240 .

Since the public institution server 30 is operated by a government agency and the service server 40 is operated by a private company, the communication network used by them may not be compatible, and is provided from the public institution server 30 to the service server 40. Since some of the information (eg, vehicle number) may include personal information, the system for providing notification information according to embodiments includes an operation unit 260 capable of linking the public institution server 30 and the service server 40 may further include. The operating unit 260 may be included in the operating device 60 . For example, the operation unit 260 may encrypt the information acquired by the travel information acquisition unit 210 or the driving information acquisition unit 220 or may mask part of the information. For another example, the operation unit 260 may analyze or process the image acquired by the traffic information acquisition unit 210 . In this case, the traffic information acquisition unit 210 may include hardware capable of implementing high-performance image processing (eg, a graphic processing unit (GPU)).

4 and 5 illustrate an example of an operation of a notification information providing system. 4 shows a flow chart, and FIG. 5 illustrates the operation of detecting an identifier.

Referring to FIG. 4, the traffic information acquisition unit 20 photographs an image, and through image analysis, a vehicle having a license plate number (identification information) of 'xx is 1234' is 'March 23, 13:15:24'. It is possible to detect speeding behavior at 'xx intersection' (location) at (time). For another example, the passage information acquisition unit 20 may detect the speed of the vehicle through a sensor capable of measuring the location or moving distance of the object. It is assumed that the navigation unit 50 having an identifier '#1234' is installed in the corresponding vehicle. The navigation unit 50 may transmit location information such as GPS coordinates (eg, 055974, 4282182) to the service server 40 in real time.

The traffic information acquisition unit 20 may provide the detection result to the public institution server 30 . The detection result includes image and action information, and may further include identification information according to an embodiment. The public institution server 30 checks whether the information received from the traffic information acquisition unit 20 has an error and whether it is normal data, and at least part of the information received from the service server 40 (eg, video and action information). You can request a notification while passing the . In the embodiment, the public institution server 30 accesses the database of the Ministry of Land, Infrastructure and Transport before requesting notification, and the owner information corresponding to the confirmed vehicle number (xx is 1234), address, or other registration information of the vehicle (eg : type, color, size, or model).

The service server 40 may detect the ID #1234 of the navigation unit 50 through information received from the public institution server 30 and information stored in the database of the service server 40 as shown in FIG. 5 . If the vehicle number is registered in the database of the service server 40, the service server 40 detects the same vehicle number as the vehicle number (xx is 1234) acquired by the public institution server 30 from the database, and the navigation ID (# 1234) can be easily detected, but since the license plate number is personal information, it may not be registered in the service server 40 depending on the user. Therefore, the service server 40 may detect the ID in consideration of the location (xx intersection) and time (March 23, 13:15:24) at which the action was detected. If several vehicles have passed the corresponding location at the corresponding time, the service server 40 may detect a plurality of navigation IDs (#1234, #2356, and #1235). In this case, the service server 40 may compare vehicle types (medium-sized cars). If there are two vehicles of the same type, the service server 40 may select the ID (#1234) of the navigation unit 50 by comparing other information such as driving direction, driving lane, or model.

Referring back to FIG. 4 , the service server 40 may provide notification information to the navigation unit 50 corresponding to the detected ID (#1234). The navigation unit 50 may visually or aurally output notification information indicating a speeding action (“The speed limit of 50 km/h was exceeded at the xx intersection”).

6 is a flowchart illustrating an operation of a notification information providing system according to various embodiments.

Referring to FIG. 6 , in operation 610 , the service server 40 may obtain driving information of the navigation unit 50 corresponding to the object 10 . When there are a plurality of navigation units 50 , driving information may be stored and updated for each identifier of the plurality of navigation units 50 .

In operation 620, the service server 40 may obtain behavior information of the object 10 analyzed through the video from the public institution server 30.

In operation 630, the service server 40 may detect the navigation unit 50 corresponding to the action information using the location and time respectively included in the action information and the driving information. Additionally, the service server 40 may detect the navigation unit 50 corresponding to the action information by further using at least one of the driving direction, driving lane, and speed included in the action information and the driving information, respectively.

In operation 640, the service server 40 may provide a notification corresponding to the action information to the detected navigation unit 50.

Claims (14)

a passage information acquisition unit configured to acquire behavior information of an object analyzed through an image;
a driving information acquisition unit configured to acquire driving information of a navigation unit corresponding to the object;
an information analyzer configured to detect a navigation unit corresponding to the behavior information using the location and time included in the behavior information and the driving information; and
An information providing unit configured to provide a notification corresponding to the action information to the detected navigation unit; including, notification information providing system. The method according to claim 1, wherein the information analysis unit,
A notification information providing system configured to detect a navigation unit corresponding to the behavior information using at least one of a driving direction and a driving lane included in the behavior information and the driving information, respectively. The method according to claim 1, wherein the information analysis unit,
A notification information providing system configured to detect a navigation unit corresponding to the behavior information using the speed included in the behavior information and the driving information, respectively. The method according to claim 1, wherein the information analysis unit,
A notification information providing system configured to detect a navigation unit using identification information of the object analyzed through the image and vehicle information registered through the navigation unit. The method according to claim 1, wherein the information providing unit,
A notification information providing system configured to perform masking on a part of information representing the notification. The method of claim 1,
The notification information providing system, wherein the traffic information acquisition unit and the driving information acquisition unit are set to perform time synchronization at each designated period. The method according to claim 1, wherein the travel information obtaining unit,
A notification information providing system configured to obtain identification information of the object by analyzing the image and to analyze at least one of the traffic information, the behavior information, or crime prevention information. The method of claim 7,
An operating device configured to control road conditions through the information obtained by the traffic information acquisition unit; further comprising a notification information providing system. The method according to claim 8, wherein the operating device,
A notification information providing system configured to encrypt the action information or the driving information, or to analyze or process the image. The method of claim 1,
A recording unit configured to capture the image; further comprising a notification information providing system. According to claim 1 or 10,
An object detection sensor unit set to measure the location or moving distance of the object by tracking the movement of the object; further comprising a notification information providing system. In the navigation unit corresponding to the object,
Transmitting the location information of the object to a service server,
It is set to receive and output notification information corresponding to the behavior information of the object from the service server,
The navigation unit detected by the service server using the location and time of each of the action information and the location information. Obtain driving information of the navigation unit corresponding to the object;
Acquiring behavior information of the object analyzed through video from a public institution server;
Detecting a navigation unit corresponding to the action information using the location and time included in the action information and the driving information, and
A service server configured to provide a notification corresponding to the action information to the detected navigation unit. In the operating method of the notification information providing system,
obtaining driving information through a navigation unit corresponding to an object in a service server;
Obtaining behavior information of the object analyzed through the video in a public institution server;
detecting a navigation unit corresponding to the behavior information by using the location and time respectively included in the behavior information and the driving information in the service server; and
A method of operating a notification information providing system comprising: providing a notification corresponding to the action information to the detected navigation unit.

Images