KR20210020463A - Method and apparatus for automatically reporting traffic rule violation vehicles using black box images - Google Patents

Abstract

According to one embodiment of the present disclosure, a method for automatically reporting a vehicle violating traffic rules using a black box image is provided. The method may comprise the steps of: obtaining an image including an object located outside the vehicle and a surrounding environment through a camera installed in the vehicle; determining the type of the object and type of a road by analyzing the image; determining whether the object violates traffic rules based on traffic rule information determined according to the type of the object and the type of the road; and transmitting an image of the object to an external server automatically at the time when the object violates the traffic rules.

Description

TECHNICAL FIELD [Method and apparatus for automatically reporting traffic rule violation vehicles using black box images}

The present invention relates to an apparatus and method for automatically reporting a vehicle in violation of traffic laws using a black box image. In more detail, according to one disclosure of the present invention, a method and apparatus for providing an apparatus and method for automatically detecting an event related to a violation of traffic laws using an image of a black box and automatically reporting a vehicle for violation of traffic regulations are disclosed. .

In recent years, as the technology of the electronic field is rapidly developed, research using the technology of the electronic field continues in all fields of the industry. In particular, in the automotive industry, it can be seen that the development direction of the automotive industry is shifting toward promoting the safety of vehicles and drivers due to high expectations of consumers not only for vehicles but also for drivers.

In order to satisfy the expectations of consumers, a black box, which is mainly used in the aviation safety field, has begun to be grafted into the automobile industry. The black box is a flight recorder that records altitude, airspeed, vertical acceleration, time, etc. necessary to explain the flight status of an aircraft. As the black box of such an aircraft is grafted with the automobile industry, various examples of vehicle operation records are provided. For example, it refers to a device that stores a driving speed, a driving lane, an external situation, and an engine state, and provides the stored driving information to a user if necessary.

However, when an accident occurs in a vehicle, such a vehicle black box is used only to identify the cause and responsibility of the accident. Looking at the procedure for reporting traffic violation videos taken by a black box, you need to move the video recorded in the vehicle from the SD card to the computer, then upload the video through the National Police Agency webpage or related app, and then write a report. However, such a reporting process is complicated and there are many inconveniences, such as a limit on the upload capacity for reporting. Furthermore, for the elderly who cannot handle computers well, it is almost impossible to report violations using a black box.

Republic of Korea Patent Publication No. 10-2016-0005149 (published on January 14, 2016) Korean Patent Registration No. 10-1725760 (announced on April 5, 2017)

The technical task according to the disclosure is a method of determining whether a vehicle or pedestrian violates road traffic laws from a black box image captured while a vehicle is moving, and automatically transmitting an image including the violation of road traffic laws to an external server; and In providing the device.

In the first embodiment, a method of automatically reporting a vehicle violating traffic regulations using a black box image is provided, and the method includes an image including an object located outside the vehicle and the surrounding environment through a camera installed in the vehicle. Acquiring, analyzing the image, determining the type of the object and the type of the road, determining whether the object violates the traffic regulations based on the traffic regulation information determined according to the type of the object and the type of the road, and the object It is possible to provide a step of automatically transmitting an image of an object to an external server when a violation of traffic laws in

In addition, the step of receiving information on the wanted vehicle and the wanted person from an external server, in the case of obtaining an image that matches 80% or more of the information about any one of the wanted vehicle and the wanted person from the surrounding image of the acquired vehicle, Transmitting the image to an external server, receiving determination information on whether the image matches information on the wanted vehicle and the wanted person from the external server, and determining that the image corresponds to either the wanted vehicle or the wanted person In the case of receiving, it is possible to provide a step of transmitting an image from a start point to an end point of detecting any one of the wanted vehicle and the wanted person to an external server.

Further, when acquiring an image of a collision between the first object and the second object, determining the fruit ratio α of the first object and the fruit ratio β of the second object, the fruit ratio α of the first object and the If any one of β is between 45 and 55% of the second object's fruit ratio, weather information, traffic information, and other object information along with images of all viewpoints at which images of the first object and the second object are acquired It is possible to provide a step of generating a report image by combining surrounding environment information including, and a step of automatically transmitting the generated report image to a police station server.

According to the second embodiment, a device for automatically reporting whether a vehicle has violated traffic laws using a black box image is provided, and the device stores instructions executable by a camera, a processor, and a processor that take an image of a vehicle's surroundings. And the processor executes instructions to obtain an image including an object located outside the vehicle and the surrounding environment through a black box installed in the vehicle, analyze the image, and determine the type of object and the type of road. It determines whether the object violates traffic regulations based on the traffic regulation information determined according to the type of the object and the type of road, and automatically transmits the image of the object to the external server at the time when the traffic violation of the object occurs. I can.

A non-transitory computer-readable storage medium in which instructions executable by a processor are stored in order to execute a method of automatically reporting a vehicle for violation of traffic laws using a black box image according to the third embodiment may be provided.

Accordingly, the method of automatically reporting a vehicle violating traffic laws using a black box image according to an embodiment of the present invention acquires an image including an object located outside the vehicle and the surrounding environment through a camera installed in the vehicle. Step to do; Analyzing the image and determining the type of the object and the type of the road; Determining whether the object violates traffic regulations based on traffic regulation information determined according to the type of the object and the type of road; And automatically transmitting an image of the object to an external server at the time when the traffic law violation of the object occurs.

A method of automatically reporting a vehicle that violates traffic regulations using the black box image includes determining the type of the object as one of a person, a bicycle, a motorcycle, and a car; If the object is a car, determining a detailed type of one of a passenger car, a freight car, and a bus according to the purpose of the car; Not determining whether the object violates traffic laws when the object corresponds to an emergency dispatch vehicle including an ambulance, a police vehicle, a hospital ambulance and a fire engine; Determining whether or not a traffic law is violated due to a yield driving of another vehicle located in the vicinity of the emergency dispatch vehicle by applying the traffic regulations according to the emergency dispatch vehicle; Determining whether or not to report a violation of traffic regulations of the other vehicle according to the severity of the traffic violation; And automatically transmitting the image at the time of violation of traffic laws of the other vehicle to the external server based on the determined result.

The method of automatically reporting a vehicle that violates traffic rules using the black box image includes obtaining movement information of the object for the speed of the object, the movement direction of the object, lane information, and location information of the object according to the movement of the object. ; Acquiring surrounding environment information including traffic regulation information, traffic light information, weather information, road traffic situation information, hypocrisy photo information, and movement information of other objects according to the characteristics of the road on which the object is moving; And the movement of the object It may include the step of combining information and surrounding environment information with the image of the object and transmitting it to the external server.

A method of automatically reporting a vehicle that violates traffic laws using the black box image includes: transmitting an image 30 seconds before/after the event occurs to the external server; Receiving, from the external server, information on a result of a traffic law violation of the object analyzing the image; And acquiring a report point according to the report of the object according to the result of the traffic violation of the object.

The method of automatically reporting a vehicle that violates traffic regulations using the black box image includes an image from a time point when the shape of the first object is detected when obtaining an image of a collision between a first object and a second object. Generating images from the point when the shape of the second object is detected, respectively; Transmitting the image of the first object and the image of the second object to an external server; Receiving information on determining an error ratio of the first object and the second object from the external server; And transmitting the image of the first object, the image of the second object, and information on determining the fruit ratio to the insurance company server of the first object and the insurance company server of the second object.

A method of automatically reporting a vehicle in violation of traffic laws using the black box image includes receiving destination information from a user of the vehicle; Generating a moving route according to the destination information, and determining a risk level in the moving route using traffic regulations, traffic violation history, accident history, and current traffic situation information on the moving route; Generating traffic guidance information to be noted in the moving route based on the risk level; Displaying the traffic guide information determined for each of the movement paths through a display of the vehicle moving along the movement path; Driving a plurality of cameras installed on side and rear sides of the vehicle while moving the area with a high risk level to acquire additional images of surrounding objects of the vehicle; And analyzing the additional image to determine whether the surrounding object violates traffic laws, and automatically transmitting an image 30 seconds before/after the time when the traffic rule violation of the surrounding object occurs to an external server. have.

According to another embodiment of the present invention, an apparatus for automatically reporting a vehicle in violation of traffic laws using a black box image includes a camera for photographing an image around the vehicle; Processor; And a memory storing instructions executable by the processor, wherein the processor obtains an image including an object located outside the vehicle and a surrounding environment through a camera installed in the vehicle by executing the instructions, and , By analyzing the image, determining the type of the object and the type of the road, determining whether the object violates the traffic rules based on the traffic law information determined according to the type of the object and the type of the road, and the object It may be characterized in that the image of the object is automatically transmitted to an external server at the time when a violation of traffic laws of

The storage medium according to another embodiment of the present invention is a non-transitory computer-readable storage medium in which instructions executable by a processor are stored in order to execute a method of automatically reporting a vehicle in violation of traffic laws using the black box image. Can be.

According to the present invention, according to the present invention, it is possible to automatically report vehicles, people, etc. that violate traffic laws, so that traffic using images of vehicles that violate traffic laws without special video editing, login, video search, etc. You can report violations of the law.

In addition, according to the present invention, it is possible to automatically report a vehicle that is continuously driving in a passing lane for a certain time or longer, a vehicle that moves in a lane without a turn indicator light, a signal violation vehicle, a reckless driving vehicle, a bus lane violation vehicle, and an illegal parking vehicle. There is an economical advantage because it can contribute to maintaining social order and automatically accumulate points according to reports.

In addition, by receiving feedback on the vehicle reported from an external server such as the National Police Agency server, there is an advantage in that it is possible to receive feedback on whether or not to report.

In addition, by analyzing information matching the information on the wanted vehicle or the wanted person in the image acquired from the vehicle using artificial intelligence data, information on the criminal who needs to be reported can be automatically transmitted to the National Police Agency server.

1 is a diagram schematically illustrating a method of automatically reporting a vehicle violating traffic rules using a black box image according to an exemplary embodiment.
FIG. 2 is a flowchart illustrating a method of automatically reporting a vehicle violating traffic laws using a black box image according to one disclosure.
3 is a diagram for explaining a method of analyzing an illegal activity by analyzing images of a plurality of objects located outside a vehicle according to an exemplary embodiment.
FIG. 4 is a diagram for explaining features for displaying information on traffic laws and danger reporting areas using a display device of a vehicle according to one disclosure.
5 is a diagram illustrating a main configuration of an apparatus for providing a dangerous area determined on a map based on a user experience according to an initiation.
6 is a diagram showing a detailed configuration of an apparatus for providing a dangerous area determined on a map based on a user experience at the beginning of the day.

The terms used in the present specification will be briefly described, and an embodiment of the present invention will be described in detail.

Terms used in the present specification have selected general terms that are currently widely used as possible while considering functions in the present invention, but this may vary depending on the intention or precedent of a technician working in the field, the emergence of new technologies, and the like. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present specification should be defined based on the meaning of the term and the overall contents of the present invention, not a simple name of the term.

When a part of the specification is said to "include" a certain component, it means that other components may be further included rather than excluding other components unless otherwise stated. In addition, terms such as "... unit" and "module" described in the specification mean units that process at least one function or operation, which may be implemented as hardware or software, or as a combination of hardware and software. .

In the present specification, the "device 100 for automatically reporting a vehicle in violation of traffic laws using a black box image" will be briefly described as the device 100 for reporting violations of traffic laws.

1 is a diagram schematically illustrating a method of automatically reporting a vehicle violating traffic rules using a black box image according to an exemplary embodiment.

A method of automatically reporting a vehicle violating traffic laws using a black box image according to an embodiment of the present invention comprises the steps of obtaining an image including an object located outside the vehicle and a surrounding environment through a camera installed in the vehicle. ; Analyzing the image and determining the type of the object and the type of the road; Determining whether the object violates traffic regulations based on the traffic law information determined according to the type of the object and the type of road; and an image of the object at the time when the traffic violation of the object occurs is automatically transmitted to an external server. It may include the step of transmitting to.

A method of automatically reporting a vehicle that violates traffic regulations using the black box image includes determining the type of the object as one of a person, a bicycle, a motorcycle, and a car; If the object is a car, determining a detailed type of one of a passenger car, a freight car, and a bus according to the purpose of the car; Not determining whether the object violates traffic laws when the object corresponds to an emergency dispatch vehicle including an ambulance, a police vehicle, a hospital ambulance and a fire engine; Determining whether or not a traffic law is violated due to a yield driving of another vehicle located in the vicinity of the emergency dispatch vehicle by applying the traffic regulations according to the emergency dispatch vehicle; Determining whether or not to report a traffic law violation of the other vehicle according to the severity of the traffic law violation; And based on the determined result, the video at the time of the traffic law violation of the other vehicle is automatically transmitted to the external server It may be to include the step of transmitting.

The method of automatically reporting a vehicle that violates traffic rules using the black box image includes obtaining movement information of the object for the speed of the object, the movement direction of the object, lane information, and location information of the object according to the movement of the object. ; Acquiring surrounding environment information including traffic regulation information, traffic light information, weather information, road traffic situation information, hypocrisy photo information, and movement information of other objects according to the characteristics of the road on which the object is moving; And the movement of the object It may include the step of combining information and surrounding environment information with the image of the object and transmitting it to the external server.

A method of automatically reporting a vehicle that violates traffic laws using the black box image includes: transmitting an image 30 seconds before/after the event occurs to the external server; Receiving, from the external server, information on the result of the traffic law violation of the object analyzed the image; And, according to the result of the traffic violation of the object, obtaining a report point according to the report of the object Can be.

The method of automatically reporting a vehicle that violates traffic regulations using the black box image includes an image from a time point when the shape of the first object is detected when obtaining an image of a collision between a first object and a second object. Generating images from the point when the shape of the second object is detected, respectively; Transmitting the image of the first object and the image of the second object to an external server; Receiving information on determining an error ratio of the first object and the second object from the external server; And transmitting the image of the first object, the image of the second object, and information on determining the fruit ratio to the insurance company server of the first object and the insurance company server of the second object.

A method of automatically reporting a vehicle in violation of traffic laws using the black box image includes receiving destination information from a user of the vehicle; Generating a moving route according to the destination information, and determining a risk level in the moving route using traffic regulations, traffic violation history, accident history, and current traffic situation information on the moving route; Generating traffic guidance information to be noted in the moving route based on the risk level; Displaying the traffic guide information determined for each of the movement paths through a display of the vehicle moving along the movement path; Driving a plurality of cameras installed on side and rear sides of the vehicle while moving the area with a high risk level to acquire additional images of surrounding objects of the vehicle; And analyzing the additional image to determine whether the surrounding object violates traffic laws, and automatically transmitting an image 30 seconds before/after the time when the traffic rule violation of the surrounding object occurs to an external server. have.

The traffic law violation reporting device 100 may be installed in a vehicle by one start. For example, the traffic law violation reporting device 100 may be included in the vehicle as a part of the vehicle, or may be mounted detachably.

By the start, the traffic law violation reporting device 100 may acquire images of the inside and outside of the vehicle using at least one camera installed in the vehicle. According to one disclosure, the camera may mean a black box camera, an infrared camera, a camera included in the traffic law violation reporting device 100, and the like, and the type of a device capable of photographing an image is not limited.

According to an initiation, the traffic law violation reporting device 100 may determine an object as the vehicle 102 or the traffic light 101 in the image acquired while the vehicle is moving. In addition, objects such as road conditions, number and shape of lanes, people, street trees, etc. can all be recognized while the vehicle is moving.

By the start of the day, when the traffic light 101 is a red light, the traffic law violation reporting device 100 can take a picture of a scene in which the car 102 moves toward the crosswalk, and the car 102 signals the signal by analyzing the captured image. It can be determined that you have violated. The traffic law violation reporting device 100 may transmit an image of the vehicle 102 at the time of violating the traffic law to the traffic law violation management server. The traffic law violation reporting device 100 automatically transmits all the images including the vehicle 102, the video at the time of violation of the signal, and the video including a predetermined time before/after the time of violation of the signal to an external server. Can be transmitted.

That is, the traffic law violation reporting device 100 analyzes an image obtained from the outside of the vehicle to determine whether the objects located in the image violate traffic law, and transmits the image including the determined result to an external server, thereby automatically Objects can report violations of traffic laws.

FIG. 2 is a flowchart illustrating a method of automatically reporting a vehicle violating traffic laws using a black box image according to one disclosure.

By the start, in block 201, the traffic law violation reporting device 100 may acquire an image including an object located outside the vehicle and a surrounding environment through a black box installed in the vehicle.

By the start, in block 202, the traffic law violation reporting device 100 may analyze the image and determine the type of the object and the type of the road. The traffic law violation reporting device 100 according to the start of the day may determine the type of the object as one of a person, a bicycle, a motorcycle, and a car. By the start of the day, the traffic law violation reporting device 100 classified the type of road according to the purpose of the road, whether a parking prohibited area, whether or not a protected area is designated, whether or not construction, the regulated speed of the road, the number of lanes, the presence or absence of traffic lights, etc. The type of road can be determined based on it. According to one disclosure, the types of roads described above are exemplary only and may be changed according to the rules determined by road traffic rules.

By the start, the traffic law violation reporting device 100 in block 203 may determine whether the object violates the traffic law, based on the traffic law information determined according to the type of the object and the type of road.

The traffic law violation reporting apparatus 100 according to the start of the day may determine whether the object violates the traffic law using traffic law information according to the detailed type of the vehicle and the characteristics of the road on which the object is moving. For example, when acquiring an image of a car moving along a bus lane, it may be determined that the car has violated traffic laws.

According to one disclosure, when the object corresponds to an emergency dispatch vehicle including an ambulance, a police car, a hospital ambulance, and a fire truck, the traffic law violation reporting device 100 may not determine whether the object violates traffic laws. If the traffic law violation reporting device 100 determines a traffic law violation with the same criteria for an emergency vehicle, economic waste may occur due to unnecessary judgment, and social confusion may be increased. Do not judge whether a violation of traffic laws in

By the start, the traffic law violation reporting device 100 may determine the emergency dispatch vehicle from the shape of the vehicle and the license plate of the vehicle. By the start of the day, even when the report video of the emergency dispatch vehicle is transmitted to an external server by the traffic law violation reporting device 100, the report of the emergency dispatch vehicle is not received by the secondary decision of the external server. .

By the start, the traffic law violation reporting device 100 may determine whether or not a traffic law violation due to yield driving of another vehicle located in the vicinity of the emergency dispatch vehicle by applying the traffic regulations according to the emergency dispatch vehicle. For example, even if the moving path of the emergency dispatch vehicle should not be obstructed, when the moving route of the emergency dispatch vehicle is obstructed, a report image of the obstructed vehicle may be transmitted to an external server based on traffic regulations.

By the start, the traffic law violation reporting device 100 may determine whether or not to report a traffic law violation of another vehicle according to the severity of the traffic law violation. By initiation, the traffic law violation reporting device 100 may automatically transmit an image at the time of violation of the traffic law of another vehicle to an external server based on the determined result.

By initiation, in block 204, the traffic law violation reporting device 100 may automatically transmit an image of the object to an external server at the time when the traffic law violation of the object occurs.

As a result of the initiation, the external server is a traffic law report server that is predetermined, and may include, for example, a police agency server, a road traffic server of a ward office, and the like. Further, the external server may include an insurance company server, a hospital server, and the like, and is not limited to the type of server.

By initiation, the traffic law violation reporting device 100 may transmit an image of 30 seconds before/after the event occurs to an external server. Alternatively, the traffic law violation reporting device 100 may transmit an image of the time when the event occurs, or transmit an image of 1 to 2 minutes before/after the event occurs to an external server. Here, the information on the amount of time to send the image may be preset by the user, may be set by an external server, or may be automatically determined by the traffic law violation reporting device 100.

According to an initiation, the traffic law violation reporting device 100 may receive information about a traffic law violation result of an object that has analyzed an image from an external server. In other words, by checking the result of the traffic law violation secondly determined by the external server, feedback on whether the report on the traffic law violation is correct can be received.

By initiation, the traffic law violation reporting device 100 may acquire a report point according to the object's report according to the object's traffic law violation result. Here, the reporting point may refer to a compensation amount determined in advance according to a report of a traffic violation. As a result, the user has the advantage of being able to automatically report traffic violations and obtain compensation by using the traffic law violation reporting device 100.

3 is a diagram for explaining a method of analyzing an illegal activity by analyzing images of a plurality of objects located outside a vehicle according to an exemplary embodiment.

By the start of the day, when the traffic law violation reporting device 100 acquires an image of a collision between the first object and the second object, the image from the time when the shape of the first object is detected and the shape of the second object are Each image from the detected time point can be generated.

By the start, the traffic law violation reporting device 100 may transmit the image of the first object and the image of the second object to an external server.

By the start, the traffic law violation reporting device 100 may receive information on determining the negligence ratio of the first object and the second object from an external server. In this case, the external server may mean a traffic law-related server, a police station server, an insurance company server, and the like, and may mean any system capable of determining an error rate.

According to one disclosure, the traffic law violation reporting device 100 may transmit an image of a first object, an image of a second object, and information on determining an error rate to the insurance company server of the first object and the insurance company server of the second object. That is, the traffic law violation reporting device 100 may help solve a problem caused by a collision of an object by automatically transmitting an image of a collision process of an object to the insurance company server of the object.

By the start of the day, when the information on the first object and the second object cannot be obtained directly, the traffic law violation reporting device 100 transmits an image of the collision of the object through an external server through the National Police Agency server. The object and the server connected to the second object may be transmitted, and a transmission result may be obtained through an external server.

According to one disclosure, the traffic law violation reporting device 100 may obtain movement information of an object with respect to the speed of the object, the movement direction of the object, lane information, and location information of the object according to the movement of the object. That is, according to an initiation, the traffic law violation reporting device 100 may acquire other information of an object through acquisition of information from a sensor, another camera, or a peripheral device.

By the start, the traffic law violation reporting device 100 includes traffic law information, traffic light information, weather information, road traffic situation information, hypocrisy photo information, and movement information of other objects according to the characteristics of the road on which the object is moving. The surrounding environment information can be obtained. That is, by the start of the day, the traffic law violation reporting device 100 collects the surrounding environment information at the time when the image is acquired through information received from sensors, satellite devices, other cameras, external servers, peripheral devices, and other vehicles. It can be acquired in real time.

By the start, the traffic law violation reporting device 100 may combine movement information of an object and surrounding environment information with an image of the object and transmit it to an external server. By initiation, the traffic law violation reporting device 100 may transmit surrounding environment information and object movement information to an external server to prevent false reporting due to machine errors, special application of laws, and changes in traffic laws. . The external server may prevent unfair reporting by determining whether the object violates traffic laws once again, and may transmit the determined result to the traffic law violation reporting device 100 or to the user's terminal.

For example, as shown in FIG. 3, an image of a collision between the car 301 and the bicycle 303 may be automatically transmitted to an external server, and the insurance company server of the car 301 and the bicycle 303 user The collision video can be transmitted to an insurance company server or the like.

In addition, the traffic law violation reporting device 100 may receive information on the wanted vehicle and the wanted person from an external server. For example, information on the vehicle type, license plate information, and vehicle status of the wanted vehicle may be obtained, and information on the impression, dress, height, age, and montage information of the wanted person may be obtained.

By the start of the day, when the traffic law violation reporting device 100 acquires an image that matches at least 80% of the information on any one of the wanted vehicle and the wanted person from the surrounding image of the acquired vehicle, the acquired image is transferred to an external server. Can be transferred to. For example, the traffic law violation reporting device 100 may obtain a match rate between the wanted vehicle and the wanted person and the acquired information using an artificial intelligence learning model. According to one disclosure, the 80% match rate is only an example, and may vary according to embodiments.

According to one disclosure, the traffic law violation reporting device 100 may receive information on whether the image matches information on the wanted vehicle and the wanted person from an external server. That is, by the start of the day, the traffic law violation reporting device 100 primarily determines whether or not it is consistent, and a more accurate determination can be made in an external server, and the traffic law violation reporting device 100 It is possible to receive the result of the correct secondary judgment.

By the start of the day, when the traffic law violation reporting device 100 receives determination information that the image corresponds to one of the wanted vehicle and the wanted person, the time from the start point to the end point of detecting any one of the wanted vehicle and the wanted person Images up to and including can be transmitted to an external server. That is, in order to provide more detailed information, all information including the wanted vehicle or the wanted person may be transmitted to an external server.

For example, when the traffic law violation reporting device 100 determines that 82% of the information on the desired person's impression of the pedestrian 302 matches, all images including the pedestrian 302 can be transmitted to the National Police Agency server. have. According to one disclosure, the traffic law violation reporting device 100 may transmit an image generated from a different angle to an external server using another camera of the vehicle.

FIG. 4 is a diagram for explaining features for displaying information on traffic laws and danger reporting areas using a display device of a vehicle according to one disclosure.

By the start, the traffic law violation reporting device 100 may receive destination information from the user of the vehicle.

By the start of the day, the traffic law violation reporting device 100 generates a moving route according to the destination information, and uses the traffic law in the moving route, the traffic law violation history, the accident history, and the current traffic situation information. The level of risk can be determined. Here, the risk level is to determine whether any traffic law violations have been frequently made on the corresponding road, and may be determined based on the fact of detecting or reporting the violation of the traffic law. For example, based on the fact of 10 or more identical speeding violation reports during a month on the first road, the speeding risk level on the first road may be determined to be 5, and one speeding violation report per month on the second road. Based on the fact, the speeding risk level of the second road may be determined as 1.

By the start, the traffic law violation reporting device 100 may generate traffic guide information to be noted in the moving route based on the risk level. The traffic law violation reporting device 100 may display traffic guide information determined for each movement path through a display of a vehicle moving along a movement path.

By the start, the traffic law violation reporting device 100 may acquire additional images of surrounding objects of the vehicle by driving a plurality of cameras installed on the side and rear of the vehicle while moving in an area with a high risk level. . That is, the traffic law violation reporting device 100 may acquire additional information by operating an additional device in order to increase the reporting rate in an area with a high risk level.

By the start of the day, the traffic law violation reporting device 100 analyzes the additional image to determine whether the neighboring object violates the traffic law, and automatically externalizes the video 30 seconds before/after the time when the traffic law violation of the neighboring object occurs. Can be sent to the server. The 30 seconds before/after are merely exemplary, and the video time may be preset by a user or an administrator.

According to one disclosure, the traffic law violation reporting device 100 may display that the current road zone is an 80 km/h speed limit zone, and that a speed violation is always reported as an area through the vehicle's head-up display device 402. In addition, the traffic law violation reporting device 100 may display a risk level for a current road.

Furthermore, the traffic law violation reporting device 100 displays the speed and signal violation of the other vehicle 401 through the display device of the vehicle, so that the fact of the speed violation of the other vehicle 401, whether it is reported, the degree of speed violation, etc. Information can be presented to the user.

5 is a diagram illustrating a main configuration of an apparatus for providing a dangerous area determined on a map based on a user experience according to an initiation.

FIG. 7 is a diagram illustrating a detailed configuration of an apparatus for providing a dangerous area determined on a map based on a user experience at an initiation.

According to another embodiment of the present invention, an apparatus for automatically reporting a vehicle in violation of traffic laws using a black box image includes a camera for photographing an image around the vehicle; Processor; And a memory storing instructions executable by the processor, wherein the processor obtains an image including an object located outside the vehicle and a surrounding environment through a camera installed in the vehicle by executing the instructions, and , By analyzing the image, determining the type of the object and the type of the road, determining whether the object violates the traffic rules based on the traffic law information determined according to the type of the object and the type of the road, and the object It may be characterized in that the image of the object is automatically transmitted to an external server at the time when a violation of traffic laws of

According to one disclosure, the traffic law violation reporting device 100 may include a camera 1610, a communication unit 1500, a processor 1300, and a memory 1700. However, not all of the components shown in FIG. 6 are essential components of the traffic law violation reporting device 100. The traffic law violation reporting device 100 may be implemented by more components than those shown in FIG. 6, and the traffic law violation reporting device 100 is implemented by fewer components than the components shown in FIG. 6 It could be.

For example, as shown in FIG. 7, the traffic law violation reporting device 100 according to an embodiment includes a user input unit 1100, a communication unit 1500, a display unit 1210, a processor 1300, and a memory. In addition to the 1700, an output unit 1200, a sensing unit 1400, and an A/V input unit 1600 may be further included.

For example, the traffic law violation reporting device 100 according to an embodiment may basically include a control unit 1300, a user input unit 1100, and a memory 1700, and report a traffic law violation according to an embodiment. In addition to the control unit 1300, the communication unit 1500, and the memory 1700, the device 100 includes at least one of the communication unit 1500, the output unit 1200, the sensing unit 1400, and the A/V input unit 1600. It may be a traffic law violation reporting device 100 that further includes.

The user input unit 1100 refers to a means for a user to input data for controlling the traffic law violation reporting device 100. For example, the user input unit 1100 includes a key pad, a dome switch, a touch pad (contact type capacitance method, pressure type resistive film method, infrared detection method, surface ultrasonic conduction method, integral type). Tension measurement method, piezo effect method, etc.), a jog wheel, a jog switch, and the like, but are not limited thereto.

The user input unit 1100 may receive a user input for receiving a user input for controlling an operation of a module installed in the traffic law violation reporting device 100.

The output unit 1200 may output an audio signal, a video signal, or a vibration signal, and the output unit 1200 may include a display unit 1210, an audio output unit 1220, and a vibration motor 1230. have. In an embodiment, the output unit 1200 may output a notification message in the form of audio, video, and/or vibration.

The display unit 1210 displays and outputs information processed by the traffic law violation reporting device 100.

The sound output unit 1220 outputs audio data received from the communication unit 1500 or stored in the memory 1700. In addition, the sound output unit 1220 outputs sound signals related to functions (eg, a call signal reception sound, a message reception sound, and a notification sound) performed by the traffic law violation reporting device 100. For example, the sound output unit 1220 may output an alarm sound for notifying that an event has occurred.

The controller 1300 controls the general operation of the traffic law violation reporting device 100 in general. According to one disclosure, the control unit is also referred to as a processor. For example, by executing programs stored in the memory 1700, the control unit 1300, the user input unit 1100, the output unit 1200, the sensing unit 1400, the communication unit 1500, the A/V input unit 1600 ) And so on. In addition, the controller 1300 may perform a function of the traffic law violation reporting device 100 by executing programs stored in the memory 1700. The control unit 1300 may include at least one processor. The controller 1300 may include a plurality of processors or may include one integrated processor according to its function and role. In an embodiment, the controller 1300 may include at least one processor that provides a notification message by executing at least one program stored in the memory 1700.

The sensing unit 1400 may detect a state of the traffic law violation reporting device 100, a user's state, or a state around the traffic law violation reporting device 100, and transmit the detected information to the controller 1300.

The sensing unit 1400 includes a magnetic sensor 1410, an acceleration sensor 1420, a temperature/humidity sensor 1430, an infrared sensor 1440, a gyroscope sensor 1450, and a position sensor. (For example, a GPS) 1460, an atmospheric pressure sensor 1470, a proximity sensor 1480, and an RGB sensor 1490 may be included, but the present invention is not limited thereto. Since the function of each sensor can be intuitively inferred by a person skilled in the art from its name, detailed description will be omitted.

The communication unit 1500 may include one or more components that allow the traffic law violation reporting device 100 to communicate with other devices and other servers. For example, the communication unit 1500 may include a short range communication unit 1510, a mobile communication unit 1520, and a broadcast reception unit 1530. The other user device may be a computing device or a sensing device, but is not limited thereto.

The short-range wireless communication unit 1510 includes a Bluetooth communication unit, a Bluetooth Low Energy (BLE) communication unit, a Near Field Communication unit, a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, an infrared ( IrDA, infrared data association) communication unit, WFD (Wi-Fi Direct) communication unit, UWB (ultra wideband) communication unit, Ant+ communication unit, etc. may be included, but is not limited thereto.

The mobile communication unit 1520 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission/reception of text/multimedia messages.

The broadcast receiver 1530 receives a broadcast signal and/or broadcast-related information from outside through a broadcast channel. Broadcast channels may include satellite channels and terrestrial channels. Depending on the implementation example, the traffic law violation reporting device 100 may not include the broadcast receiver 1530.

In one embodiment, the communication unit 1500 may receive a video sequence including a plurality of frames from a camera installed in the traffic law violation reporting device 100. In one embodiment, the communication unit 1500 may transmit a command for controlling the operation of a module installed in the traffic regulation violation reporting device 100 to a module installed in the traffic regulation violation reporting device 100.

The A/V (Audio/Video) input unit 1600 is for inputting an audio signal or a video signal, and may include a camera 1610 and a microphone 1620. The camera 1610 may obtain an image frame such as a still image or a video through an image sensor in a video call mode or a photographing mode. The image captured through the image sensor may be processed by the controller 1300 or a separate image processing unit (not shown). For example, an image captured by the camera 1610 may be used as information for determining whether an event has occurred.

The microphone 1620 receives an external sound signal and processes it as electrical voice data. For example, the microphone 1620 may receive an acoustic signal from an external device or a user. The microphone 1620 may use various noise removal algorithms for removing noise generated in a process of receiving an external sound signal.

The memory 1700 may store a program for processing and control of the controller 1300 and may store data input to the traffic law violation reporting device 100 or output from the traffic law violation reporting device 100.

The memory 1700 is a flash memory 1700 type (flash memory type), a hard disk type (hard disk type), a multimedia card micro type (multimedia card micro type), a card type memory 1700 (for example, SD or XD memory (1700), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read- Only Memory), a magnetic memory 1700, a magnetic disk, and an optical disk.

Programs stored in the memory 1700 can be classified into a plurality of modules according to their functions. Here, the plurality of modules are software, not hardware, meaning modules that operate functionally. For example, a UI module ( 1710), a touch screen module 1720, a notification module 1730, and the like.

The UI module 1710 may provide a specialized UI, a GUI, etc. linked to the traffic law violation reporting device 100 for each application. The touch screen module 1720 may detect a user's touch gesture on the touch screen and transmit information on the touch gesture to the controller 1300. The touch screen module 1720 according to an embodiment may recognize and analyze a touch code. The touch screen module 1720 may be configured as separate hardware including a controller.

The notification module 1730 may generate a signal for notifying the occurrence of an event. The notification module 1730 may output a notification signal in the form of a video signal through the display unit 1210, may output a notification signal in the form of an audio signal through the sound output unit 1220, and the vibration motor 1230 It is also possible to output a notification signal in the form of a vibration signal through.

The storage medium according to another embodiment of the present invention is a non-transitory computer-readable storage medium in which instructions executable by a processor are stored in order to execute a method of automatically reporting a vehicle in violation of traffic laws using the black box image. Can be.

Accordingly, the method according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded in the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements by those skilled in the art using the basic concept of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

Claims (9)

Obtaining an image including an object located outside the vehicle and a surrounding environment through a camera installed in the vehicle;
Analyzing the image and determining the type of the object and the type of the road;
Determining whether the object violates traffic regulations based on traffic regulations information determined according to the type of the object and the type of road; And
A method of automatically reporting a vehicle that violates traffic laws using a black box image, comprising the step of automatically transmitting an image of the object at the time when the traffic violation of the object occurs to an external server. The method of claim 1,
Determining the type of the object as one of a person, a bicycle, a motorcycle, and a car;
If the object is a car, determining a detailed type of one of a passenger car, a freight car, and a bus according to the purpose of the car;
Not determining whether the object violates traffic laws when the object corresponds to an emergency dispatch vehicle including an ambulance, a police vehicle, a hospital ambulance and a fire engine;
Determining whether or not a traffic law is violated due to a yield driving of another vehicle located in the vicinity of the emergency dispatch vehicle by applying the traffic regulations according to the emergency dispatch vehicle;
Determining whether or not to report a violation of the traffic regulations of the other vehicle according to the severity of the violation of the traffic regulations; And
Based on the determined result, a method of automatically reporting a vehicle in violation of traffic laws using a black box image comprising the step of automatically transmitting an image at the time of violation of traffic laws of the other vehicle to the external server. The method of claim 1,
Obtaining movement information of the object with respect to the speed of the object according to the movement of the object, the movement direction of the object, lane information, and location information of the object;
Acquiring surrounding environment information including traffic regulation information, traffic light information, weather information, road traffic situation information, hypocrisy photo information, and movement information of other objects according to the characteristics of the road on which the object is moving; And
A method for automatically reporting a vehicle in violation of traffic laws using a black box image, comprising the step of combining the movement information of the object and the surrounding environment information with the image of the object and transmitting it to the external server. The method of claim 1,
Transmitting an image of 30 seconds before/after the event occurs to the external server;
Receiving, from the external server, information on a result of a traffic law violation of the object analyzing the image; And
A method of automatically reporting a vehicle for violating traffic laws using a black box image, comprising the step of acquiring a report point according to the report of the object according to the result of the traffic violation of the object. The method of claim 1,
Generating an image from a point when the shape of the first object is detected and an image from a point when the shape of the second object is detected when acquiring an image of a collision between the first object and the second object;
Transmitting the image of the first object and the image of the second object to an external server;
Receiving information on determining an error ratio of the first object and the second object from the external server; And
Traffic regulations using a black box image, comprising transmitting the image of the first object, the image of the second object, and information on determining the percentage of errors to the insurance company server of the first object and the insurance company server of the second object. How to automatically report violating vehicles. The method of claim 1,
Receiving destination information from a user of the vehicle;
Generating a moving route according to the destination information, and determining a risk level in the moving route using traffic regulations, traffic violation history, accident history, and current traffic situation information on the moving route;
Generating traffic guide information to be noted in the moving route based on the risk level;
Displaying the traffic guide information determined for each of the movement paths through a display of the vehicle moving along the movement path;
Driving a plurality of cameras installed on side and rear sides of the vehicle while moving the area with a high risk level to obtain additional images of surrounding objects of the vehicle; And
A black box comprising the step of analyzing the additional image to determine whether the surrounding object violates traffic laws, and automatically transmitting an image 30 seconds before/after the time when the traffic rule violation of the surrounding object occurs to an external server How to automatically report traffic violations using video. A camera for photographing an image around the vehicle;
Processor; And
It includes a memory for storing instructions executable by the processor, the processor,
By executing the above commands,
Through a camera installed in the vehicle, an image including an object located outside the vehicle and the surrounding environment is acquired,
By analyzing the image, the type of the object and the type of the road are determined,
Based on the traffic law information determined according to the type of the object and the type of road, it is determined whether the object violates traffic regulations,
Characterized in that the image of the object at the time when the violation of traffic laws of the object occurs to an external server automatically,
A device that automatically reports a vehicle violating traffic laws using a black box image. The method of claim 7,
The transmission to the external server is
Transmitting information obtained by combining movement information and surrounding environment information of the object with the image of the object
A device that automatically reports a vehicle violating traffic regulations using a black box image. A non-transitory computer-readable storage medium storing instructions executable by a processor to execute the method of claim 1.

Images