KR102426735B1 - Automotive security system capable of shooting in all directions with theft notification function applied - Google Patents

Abstract

A security system for an automobile capable of omnidirectional shooting is installed inside the vehicle and includes an omnidirectional shooting unit including a single lens module for shooting a 360-degree direction, and image processing of the captured image of the omnidirectional shooting unit to generate an omnidirectional flat image, An image processing unit that divides and outputs a 180-degree image and a 180-degree rear image, and recognizes the object of the omnidirectional plane image, but stores the omnidirectional plane image for a predetermined time only when the occupant's preset theft is recognized as an object It characterized in that it comprises a control unit for controlling.

Description

{Automotive security system capable of shooting in all directions with theft notification function applied}

The present invention relates to a security system for a vehicle, and more particularly, to a security system for a vehicle capable of omnidirectional shooting to which a theft notification function is applied.

In recent years, assaults on buses and taxis are becoming more and more common. If a separate CCTV or black box is installed inside the vehicle, such data can be obtained, but otherwise, the method of securing evidence is not easy.

Currently, most drivers install a vehicle black box that takes pictures of the outside of the vehicle and use it as evidence in case of an accident.

In case of traffic accidents, when the parties agree or report, the amount of damage is shared according to the mutual negligence according to the judgment of the police authorities and the insurance company. There are frequent cases where a different amount is charged to one side, and a lot of time and effort is wasted in order to clearly identify the cause of the accident.

In particular, insurance companies spend a considerable amount of money, both in human and material terms, for this purpose, such as seeking help from experts or obtaining advice from specialized agencies, because there is a significant difference in the amount of insurance paid to the driver depending on the judgment and mutual responsibility of the perpetrator and victim. this was requested

However, even if the judgment of the perpetrator and the victim and the degree of mutual responsibility were defined by seeking advice from experts and specialized agencies, it was difficult for the victim to understand the accident. the current situation.

Moreover, in a situation where the judgment and mutual responsibility of the perpetrators and victims are evaluated without objective data, arbitrary manipulation of the accident situation is prevalent, resulting in innocent victims, and lawsuits are on the rise. Therefore, there was a problem in that it was difficult to make objective rules for accident situations because it was not possible to clearly identify the situation judgment accompanying the traffic accident.

In order to solve the above-mentioned problems, an image recording system for photographing the internal and external influences of a vehicle, aka a black box, has been released. However, in the existing black box, there are many difficulties in terms of cost and installation because it is possible to shoot all 4 sides of the vehicle only by using 4 channels.

US 20-2011-0000977 U

The present invention has been proposed to solve the above technical problems, and by photographing the inside of the vehicle using a 360-degree single lens module, it prevents unpleasant incidents with passengers while driving the vehicle, and stores the situation that occurs during parking. It provides a security system for automobiles that can take omnidirectional shooting that informs the user afterward.

In addition, there is provided a security system for a vehicle capable of omnidirectional photographing that stores an omnidirectional flat image for a predetermined time only when the occupant's preset theft behavior is recognized as an object.

In addition, the data server receives the omnidirectional plane image in LTE communication method, recognizes the object of the omnidirectional plane image in real time, and provides a security system for omnidirectional imaging that can feed back the recognized object information to the vehicle imaging device.

According to an embodiment of the present invention for solving the above problems, an omnidirectional photographing unit including a single lens module for photographing a 360-degree direction installed inside a car, and an omnidirectional flat image by image processing the photographed image of the omnidirectional photographing unit an image processing unit that divides and outputs the front 180-degree image and the rear 180-degree image, and recognizes the object of the omnidirectional flat image, but only when the occupant's preset theft is recognized as an object for a predetermined time. There is provided a security system for a vehicle capable of omnidirectional shooting including a control unit for controlling to store.

In addition, the present invention is a communication module that transmits an omnidirectional plane image in real time, and receives the omnidirectional plane image transmitted from the communication module, recognizes the object of the omnidirectional plane image in real time, and feeds back the recognized object information to the image processing unit There is provided a security system for automobiles capable of omnidirectional shooting, including a data server.

In addition, when the data server included in the present invention feeds back the recognized object information to the image processing unit, each object information is characterized in that it includes an identification code allocated in advance for each type of object.

In addition, in the data server included in the present invention, in feeding back the recognized object information to the image processing unit, each object information includes an identification code pre-allocated for each object type and location information for each time of the central region of each object. characterized in that

In addition, the image processing unit included in the present invention, when receiving a rear image of the rear region of the vehicle from the rear camera, it characterized in that the display by matching the coordinates in the omnidirectional plane image.

The security system for a vehicle capable of omnidirectional shooting according to an embodiment of the present invention stores an omnidirectional plane image for a predetermined time only when a preset theft behavior of a occupant is recognized as an object. That is, not all images are recorded, but only actions performed in a specific situation, such as theft or violence, are recorded by object recognition, so that the invasion of personal privacy can be minimized.

In addition, in the vehicle security system capable of omnidirectional shooting, the data server receives the omnidirectional plane image through LTE communication method, recognizes the object of the omnidirectional plane image in real time, and feeds back the recognized object information to the vehicle imaging device. It is possible to reduce the power consumption of the vehicle photographing device.

1 is a configuration diagram of a security system for a vehicle capable of omnidirectional shooting according to an embodiment of the present invention (1)
2 is a conceptual diagram illustrating a method for generating a flat image;
3 is an exemplary view in which a planar image is divided into a front 180-degree image and a rear 180-degree image and output
4 is an exemplary view in which a person and a vehicle are distinguished and object recognized;
5 is an exemplary view in which a vehicle is recognized as an object;

Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings in order to describe in detail enough that a person of ordinary skill in the art to which the present invention pertains can easily implement the technical idea of the present invention.

1 is a configuration diagram of a security system for a vehicle capable of omnidirectional shooting according to an embodiment of the present invention (1), and FIG. 2 is a conceptual diagram illustrating a method for generating a planar image.

The security system for a vehicle capable of omnidirectional shooting according to this embodiment includes only a simple configuration for clearly explaining the technical idea to be proposed.

Referring to FIGS. 1 and 2 , the vehicle security system capable of omnidirectional photographing includes a vehicle photographing device 100 , a rear camera 200 , a data server 300 , and a user terminal 400 .

The main operation of the security system for a vehicle capable of omnidirectional shooting configured as described above is made as follows.

The vehicle photographing device 100 is defined as a vehicle black box, which is a device for photographing interior/external images of a vehicle. The vehicle photographing apparatus 100 includes an omnidirectional photographing unit 110 , an image processing unit 120 , a carbon dioxide sensor 130 , and a control unit 140 .

The control unit 140 controls the operations of the omnidirectional photographing unit 110 , the image processing unit 120 , and the carbon dioxide sensor 130 , and includes a memory for image storage, a communication module, and a battery module. It is preferable that the communication module is equipped with an LTE communication module that is a broadband communication method.

The omnidirectional photographing unit 110 is installed inside the vehicle and includes a single lens module for photographing a 360-degree direction.

That is, the omnidirectional photographing unit 110 refracts the incident light, and a side surface made of a convex light refraction surface to the lower side, an upper surface consisting of a light reflection surface on which the light incident on the light refraction surface is reflected, and a lower part of the light reflection surface and a catadioptric lens having a lower surface formed of a light exit surface through which light reflected from the light reflection surface is emitted downward.

In addition, the omnidirectional photographing unit 110 includes a catadioptric lens holder having a light transmitting part of a transparent material to surround and accommodate the side surface of the catadioptric lens, and to cover the upper surface of the catadioptric lens, to the catadioptric lens holder. It includes a cover that is fastened to fix the catadioptric lens, at least one light-transmitting lens through which light emitted downward through the light-exiting surface transmits, and an image sensor that captures the light transmitted through the light-transmitting lens, , can be manufactured to have a barrel assembly coupled to the catadioptric lens holder.

For reference, since the image by the omnidirectional lens can cause a blind spot in the central area, the shooting unit can minimize the blind area by applying a fisheye lens, and apply a lens that supports up to 5Mega (QHD) and use a 3Mega image sensor (Image Sensor) may be applied to secure a high-resolution 360-degree image.

The image processing unit 120 generates an omnidirectional flat image by image processing the captured image of the omnidirectional photographing unit.

Referring to FIG. 2A , the image processing unit 120 may obtain an original image through an omnidirectional optical lens unit, and may obtain a circular image by preferentially removing unnecessary image portions.

The circular image 30 may be divided for partial distortion reduction and partial image processing to generate a flat image.

The unit of the divided circular image (the circular division unit image, 31) may be divided in consideration of resolution, arc, pixel, image distortion, and the like.

A method of generating a planar image based on the circular division unit image 31 will be described with reference to FIG. 2B .

First, the pixel structure of the circular division unit image 31 may be grasped. The reference focal pixel 32 for the circular division unit image 31 for which the pixel structure is identified may be extracted. The reference focal pixel 32 may be a pixel that does not require expansion or contraction. The pixel structure may be divided into a pixel to be reduced and a pixel to be expanded based on the reference focal pixel 32 .

Correction processing may be performed per pixel in order to eliminate partial distortion for generating a plane division unit image. For example, the reduction is performed by determining the reduction area 33 for the area expanded based on the reference focal pixel 32 , and the expansion area 34 is determined for the reduced area and expansion is performed through interpolation. can do. A plane division unit image may be extracted through additional image processing in consideration of resolution, arc, pixel, image distortion, and the like. Through this method, a plurality of circular division unit images may be generated as a plurality of plane division unit images.

3 is an exemplary diagram in which a planar image is divided into a front 180-degree image and a rear 180-degree image and output.

Referring to FIG. 3 , the image processing unit generates an omnidirectional flat image by image processing the captured image of the omnidirectional photographing unit, and may divide the image into a front 180-degree image and a rear 180-degree image and output it.

4 is an exemplary diagram in which a person and a vehicle are distinguished and object is recognized, and FIG. 5 is an exemplary diagram in which a vehicle is recognized as an object.

4 and 5 , the control unit recognizes the object of the omnidirectional plane image, but may control to store the omnidirectional plane image for a predetermined time only when the occupant's preset theft behavior is recognized as an object. Here, the preset behavior of the passenger may be an act of violence using hands or a violent act using feet while moving toward the driver's seat. In this case, the controller may identify the violent act by additionally considering the voice of the passenger. That is, it will be possible to improve the behavior recognition accuracy by recognizing the case where the passenger performs a specific action while swearing.

The communication module of the control unit 140 transmits the omnidirectional plane image generated by the image processing unit 120 in real time, and receives object information transmitted from the data server 300 .

The data server 300 receives the omnidirectional plane image transmitted from the communication module, and performs an image processor for recognizing the object of the omnidirectional plane image in real time. The data server 300 feeds back the recognized object information to the image processing unit 120 . That is, the object recognition process is performed in the data server 300, and the data server 300 feeds back only the recognized result as object information to the image processing unit 120, thereby reducing the computational load of the image processing unit 120. effect occurs. In this case, the image processing unit 120 may transmit an omnidirectional flat image and, at the same time, transmit a desired image processing command to the data server 300 , and receive only the result value as feedback.

In this way, the data server 300 feeds back the recognized object information to the image processing unit 120, and each object information includes an identification code pre-allocated for each object type and location information for each time of the central region of each object. .

For example, when an object called a license plate is recognized, an identification code assigned in advance to the license plate and location information for each time on the location (coordinate) of the central region of the license plate are transmitted.

For reference, the identification code includes an object code and an additional code, the object code is a code assigned to the shape of a vehicle license plate, and the additional code is defined as encoding additional data information such as the number of the vehicle license plate.

Therefore, the image processing unit 120 can receive the object information transmitted from the data server 300 without directly processing the image processing operation, and determine the recognized number of the object called the license plate and its movement position. The data server 300 simultaneously recognizes a plurality of objects at the request of the image processing unit 120 and can track their respective locations in real time.

On the other hand, when the image processing unit 120 receives the rear image of the rear region of the vehicle from the rear camera 200, it can display the coordinates by matching the coordinates in the omnidirectional plane image.

That is, when the vehicle photographing apparatus 100 is installed near the driver's seat and there are many occupants, the image of the rear of the vehicle may not be displayed. In order to compensate for this, when a separate rear camera 200 is installed and transmitted, the image processing unit 120 coordinates the rear image to the omnidirectional flat image and then generates one image.

The vehicle security system capable of omnidirectional imaging includes a carbon dioxide sensor 130 , and the carbon dioxide sensor 130 detects the carbon dioxide concentration and transmits it to the image processing unit 120 .

The image processing unit 120 processes the carbon dioxide concentration to be displayed on the omnidirectional planar image. When the carbon dioxide concentration exceeds a reference value, it controls to warn using visual and auditory means.

Meanwhile, when the carbon dioxide concentration prediction mode is set, the image processing unit 120 may automatically warn after a predetermined delay time when the change rate of the carbon dioxide concentration exceeds the reference change rate. At this time, as the carbon dioxide concentration change rate increases, the delay time is automatically decreased.

In addition, in the carbon dioxide concentration prediction mode, the number of occupants and the internal area of the vehicle are automatically detected from the image taken by the omnidirectional photographing unit 110, and the number of occupants and the interior area are additionally taken into consideration - estimating the amount of carbon dioxide accumulation - and outputting a warning. Delay time can be adjusted automatically. At this time, based on the object recognition of the occupant, it is possible to classify the carbon dioxide emissions by classifying women, men, and children.

This object recognition operation is performed in the data server 300 . For reference, window opening recognition (window opening time), door opening recognition (number and time of door opening), and vehicle air conditioner operation status can be used as reference variables to estimate the amount of carbon dioxide accumulation and adjust the delay time for outputting a warning.

The data server 300 may intelligently analyze and feed back the error rate when the accident occurrence image is received. In addition, the data server 300 may intelligently analyze the vehicle image that violates the law and extract only the image necessary for reporting the violation of the law. When the data server 300 determines a vehicle violating the law from the image, the violation situation may be intelligently determined by considering the map information (parking and stopping information, road information, and local government notices) together.

In addition, the data server 300 feeds back a portion of the 360-degree captured image in which there is no change in the image, and the image processing unit 120 automatically removes the portion in which the image does not change, thereby reducing the storage capacity.

In addition, after dividing the image into a plurality of regions, the data server 300 may feed back information to the image processing unit 120 to change the stored image frame for each region in consideration of the motion of the object or the vehicle speed. .

The user terminal 400 is a generic term for devices that a user can carry and use, such as a mobile phone, a smart phone, and a smart pad.

The user terminal 400 may receive an alarm when a theft situation is recognized among the object recognition results of the vehicle photographing apparatus 100 .

In addition, when an occupant or driver in the vehicle uses the user terminal 400 to photograph the side of the vehicle, an external image corresponding to the side of the vehicle is transmitted to the image processing unit 120 . In this case, the image processing unit 120 may generate one image after coordinate matching the external image to the omnidirectional flat image.

In addition, when an external image is transmitted from the plurality of user terminals 400 to the image processing unit 120 , the image processing unit 120 may coordinate-match the plurality of external images to the omnidirectional flat image and then generate one image. . In this case, different location identifiers may be attached to seats, windows, etc. inside the vehicle, and the image processing unit 120 may perform coordinate matching with reference to a plurality of location identifiers.

In addition, when the data server 300 recognizes an object in which a child is riding in the vehicle, the child protection mode is automatically executed in the vehicle security system capable of omnidirectional photographing.

The child protection mode executes a function to prevent children from being left unattended after object recognition of whether the engine is maintained or whether the driver and guardians get off. That is, when only a child is detected for a predetermined time or longer without a driver and a guardian, a warning is transmitted to the user terminal 400 .

On the other hand, when an accident image is transmitted from the vehicle photographing device 100 to the data server 300, the data server 300 recognizes the received video or still image to determine the type of vehicle (front wheel, rear wheel, four wheel), vehicle After automatically determining the size, state of damage, and number of vehicles, this information can be included in a push message and sent to the tow truck company. In this case, after recognizing the number of the license plate, the type of vehicle may be recognized based on the number.

That is, the number of required tow trucks, the size of the tow vehicle, and the towing type (front, rear, four-wheel) may vary depending on the type of vehicle (front, rear, four-wheel), the size of the vehicle, the state of damage, and the number of vehicles. The server 300 may automatically recognize the image required for towing and include it in the transmission message.

When the data server 300 determines the damage state of the vehicle through image recognition, it may convert the damage to each wheel part of the vehicle into a numerical value and include it in the transmission message. For example, the damage state of the front left wheel is 1 to 100% (the closer to 100%, the greater the damage), the damage to the right front wheel is 1 to 100%, the damage to the rear left wheel is 1 to 100%, The damage status of the right rear wheel can be converted to 1 ~ 100% and included in the push message.

The present invention has been proposed to solve the above technical problems, and by photographing the inside of the vehicle using a 360-degree single lens module, it prevents unpleasant incidents with passengers while driving the vehicle, and stores the situation that occurs during parking. It provides a security system for automobiles that can take omnidirectional shooting that informs the user afterward.

In addition, there is provided a security system for a vehicle capable of omnidirectional photographing that stores an omnidirectional flat image for a predetermined time only when the occupant's preset theft behavior is recognized as an object.

In addition, the data server receives the omnidirectional plane image in LTE communication method, recognizes the object of the omnidirectional plane image in real time, and provides a security system for omnidirectional imaging that can feed back the recognized object information to the vehicle imaging device.

As such, those skilled in the art to which the present invention pertains will understand that the present invention may be embodied in other specific forms without changing the technical spirit or essential characteristics thereof. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. The scope of the present invention is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

100: vehicle photographing device
110: omnidirectional shooting unit
120: image processing unit
130: carbon dioxide detection sensor
200: rear camera
300 : data server
400: user terminal

Claims (5)

An omnidirectional photographing unit that is installed inside the vehicle and includes a single lens module for photographing a 360-degree direction;
an image processing unit for generating an omnidirectional flat image by image processing the captured image of the omnidirectional photographing unit, dividing the image into a front 180-degree image and a rear 180-degree image;
a control unit for recognizing the object of the omnidirectional plane image, but controlling to store the omnidirectional plane image for a predetermined time only when the occupant's preset theft behavior is recognized as an object;
a communication module for transmitting the omnidirectional flat image in real time; and
A data server that receives the omnidirectional plane image transmitted from the communication module, recognizes the object of the omnidirectional plane image in real time, and feeds back the recognized object information to the image processing unit;
When the data server feeds back the recognized object information to the image processing unit, each object information includes an identification code pre-allocated for each object type and location information for each time on the central region of each object. A security system for cars that can take pictures.
delete delete delete According to claim 1,
The image processing unit,
When receiving a rear image of the rear area of the vehicle from the rear camera, the vehicle security system capable of omnidirectional shooting, characterized in that the display by matching the coordinates to the omnidirectional plane image.

Images