KR101922376B1 - Method for sharing and start controlling of vehicle driving information in user terminal using face recognition function - Google Patents

Abstract

The present invention relates to a vehicle driving information sharing system using a face recognition function, capable of sharing vehicle driving information stored in a black box of the vehicle in a user terminal using a face recognition function. The system includes: a vehicle black box for storing vehicle driving information including photographing information and state information of the vehicle; and a control device for allowing a user terminal to share the vehicle driving information stored in the vehicle black box. The control device includes: a photographing unit for photographing a face image; a face region detecting unit for detecting a face region by sequentially irradiating an image input from the photographing unit in a unit of blocks having a predetermined size; a face recognition unit for performing face recognition by comparing an authentication image input from the face region detecting unit and a plurality of registered face images stored in advance; and a communication unit for wirelessly communicating with the vehicle black box upon completion of authentication of the face recognition unit.

Description

TECHNICAL FIELD [0001] The present invention relates to a system and method for sharing and operating a vehicle, and more particularly, to a system and method for sharing < RTI ID = 0.0 >

More particularly, the present invention relates to a system for sharing vehicle driving information and controlling start-up of the vehicle. More particularly, the present invention relates to a system for sharing vehicle driving information stored in a black box of a vehicle using a face recognition function, And more particularly, to a system for sharing vehicle operation information using a face recognition function and a start control system.

In general, a vehicle black box is a device for obtaining information necessary for judging how an accident has occurred in the event of a vehicle accident, including information on vehicle driving, that is, information about the surroundings of the vehicle, State information such as an operation state of an emergency light or whether various lamps are driven is stored.

However, in the related art, there is a problem that information stored in a black box for a vehicle can not be checked in real time from the outside, so that black box information of the vehicle can not be used more efficiently.

In addition, in the present vehicle, a system for preventing vehicle theft is developed and applied by a start control method according to a code embedded in a key called an immobilizer.

However, when the key was stolen by the key of the vehicle, the stolen immobilizer could not prevent the stolen vehicle from starting.

Meanwhile, various face recognition (or facial recognition) systems have been developed and commercialized recently. Such a face recognition system has the advantage that there is no fear of infection due to contact, and a high level of security is possible. There are many applications such as access control and security system, criminal search and montage creation system, computer interface, animation and game. However, there is no case where this face recognition function is applied to black box of car or theft prevention of vehicle. It is true.

An object of the present invention is to provide a system for sharing vehicle driving information using a face recognition function capable of sharing vehicle driving information stored in a black box of a vehicle using a face recognition function and capable of startup control.

According to an aspect of the present invention, there is provided a system for sharing and starting vehicle operation information using a face recognition function, the system comprising: a vehicle black box storing vehicle operation information including photographing information and state information of the vehicle; And a controller for sharing vehicle driving information stored in the vehicle black box with a user terminal and performing startup control, wherein the control device comprises: a photographing unit for photographing a face image; A face region detecting unit for detecting a face region by sequentially irradiating an image input from the photographing unit in block units of a predetermined size; A face recognition unit for performing face recognition by comparing the authentication image input from the face area detection unit and a plurality of registered face images stored in advance; And a communication unit for wirelessly communicating with the vehicle black box and the startup control module upon completion of the authentication of the face recognition unit.

The apparatus further includes a face area correction unit that corrects the extracted face area to correspond to the size of the reference face area set in advance when the size of the extracted face area is less than a predetermined size.

The face area correction unit may correct the size of the reference face area by using a zoom in-out focusing function when the size of the extracted face area is less than a predetermined size.

The display device further includes a display unit for outputting the user's face image and vehicle driving information to the user.

In addition, the photographing unit includes an infrared camera and a color camera. The face image photographed by the infrared camera is output to the face region detecting unit, and the face image photographed by the color camera is output to the display unit.

Further, the image forming apparatus may further include a start control module for controlling start-up of the vehicle, and the start control module is configured to input a start signal of the vehicle when the face recognition result of the face recognition unit is completed.

The startup control module may further include a first switch for determining a startable or non-startable state depending on whether or not the vehicle is authentic, and a second switch for starting the engine of the vehicle in a startable state, wherein the first switch and the second switch Are connected in series.

According to the present invention, the vehicle driving information stored in the black box of the vehicle can be shared by the control device (or the user terminal) by using the face recognition function, and the startup control can be performed, It is possible to prevent theft of the vehicle.

1 is a diagram showing a configuration of a system for sharing and running vehicle information using a face recognition function according to an embodiment of the present invention.
2 is a block diagram showing the configuration of the control apparatus of Fig.
Fig. 3 is a diagram showing an embodiment of the control apparatus of Fig. 1. Fig.
4 is a view for explaining a method of detecting a face area according to an embodiment of the present invention.
5 is a block diagram showing a configuration of the face recognition unit according to Fig. 2
6 is a flowchart illustrating a method of sharing vehicle driving information using a face recognition function according to an exemplary embodiment of the present invention.
7 is a view showing an embodiment for displaying vehicle driving information according to an embodiment of the present invention.

Hereinafter, an embodiment of the present invention will be described in detail with reference to exemplary drawings. It should be noted that, in adding reference numerals to the constituent elements of the drawings, the same constituent elements are denoted by the same reference symbols as possible even if they are shown in different drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

Furthermore, in describing the components of the present invention, when a component is described as being "connected", "coupled" or "connected" to another component, the component may be directly connected to the other component It should be understood that another component may be "connected "," coupled ", or "connected" between each component.

FIG. 1 is a block diagram showing the configuration of a system for sharing and running a vehicle, using a face recognition function according to an embodiment of the present invention, FIG. 2 is a block diagram showing the configuration of the control apparatus of FIG. 1, FIG. 3 is a view showing an embodiment of the control apparatus of FIG. 1, and FIG. 4 is a view for explaining a method of detecting a face region according to an embodiment of the present invention.

1, a vehicle navigation system sharing system using a face recognition function according to an exemplary embodiment of the present invention includes a vehicle black box 100, a controller 200, and a startup control module 300 . In addition, it may include a user terminal 400 owned by the user, if necessary.

As shown in FIG. 1, the system for applying the present invention may be configured such that the vehicle black box 100, the startup control module 300, and the control device 200 can communicate with each other. For example, the vehicle black box 100 and the startup control module 300 may be configured to perform wireless communication with the control device 200 through a wireless network. Here, the wireless network may be various types of wireless communication networks such as CDMA, W-CDMA (UMTS), Wibro, etc. in a conventional mobile communication.

The vehicle black box 100 photographs the periphery of the vehicle, detects the state information of each device provided in the vehicle, and stores the vehicle driving information including the photographing information and the state information.

The control device 200 is configured to communicate with the vehicle black box 100 and the startup control module 300 to share vehicle driving information stored in the vehicle black box 100 or to perform startup control. Of course, if necessary, the control device 200 may communicate with the user terminal 400 owned by the user to share vehicle driving information stored in the black box 100 through the user terminal 400, 300 to perform startup control.

2, the control device 200 includes a photographing unit 220, a face area detecting unit 230, a face area correcting unit 240, a display unit 250, an illuminating unit 260, a face recognizing unit 210, and a communication unit 270

It is preferable that the photographing unit 220 basically includes an infrared camera 221 and further includes a color camera 222. An image photographed by the infrared camera 21 is output to the face region detection unit 230 and used for face region detection and face recognition as described later and the face image photographed by the color camera 222 is displayed on the display unit 250 And displays the image of the user who is currently photographed to the user.

The start control module 300 is for starting control of the vehicle, and is configured to input a start signal of the vehicle when the authentication of the face recognition unit 210 is completed.

The startup control module 300 may be an engine control unit (ECU), and may further include a separate communication unit (not shown).

The startup control module 300 further includes a first switch SW1 for determining whether the vehicle can be started or disabled in accordance with whether or not the vehicle is to be authenticated, and a second switch SW2 for starting the engine of the vehicle in the startable state The first switch SW1 and the second switch SW2 are connected in series.

The first switch SW1 has one end connected to the battery B + and the other end connected to the second switch SW2. When the authentication is completed, the first switch SW1 is turned on to be in the startable state. If the authentication is not completed, To be in an impossible state.

For example, even if an illegal user (a car theft person) tries to start the vehicle engine by operating the second switch SW2 after boarding the vehicle through illegally obtained vehicle key, since the face recognition authentication is not completed, The first switch SW1 maintains the turn-off state, and therefore, the start of the vehicle engine by the second switch SW2 becomes impossible. At this time, it is of course possible to output sound such as a siren or the like so as to inform the outside that an illegal occupation state is provided by further providing a warning section.

In the case of a normal user, when the face recognition authentication is completed, the first switch SW1 is turned on, so that the vehicle engine can be started by the second switch SW2.

3, the photographing unit 220 is coupled to a fixed position of a base unit 210 installed on a dashboard or the like in the vehicle. The photographing unit 220 can be rotated in the vertical and horizontal directions To the base portion 210.

In order to detect the face region, the face region detecting unit 230 performs a pre-processing such as size adjustment, pixel conversion, and the like on the face image photographed by the infrared camera 221, and extracts the face region from the preprocessed face image .

Preferably, the face area detection unit 230 sequentially detects the face area by irradiating the image inputted from the photographing unit 220 in block units of a preset size.

Referring to FIG. 4, the face area detecting unit 230 sequentially searches the (1, 1) block to (6, 1) blocks sequentially from the (1, 2) 6,2) blocks. The face area detection unit 230 detects the face area from the (1, 3) block to the (6, 6) block in the same manner.

In the example of FIG. 4, the photographed face image is divided into 36 blocks, but this is for the convenience of explanation, and it is needless to say that it can be divided into more blocks.

In the example of FIG. 4, the blocks 400 are sequentially scanned in the horizontal direction, but it is also possible to detect the face region by irradiating the blocks in the vertical direction.

The face area correcting unit 240 corrects the size of the face area extracted from the face area detecting unit 230 to correspond to the size of the reference face area set in advance when the size of the face area extracted is smaller than a predetermined size.

The face area correcting unit 240 corrects the size of the extracted reference face area to a predetermined reference face area size using a zoom in-out focusing function when the size of the extracted face area is less than a predetermined size.

The face recognition unit 210 performs face recognition by comparing the authentication image input from the face area correction unit 240 and a plurality of registered face images stored in advance.

The communication unit 270 wirelessly communicates with the vehicle black box 100 to share the vehicle driving information stored in the vehicle black box 100 upon completion of the authentication of the face recognition unit 210.

The display unit 250 displays the face image received from the color camera 22 to the user, and the illumination unit 260 is installed around the camera to illuminate the user's face with illumination. The illuminating unit 260 may include an illuminance sensor to operate when the ambient illuminance is darker than a preset illuminance, and may further include a human detection sensor for sensing the user.

FIG. 5 is a block diagram illustrating a configuration of a face recognition unit according to FIG. 2, and FIG. 6 is a flowchart illustrating a method of sharing vehicle driving information using a face recognition function according to an embodiment of the present invention.

5, the face recognizing unit 210 includes an authenticating unit 213, a matching count managing unit 214, a database managing unit 215, and a database 216.

When the image for authentication (image for authentication) is input from the face area correcting unit 230, the authentication unit 213 compares the image for authentication with a plurality of face images for each user stored in the database 216 to perform authentication The matching count management unit 214 updates the matching frequency of the pre-registered face images used for the user authentication by +1 in the authentication unit 213 and stores the updated number in the database 216. [

As described above, according to the present invention, the recognition speed of the face is improved by first comparing face images having a high matching frequency. That is, in the conventional face authentication method, the input authentication image is compared with all registered face images for each user stored in the database 216 to authenticate the user. In the present invention, however, The number of times of matching (number of matching times) (that is, the number of times of directly used in face authentication) that are matched with each other is stored in association with each other and the time required for face authentication is compared by comparing the number of matching times Save.

The database 216 stores the face image registered by the user under the control of the database management unit 215 so as to correspond to the size of the preset reference face area. At this time, the database 216 may store the face image itself, or may extract and store only the characteristic information used for face recognition, and may store both the face image itself and the feature information extracted therefrom. Also, the database 216 of the present invention stores the matching frequency of each registered image together. It should be noted here that the term "facial image" is a concept that includes all of these.

The database management unit 215 manages the face images of the users stored in the database 216. The database management unit 215 receives facial images captured in various angles and stores the received facial images for each user, The images stored in the database 216 can be classified into a plurality of groups according to the number of matching times and the face images having the smallest number of matching times can be classified into new groups in a predetermined time period (e.g., 1 month, 6 months, 1 year, So that the image reflecting the latest face of the user can be updated naturally.

Hereinafter, a method of sharing vehicle driving information using a face recognition function according to an embodiment of the present invention will be described.

FIG. 6 is a flowchart illustrating a method of sharing vehicle driving information using a face recognition function according to an exemplary embodiment of the present invention. FIG. 7 illustrates an example of displaying vehicle driving information according to an embodiment of the present invention FIG.

Referring to FIG. 6, the vehicle black box 100 collects and stores vehicle driving information including photographing information and state information of the vehicle (S100).

When the user requests vehicle driving information, that is, when an input signal of a specific key is input from the control device 200 (S102), face image authentication is performed to connect to the vehicle black box 100 (S104).

In the face image authentication step, the photographing unit 220 photographs a face image, and the face region detecting unit 230 sequentially irradiates an image input from the photographing unit 220 on a block unit of a predetermined size, And the face recognition unit 210 compares the authentication image input from the face area detection unit 230 with a plurality of registered face images stored in advance to perform face recognition. At this time, when the size of the face area extracted by the face area detection unit 230 is less than a preset size, the face area correction unit 240 corrects the size to correspond to the size of the preset reference face area.

When the authentication of the face recognition unit 210 is completed, the communication unit 270 wirelessly communicates with the vehicle black box 100 to display the vehicle driving information through the display unit 250 of the control device 200 (S106).

The display of the vehicle driving information may be constituted by a main menu and a plurality of submenus and displayed according to the selection.

For example, as shown in FIG. 7, when displaying the vehicle periphery image information, a predetermined screen may be provided to select one of a front or back image.

In the present embodiment, the sub-menu may be configured to select and display a back-up mode, an event mode, a parking mode, a driving log mode, a format mode, and the like.

If the user selects the format mode (S108), the facial image authentication process is performed again (S110).

When the authentication is completed, the format of the vehicle black box 100 may be performed (S112).

Meanwhile, in the present invention, sharing of vehicle driving information using the face recognition function and startup control can be used together.

To this end, a control unit (not shown) of the control device 200 may provide a menu to the display 250 of the control device 200, allowing the user to select either sharing of vehicle driving information or startup control .

When the user selects the menu for the start control, the face image authentication process is performed as in the vehicle operation information sharing method, and the start control of the vehicle is performed according to the authentication result as described above.

That is, in the case of the normal user, when the face recognition authentication is completed, the first switch SW1 is turned on, and therefore the vehicle engine can be started by the second switch SW2.

However, even if an illegal user (a car theft) tries to start the vehicle engine by operating the second switch SW2 after boarding the vehicle through illegally obtained vehicle key, since the face recognition authentication is not completed, The switch SW1 maintains the turn-off state, and therefore, the start of the vehicle engine by the second switch SW2 becomes impossible. At this time, it is possible to output sound such as a siren or the like so as to inform the outside that the state is illegally occupied by providing a warning part (not shown).

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention. Accordingly, the scope of the present invention should not be limited by the illustrated embodiments, but should be determined by equivalents of the claims and the claims.

100: vehicle black box 200: control device
300: user terminal 210: face recognition unit
220: photographing part 230: face area detecting part
240: face area correcting unit 250:
260: illumination unit 270: communication unit
300: Startup control module

Claims (7)

1. A system for sharing and running a vehicle, comprising:
A vehicle black box storing vehicle driving information including photographing information and state information of the vehicle;
A control device for sharing vehicle driving information stored in the vehicle black box with a user terminal and performing startup control; And
And a start control module for starting control of the vehicle under the control of the control device,
The control device includes:
A photographing unit for photographing a face image;
A face region detecting unit for detecting a face region by sequentially irradiating an image input from the photographing unit in block units of a predetermined size;
A face recognition unit for performing face recognition by comparing the authentication image input from the face area detection unit and a plurality of registered face images stored in advance;
A communication unit that wirelessly communicates with the vehicle black box and the startup control module when the authentication of the face recognition unit is completed;
A display unit for outputting a user's face image and vehicle driving information to a user; And
And a database management unit for managing face images of users stored in the database,
Wherein the photographing unit includes an infrared camera and a color camera,
The face image photographed by the infrared camera is output to the face region detection unit, the face image photographed by the color camera is output to the display unit,
The database manager may replace the face image having the smallest matching frequency with a new image at a predetermined time interval,
Wherein the start-up control module is configured to input a start signal of the vehicle when the authentication is completed, as a face recognition result of the face recognition unit.
delete delete delete delete delete The method according to claim 1,
Wherein the startup control module further includes a first switch for determining whether the vehicle can be started or disabled according to whether or not the vehicle is authenticated, and a second switch for starting the engine of the vehicle in a startable state, wherein the first switch and the second switch are connected in series And a control unit for controlling the operation of the vehicle.

Images