KR100853234B1 - Security system and method for automobile using multimedia data - Google Patents

Abstract

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a vehicle security system and method using multimedia data, and more particularly, to a vehicle security system and method using multimedia data that can be secured by user authentication using video data and audio data. According to an aspect of the present invention, a vehicle security system using multimedia data includes a face authentication unit that performs user authentication through face recognition using image data input through an image input unit, a face authentication unit that uses audio data input through an audio input unit, An authentication control unit for controlling a user authentication of the face authentication unit and the voice authentication unit and outputting an authentication result signal, a voice authentication unit for performing user authentication through voice recognition, a storage unit for storing a program for user authentication and data, A main control unit for receiving an authentication result signal from the authentication control unit and outputting a control signal for performing a corresponding operation, and a remote controller for transmitting and receiving data from the main control unit, By signal The vehicle may start up or the vehicle door may be opened or closed.

User Authentication

Description

TECHNICAL FIELD [0001] The present invention relates to a vehicle security system and method using multimedia data,

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram schematically showing a configuration of a vehicle security system according to a preferred embodiment of the present invention; FIG.

2 is a diagram illustrating an example of the arrangement of a system for user authentication according to a preferred embodiment of the present invention.

3 is a diagram for explaining a function of a system control unit according to a preferred embodiment of the present invention.

4 is a view for explaining a function of an authentication unit according to a preferred embodiment of the present invention;

5 is a diagram for explaining a configuration of a remote controller according to an embodiment of the present invention.

6 is a view for explaining a method of controlling opening and closing of a vehicle door in a system control unit according to a preferred embodiment of the present invention.

FIG. 7 is a diagram for explaining user authentication in a system control unit according to a preferred embodiment of the present invention; FIG.

8 is a view for explaining a vehicle security method in an authentication unit according to a preferred embodiment of the present invention.

Description of the Related Art

100: System control section 130: Main control unit

170: communication unit 200: authentication unit

230: face recognition system module 260: voice recognition system module

280: USB OTG system unit 270: storage unit

275: direction control unit 300: remote controller

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a vehicle security system and method using multimedia data, and more particularly, to a vehicle security system and method using multimedia data that can be secured by user authentication using video data and audio data.

As society develops and the number of vehicles increases dramatically, related theft and accidents occur frequently. Conventional vehicle security types are widely used as door lock security and alarm systems using vehicle keys. Such a door lock type security system is not only easy to modulate the key, but also has a high risk of theft, and also performs a simple security function related to opening and closing the door independently.

In addition, the door lock type system that performs the simple security function does not have a memory function to preserve the situation in the event of a vehicle related accident, etc., and can not grasp the cause and cause of the vehicle accident objectively, . As science has developed very rapidly and the general people have also pursued greater convenience, there has been a need for security and alarm systems that can identify and control accident situations in vehicle management.

The face and voice of people in biometrics technology are different and unique and they do not change during their lifetime, so they have security and user convenience. . In addition, when the video and audio data of the surroundings of the vehicle are stored using the memory device, it can be used as objective evidence of an accident event at the time of an accident event.

An object of the present invention is to provide a multimedia vehicle security system capable of verifying a user using multimedia information by simultaneously performing user authentication through facial recognition or voice recognition without inconvenience of contact and hygienic biometric technology, Method.

It is another object of the present invention to provide an authentication unit for performing biometric authentication for user authentication through face recognition or voice recognition, so that user authentication can be performed more quickly, so that a multimedia vehicle remote control Security device and system.

It is still another object of the present invention to provide a multimedia vehicle remote control security device and system capable of receiving a video data and audio data in and around the vehicle using a remote controller, .

It is still another object of the present invention to provide an image processing apparatus and method capable of real-time storing image data and audio data in and around a vehicle through a storage unit, and capable of moving stored data using a USB (Universal Serial Bus) OTG And to provide a multimedia vehicle security system and method capable of performing program upgrading and inputting a video / audio file and outputting the input via a video output unit or an audio output unit.

According to an aspect of the present invention, a vehicle security system using multimedia data includes a face authentication unit that performs user authentication through face recognition using image data input through an image input unit, a face authentication unit that uses audio data input through an audio input unit, An authentication control unit for controlling a user authentication of the face authentication unit and the voice authentication unit and outputting an authentication result signal, a voice authentication unit for performing user authentication through voice recognition, a storage unit for storing a program for user authentication and data, A main control unit for receiving an authentication result signal from the authentication control unit and outputting a control signal for performing a corresponding operation, and a remote controller for transmitting and receiving data from the main control unit, To signal Take a vehicle start or a vehicle door can be opened and closed.

The face authentication unit may include an image input unit into which the image data is input, an image processing unit that converts the input image data into converted image data of a predetermined format,

And a face recognition system unit for performing user authentication by comparing the converted image data with facial image data stored in the storage unit.

The image input unit may input image data around the vehicle by one or more camera modules and store the input image data in the storage unit.

The image input unit may further include a direction adjustment controller for adjusting a photographing direction of the camera module.

The audio authentication unit may include an audio input unit to which the audio data is input, an audio processing unit to convert the input audio data into converted audio data of a predetermined format, and a control unit that compares the converted audio data with the audio data stored in the storage unit, And a voice recognition system unit for performing voice recognition.

And a USB OTG system unit having a USB-OTG (On-The-Go) function for exchanging data with the storage unit.

The exchange of data may include output of video data and audio data stored in the storage unit, input of a video file and an audio file, user authentication, and an upgrade of a program for driving the system.

The remote controller includes a remote communication unit for transmitting and receiving data to and from the main control unit, a remote switch input unit for receiving a command from a user, a remote output unit for outputting vehicle status data received through the remote communication unit, And a remote control unit for controlling the remote communication unit and the remote output unit by a user command.

The remote switch input unit may include means for inputting a remote control command for controlling the shooting direction of the image input unit.

The remote output unit may receive and output the image data and the audio data.

According to another aspect of the present invention, there is provided a vehicle security method using multimedia data, the method comprising the steps of: (a) converting image data input through an image input unit into converted image data of a predetermined format; (b) (C) outputting a control signal for performing an operation corresponding to the user authentication result from the main control unit by comparing the image data stored in the storage unit with the image data stored in the storage unit, and (d) And if the result is an authorized user, starting the vehicle by the control signal or opening and closing the door of the vehicle, the input image data may be transmitted to the remote controller.

The step of converting the audio data input through the audio input unit into the converted audio data of a predetermined format after the step (b), comparing the converted audio data with the audio data stored in the storage storage unit, .

The image input unit may include a direction adjustment control unit for adjusting a shooting direction for inputting an image.

And a USB OTG system unit having a USB-OTG (On-The-Go) function for exchanging data with the storage unit.

According to another aspect of the present invention, a vehicle security method using multimedia data includes the steps of (a) inputting image data around a vehicle through an image input unit, (b) storing the input image data in a storage unit (c) receiving a sensor signal from the sensor input unit in the main control unit and judging whether or not an accident situation exists; and (d) if it is judged that an accident has occurred, the control signal outputted from the main control unit And extracting and transmitting the image data stored in the storage unit.

The step (b) may further include inputting audio data around the vehicle through the audio input unit and storing the input audio data in the storage unit.

If the memory capacity is insufficient, the storage unit of the step (b) may continue to store new data in chronological order by a data erasure storage method in which erroneous data are sequentially erased and updated in the order of old data.

And outputting the data stored in the storage unit to the memory stick using the USB port having the USB OTG function after the step (d).

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following will illustrate and explain only the principles of the present invention with respect to a multimedia vehicle remote control security device and system according to a preferred embodiment of the present invention. Accordingly, those skilled in the art will be able to devise various ways of practicing the principles of the invention, including the concept and scope of the invention, and apparatuses and the like, which are not explicitly described or illustrated herein. It is also to be understood that all of the conditional terms and embodiments listed herein are in principle intended only for the purpose of enabling the inventive concept to be understood and are not to be construed as being limited to such specifically recited embodiments and conditions .

It is also to be understood that the detailed description, as well as the principles, aspects and embodiments of the invention, as well as specific embodiments thereof, are intended to cover structural and functional equivalents thereof. It is also to be understood that such equivalents include all elements contemplated to perform the same function irrespective of the currently known equivalents as well as the equivalents to be developed in the future, i.e., the structure.

Thus, for example, it should be understood that the block diagrams herein illustrate conceptual aspects of exemplary circuits embodying the principles of the invention.

The functionality of the various elements shown in the figures, including functional blocks shown in the figures of the processor or similar concepts, may be provided by use of dedicated hardware as well as hardware capable of executing software in connection with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which may be shared.

BRIEF DESCRIPTION OF THE DRAWINGS The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. It should be noted that, in adding reference numerals to the constituent elements of each drawing, only the same constituent elements have the same number as possible even if they are displayed on different drawings.

In the following description of the present invention, a detailed description of known related arts will be omitted when it is determined that the gist of the present invention may unnecessarily obscure the present invention. Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

FIG. 1 is a configuration diagram briefly showing a configuration of a vehicle security system according to a preferred embodiment of the present invention.

Referring to FIG. 1, the configuration of a multimedia vehicle remote control security system according to an exemplary embodiment of the present invention includes a system control unit 100, an authentication unit 200, and a remote controller 300.

 The system control unit 100 senses the environment inside and outside the vehicle, such as an impact, a temperature, and a motion, from sensors installed inside or outside the vehicle, and outputs a control signal to the authentication unit 200 for user authentication. The system control unit 100 transmits data expressing the state of the vehicle to the remote controller 300 through data transmission and reception with the remote controller 300 and transmits the data representing the state of the vehicle to the remote controller 300. In response to the control signal of the remote controller 300, Remote control.

The authentication unit 200 receives facial image data or audio data of an authentication requester who wishes to use the vehicle according to a control signal of the system control unit 100 and processes the received facial image data or audio data to perform user authentication through facial recognition or voice recognition . In addition, the authentication unit 200 can continuously input image data and audio data photographed inside or outside the vehicle, and can store it in the memory device, and can input and output data using the USB OTG system.

The remote controller 300 receives data representing the state of the vehicle from the system control unit 100 and outputs a remote control signal corresponding to the data to the system control unit 200. In addition, the remote controller 300 receives the video data and the audio data from the authentication unit 200 and outputs the video data and the audio data through the output device to confirm the authentication requester. In addition, the remote controller 300 can remotely control the photographing direction of the camera module to which the image data is input, so that the user can input desired image data.

Each of the above components will be described in more detail with reference to FIGS. 3 to 5, which will be described later.

2 is a diagram illustrating an example of the arrangement of a system for user authentication according to a preferred embodiment of the present invention.

As shown in FIG. 2, an image input unit 210 for inputting image data and an audio input unit 240 for inputting an audio signal are located inside the vehicle.

A plurality of camera modules may be positioned around the vehicle so that the image input unit 210 can photograph the upper body of the authentication requestor located in the driver's seat and input image data inside and outside the vehicle. The image input unit 210 may include a horizontal motor and a vertical motor for automatically adjusting a photographing direction by a motion sensor or adjusting a camera photographing direction by a remote controller.

The audio input unit 240 may be located within a predetermined distance (for example, 0.5 m) from the driver's seat so as to input the voice of the authentication requester in user authentication through voice recognition.

The authentication unit 200 converts the raw video data or raw audio data input from the video input unit 210 or the audio input unit 240 into converted video data and converted audio data to perform user authentication.

The audio output unit 245 may be located inside the vehicle for audio output.

3 is a view for explaining a function of a system control unit according to a preferred embodiment of the present invention.

3, the system control unit 100 includes a door control unit 110, a sensor input unit 120, a main control unit 130, a start on / off control unit 140, a door lock control unit 150, An alarm sound operation control unit 160 and a communication unit 170. [

The door control unit 110 controls the opening of the door through a mechanical locking device using a normal door locking mechanism. The door control unit 110 can control the opening and closing of the door by using an integrated circuit (IC) chip built-in card that can not be falsified or duplicated instead of a conventional vehicle key, an electronic door key having a keypad for inputting a password, or face recognition. The door control unit 110 stores the face of the driver or the passenger in the memory of the system controller unit 100 when the door of the vehicle is opened or closed by using the face recognition of the driver or the passenger, When approaching within a certain distance, the face of the driver or the passenger is automatically authenticated using the image input unit 210 to open the door of the vehicle, and the vehicle door is closed when the driver and the passenger try to face the face again. Also, the door control unit 110 includes a video input unit 210 in the rear direction of the vehicle, so that the trunk can be opened and closed by the method described above.

The sensor input unit 120 senses the impact and temperature of the vehicle, detects the movement of the vehicle, and inputs the vehicle state data. The sensor input unit 120 may include an impact sensor, a temperature sensor, and a motion sensor. In addition, it is apparent that various sensors having a function of measuring or monitoring the state of the vehicle other than the sensors may be included. The sensor input unit 120 senses the state of the vehicle and provides information so that an abnormal symptom is caught or a strange motion is detected around the vehicle so that a corresponding action can be taken. It is obvious that each sensor constituting the sensor input unit 120 can detect an abnormal symptom by setting a certain threshold value in detecting the vehicle state, and the threshold value can be set by a designer or a user. For example, when the vehicle collides during parking, impact information is input through the impact detection sensor of the sensor input unit 120, and the main control unit 130 transmits the impact information to the remote controller 300, . In addition, when the car thief is standing around the driver's seat, the sensor input unit 120 inputs motion detection information for a predetermined time or longer through the motion detection sensor, and the main control unit 130 controls the authentication control unit 200 The direction of the camera module for monitoring the outside of the vehicle can be adjusted to capture the image of the thief and store the image data. The image data can be transmitted to the remote controller 300 through the communication unit 170, And can cope with it.

 The main control unit 130 controls all components of the system control unit 100 and outputs a control signal to the authentication unit 200 for user authentication through face recognition speech recognition. The main control unit 130 can wirelessly receive remote control signals from the remote controller 300 and control the respective components of the system control unit 100 so that the corresponding operations are performed. The main control unit 130 can perform user authentication by controlling the authentication unit 200 or the authentication control unit 290, for example, when user authentication through face recognition or voice recognition is required. When the information representing the vehicle state input through the sensor input unit 120 is equal to or greater than a preset threshold value, that is, for example, when a vehicle accident occurs, the main control unit 130 transmits, via the authentication control unit 290, Accident-related image data and audio data can be outputted to obtain objective judgment and evidence data on the accident.

The startup ON / OFF control unit 140 receives a remote start control signal from the remote controller 300 or controls the on / off state of the start of the vehicle according to a user authentication result through face recognition or voice recognition in the authentication unit 200 do. The startup ON / OFF control unit 140 may be configured to perform a user authentication (e.g., face recognition or voice recognition) in the authentication unit 200, except when a remote start control signal is received from the remote controller 300 when the vehicle is not in operation Quot; off " until < / RTI > However, when it is determined that the user is authenticated as a result of the user authentication, the startup ON / OFF control unit 140 can change the startup state from the OFF state to the ON state.

The door lock control unit 150 receives a control signal for locking or unlocking the remote door from the remote controller 300 or controls the locking and unlocking of the door when the door locking or unlocking signal is input to the door control unit 110. [

The alarm sound operation control unit 160 controls the operation and release of the alarm sound by the control from the main control unit 130 which receives the signal for activating and deactivating the alarm sound from the sensor input unit 120 or the authentication unit 300. [

The communication unit 170 includes an antenna and transmits / receives data and control signals to / from the remote controller 300 via radio waves. The communication unit 170 transmits data representing the video data, the audio data, and the vehicle state input to the sensor input unit 120 to the inside or the outside of the vehicle through a predetermined radio frequency Band. The communication unit 170 receives a control signal from the remote controller 300 via the antenna for remote start, remote door locking and unlocking, or activation / deactivation of the alarm sound, and transmits the control signal to the main control unit 130, Can be achieved.

4 is a view for explaining a function of the authentication unit according to a preferred embodiment of the present invention.

4, the authentication unit 200 includes an image input unit 210 and an image output unit 215 for inputting and outputting raw image data for user's face authentication, A facial recognition system unit 230 for comparing the facial image data of the stored user with the converted image data to authenticate the user through facial recognition, An audio output unit 245 for outputting audio to guide the authentication process during the user authentication process, an audio processing unit 250 for converting the input audio data into converted audio data that can be authenticated by the audio authentication unit, , A voice recognition system for authenticating a user's voice by comparing the voice audio data of the stored user with the converted audio data A storage unit 270 for storing video data and audio data input through the video input unit 210 and the audio input unit 240 for vehicle security and programs and data for user authentication, A USB OTG system unit for data communication for extracting image data and audio data stored in a direction adjustment control unit 275 and a storage storage unit 270 for adjusting a shooting direction of an image input unit 210 for a program, And an authentication control unit 290 for controlling each component of the authentication unit 200 by a control signal from the control unit 280 and the main control unit 130. [

The image input unit 210 photographs a subject using a camera module equipped with the camera and inputs captured image data. The image input unit 210 may be a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor) camera module. The image input unit 210 may include a plurality of camera modules in or outside the vehicle to input image data of the surroundings of the vehicle. The image input unit 210 may include a camera module for capturing a face of a driver at a predetermined position in front of the vehicle and may include direction adjusting means for adjusting the photographing direction according to the height and the movement of the subject have. In this case, the direction adjusting means may include a vertical driving motor for moving the camera module up and down, and a driving circuit for driving the camera module. The horizontal driving motor and the driving circuit may include a horizontal driving motor for moving the camera module to the left and right. In addition, the image input unit 210 may include a motion tracking sensor in a camera module used to photograph a subject while tracking an object such as a human being.

The video output unit 215 outputs the input video data when the video data is input through the video input unit 210. [ The user can determine the surrounding state of the vehicle by seeing that the image data input through the plurality of camera modules is output through the image output unit 215 while the vehicle is traveling. 215 can confirm the image captured by the authentication requester through the image output unit 215 together with the guidance voice to guide the position and direction of the user's face in order to accurately authenticate the user through the face recognition.

The image processing unit 220 converts the image data input through the image input unit 210 into converted image data capable of face recognition. The image processing unit 220 can select the face region of the authentication requester, separate the input image data, and convert the face region into the converted image data including the feature of each face portion. In addition, the image processing unit 220 may include an image processing processor, an image codec, or the like to decompress the compressed image data in order to improve the image quality of the displayed image or increase the data processing speed and storage capacity.

The face recognition system unit 230 compares the converted image data capable of face recognition in the image processing unit 220 and the face recognition image data of the user stored in the storage unit 270 for user authentication through face recognition, , And outputs a determination signal to the authentication control unit 290. When it is determined that the authentication requestor is not the user, the face recognition system unit 230 may output the authentication reject voice message through the audio output unit 245 and transmit a signal for activating the alarm sound to the main control unit 130 . Also, the facial image data of the authentication requester can be stored in the storage unit 270 and transmitted to the remote controller 300.

The audio input unit 240 inputs audio data using a microphone. The audio input unit 240 may use a conventional microphone as an input means, and a device having a similar function may also be included. The audio input unit 240 may be provided inside or outside the vehicle so that not only the voice of the individual to be authenticated in the driver's seat but also the audio data of the surroundings of the vehicle can be input.

When receiving a control signal for user authentication, the audio output unit 245 extracts and outputs a guidance voice for user authentication stored in the storage storage unit 270. [

The audio processing unit 250 converts the audio data of the authentication requestor input through the audio input unit 240 into converted audio data capable of voice recognition. The audio processing unit 250 may analyze the audio of the authentication requestor in the input audio data and convert the audio data into audio data including a frequency characteristic. The audio processing unit 220 may include an audio codec or the like to decompress the data to increase data processing efficiency or to decompress the data for playback.

The voice recognition system unit 260 compares the converted audio data that can be recognized by the audio processor 250 and the user's voice audio data stored in the storage unit 270 for user authentication through voice recognition, And outputs a determination signal to the authentication control unit 290. [ When it is determined that the voice of the authentication requester is different from the voice of the user who stored the voice of the authentication requester, the voice recognition system unit 260 outputs an authentication reject voice message through the audio output unit 245 and outputs an alarm sound activation signal to the main control unit 130).

The storage unit 270 stores programs and data for user authentication. In order to secure the vehicle, video data and audio data of the inside and outside of the vehicle inputted through the video input unit 210 and the audio input unit 240 can be continuously stored. The memory storage unit 270 may be a nonvolatile memory capable of updating data and capable of retaining all stored data even if power supply is interrupted. The face image data and the audio data for authentication may be stored in advance by the user through the image input unit 210 and the audio input unit 240 using the input program. The storage storage unit 270 may store video data and audio data expressing the user authentication information and the vehicle status according to the storage capacity. However, the storage unit 270 sequentially deletes the old data in the order of old data, The data erasure storage algorithm program can be operated so that new data can be continuously stored in chronological order and the input image data and audio data can be stored without the storage capacity expansion of the storage storage unit 270. [ The storage unit 270 may store the stored user authentication information and the image data representing the vehicle state and the audio data in real time, and may act as a black box when an accident or accident occurs.

The direction adjustment control unit 275 adjusts the photographing direction of the camera module of the image input unit 210 according to the control signal of the authentication control unit 290. [ When an abnormality is detected in the state of the vehicle through the sensor input unit 120 or when the authentication requestor requests user authentication, the direction adjustment control unit 275 controls the image input unit 210 to photograph the state of the vehicle and the authentication requestor, It is possible to adjust the shooting direction of the camera module used as the camera module. Also, when a control signal for adjusting the direction of the camera module is received from the remote controller 300, the photographing direction of the camera module can be adjusted correspondingly.

  The USB-OTG system unit 280 is used for data communication for transferring data stored in the storage storage unit 270 to another storage device or upgrading a program for operating the system. The USB-OTG system unit 280 can simultaneously use a USB port as a master or a slave, so that data can be directly exchanged with a peripheral device without a host. OTG system unit 280 to the external storage device via the USB-OTG system unit 280 using a removable storage device such as a memory stick, and stores or outputs the data can do. If it is necessary to upgrade the program stored in the storage unit 270, the storage unit 270 can be accessed via the USB-OTG system unit 280 without inconvenience of exchanging the storage unit 270, Can be upgraded quickly and easily. Also, since the memory storage unit 270 can function as a black box when an event or an accident occurs, the memory storage unit 270 stores information on the state of the event or accident stored in the memory storage unit 270 through the USB- (E.g., a computer, a PDA (Personal Digital Assistant), a digital multimedia player, or the like) capable of quickly moving image data or audio data and outputting the data. Also, by using the USB-OTG system unit 280, the audio file and the video file stored in the memory stick can be connected to and reproduced from the audio / video equipment installed in the vehicle.

The authentication control unit 290 receives control signals from the main control unit 130 and controls the respective components of the authentication unit 200. For example, when receiving the control signal of the user authentication request from the main control unit 130, the authentication control unit 290 adjusts the photographing direction of the camera module through the direction adjustment control unit 275 to photograph the face of the authentication requestor The face image data of the authentication requestor inputted through the image input unit 210 may be processed and compared with the face image data of the user stored in the storage storage unit 270 to perform user authentication through face recognition. As a result of user authentication through facial recognition, if the user is an authenticated user, the user recognizes the voice inputted through the audio input unit 240 and once again confirms the user through voice authentication. It can send a signal to the main control unit 130 that it has been completed. The authentication control unit 290 continuously performs user authentication through face recognition and voice recognition, thereby enhancing security performance. In addition, since the authentication unit 200 is separately provided, the user authentication is performed through facial recognition or voice recognition, and the convenience of the user is increased because the authentication speed is fast and there is no contact at the time of authentication because it is sanitary.

5 is a diagram for explaining a configuration of a remote controller according to an embodiment of the present invention.

Referring to FIG. 5, the remote controller 300 may include a switch input unit 310, a remote communication unit 320, a remote control unit 330, and a remote output unit 340.

The switch input unit 310 receives a user's command to remotely control the vehicle. The switch input unit 310 may input a user's command for controlling the user to turn on / off the vehicle, lock and unlock the door, generate and release the alarm sound, and adjust the shooting direction of the camera module.

The remote communication unit 320 is provided with an antenna so that control signals and data for remote control by the remote controller 300 are transmitted and received via radio waves. The remote communication unit 320 can receive data expressing video data, audio data, and vehicle status inside or outside the vehicle from the communication unit 170, and can start and stop the vehicle, lock and unlock the door, A control signal for adjusting the photographing direction of the camera module used as the input unit 210, and the like can be transmitted.

The remote control unit 330 controls each component of the remote controller 300. When a user command for remote control is inputted through the switch input unit 310, the remote control unit 330 transmits a corresponding control signal through the remote communication unit 320. [ Further, the remote control unit 330 outputs the data received from the communication unit 170 through the remote output unit 340.

The remote output unit 340 outputs data expressing the vehicle condition received via the remote communication unit 320 and video data and audio data in or outside the vehicle. In addition, the remote output unit 340 can display the remaining capacity of the battery and the clock display for the operation of the remote controller 300. The remote output unit 340 includes data representing the state of the vehicle received through the remote communication unit 320, for example, a bill display, a trunk open indication, a hood open indication, a door open indication, A voltage display, an impact detection display, an alarm sounding display, and the like, and image data and audio data photographed at the time of user authentication can be output. The remote output unit 340 may further include a storage device for temporarily storing data to be output.

6 is a view for explaining a method of controlling opening and closing of a vehicle door in a system control unit according to a preferred embodiment of the present invention.

6, the main control unit 130 requests authentication to the authentication control unit 290 for facial image data input through the image input unit 210 when a driver or a user approaches the vehicle (S610) do. The authentication control unit 290 performs user authentication through face recognition (S620), and determines whether the user is an authorized user (S630). If the authentication result is approved, the main control unit 130 opens and closes the door of the vehicle through the door control unit 110 (S640). If the user is not an authorized user, the user can repeat the face recognition three times in a row. When the user fails to authenticate the user more than three times, the main control unit 130 controls the alarm sound operation controller 160 to generate an alarm sound (S650).

Also, the main control unit 130 can be opened and closed by the method described above by using the image input unit 210 in the vehicle back direction to open and close the trunk.

7 is a diagram for explaining user authentication in a system control unit according to a preferred embodiment of the present invention.

7, after the main control unit 130 requests the authentication control unit 290 for authentication, the main control unit 130 performs user authentication through facial recognition or voice recognition under the control of the authentication control unit 290, (S703). If the authenticated user is the authenticated user, the authentication confirmation voice message is output through the audio output unit 245 (S705) The start-off state is switched to the on-state by the control (S707). If it is determined that the user is not the authenticated user, the authentication rejection message is output through the audio output unit 245 (S709), and the video data and audio data of the authentication requester are transmitted to the remote controller 300 through the communication unit 170. [ (S711). In addition, the alarm sound operation control unit 160 sounds an alarm sound (S713).

8 is a diagram for explaining a vehicle security method in an authentication unit according to a preferred embodiment of the present invention.

8, when the authentication control unit 290 receives a control signal for requesting authentication from the main control unit 130 (S801), the orientation of the camera module is controlled by the direction adjustment control unit 275, (S805). When the original image data of the authentication requestor is input through the image input unit 210, the image processing unit 220 converts the raw image data into converted image data capable of face recognition, and the face image data of the user stored in the face recognition system unit 230 Is compared with the image data of the converted authentication requestor to determine whether the user is an authenticated user (S815). If it is determined that the user is not the authorized user, the unauthenticated message is transmitted to the main control unit 130 (S831). As a result of the determination, if the user is an authenticated user, a voice for guiding voice authentication is output through the audio output unit 245, and voice audio data of the authentication requester is input through the audio input unit 240 (S821). The input audio data is frequency analyzed to enable speech recognition, and is compared with the frequency characteristics of the stored user's voice to determine whether the user is an authorized user (S827). If it is determined through the speech recognition that the authentication requestor is the authenticated user, the authentication message is output (S829). If the authentication requestor is not the authenticated user, the nonauthentication message is output (S831).

On the other hand, when the authentication request signal is not received from the main control unit 130, the direction of the image input unit 210 used for user authentication is adjusted by the direction adjustment control unit 275 so that the user can take an image of the outside of the vehicle (S803). When the main control unit 130 receives a detection signal indicating that a vehicle accident (e.g., collision) has occurred through the sensor input unit 120 in step S807, The direction of the vehicle can be photographed through the plurality of image input units 210, and the image data can be stored in the storage storage unit 270. In addition, the audio input unit 240 may receive audio data around the vehicle, and the input audio data may be stored in the storage unit 270 (S813). In addition, the main control unit 130 may transmit the image data and the audio data of the accident occurrence message and the accident situation to the remote controller 300 (S816). If there is a memory stick through the USB OTG system unit 280 (S819), the data stored in the memory storage unit 270 with respect to the collision situation can be stored in the memory stick (S825). The image data and audio data related to the stray situation stored in the memory stick can be utilized as data for objectively determining the accident state.

On the other hand, when there is no signal from the main control unit 130, the authentication unit 100 continuously stores the data input through the video input unit 210 and the audio input unit 240 in the storage storage unit 270 S811), the data stored in the storage storage unit 270 can be moved to a storage device external to the vehicle via the USB OTG system unit 280 (S817) if necessary, and stored in a storage device outside the vehicle (S823 ).

While the present invention has been described in connection with certain exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. .

As described above, the vehicle security system and method using the multimedia authentication according to the present invention does not inconvenience the contact, and simultaneously performs the user authentication through face recognition or voice recognition, which is a hygienic biometric technology, It is possible to enhance security completely.

In addition, the vehicle security system and method using multimedia authentication according to the present invention may further include an authentication unit for performing biometric authentication for user authentication through face recognition or voice recognition, so that user authentication can be performed more quickly, The speed is improved.

In addition, the vehicle security system and method using multimedia authentication according to the present invention allow the user to check the state of the vehicle and remotely control the vehicle by receiving image data and audio data in and around the vehicle using the remote controller even when the vehicle is parked There is a convenient effect.

In addition, the vehicle security system and method using multimedia authentication according to the present invention can store video data and audio data in and around the vehicle in real time through a storage unit, and can use a USB (Universal Serial Bus) OTG So that the stored data can be moved and the program can be upgraded and the video / audio file can be outputted through the input and output unit.

Claims (18)

A vehicle security system using multimedia data, A face authentication unit for performing user authentication through face recognition using image data input through an image input unit; A voice authentication unit for performing user authentication through voice recognition using audio data input through an audio input unit; A storage unit for storing programs and data for user authentication; An authentication control unit for controlling user authentication of the face authentication unit and the voice authentication unit and outputting an authentication result signal; A main control unit for receiving an authentication result signal from the authentication control unit and outputting a control signal to perform a corresponding operation; And And a remote controller for transmitting and receiving data from the main control unit, Wherein the remote controller includes a remote output unit receiving and outputting the video data and the audio data from the main control unit, Wherein the vehicle is started by a control signal outputted from the main control unit or the vehicle door is opened or closed. The method according to claim 1, The face authentication unit A video input unit into which the video data is input; An image processor for converting the input image data into converted image data of a predetermined format, And a face recognition system unit for performing user authentication by comparing the converted image data with facial image data stored in the storage unit. 3. The method of claim 2, Wherein the image input unit inputs image data around a car by one or more camera modules and stores the input image data in the storage unit. The method of claim 3, Wherein the image input unit further comprises a direction adjustment control unit for adjusting a shooting direction of the camera module. The method according to claim 1, The voice authentication unit An audio input unit into which the audio data is input; An audio processor for converting the input audio data into converted audio data of a predetermined format, And a voice recognition system unit for performing user authentication by comparing the converted audio data with voice data stored in the storage unit. The method according to claim 1, Further comprising a USB OTG system unit having a USB-OTG function for exchanging data with the storage unit. delete The method according to claim 1, The remote controller A remote communication unit for transmitting and receiving data to and from the main control unit; A remote switch input unit for receiving a command from a user; Further comprising a remote control unit for controlling the remote communication unit and the remote output unit according to a user command input to the remote switch input unit. 9. The method of claim 8, Wherein the remote switch input unit includes means for inputting a remote control command for controlling a photographing direction of the image input unit. delete delete delete delete delete A vehicle security method using multimedia data, (a) inputting image data around a vehicle through an image input unit; (b) storing the input image data in a storage unit; (c) receiving a sensor signal from a sensor input unit in the main control unit and determining whether an accident situation exists; And (d) extracting and transmitting image data stored in the storage unit at the time of the accident situation to the remote controller by the control signal output from the main control unit when it is determined that the accident situation is present; And transmitting the multimedia data. 16. The method of claim 15, The step (b) Further comprising the step of inputting audio data around the vehicle through the audio input unit and storing the input audio data in the storage unit. 16. The method of claim 15, Wherein the storage unit of the step (b) continues to store new data in chronological order by a data erasure storage method in which, when the memory capacity is insufficient, the old data is sequentially erased and updated in the old data order. How to secure your vehicle. 16. The method of claim 15, After the step (d) And outputting the data stored in the storage unit to a memory stick using a USB port having a USB OTG function.

Images