KR101562234B1 - Apparatus and method for mobile terminal use warnig danger during driving of vehicle - Google Patents

Abstract

The present invention relates to a danger warning device and method for use in a vehicle, which includes an input unit for inputting a voice signal generated in a vehicle, a voice database for storing voice information used for voice communication using a portable terminal and DMB, A control unit for determining whether to make a voice call or whether to watch a DMB by associating a voice signal input through the voice database with voice information stored in a voice database, and a danger warning unit for warning a danger due to a voice call or DMB watching during driving according to a control signal of the control unit The voice signal generated during the driving of the vehicle is matched with the voice information stored in the voice DB to judge whether the voice call or the DMB is watched and the danger of using the portable terminal can be warned.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a danger warning device,

More particularly, the present invention relates to a device and method for warning a dangerous use of a portable terminal while driving a vehicle, and more particularly, Warning device and method.

2. Description of the Related Art As mobile communication technology has developed, a variety of terminals such as Personal Communication Service (PCS), digital cellular phone, and the like have been commercialized so that individuals can communicate with a called party using a mobile phone terminal.

Particularly, in recent years, due to the spread of smart phones, various services using data communication as well as voice and video communication have been offered regardless of time and place.

However, the use of mobile phones by drivers during driving has become a major cause of accidents, and legal restrictions on the use of mobile phones during vehicle driving have been strengthened.

That is, according to the Survey on the Risk Behaviors of Drivers during the Operation of the Ministry of Land, Transport and Maritime Affairs, drivers who have a driving experience of 11 ~ 20 years have experienced using mobile phones or watching DMB (Digital Multimedia Broadcasting) .

As a result of the survey, 83.1% of respondents had experience using mobile phones while driving, 41% had experience of sending and receiving text messages, and 13.4% had experience using smartphone applications.

As described above, among the annual traffic accidents occurring in Korea, 10 to 20% of accidents occur due to the use of mobile phones or DMB viewing, among others.

According to the Korea Transport Research Institute, the use of mobile phones, watching DMB, and manipulation of the device during driving cause a risk situation similar to driving with a blood alcohol concentration of 0.10%.

In addition, the National Police Agency said that the Enforcement Decree of the Road Traffic Act and the Enforcement Regulations, which contain the content of punishing the act of watching video and operating the device during driving in 2013, have recently passed the police committee.

As a result, Bluetooth hands-free calls are emerging as an alternative to limiting the use of mobile phones while driving, but hands-free does not mean that they do not use their hands and is free from accident risk.

As a result of the experiment using the mobile phone during driving, the stopping distance when driving was 40 km / hour and the stopping distance was about 45.2m using the handsfree. The result was that the stoppage at the alcohol stopping level (0.05% It is longer than the distance of about 18.6m, which causes traffic accidents.

Accordingly, techniques for restricting the use of a mobile phone while the vehicle is operating have been developed.

For example, Patent Document 1 and Patent Document 2 described below disclose a configuration of a device for limiting the use of a mobile phone by a driver of a vehicle.

Patent Document 1 discloses a mobile phone use restricting device technology of a vehicle driver who generates a disturbance wave corresponding to various electromagnetic wave signals and disables the mobile phone terminal when a mobile phone user places a mobile phone terminal in a predetermined area for communication.

Patent Document 2 discloses a vehicle accident prevention safety control method technique for determining whether or not a hands-free use is made during a high-speed traveling of a vehicle and switching to a safe mode.

In recent years, there has also been used a method of prohibiting the use of a smartphone by transmitting a disturbance frequency to a smartphone by measuring a change in GPS position.

Korean Patent Publication No. 10-2001-0108567 (published on December 8, 2001) Korean Patent Publication No. 10-2005-0057896 (published on June 16, 2005)

However, as the number of infotainment devices installed in a vehicle increases, blocking the use of mobile communication terminals or smartphones is a controversial issue in terms of future services in terms of vehicle connectivity.

Therefore, it is necessary to develop a technology that induces safe driving by notifying the danger to the driver by detecting whether or not the user is talking on a portable terminal and watching a DMB, which causes the user to neglect forward attention while driving the vehicle.

An object of the present invention is to solve the above-mentioned problems, and it is an object of the present invention to solve the above-mentioned problems, and it is an object of the present invention to provide a system and method for distributing forward- And to provide a device and method for warning of dangerous use of a portable terminal.

It is another object of the present invention to provide a mobile terminal use warning device and method for accurately determining whether or not a voice call is made and a DMB viewing by using a voice pattern generated in a vehicle.

In order to achieve the above object, the present invention provides a danger warning device for a portable terminal during driving of a vehicle, comprising: an input unit for inputting voice signals generated in a vehicle; voice calls using a portable terminal; A control unit for determining whether to make a voice call or whether to watch a DMB by associating the voice signal inputted through the input unit with voice information stored in a voice database, and a control unit for controlling the voice call or the DMB And a danger warning section for warning the user of the danger caused by the danger.

The voice database is provided in a cloud-based or embedded-based manner, and stores frequently used words and phrases, business terms, and voice patterns at the time of DMB viewing in a database.

The control unit includes a voice signal separating unit for separating the voice signal of the driver based on the position, direction and intensity of the sound source and removing the noise, a traveling state determining unit for determining the traveling state of the vehicle, A voice extracting unit for extracting a voice word or a sentence frequently used in a voice call in a voice signal, a business term or a voice pattern for DMB watching, and a word or sentence, a business term or a voice pattern extracted from the voice extracting unit, And a use state determination unit for determining whether to make a voice call or a DMB viewing in response to the information.

The traveling state judging section obtains IVN (In Vehicle Network) information by interlocking with navigation or a self-diagnosis device provided in the vehicle, or detects the change of the position of the vehicle by using the GPS signal of the GPS module to judge the traveling state of the vehicle .

The danger warning unit outputs a warning sound, lights or flashes a warning light, displays a warning image, or warns of a danger through a haptic reaction.

According to another aspect of the present invention, there is provided a danger warning method for a portable terminal during driving of a vehicle, comprising the steps of: (a) receiving a voice signal generated in a vehicle; (b) (C) determining whether a voice call is made by the driver by associating the voice signal inputted in the step (a) with the voice information stored in the voice database, if it is determined that the vehicle is in the driving state ) If the voice communication state is determined as a result of the step (c), warning the user through the danger warning unit.

(C1) separating the driver's voice signal based on the position, direction, and intensity of the voice signal input; (c2) comparing the voice signal separated in the step (c1) (C3) comparing the voice information extracted in the step (c2) with the voice information stored in the voice database to determine whether voice communication is performed using the portable terminal, .

(E) if it is determined in step (c) that the voice is a voice other than the driver, extracting a voice pattern from the voice signal and determining whether the voice pattern is in the DMB viewing state And (f) warning the user of the danger through the danger warning unit if the DMB viewing state is determined as a result of the determining in the step (e).

The steps (c) and (e) may compare voice information of the voice database provided on a cloud-based or embedded basis with voice information separated to determine whether a voice call or a DMB is being viewed.

The steps (d) and (f) may be performed by outputting a warning sound, lighting or flashing a warning light, displaying a warning image, or warning a danger through a haptic reaction.

As described above, according to the apparatus and method for warning of a mobile terminal use during driving of a vehicle according to the present invention, a voice signal generated during a vehicle operation is matched with voice information stored in a voice DB to determine whether a voice call or a DMB is viewed, It is possible to warn the user of the risk of using the portable terminal.

In particular, according to the present invention, it is possible to accurately determine whether a voice call or a DMB is viewed by comparing or matching voice signals generated during operation with voice information stored in a voice database provided on a cloud-based or embedded basis.

According to the present invention, it is possible to warn a driver of a voice call only when a voice call of a driver or a DMB is viewed by distinguishing a voice pattern of a driver's voice and a voice pattern of an in-vehicle infotainment device when watching a DMB.

Further, according to the present invention, the sound source can be separated according to the position of the microphone and the position, direction and strength of the sound source of the driver and the passenger using the array microphone.

Thus, according to the present invention, it is possible to accurately drive the portable terminal such as a voice call or DMB watching that disperses the forward-looking attention during operation and induce a traffic accident, Loses.

FIG. 1 is a block diagram of a portable terminal-use danger warning device during vehicle operation according to a preferred embodiment of the present invention;
BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a danger warning method for a portable terminal,

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0028] Hereinafter, an apparatus and method for using a mobile terminal in a vehicle driving state according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram of a portable terminal use warning device during vehicle operation according to a preferred embodiment of the present invention.

As shown in FIG. 1, the portable terminal use warning device 10 in the vehicle driving mode according to the preferred embodiment of the present invention includes an input unit 20 for receiving voice signals generated in the vehicle, (Hereinafter, referred to as 'voice DB') 30 for storing voice information to be used, voice information inputted through the input unit 20 and voice information stored in the voice DB, And a danger warning unit 50 for warning a danger due to watching a call or DMB during driving according to control signals of the control unit 40 and the control unit 40.

The input unit 20 may be provided with one or a plurality of microphones or array microphones so as to receive an operator's voice signal.

The microphone may be installed on a driver's seat ceiling, a dashboard top, a steering wheel, or a windshield so that a driver's voice signal can be smoothly input.

In order to determine whether a voice call or a DMB is to be viewed, the voice DB 30 can store words and phrases frequently used in voice communication, business terms, and voice patterns at the time of watching the DMB into a database.

For example, in the voice DB 30, words and phrases that are frequently used in voice calls such as "Hello," "Are you okay," "It is a long time", "***", " A formal voice pattern that is far away from the business terms such as "please", "thank you", "thank you", "do well", and the daily life conversation coming out from the DMB viewing can be stored.

The voice DB 30 may be connected to the control unit 40 on a cloud-based or embedded basis.

That is, the control unit 40 compares or matches the voice signal input through the input unit 20 with the voice DB 30 on a cloud-based or an embedded basis to determine whether a voice call or a DMB is viewed.

To this end, the control unit 40 includes a voice signal separating unit 41 for separating the voice signal of the driver based on the position, direction and intensity at which the sound source is generated and eliminating noise, a traveling state judging unit 41 for judging the traveling state of the vehicle, A voice extracting unit 43 for extracting voice words or phrases frequently used in voice communication in a separated voice signal, a business term or a voice pattern when watching a DMB, and an extracting unit 43 for extracting extracted words or phrases, business terms, And a usage state determination unit 44 for determining whether to make a voice call or view a DMB in response to information stored in the DB.

The voice signal separating unit 41 separates the voice signal of the driver and the passenger according to the position where the voice source is generated and removes noise of the noise generated in the vehicle according to the strength of the voice source to separate the voice signal of the driver have.

The running state determination unit 42 acquires IVN information in conjunction with the navigation system 11 and on-board diagnostics (OBD apparatus) 12 provided in the vehicle, The traveling state of the vehicle can be determined by detecting the change in the position of the vehicle using the GPS signal of the GPS module 13 provided inside or outside the portable terminal use warning device 10. [

The IVN information may include inertia information such as the running speed of the vehicle, the RPM, and the acceleration / deceleration rate.

The voice extracting unit 43 extracts voice signals separated from the voice signal separated by the voice signal separating unit 41 so as to determine frequently used words and phrases, business terms, and DMB viewing, The pattern can be extracted.

The use state determination unit 44 can determine whether to listen to a voice call or a DMB by distinguishing from the voice signal and voice pattern extracted by the voice extraction unit and the voice output from the infotainment device such as the announcement of the navigation device 11. [

The danger warning section 50 can warn of a danger in various ways such as voice, image, and haptic.

For example, the danger warning section 50 may include a speaker (not shown) for outputting a warning alarm, a warning light (not shown) that is installed on the instrument panel of the vehicle and lights or blinks when a voice call or DMB is viewed, At least one of a head-up display device (not shown) for displaying a warning image or characters and a haptic module (not shown) for generating vibrations installed on a steering wheel or seat of a vehicle or an accelerator pedal of a vehicle Or more.

Meanwhile, when the voice DB 30 is provided in a cloud-based manner, the portable terminal usage risk warning device 10 during vehicle driving according to the preferred embodiment of the present invention includes a communication module (Not shown).

Next, referring to FIG. 2, a risk warning method of a mobile terminal use danger warning device during vehicle driving according to a preferred embodiment of the present invention will be described in detail.

FIG. 2 is a flowchart illustrating a risk warning method of a portable terminal use danger warning device during vehicle operation according to a preferred embodiment of the present invention.

In step S10 of FIG. 2, the input unit 20 receives voice generated in the vehicle.

Then, the running state determination unit 42 of the control unit 40 determines whether the vehicle is running (S12).

At this time, the driving state determination unit 42 may obtain the IVN information in cooperation with the navigation device 11 or the OBD device 12, or may determine whether the vehicle is in a running state using the GPS signal of the GPS module 13 .

If it is determined in step S12 that the vehicle is not running, the control unit 40 controls the control unit 40 to return to step S10

On the other hand, if it is determined in step S12 that the vehicle is in the running state, the voice signal separation unit 41 of the control unit 40 separates the driver's voice signal based on the position and intensity of the sound source generated (S14).

At this time, the voice signal separating unit 41 separates the voice signal of the driver and the passenger according to the position where the voice source is generated, removes the noise of the noise generated in the vehicle according to the strength of the voice source, can do.

In step S16, the control unit 40 determines whether the separated voice signal is the driver's voice signal.

As a result of the determination in step S16, the voice extracting unit 43 extracts frequently used words, phrases, and business terms from the voice signal separated by the voice signal separating unit 41 (S18).

Then, the use state determination unit 44 compares or matches the extracted voice with the voice information stored in the voice DB 30 to determine whether it is in a voice communication state (S20).

If it is determined in step S20 that the voice call is in the voice call state, the control unit 40 generates a control signal to warn the user of the risk of the voice call.

Accordingly, the danger warning section 50 outputs a warning alarm through a speaker in accordance with the control signal of the control section 40, or illuminates or flashes a warning light provided on the instrument panel of the vehicle, or drives the head- A warning image or a character may be displayed on the display screen, or a danger may be warned using a haptic technique such as vibration (S22).

On the other hand, if it is determined in step S20 that the voice call is not in progress, the control unit 40 proceeds to step S30.

On the other hand, if it is determined in step S16 that the voice signal is not the driver's voice signal, the voice extracting unit 43 extracts the voice pattern of the voice signal separated by the voice signal separating unit 41 in step S24.

In operation S26, the use state determination unit 44 determines whether the extracted voice is in the DMB viewing state by comparing or matching the extracted voice with the voice information when viewing the DMB stored in the voice DB 30.

If it is determined in step S26 that the DMB service is in the watching state, the control unit 40 generates a control signal to warn the user of the risk of watching the DMB during operation.

Accordingly, the danger warning section 50 outputs a warning alarm through a speaker in accordance with the control signal of the control section 40, or illuminates or flashes a warning light provided on the instrument panel of the vehicle, or drives the head- A warning image or a character may be displayed on the display screen or a haptic technique such as vibration may be used to warn the user of the danger (S28).

On the other hand, if it is determined in step S26 that the DMB viewing state is not satisfied, the control unit 40 controls to proceed to step S30.

In step S30, the driving state determination unit 42 determines whether or not the vehicle travel is stopped.

If it is determined in step S30 that the vehicle is in the running state, the control unit 40 controls to repeat step S10 through step S30 until the running of the vehicle is stopped.

On the other hand, if it is determined in step S30 that the vehicle driving is stopped, the control unit 40 stops driving the portable terminal use danger warning device 10 during operation of the vehicle and ends the process.

Through the process as described above, the present invention matches a voice signal generated during driving a vehicle with voice information stored in a voice DB to determine whether a voice call or a DMB is viewed, and warns of a danger due to use of the portable terminal.

Although the invention made by the present inventors has been described concretely with reference to the above embodiments, the present invention is not limited to the above embodiments, and it goes without saying that various changes can be made without departing from the gist of the present invention.

The present invention relates to a portable terminal use warning device for warning a driver of a danger due to use of a portable terminal by determining whether a voice call or a DMB is viewed by matching a voice signal generated during driving a vehicle with voice information stored in a voice DB, Technology.

10: Hazard warning device using mobile terminal while driving
11: Navigation 12: Self-diagnosis device
13: GPS module 20: Input section
30: voice database 40:
41: audio signal separation unit 42:
43: voice extracting unit 44: use state judging unit
50: Danger Warning Section

Claims (10)

An input unit for receiving a voice signal generated inside the vehicle,
A voice database for storing voice information used in voice communication and DMB viewing using a portable terminal,
A controller for determining whether a voice call is made or a DMB viewing by associating a voice signal input through the input unit with voice information stored in a voice database;
And a danger warning unit for warning a danger due to a voice call or watching a DMB during driving according to a control signal of the control unit,
Wherein the control unit extracts a voice pattern from the voice signal and determines whether or not the DMB viewing state corresponds to the voice pattern when the DMB is viewed in the voice database, Hazard warning device using mobile terminal during driving. The method according to claim 1,
The voice database is provided on a cloud-based or an embedded basis,
And stores the words and phrases frequently used in voice communication, business terms, and voice patterns at the time of watching DMB into a database and stores the data in a database. The apparatus of claim 1, wherein the control unit
A voice signal separator for separating the voice signal of the driver based on the position, the direction and the strength at which the voice source is generated and removing the noise,
A running state determining unit for determining a running state of the vehicle,
A voice extracting unit for extracting a word or sentence frequently used in voice communication from the voice signal separated by the voice signal separating unit, a business term, or a voice pattern upon DMB viewing,
And a use state judging unit for judging whether a voice call or a DMB is viewed by associating words or phrases, business terms, or voice patterns extracted by the voice extracting unit with information stored in a voice database. Hazard warning devices. The method of claim 3,
The traveling state judging section obtains IVN (In Vehicle Network) information by interlocking with navigation or a self-diagnosis device provided in the vehicle, or detects the change of the position of the vehicle by using the GPS signal of the GPS module to judge the traveling state of the vehicle A danger warning device for use of a mobile terminal while driving a vehicle. The method according to claim 1,
Wherein the danger warning unit outputs a warning sound, lights or flashes a warning light, displays a warning image, or warns a danger through a haptic reaction. (a) receiving a voice signal generated in a vehicle,
(b) determining whether the vehicle is traveling,
(c) determining whether the driver has a voice call by associating the voice signal inputted in the step (a) with the voice information stored in the voice database, if it is determined that the vehicle is in the driving state,
(d) warning a danger through a danger warning unit if the result of the determination in step (c)
(e) extracting a voice pattern from the voice signal if the voice is voice other than the driver as a result of the determining in the step (c), determining whether the voice pattern is in the DMB viewing state in correspondence with the voice pattern when viewing the DMB stored in the voice database;
(f) warning a danger through the danger warning unit if the DMB watching state is determined as a result of step (e). 7. The method of claim 6, wherein step (c)
(c1) separating the driver's voice signal based on the position and intensity at which the voice signal is input,
(c2) extracting words, phrases, and business terms frequently used in voice communication in the voice signal separated in the step (c1); and
(c3) comparing the voice information extracted in the step (c2) with the voice information stored in the voice database to determine whether voice communication is performed using the portable terminal. Warning method. delete 8. The method according to claim 6 or 7,
Wherein the step (c) and the step (e) include comparing or matching voice information of the voice database provided on a cloud-based or embedded basis with separated voice information, Hazard warning method of using mobile terminal during driving. 8. The method according to claim 6 or 7,
Wherein the step (d) and the step (f) warn the user of danger through the output of a warning sound, a warning light on or off, a warning image, or a haptic reaction. .

Images