KR100621856B1 - Method and apparatus for preventing drowsiness driving - Google Patents

Abstract

The present invention relates to a method and apparatus for preventing driver drowsiness. A method of providing a drowsiness prevention service to a driver in a vehicle in a vehicle according to the present invention, the method comprising: registering at least one drowsy image, receiving an actual driving image from a camera mounted on the vehicle, Comparing the drowsy images to calculate a similarity level, determining whether the calculated similarity level is less than a predetermined tolerance value, and outputting a preset alarm message if the similarity level is less than a predetermined tolerance value as a result of the determination. Include.

Drowsiness prevention, mobile terminal, drowsiness prevention server

Description

Method and apparatus for preventing drowsiness driving using a mobile terminal {Method and apparatus for preventing drowsiness driving}

1 is a schematic view showing the configuration of a drowsy driving prevention method and apparatus.
Figure 2 is an exemplary view of the attachment of the part attached to the vehicle of the drowsy driving prevention method and apparatus.
3 is a flowchart schematically illustrating the operation of the method and apparatus for preventing drowsy driving.
4 is a block diagram schematically illustrating a drowsiness prevention process of a method and apparatus for preventing drowsy driving.
5 is a schematic block diagram of a drowsiness alert signal processing operation of a method and apparatus for preventing drowsy driving;
6 is a signal flow diagram schematically illustrating a process of processing a drowsiness alert message between a drowsiness prevention service server and a mobile communication terminal including a drowsiness prevention process therein;
7 is a signal flow diagram schematically illustrating an automatic call connection process of a drowsy driving prevention method and apparatus.
8 is a block diagram schematically illustrating a video storing sequence of a method and apparatus for preventing drowsy driving.
FIG. 9 is a diagram illustrating a structure of a mobile platform of a mobile communication terminal including a drowsiness prevention process included in a drowsy driving prevention method and device;
10 is a block diagram showing a system of the drowsiness prevention service server of the drowsy driving prevention method and apparatus.
11 is a module configuration diagram of a system of a sleepiness prevention service server.

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

<Explanation of symbols for the main parts of the drawings>

100: part attached to the car

101: camera attached to the car

103: a mobile communication terminal including a drowsiness prevention process inside

110: mobile communication network

120: Drowsiness Prevention Service Server

The present invention relates to a method and apparatus for preventing drowsy driving using a mobile communication terminal.
As the number of traffic accidents due to drowsiness is increasing on the dull highway, the research on the development of a sleepiness prevention system is being actively conducted not only in Europe, Japan, and the United States but also in the domestic automobile industry.
The detection methods of drowsy driving have been studied by measuring the physiological signal change of the driver, by changing the eyelids, and also by changing the heart rate and brain wave of the drowsiness through electrocardiogram measurement. However, the conventional method has a problem that a separate device is bulky and expensive.

delete

delete

An object of the present invention is to provide a method and apparatus for preventing drowsy driving by using a mobile communication terminal combined with a camera attached to a vehicle.

Another object of the present invention is to compare the actual drowsiness image that the mobile communication terminal is previously input to the mobile communication terminal and the actual driving image of the current driver transmitted from the camera attached to the vehicle coupled with the mobile communication terminal It is to provide a method and apparatus for preventing drowsy driving to determine the degree of similarity.

Another object of the present invention is that the drowsiness prevention service server that receives the drowsiness signal sent by the mobile communication terminal when the mobile communication terminal including the drowsiness prevention process is determined that the driver is drowsy, the mobile communication terminal The present invention provides a method and apparatus for preventing sleepiness driving to transmit a sleepiness prevention message to a terminal.                         

Still another object of the present invention is to store the actual driving image transmitted from the camera attached to the vehicle at the time when the mobile terminal is determined to be drowsy when the mobile communication terminal including the drowsiness prevention process is determined inside To provide a method and apparatus for preventing drowsy driving.

According to an aspect of the present invention, there is provided a method of providing a drowsiness prevention service to a driver through a mobile terminal in a vehicle, the method comprising: registering at least one drowsy image of the drowsiness of the driver to the mobile terminal; Receiving, by the mobile terminal, an actual driving image of the driver from a camera mounted on the vehicle; Comparing the actual driving image of the driver with at least one drowsy image of the driver registered in advance by the mobile terminal by a predetermined criterion to calculate a degree of similarity for each level classified according to a predetermined criterion; And outputting a drowsiness warning message corresponding to each class when the similarity calculated by the mobile terminal exceeds a predetermined tolerance value for each class by the mobile terminal. Provide a method of providing.
Here, the camera may be coupled to the mobile terminal by wire or wirelessly.
The receiving of the driver's actual driving image from the camera mounted on the vehicle may further include temporarily storing the driver's actual driving image received from the camera in a memory of the mobile terminal. can do.
In addition, the drowsiness warning message may be output in a form that can be perceived by at least one sense of hearing, touch and sight.
According to another aspect of the present invention, a method for providing a drowsiness prevention service to a driver through a mobile terminal which is located in a vehicle and coupled with a drowsiness prevention service server through a mobile communication network, the drowsiness image of the driver sleeping on the mobile terminal Registering at least one or more; Receiving, by the mobile terminal, an actual driving image of the driver from a camera mounted on the vehicle; Comparing the actual driving image of the driver with at least one drowsy image of the driver registered in advance by the mobile terminal by a predetermined criterion to calculate a degree of similarity for each level classified according to a predetermined criterion; And transmitting, by the mobile terminal, a drowsiness signal corresponding to each class to the drowsiness prevention service server when the degree of similarity calculated for each of the previously divided classes exceeds a predetermined tolerance value for each class; Receiving, by the mobile terminal, a sleepiness warning message corresponding to the sleepiness signal from the sleepiness prevention service server; And outputting the received drowsiness warning message by the mobile terminal.
According to another aspect of the present invention, a method for providing a sleepiness prevention service in a sleepiness prevention service server coupled with at least one mobile terminal located in a vehicle through a mobile communication network, receiving a sleepiness signal from the mobile terminal Herein, the mobile terminal registers at least one drowsiness image of the driver sleeping, the mobile terminal receives the actual driving image of the driver from a camera mounted on the vehicle, and the actual terminal of the driver at the mobile terminal. The driving image is compared with at least one drowsy image of the driver registered in advance based on a predetermined criterion to calculate a degree of similarity for each class classified according to a predetermined criterion. The degree exceeds the predefined limits for each class It transmits a drowsiness signal corresponding to each of the right to the drowsiness grade prevent the service server; Extracting a sleepiness warning message corresponding to the received sleepiness signal; And transmitting the extracted drowsiness warning message to the mobile terminal.
According to still another aspect of the present invention, a mobile terminal for providing a drowsiness prevention service to a driver in a vehicle, the mobile terminal comprising: a drowsiness image registration unit that registers at least one drowsy image of the drowsy driver; An actual driving image receiver configured to receive an actual driving image of the driver from a camera mounted on the vehicle; A similarity calculating unit configured to compare the actual driving image of the driver with at least one drowsy image of the driver registered in advance based on a predetermined criterion and calculate a similarity level for each of the classes classified according to a predetermined criterion; And a drowsiness warning message output unit that outputs a drowsiness warning message corresponding to each class when the degree of similarity calculated for each of the predetermined classes exceeds a predetermined tolerance value for each class.
According to still another aspect of the present invention, a mobile terminal for providing a drowsiness prevention service to a driver in combination with a drowsiness prevention service server located in a vehicle through a mobile communication network, wherein the driver registers at least one drowsy image Drowsy image register; An actual driving image receiver configured to receive an actual driving image of the driver from a camera mounted on the vehicle; A similarity calculating unit configured to compare the actual driving image of the driver with at least one drowsy image of the driver registered in advance based on a predetermined criterion and calculate a similarity level for each of the classes classified according to a predetermined criterion; And a drowsiness signal transmission unit for transmitting a drowsiness signal corresponding to each class to the drowsiness prevention service server when the similarity calculated for each of the predetermined grades exceeds a predetermined tolerance value for each class. A drowsiness warning message receiver configured to receive a drowsiness warning message corresponding to the drowsiness signal from the drowsiness prevention service server; And a drowsiness warning message output unit configured to output the received drowsiness warning message.
According to still another aspect of the present invention, a sleepiness prevention service server for providing a sleepiness prevention service in combination with at least one mobile terminal located in a vehicle through a mobile communication network, the sleepiness signal for receiving a sleepiness signal from the mobile terminal Receiving unit-Here, the mobile terminal registers at least one drowsiness image of the driver dozing, the mobile terminal receives the actual driving image of the driver from a camera mounted on the vehicle, the mobile terminal of the driver The actual driving image and the at least one drowsy image of the driver registered in advance are compared by a predetermined criterion to calculate a degree of similarity for each of the predetermined grades according to a predetermined criterion, and the mobile terminal is calculated for each of the predetermined grades. The degree of similarity is second to the predefined tolerance for each class. It transmits a drowsiness signal corresponding to each class in the service server if the drowsiness preventing; A drowsiness warning message extractor configured to extract a drowsiness warning message corresponding to the received drowsiness signal; And a sleepiness warning message transmitter configured to transmit the extracted sleepiness warning message to the mobile terminal.
According to still another aspect of the present invention, a drowsiness prevention service server for providing a drowsiness prevention service in combination with at least one mobile terminal located in a vehicle through a mobile communication network, comprising: a memory in which a program is stored; A processor coupled to the memory to execute the program, wherein the processor receives, by the program, a drowsiness signal from the mobile terminal, wherein the mobile terminal is configured to at least one drowsy image of the driver dozing off; The mobile terminal receives the actual driving image of the driver from a camera mounted on the vehicle, and the mobile terminal receives the actual driving image of the driver and at least one drowsy image of the driver registered in advance. Comparing to calculate the degree of similarity for each of the grades according to a predetermined criterion according to a predetermined criterion, and if the degree of similarity calculated by the mobile terminal for each of the pre-divided grades exceeds a predetermined allowance for each class corresponding to each class Transmits the drowsiness signal to the drowsiness prevention service server -May extract a drowsiness warning message corresponding to the received drowsiness signal, and transmit the extracted drowsiness warning message to the mobile terminal.

delete

delete

delete

delete

delete

delete

delete

Next, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram schematically showing the configuration of a drowsiness driving prevention method and apparatus using a mobile communication terminal according to an embodiment of the present invention.

Referring to FIG. 1, the drowsiness driving prevention device using a mobile communication terminal is composed of a part 100, a mobile communication network 110, and a drowsiness prevention service server 120 largely attached to a vehicle. The portion 100 to be attached to the vehicle consists of a mobile communication terminal 103 including a camera 101 attached to the vehicle and a drowsiness prevention process inside the portable.

The camera 101 attached to the vehicle is coupled to the mobile communication terminal 103 including a drowsiness prevention process therein to transmit a real time image of a driver driving the vehicle 100 to the mobile communication terminal 103. It plays a role. The mobile communication terminal 103 including the sleepiness prevention process therein is previously included in the mobile communication terminal 103 and a real time image of the driver transmitted by the camera 101 attached to the vehicle in the vehicle 100. By comparing the drowsy image of the driver to determine whether the driver is drowsy, and serves to transmit the drowsiness signal to the drowsiness prevention service server 120.

The mobile communication network 110 serves to couple the mobile communication terminal 103 including the sleepiness prevention process and the sleepiness prevention service server 120 therein.

The drowsiness prevention service server 120 receives a drowsiness signal sent by the mobile communication terminal 103 including a drowsiness prevention process therein to provide an appropriate service to the mobile communication terminal 103 or another terminal previously designated. By connecting the call to the mobile phone, the mobile communication terminal 103 including the sleepiness prevention process therein serves to connect the call between the predetermined terminal.

2 is a diagram illustrating an attachment of a part 100 attached to a vehicle of a drowsiness driving prevention method and apparatus using a mobile communication terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 2, the camera 201 attached to the vehicle may be attached to the sun shade of the driver's seat. The camera 201 may photograph a driver's driving state from the front. The mobile communication terminal 203 including the drowsiness prevention process therein may be coupled to the camera 201 in a wired or wireless manner, and the image captured by the camera 201 is real-time in the mobile communication terminal 203. Is sent to.

3 is a flowchart schematically illustrating an operation of a method and apparatus for preventing drowsy driving using a mobile communication terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 3, a normal drowsiness image is input and stored in the mobile communication terminal 103 including the drowsiness prevention process therein (step 301). Thereafter, the camera 101 attached to the vehicle and the mobile communication terminal 103 are combined (step 303). The driver then drives the vehicle 100 (step 305). Then, the camera 101 photographs the driver's driving state and transmits the driving state to the mobile communication terminal 103 in real time (step 307). The mobile communication terminal 103 receives the driver transmitted from the camera 101. If it is determined that the real-time image and the pre-stored drowsiness image is similar, if it is determined that the similarity is similar, the step 311 for providing the drowsiness prevention service is performed, otherwise, the process returns to step 307 again (step 309). It will be described in detail in FIG.

In step 311, the mobile communication terminal 103 provides various drowsiness prevention services. The drowsiness prevention service will be described in detail with reference to FIG. 5.

4 is a block diagram schematically illustrating a drowsiness prevention process of a method and apparatus for preventing drowsy driving using a mobile communication terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 4, the storage window 400 of the mobile communication terminal including the drowsiness prevention process therein first stores the driver's usual drowsy image. The driver's usual drowsy image includes an image of closing eyes 401, an image of bowing down 403, a yawning image 405, and the like, each of which is an image of wearing glasses and an image of wearing a hat. Can be added. Meanwhile, the memory 410 of the camera attached to the vehicle transmits the actual driving image 411 to the mobile communication terminal 103 in real time.

Then, in the image comparison process 420 of the central processing unit of the mobile communication terminal including the drowsiness prevention process therein, the image stored in the storage device 400 of the mobile communication terminal and the memory 410 of the camera. Compare the video being sent.

The comparison process 420 first compares the actual driving image 411 with the stored eye closing image (including a hat or glasses) and performs step 427 if the image is similar. Step 423 is performed (step 421).

In operation 427, the comparison process 420 stores the actual driving image 411 transmitted from the memory 410 of the camera in the storage memory of the mobile communication terminal. The comparison process 420 then generates a drowsy alert 2 signal (step 433). Thereafter, the comparison process 420 compares the actual driving image 411 with the stored bow image (including a hat or glasses) and performs step 443 if the images are similar. If not, go back to the beginning of the comparison process (step 439). In operation 443, the comparison process 420 stores the actual driving image 411 transmitted from the memory 410 of the camera in the storage memory of the mobile communication terminal. The comparison process 420 then generates a drowsy alert 1 signal (step 447).

Meanwhile, in step 423, the comparison process 420 compares the actual driving image 411 with the stored bow image (including a hat or glasses) to perform step 429 if the images are similar. Otherwise, perform step 425.

In operation 429, the comparison process 420 stores the actual driving image 411 transmitted from the memory 410 of the camera in the storage memory of the mobile communication terminal. The comparison process 420 then generates a drowsy alert 2 signal (step 435). Thereafter, the comparison process 420 compares the actual driving image 411 with the stored eye closing image (including a hat or glasses) to perform step 445 if the image is similar. If not, return to the beginning of the comparison process (step 441). In operation 445, the comparison process 420 stores the actual driving image 411 transmitted from the memory 410 of the camera in the storage memory of the mobile communication terminal. The comparison process 420 then generates a drowsy alert 1 signal (step 447).

Meanwhile, in step 425, the comparison process 420 compares the actual driving image 411 with the stored yawn image (including a hat or glasses) to perform step 431 if the images are similar. If not, you are returned to the first part of the comparison process.

In operation 431, the comparison process 420 stores the actual driving image 411 transmitted from the memory 410 of the camera in the storage memory of the mobile communication terminal. The comparison process 420 then generates a drowsiness alert 3 signal (step 437).
As such, the driver may divide the eyes closed, the bowed down image, or the yawned image into classes so as to generate a separate drowsiness alarm signal. The process of comparing each image is related to image processing and comparison. Conventional techniques can be used. That is, the image comparison method for comparing the two image signals to match the two image signals may use a known conventional technique.

5 is a schematic block diagram of a drowsy alarm signal processing operation of a method and apparatus for preventing drowsy driving using a mobile communication terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 5, when it is determined in the comparison process (step 501) of FIG. 4 that the user feels drowsy, a drowsy alarm signal is generated (step 505). However, if it is not judged to be drowsy, it returns to the first part of the comparison process (step 503).

When the drowsy alarm signal is generated (step 505), the drowsy alarm signal is divided into alarm 1, alarm 2, and alarm 3. Alarm 1 (510) occurs in the most critical situation-close your eyes, at the same time bowing head, according to the preventive measures, such as automatic call through the drowsiness service server, automatic message transmission, radio signal transmission, etc. There may also be an alarm origination of the mobile communication terminal itself.

Alert 2 (520) occurs in a certain degree of emergencies-either in closed or bowed heads, and as a preventive method, such as automatic connection of the call through the drowsiness service server, automatic message sending, There may be a radio signal transmission, and there may also be an alarm transmission of the mobile communication terminal itself.

Alarm 3 (520) occurs in a minor emergency situation-yawning, the prevention method according to the automatic call through the drowsiness prevention service server, automatic message transmission, radio signal transmission, etc. Also, the mobile terminal There may be its own alarm origination.

The service according to each alarm is similar, but there may be differences in the contents of the alarm message such as the person of the automatic call connection, the content of the automatic voice message, the channel or the content of the radio call.

6 is a signal flow diagram schematically illustrating a process of processing a drowsiness alert message between a drowsiness prevention service server 610 and a mobile communication terminal 600 including a drowsiness prevention process therein according to an exemplary embodiment of the present invention. .

Referring to FIG. 6, the mobile communication terminal 600 including the sleepiness prevention process therein may transmit a sleepiness signal to the sleepiness prevention service server 610 (step 601). Thereafter, the sleepiness prevention service server 610 may make a call connection request to the mobile communication terminal 600 (step 603). Thereafter, the mobile communication terminal 600 may answer a call connection (step 605), and then the drowsiness prevention service server 610 may perform a sleepiness prevention voice message (step 607) or a sleepiness prevention radio broadcast (step 609). Can provide

7 is a signal flowchart schematically illustrating an automatic call connection process of a method and apparatus for preventing drowsy driving using a mobile communication terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 7, the mobile communication terminal 700 including the sleepiness prevention process therein may transmit a sleepiness signal to the sleepiness prevention service server (step 701). Thereafter, the drowsiness prevention service server 710 may make a call connection request to the predetermined terminal 720 (step 703). The predetermined terminal 720 may make a call connection response (step 705), and the drowsiness prevention service server 710 may include a drowsiness prevention process inside the predetermined terminal from the mobile communication terminal 700. The announcement that the connection is made by the drowsiness signal is transmitted (step 707). Thereafter, the drowsiness prevention service server 710 may make a call connection request to the mobile communication terminal 700 including the drowsiness prevention process therein (step 709). Thereafter, the mobile communication terminal 700 including the drowsiness prevention process therein may make a call connection response (step 711), and the mobile communication terminal 700 including the drowsiness prevention process therein and the predetermined A call path is created between the mobile communication terminals 720 (step 713).

8 is a block diagram schematically illustrating a video storing procedure of a method and apparatus for preventing drowsy driving using a mobile communication terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 8, if it is determined that the drowsiness prevention process is drowsiness (step 801), it is determined whether a previously stored video exists (step 803), and if it exists, step 805 is performed, and otherwise, the video is stored (step 809). ).

In step 805, the alarm level that occurred when the previously stored video is saved is compared with the alarm level of the video that has occurred (step 805). If the alarm level of the previously stored video is higher, the previous video is kept (step 811). Delete the video stored in the and save a new video (step 807).

9 is a diagram illustrating a structure of a mobile platform of a mobile communication terminal in which a drowsiness prevention process is included in a method and device for preventing drowsy driving using a mobile communication terminal according to an embodiment of the present invention.

9, the mobile platform includes mobile communication terminal hardware 901, terminal basic software 903, HAL (Handset Application Layer) 905, run time engine (907), and basic API (909). ), An API manager 911, an application manager 913, an extended API 915, and an application 917.

The mobile communication terminal hardware 901 may include any mobile communication terminal or a portable terminal, such as a mobile phone, a PDA, a PDA phone, a smart phone, and the like. The terminal basic software 903 includes software for basic terminal operation, an LCD driver, a KPD driver, and a serial driver. The HAL 905 is an abstraction layer for maintaining hardware independence of the platform. The HAL 905 supports independence where upper layers can operate independently of the mobile terminal hardware 501 and the terminal basic software 903 on the HAL 905. .

The base API 909 is a collection of base APIs supported by the platform used by the application developer. The basic API 909 includes a C API and a Java API to provide convenience for program developers. The API manager 911 updates and adds the base API 909 and the extended API 515 of the platform. In addition, the API manager 911 provides a function of downloading an application manager 913. The application manager 913 performs overall management functions such as viewing, downloading, installing, executing, deleting, and managing security of the application 917. The extension API 915 is a collection of APIs that are candidates for standardizing a mobile platform, and provides a collection of APIs for providing various services.

The application program 917 refers to an application that is installed in a terminal equipped with a mobile platform and can operate regardless of a terminal environment or terminal basic software. The application includes a drowsiness prevention process according to an embodiment of the present invention.

A method of providing a drowsiness preventing service according to the present invention will be described with reference to the above configuration. First, the mobile communication terminal is equipped with a mobile platform having the above configuration. The user of the mobile communication terminal downloads the sleepiness prevention process according to the present invention from the mobile communication service provider or the service management server using the application manager 913 by performing key operation of the mobile communication terminal. The drowsiness prevention process may be implemented in C language or Java language. The user may execute the drowsiness prevention process in combination with a camera attached to the vehicle while driving. The user may also execute the drowsiness prevention process during a call. Meanwhile, when the user does not want the service according to the present invention, the user may delete the sleepiness prevention process by using the application manager 913.

10 is a block diagram illustrating a system of a drowsiness prevention service server of a method and an apparatus for preventing drowsy driving using a mobile communication terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 10, the system of the drowsiness preventing service server may include a memory system 1020, at least one central processing unit (CPU) 1010, and an input device 1030 coupled to the memory system 1020 to perform high-speed operation. And a communication device 1040.

The central processing unit 1010 includes an Arithmetic Logic Unit (ALU) 1012 for performing calculations, a register 1014 for temporary storage of data and instructions, and a controller 1016 for controlling the operation of the ARS system. The central processing unit 1010 includes Digital, MIPS such as Alpha, MIPS Technology, NEC, IDT, Siemens, Intel, Cyrix, AMD, and Nexgen. It could be a processor with a variety of architectures, such as the company's x86 and IBM's and Powerola's PowerPC.

The memory system 1020 generally includes a high speed main memory 1022 in the form of storage media such as random access memory (RAM) and read only memory (ROM), floppy disk, hard disk, tape, CD-ROM, flash memory, and the like. Auxiliary memory 1024 in the form of a long-term storage medium, and an apparatus for storing data using electrical, magnetic, optical or other storage media. In addition, the main memory 1022 may include a video display memory for displaying an image through the display device.

In addition, the input device 1030 includes a keyboard, a mouse, and the like. The mouse may include, for example, a physical transducer such as a touch screen or a microphone. The communication device 1040 includes a communication interface for communicating with a content providing server and a switch of a wired / wireless communication network.

11 is a module configuration diagram of a system of a sleepiness prevention service server using a mobile communication terminal according to an embodiment of the present invention.

Referring to FIG. 11, the system of the drowsiness prevention service server includes a transmission / reception processing module 1132 for processing wired / wireless communication with a content providing server and a switch of a wired / wireless communication network, and a pre-stored drowsy alert voice message when receiving a drowsy alert signal. The drowsiness alert voice message module 1134 outputs different drowsiness alert voice messages according to the alarm class, and the drowsiness alert radio broadcast module outputs different drowsiness alert radio broadcast signals according to the alert class when receiving a drowsiness alert signal. 1136) and the drowsiness alert signal may include a drowsiness alert call automatic connection module 1138 that automatically connects the call with each other predetermined receiving terminal according to the alarm class. Looking at the overall configuration of the system of the drowsiness prevention service server according to an embodiment of the present invention through such an application module as follows.

The system of the sleepiness prevention service server can use various OS (Operating System) as the OS of the system. The OS controls the operation of each application module 1130 by providing a high level command to an application program interface (API) 1100.

The system of the sleepiness prevention service server identifies each corresponding application module 1130 according to the high level command provided from the API 1100, and decodes the high level command and provides the high level command processing unit 1110 to the corresponding place. It includes. The application module controller 1120 controls the operation of the application module 1130 according to a command provided from the high level command processor 1110. That is, the high level command processor 1110 identifies whether there is an application module 1130 corresponding thereto according to the high level command provided through the API 1100, and corresponds to the case where the corresponding application module 1130 exists. Decoded by a command that can be recognized by the application module 1130 to be transmitted to the corresponding mapping unit or to control the transmission of the message. Here, the application module 1130 includes a transmission and reception processing module 1132, a drowsy alert voice message module 1134, a drowsy alert radio broadcast processing module 1136, and a drowsy alert call automatic connection module 1138. The application module controller 1120 includes a mapping unit 1121, 1123, 1125, and 1127 and an interface unit 1122, 1124, 1126, and 1128 for each application module.

The transmission / reception processing module mapping unit 1121 receives a high-level command for performing wired / wireless communication with the drowsiness prevention service server or the user terminal from the high-level command processing unit 1110, and processes the transmission / reception processing module 1132. Maps to device level instructions, and provides them to the transmit / receive processing module 1132 via the transmit / receive processing module interface 1122. In addition, the transmission and reception processing module 1132 may include a physical transmission interface for data transmission and reception with the drowsiness prevention service server as needed. In this case, the physical transport interface includes a communication interface such as SS7 voice network interworking interface or TCP / IP network interworking interface.

The drowsy alert voice message module 1134 stores the drowsy alert voice message and outputs a drowsy alert voice message according to the drowsy alert signal. That is, the drowsiness alert voice message mapping unit 1123 receives a high level command for storing and outputting the drowsiness alert voice message from the high level command processor 1110 and recognizes the drowsiness alert voice message module 1134. Maps to a level command and provides it to the drowsy alert voice message module 1134 via the drowsy alert voice message module interface 1124.

The drowsiness alert radio broadcast module 1136 is a part that outputs the drowsiness alert radio broadcast signal according to the drowsiness alert signal. That is, the drowsiness alert radio broadcast module mapping unit 1125 receives a high level command for outputting the drowsiness alert radio broadcast signal from the high level command processor 1110, so that the drowsiness alert radio broadcast module 1136 can recognize the device. Map to a level command and provide it to the drowsy alert radio broadcast module 1136 through the drowsy alert radio broadcast module interface 1126.

The drowsiness alert call automatic connection module 1138 is a part for automatically connecting a call with a predetermined receiving terminal according to the drowsiness alert signal. That is, the drowsiness alert call automatic connection module mapping unit 1127 receives a high level command for automatically connecting a call to a predetermined receiving terminal from the high level command processor 1110, so that the drowsiness alert call automatic connection module 1138 is provided. Maps to recognizable device level commands and provides it to the drowsy alert call autoconnect module 1138 via the drowsy alert call autoconnect module interface 1128.

The present invention is not limited to the above embodiments, and many variations are possible by those skilled in the art within the spirit of the present invention.

According to the present invention can provide a method and apparatus for preventing drowsy driving by using a mobile communication terminal combined with a camera attached to a vehicle. Therefore, there is an effect that can achieve a light weight of the drowsy driving prevention device.

According to the present invention, the mobile communication terminal compares the usual drowsy image previously input to the mobile communication terminal with the actual driving image of the current driver transmitted from the camera attached to the vehicle coupled with the mobile communication terminal. It is possible to provide a drowsiness driving prevention method and apparatus for determining the degree. Therefore, there is an effect that can effectively determine the sleepiness inside the mobile communication terminal.

In addition, according to the present invention, when the mobile communication terminal including the drowsiness prevention process is determined that the driver is drowsy, the drowsiness prevention service server receiving the drowsiness signal sent by the mobile communication terminal to the mobile communication terminal A sleepiness driving prevention method and apparatus for transmitting a sleepiness prevention message may be provided. Therefore, the drowsiness prevention service is possible through the drowsiness prevention service server combined with the wireless communication network.

Also, when the mobile communication terminal including the drowsiness prevention process is determined to be drowsy according to the present invention, the mobile communication terminal stores the actual driving image transmitted from the camera attached to the vehicle at the time of determining the drowsiness. Driving prevention method and apparatus can be provided. Therefore, the driver may be aware of the risk of drowsy driving by referring to the drowsy driving image, and has an effect of preventing drowsy driving.

Claims (13)

In the method for providing a drowsiness prevention service to a driver through a mobile terminal in a vehicle, Registering at least one drowsiness image of the driver sleeping with the mobile terminal; Receiving, by the mobile terminal, an actual driving image of the driver from a camera mounted on the vehicle; Comparing the actual driving image of the driver with at least one drowsy image of the driver registered in advance by the mobile terminal by a predetermined criterion to calculate a degree of similarity for each level classified according to a predetermined criterion; And Outputting a drowsiness warning message corresponding to each class when the degree of similarity calculated for each of the predetermined classes exceeds a predetermined tolerance value for each class by the mobile terminal; Drowsiness prevention service providing method using a mobile terminal comprising a. delete The method of claim 1, The camera is coupled to the mobile terminal by wire or wireless Drowsiness prevention service providing method using a mobile terminal, characterized in that. The method of claim 1, Receiving the actual driving image of the driver from the camera mounted on the vehicle, the mobile terminal further comprises the step of temporarily storing the actual driving image of the driver received from the camera in the memory of the mobile terminal; Drowsiness prevention service providing method using a mobile terminal, characterized in that. delete delete The method of claim 1, The drowsiness warning message is output in a form recognizable by at least one sense of hearing, touch and sight. Drowsiness prevention service providing method using a mobile terminal, characterized in that. A method of providing a drowsiness prevention service to a driver through a mobile terminal located in a vehicle and coupled with a drowsiness prevention service server through a mobile communication network, Registering at least one drowsiness image of the driver sleeping with the mobile terminal; Receiving, by the mobile terminal, an actual driving image of the driver from a camera mounted on the vehicle; Comparing the actual driving image of the driver with at least one drowsy image of the driver registered in advance by the mobile terminal by a predetermined criterion to calculate a degree of similarity for each level classified according to a predetermined criterion; And Transmitting, by the mobile terminal, a drowsiness signal corresponding to each class to the drowsiness prevention service server when the degree of similarity calculated for each of the predetermined classes exceeds a predetermined tolerance value for each class; Receiving, by the mobile terminal, a sleepiness warning message corresponding to the sleepiness signal from the sleepiness prevention service server; And Outputting the received drowsiness warning message by the mobile terminal; Drowsiness prevention service providing method using a mobile terminal comprising a. A method of providing a sleepiness prevention service in a sleepiness prevention service server coupled with at least one mobile terminal located in a vehicle through a mobile communication network, Receiving a drowsiness signal from the mobile terminal, wherein the mobile terminal registers at least one or more drowsy images of the driver sleeping, and receives the actual driving image of the driver from a camera mounted on the vehicle by the mobile terminal The mobile terminal compares the actual driving image of the driver with the at least one drowsy image of the driver registered in advance using a predetermined criterion to calculate a degree of similarity for each level classified according to a predetermined criterion. Transmitting a drowsiness signal corresponding to each class to the drowsiness prevention service server when the degree of similarity calculated for each of the predetermined classes exceeds a predetermined tolerance value for each class; Extracting a sleepiness warning message corresponding to the received sleepiness signal; And Transmitting the extracted drowsiness warning message to the mobile terminal; Drowsiness prevention service providing method using a mobile terminal comprising a. In a mobile terminal for providing a drowsiness prevention service to a driver in a vehicle, A drowsiness image registration unit that registers at least one drowsiness image that the driver is dozing; An actual driving image receiver configured to receive an actual driving image of the driver from a camera mounted on the vehicle; A similarity calculating unit configured to compare the actual driving image of the driver with at least one drowsy image of the driver registered in advance based on a predetermined criterion and calculate a similarity level for each of the classes classified according to a predetermined criterion; And Drowsiness warning message output unit for outputting a drowsiness warning message corresponding to each class when the degree of similarity calculated for each pre-divided class exceeds a predetermined allowance for each class A mobile terminal comprising a. A mobile terminal, which is located in a vehicle and provides a drowsiness prevention service to a driver in combination with a drowsiness prevention service server through a mobile communication network, A drowsiness image registration unit that registers at least one drowsiness image that the driver is dozing; An actual driving image receiver configured to receive an actual driving image of the driver from a camera mounted on the vehicle; A similarity calculating unit configured to compare the actual driving image of the driver with at least one drowsy image of the driver registered in advance based on a predetermined criterion and calculate a similarity level for each of the classes classified according to a predetermined criterion; And A drowsiness signal transmitter for transmitting a drowsiness signal corresponding to each grade to the drowsiness prevention service server when the similarity calculated for each of the grades exceeds a predetermined tolerance value for each grade; A drowsiness warning message receiver configured to receive a drowsiness warning message corresponding to the drowsiness signal from the drowsiness prevention service server; And Drowsiness warning message output unit for outputting the received drowsiness warning message A mobile terminal comprising a. A sleepiness prevention service server for providing a sleepiness prevention service in combination with at least one mobile terminal located in a vehicle through a mobile communication network, A drowsiness signal receiver for receiving a drowsiness signal from the mobile terminal, wherein the mobile terminal registers at least one drowsiness image of the driver dozing, and the mobile terminal is a real driving image of the driver from a camera mounted on the vehicle. Receives, and the mobile terminal compares the actual driving image of the driver and the at least one drowsy image of the driver registered in advance by a predetermined criterion to calculate the degree of similarity for each of the grades previously classified according to a predetermined criterion, The mobile terminal transmits a drowsiness signal corresponding to each class to the drowsiness prevention service server when the degree of similarity calculated for each of the predetermined classes exceeds a predetermined tolerance value for each class; A drowsiness warning message extractor configured to extract a drowsiness warning message corresponding to the received drowsiness signal; And Sleepiness warning message transmission unit for transmitting the extracted sleepiness warning message to the mobile terminal Drowsiness prevention service server comprising a. A sleepiness prevention service server for providing a sleepiness prevention service in combination with at least one mobile terminal located in a vehicle through a mobile communication network, A memory in which a program is stored; A processor coupled to the memory to execute the program Including but not limited to: The processor receives, by the program, a drowsiness signal from the mobile terminal, wherein the mobile terminal registers at least one or more drowsy images of the driver's drowsiness, and the mobile terminal from the camera mounted on the vehicle. Receives the actual driving image of the driver, and compares the actual driving image of the driver and the at least one drowsy image of the driver registered in advance by a predetermined criterion in the mobile terminal according to a predetermined degree classified according to a predetermined criterion And calculating the drowsiness signal corresponding to each class to the drowsiness prevention service server when the similarity calculated for each of the previously divided classes exceeds a predetermined allowance for each class. Extracts a drowsiness warning message corresponding to the received drowsiness signal; To send the exported drowsiness warning message to the mobile communication Drowsiness prevention server, characterized in that.

Images