WO2021112537A1

WO2021112537A1 - System for providing safe driving service

Info

Publication number: WO2021112537A1
Application number: PCT/KR2020/017403
Authority: WO
Inventors: 고준택
Original assignee: 고준택
Priority date: 2019-12-02
Filing date: 2020-12-01
Publication date: 2021-06-10
Also published as: KR102169168B1

Abstract

Provided is a system for providing a safe driving service, wherein the system comprises: a user terminal which registers at least one acquaintance terminal, and which sends a drowsy driving message to the at least one acquaintance terminal when a drowsy driving event is sensed; and a safe driving service providing server which includes a registration unit to which the at least one acquaintance terminal is registered from the user terminal, a monitoring unit that monitors a video being streamed in real time from the user terminal, and a transmission unit which, when the video is analyzed and a drowsy driving event of a user is sensed, transmits a call to the at least one registered acquaintance terminal and the user terminal.

Description

Safe driving service provision system

The present invention relates to a system for providing a safe driving service, and provides a system for inducing an arousal effect through interaction between people by sending a call to a previously registered acquaintance terminal when drowsy driving is detected.

Despite the government's active crackdown, the number of drowsy driving accidents is increasing every year. Among the various causes of traffic accidents, traffic accidents caused by driver's drowsiness or fatigue have a greater risk in that the driver's cognitive ability decreases and the vehicle cannot be controlled. In order to prevent drowsy driving, which is recognized as a social problem, various techniques for predicting and preventing the driver's drowsiness state have been recently proposed. Typical examples of detecting drowsy driving include a method of recognizing the driver's eye blinks and extracting facial feature points using computer vision technology and a camera, and a method of analyzing the driver's biological characteristics by measuring brain waves, heart rate, and pulse rate etc. have been researched and developed.

At this time, the method for preventing drowsy driving consists of a method of stimulating at least one part of the human body. Patent No. 2019-0104725 (published on September 11, 2019) discloses a configuration using a parametric speaker that provides sound only to the occupant when the occupant's drowsiness is detected through the drowsy driving detection device, and the driver's visual , an arousal device that stimulates at least one of olfactory and tactile senses and a configuration for controlling the arousal device to operate are disclosed, respectively.

However, even if the above-described configuration is used, the machine has no choice but to come back to sleep because of the monotony and repetition that the machine stimulates, and since the event to evoke the drowsy state does not occur, the awakening does not occur and the drowsy driving continues. none. In addition, if an accident is predicted to occur, secondary damage may occur because the user is notified of an alarm and not notified to nearby vehicles. Even if an accident occurs, quick action is not taken, so the golden time is missed. In most cases, it leads to death.

According to an embodiment of the present invention, based on the concept that the arousal effect is induced by interaction with the passenger, when it is determined as drowsy driving through the camera, a call is transmitted to a preset acquaintance terminal, and when the call is made By controlling so that the message about drowsy driving can be checked on the receiving screen with instant lettering, the call is answered. If the call is not answered, the call is made to the next-priority acquaintance terminal, and the call is attempted until the call is connected, and the call is not connected. If the outgoing call is finished without a message being sent, a message is sent so that a call can come from the terminal of the acquaintance, which is the receiver terminal, and the warning light is controlled while drowsy driving is detected to prevent damage to nearby vehicles, and an accident occurs when an accident is detected It is possible to provide a safe driving service providing method that minimizes the occurrence of accidents by providing location and user information to the server of a public institution in the jurisdiction where it occurs so that an ambulance can arrive in a short time. However, the technical task to be achieved by the present embodiment is not limited to the technical task as described above, and other technical tasks may exist.

As a technical means for achieving the above technical problem, an embodiment of the present invention is a user terminal that registers at least one acquaintance terminal and transmits a drowsy driving message to at least one acquaintance terminal when a drowsy driving event is detected. and a registration unit for registering at least one acquaintance terminal from the user terminal, a monitoring unit monitoring an image streamed in real time from the user terminal, and at least one registered acquaintance terminal when the user's drowsy driving event is detected by analyzing the image It includes a safe driving service providing server including a transmitter for sending a call to the user terminal.

According to any one of the above-described problem solving means of the present invention, based on the concept that the arousal effect is induced by interaction with a passenger, when it is determined that the driving is drowsy through the camera, a call is transmitted to a preset acquaintance terminal and , When making a call, it is controlled so that the message about drowsy driving can be checked on the receiving screen with instant lettering to answer the call. If the call is not answered, the call is made to the next-priority acquaintance terminal, and the call is attempted until the call is connected. When the outgoing call is terminated without a call connected, a message is sent so that a call can be received from the acquaintance terminal, which is the receiver terminal, and the warning light is controlled while drowsy driving is detected to prevent damage to nearby vehicles, and accidents When an occurrence is detected, the location and user information are provided to the server of the public institution in the jurisdiction where the accident occurred so that an ambulance can arrive in a short time.

1 is a view for explaining a system for providing a safe driving service according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating a safe driving service providing server included in the system of FIG. 1 .

3 is a view for explaining an embodiment in which a safe driving service according to an embodiment of the present invention is implemented.

4 is a diagram illustrating a process of transmitting and receiving data between each component included in the safe driving service providing system of FIG. 1 according to an embodiment of the present invention.

5 is an operation flowchart illustrating a method for providing a safe driving service according to an embodiment of the present invention.

A safe driving service providing system is provided, and a user terminal that registers at least one acquaintance terminal and transmits a drowsy driving message to at least one acquaintance terminal when a drowsy driving event is detected, and at least one acquaintance terminal from the user terminal A registration receiving registration unit, a monitoring unit monitoring the video streamed in real time from the user terminal, and when a user's drowsy driving event is detected by analyzing the video, a call is sent to the user terminal by at least one registered acquaintance terminal. By including a safe driving service providing server including a calling unit, when it is determined that drowsy driving through the camera, it transmits a call to a preset acquaintance terminal, and receives a message about drowsy driving with instant lettering when making a call It has the advantage of controlling so that it can be checked in .

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement them. However, the present invention may be embodied in many different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is "connected" with another part, this includes not only the case of being "directly connected" but also the case of being "electrically connected" with another element interposed therebetween. . Also, when a part "includes" a component, it means that other components may be further included, rather than excluding other components, unless otherwise stated, and one or more other features However, it is to be understood that the existence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded in advance.

The terms "about", "substantially", etc. to the extent used throughout the specification are used in a sense at or close to the numerical value when manufacturing and material tolerances inherent in the stated meaning are presented, and are intended to enhance the understanding of the present invention. To help, precise or absolute figures are used to prevent unfair use by unscrupulous infringers of the stated disclosure. As used throughout the specification of the present invention, the term “step for (to)” or “step for” does not mean “step for”.

In this specification, a "part" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. In addition, one unit may be implemented using two or more hardware, and two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by the terminal, apparatus, or device may be performed instead of in a server connected to the terminal, apparatus, or device. Similarly, some of the operations or functions described as being performed by the server may also be performed in a terminal, apparatus, or device connected to the server.

In this specification, some of the operations or functions described as mapping or matching with the terminal means mapping or matching the terminal's unique number or personal identification information, which is the identification data of the terminal. can be interpreted as

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a view for explaining a system for providing a safe driving service according to an embodiment of the present invention. Referring to FIG. 1 , the safe driving service providing system 1 includes at least one user terminal 100 , a safe driving service providing server 300 , at least one acquaintance terminal 400 , and at least one public institution server. (500). However, since the safe driving service providing system 1 of FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1 .

In this case, each component of FIG. 1 is generally connected through a network 200 . For example, as shown in FIG. 1 , at least one user terminal 100 may be connected to the safe driving service providing server 300 through the network 200 . And, the safe driving service providing server 300, through the network 200, at least one user terminal 100, at least one acquaintance terminal 400, at least one public institution server 500, and a manager terminal ( 600) can be connected. In addition, the at least one acquaintance terminal 400 may be connected to the safe driving service providing server 300 through the network 200 . In addition, the at least one public institution server 500 may be connected to at least one user terminal 100 , the safe driving service providing server 300 , and at least one acquaintance terminal 400 through the network 200 .

Here, the network refers to a connection structure in which information exchange is possible between each node, such as a plurality of terminals and servers, and an example of such a network includes RF, 3rd Generation Partnership Project (3GPP) network, Long Term (LTE). Evolution) network, 5th Generation Partnership Project (5GPP) network, WIMAX (World Interoperability for Microwave Access) network, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network) , PAN (Personal Area Network), Bluetooth (Bluetooth) network, NFC network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) network, and the like are included, but are not limited thereto.

In the following, the term at least one is defined as a term including the singular and the plural, and even if the term at least one does not exist, each component may exist in the singular or plural, and may mean the singular or plural. it will be self-evident In addition, that each component is provided in singular or plural may be changed according to embodiments.

The at least one user terminal 100 may be a terminal of a user who does not want to drive while drowsy by using a safe driving service related web page, an app page, a program, or an application. To this end, the user terminal 100 registers the phone number of at least one acquaintance in the safe driving service providing server 300, and even if other applications are driven in the foreground mode, they are overlaid and driven together. It may be a terminal capable of forming a multi-window. And, when drowsy driving is detected, the user terminal 100 is a terminal that transmits the sensed data to make a call to the phone number of at least one acquaintance or to make a call through the safe driving service providing server 300 . can If the networking resources and computing resources of the user terminal 100 can perform all of the multi-window driving, drowsy driving analysis, and in addition to call origination, the driving or configuration of the safe driving service providing server 300 is not required, but otherwise If not, the above-described configuration may be performed in the safe driving service providing server 300 . In addition, the user terminal 100 may be a terminal that interworks with at least one IoT node of the vehicle to perform an AP (Access Point) role so as to be connected to the safe driving service providing server 300, and at least one wearable terminal (not shown). City) may be a terminal connected to. At this time, when drowsy driving is detected, when a control command is received through the safe driving service providing server 300, the user terminal 100 may be a terminal that transmits the control command to at least one node and at least one wearable terminal. .

Here, the at least one user terminal 100 may be implemented as a computer that can access a remote server or terminal through a network. Here, the computer may include, for example, a navigation device, a laptop computer equipped with a web browser, a desktop computer, and a laptop computer. In this case, the at least one user terminal 100 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one user terminal 100 is, for example, a wireless communication device that guarantees portability and mobility, such as navigation, Personal Communication System (PCS), Global System for Mobile communications (GSM), Personal Digital Cellular (PDC), PHS(Personal Handyphone System), PDA(Personal Digital Assistant), IMT(International Mobile Telecommunication)-2000, CDMA(Code Division Multiple Access)-2000, W-CDMA(W-Code Division Multiple Access), Wibro(Wireless Broadband Internet) ) terminal, a smart phone, a smart pad, a tablet PC, etc. may include all kinds of handheld-based wireless communication devices.

The safe driving service providing server 300 may be a server providing a safe driving service web page, an app page, a program or an application. In addition, the safe driving service providing server 300 may be a server that receives a phone number of an acquaintance from the user terminal 100 and analyzes the sensed data received from the user terminal 100 to determine whether or not to drive while drowsy. At this time, if it is determined that the safe driving service providing server 300 is drowsy driving, it may send a call to the registered acquaintance terminal 400, and at this time, it may be a server informing that the user is drowsy driving by transmitting an instant lettering together. In addition, the safe driving service providing server 300 may be a server that transmits a control command pre-mapped to the at least one IoT node to the user terminal 100 when the user terminal 100 and at least one IoT node are connected. , may be a server that transmits a control command via the user terminal 100 similarly to the wearable device. In addition, when the ECM of the vehicle and the user terminal 100 are interlocked, the safe driving service providing server 300 may be a server that controls at least one device of the vehicle through CAN communication through the ECM.

Here, the safe driving service providing server 300 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a navigation device, a laptop computer equipped with a web browser, a desktop computer, and a laptop computer.

The at least one acquaintance terminal 400 may be a terminal of an acquaintance who uses a safe driving service related web page, an app page, a program, or an application. In this case, the at least one acquaintance terminal 400 may be a terminal capable of receiving a call from the safe driving service providing server 300 and outputting an instant lettering about drowsy driving on the screen. Here, when the acquaintance terminal 400 fails to receive a call, it may be a terminal that receives a drowsy driving message.

Here, the at least one acquaintance terminal 400 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a navigation device, a laptop computer equipped with a web browser, a desktop computer, and a laptop computer. In this case, the at least one acquaintance terminal 400 may be implemented as a terminal capable of accessing a remote server or terminal through a network. The at least one acquaintance terminal 400 is, for example, a wireless communication device that guarantees portability and mobility, including navigation, Personal Communication System (PCS), Global System for Mobile communications (GSM), Personal Digital Cellular (PDC), PHS(Personal Handyphone System), PDA(Personal Digital Assistant), IMT(International Mobile Telecommunication)-2000, CDMA(Code Division Multiple Access)-2000, W-CDMA(W-Code Division Multiple Access), Wibro(Wireless Broadband Internet) ) terminal, a smart phone, a smart pad, a tablet PC, etc. may include all kinds of handheld-based wireless communication devices.

At least one public institution server 500 is a server that receives the accident location and driver information from the safe driving service providing server 300 with or without using a safe driving service related web page, app page, program or application. can Here, the at least one public institution server 500 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a navigation device, a laptop computer equipped with a web browser, a desktop computer, and a laptop computer.

2 is a block diagram for explaining a safe driving service providing server included in the system of FIG. 1 , and FIG. 3 is a diagram for explaining an embodiment in which a safe driving service according to an embodiment of the present invention is implemented .

Referring to FIG. 2 , the safe driving service providing server 300 may include a registration unit 310 , a monitoring unit 320 , a sending unit 330 , a message unit 340 , and an accident processing unit 350 . .

At least one user terminal 100, at least one acquaintance terminal 400, and at least one other server (not shown) operating in conjunction with the safe driving service providing server 300 according to an embodiment of the present invention When transmitting a safe driving service application, program, app page, web page, etc. to the public institution server 500 , at least one user terminal 100 , at least one acquaintance terminal 400 , and at least one public institution server 500 may install or open a safe driving service application, a program, an app page, a web page, and the like. In addition, the service program may be run in at least one user terminal 100 , at least one acquaintance terminal 400 , and at least one public institution server 500 by using a script executed in a web browser. Here, the web browser is a program that enables the use of a web (WWW: world wide web) service, and refers to a program that receives and displays hypertext written in HTML (hyper text mark-up language), for example, Netscape , Explorer, Chrome, and the like. In addition, the application means an application on the terminal, for example, includes an app (app) executed in a mobile terminal (smartphone).

Referring to FIG. 2 , the registration unit 310 may receive registration of at least one acquaintance terminal 400 from the user terminal 100 . In this case, although it is based on registering the phone number of the acquaintance terminal 400 , registration of an account of a messenger or at least one social media is not excluded. When registering a messenger or social media account, it is necessary to check whether the corresponding program or application is frequently used in the acquaintance terminal 400 . This is because, in the case of programs that are not used frequently, there are cases where the alarm is turned off or deleted. Accordingly, the registration unit 310 accesses the account of the user terminal 100, checks the activity log of the connected acquaintance terminal 400, and does not register it if it is not accessed at a preset frequency or period, and does not register other types of messenger or You can check or request on social media.

The monitoring unit 320 may monitor an image streamed from the user terminal 100 in real time. At this time, after shooting using the front or rear camera in the user terminal 100 , the image is streamed to the monitoring unit 320 . If a separate photographing device such as a black box exists, the resolution is the reference value. If it is satisfied, it can be registered and used. For example, if too many applications are running in the user terminal 100, the service according to an embodiment of the present invention does not work properly because computing resources such as CPU or RAM limited according to the driving order or priority of the application must be used. This is because drowsy driving, which must be monitored in real time, leads to an accident, resulting in delay. In this case, the monitoring unit 320 may control other applications to be stopped to secure resources so that the application of the present invention can be driven with the highest priority, and to drive only the navigation and drowsiness prevention applications.

In this case, a real-time object detection algorithm based on a deep learning method may be used as a method for analyzing the image. Unlike R-CNN, which requires thousands of network evaluations on a single image, predictions can be made with a single network evaluation on a single image. Because of this, it is 1,000 times faster than R-CNN and 100 times faster than Fast R-CNN, so it can detect objects in real time. In this case, it is possible to determine drowsiness by photographing the driving state of the driver, who is the user, and if it is determined that the user is in a drowsy state, a warning sound is issued to inform the driver that he is in a drowsy state and to recognize it by himself. To this end, the motion of the eyes, face, and head (head) is extracted and detected from the frame in which the driver is photographed, and the time when the eyes are closed (Eye Aspect Ratio) is measured (Eye Aspect Ratio) and a warning sound is generated through an algorithm that determines the state of drowsiness. can be printed out. In addition, it is possible to minimize judgment errors by using all of the properties of the ratio of the time when the eyes are closed for the preset time, the ratio between the height and width of the eyes, and the blinking time (Eye Blink Rate) properties. In addition, MTCNN (Multi-Task Cascaded Convolutional Networks) may be used as a network for recognizing and aligning faces, and DDDN (Driver Drowsiness Detection Network) may be used as a network for determining whether a person is drowsy. it will be self-evident

When the drowsy driving event of the user is detected by analyzing the image, the transmitter 330 may transmit a call to the user terminal 100 to the registered at least one acquaintance terminal 400 . In this case, the transmitter 330 may transmit a drowsy driving message through call lettering when the call is made to the at least one acquaintance terminal 400 to be displayed on the reception screen. Call lettering is a method of displaying the text set by the A caller on the call receiving screen of the B recipient in addition to the name or text set by the B recipient for the A caller when the A caller makes a call to the B recipient. If you are in a meeting, even if you look at the reception screen, you can't know what the content is, so you may not answer the call. However, in case of an emergency, call lettering may be used because the call connection rate may increase. At this time, the calling unit 330 attempts to make a call in the order of the registered acquaintances. If it is assumed that A, B, C, and D acquaintances are registered in order, the call is made to A, but A does not answer the call. In this case, B is called again and this process is repeated until the call is answered.

The transmitter 330 converts the user's specific word to STT (Speak to Text) when the user's specific word is uttered even without analyzing the image, and the converted text is a preset specific word, for example, "I'm sleepy". In the case of , a call may be automatically transmitted to the previously registered acquaintance terminal 400 . At this time, the language spoken when drowsiness does not need to be a complete sentence such as a noun or a verb, nor does it need to be a complete word. For example, it may be an onomatopoeic sound such as a yawning sound, or it may be a snoring sound. Of course, before proceeding to the snoring step, a warning should be given to awaken the person according to an embodiment of the present invention, but an example is given for convenience of explanation. In addition, when an utterance "Call XX" is uttered after a specific word, it may be recognized and an operation to call XX may be performed.

At this time, the artificial intelligence assistant or virtual assistant recognizes the key words of the input word using speech recognition technology and natural language processing among artificial intelligence technologies, and delivers the results derived through the built algorithm to the user. , can be built on the basis of human understanding structures. A virtual assistant using artificial intelligence technology can grasp its importance through the interface of human and computer information input. In the case of humans, the medium of information transmission is language, and the other party recognizes the voice information in the brain by recognizing the voice generated for the language, but in the case of a machine, the information is processed through formulas and computer languages built through programming. Although human and machine languages have different systems, inputting commands to a machine through human language is called speech recognition and information recognition and processing in a computing environment is called natural language processing. Based on such speech recognition technology and natural language processing technology, the virtual assistant can learn the user's commands through machine learning during the process of repetitive command input.

If all of the registered acquaintances do not answer the call, the calling unit 330 may attempt to make a call by further extracting contacts having a high frequency or period of contact, excluding the contact list including the title, until the call is connected. Here, the transmitter 330 may control the user terminal 100 so that the artificial intelligence assistant can attempt a conversation when no one answers the phone for a preset time while drowsy driving is continuously monitored. Furthermore, the transmitter 330 enables the user to wake up using at least one IoT node interlocked with the user terminal 100 , a Bluetooth speaker, a wearable device, or equipment such as a navigation device.

Accordingly, the user terminal 100 may output a warning sound when a drowsy driving event is detected, interwork with at least one IoT node installed in the vehicle, and, when a drowsy driving event is detected, to at least one IoT node A previously mapped and stored control signal may be transmitted. However, there are cases in which the user does not wake up with no terminal interlocked in the vicinity or only by the speaker output of the user terminal 100 . When driving at 100 km/h, even if you fall asleep for just 2 to 3 seconds, the distance is more than 100 m, which is very dangerous, so a method that can give an immediate awakening effect is required. To this end, the transmitter 330 may transmit a control command for controlling at least one object of the vehicle using On-Board Diagnostics (OBD) and Restful API communication. In this case, the control command may be used to verify the validity of command execution through a callback URL that sends a parameter upon request in a callback method.

At this time, REST (Representational State Transfer) is a software protocol structure for a distributed hypermedia system, and it is an architecture that delivers data through HTTP and strictly separates components between the client and the server to increase the simplification and scalability of implementation. REST has been established as a web application that can easily use resources open to the web, and a service or application defined and used according to this REST architecture style is called a RESTful web service. RESTful web service can be contrasted with SOA (Service Oriented Architecture) as ROA (Resource Oriented Architecture) that a resource provider directly provides to a resource requester without an intermediate that registers and stores resources. In addition, the basic elements of REST are composed of three elements: resource, method, and message. When designing a RESTful API, a resource is designed intuitively and simply by using a noun, and represents a set of resources or one resource. Methods can use only 4 methods corresponding to CRUD among various methods in HTTP. Finally, messages can be expressed in various ways such as XML, JSON, HTML, text, images, etc., but is not limited thereto.

Control modules such as ECU (Electric Control Unit), TCU (Transmission Control Unit), ACU (Airbag Control Unit), ABS (Anti-lock Braking System), etc. are installed in the vehicle to improve performance, safety and convenience. Modules enhance the overall functionality by sharing data values of other modules as needed. For this purpose, CAN (Controller Area Network) communication is used to organically control the control module (ECM). One of the most effective ways to awaken drowsiness is to ventilate. When driving with the vehicle closed, it takes less than an hour for carbon dioxide to rapidly build up inside the vehicle and exceed 4 to 5 times the allowable standard. Accordingly, the transmitter 330 opens the window of the vehicle to ventilate the vehicle through the ECU, but if the driver is startled while drowsy, the steering wheel may be bent due to reflex movement, so it is linearly controlled can make it In addition, in order to be converted to the awakening state, the same rhythm or melody must not be continued and the change must be non-linear or there must be an impulse. Accordingly, the transmitter 330 may randomly change the channel of the vehicle's radio through the ECU, but change the frequency and intensity to irregular intervals so that the user can recognize and wake up irregularities.

As one of the characteristics of sound, 1/f wave (Fluctuation) can relieve stress because the rhythm of the notes is regular and balanced. If used in reverse, it can be interpreted that stress can be used to wake up the drowsy state. 1/f wave is a generic term for waves whose power spectrum is inversely proportional to frequency f. Although the power spectrum is a hyperbola, when expressed in logarithmic terms, it is called a 1/f wave. However, different characteristics can be expressed by adjusting the slope value (α slope). Therefore, in the case of playing music with an f wave instead of 1/f, it is not the physiological response of the low respiratory rate, heart rate, and skin conduction level entering the sleep phase, but the physiological response of the high respiratory rate, heart rate, and skin conduction level entering the awakening phase. It can induce a response, which can be adjusted to be proportional to the high frequency.

At this time, there are cases in which drowsiness is not awakened or effective even with ventilation and sound. Here, a low-frequency stimulator or a vibration element may be further included in the seat or seat belt, which may be configured to be controlled by the ECU. You can use a vibrating element like a smart watch, but in the case of a smart watch, it is worn on the wrist and the hand connected to the wrist is basically holding the handle, so if you wake up from drowsiness due to stimulation on your wrist, you can unknowingly take your hand off the handle. It can lead to accidents. Accordingly, when a vibration element is used, the transmitter 330 uses the stimulation time and stimulation time difference as independent variables for configuring the difference in vibration patterns in consideration of the characteristics of the rotary vibrator that rotates in only one direction when a voltage is applied. It is possible to transmit a control command in consideration of Here, different signal patterns may be provided by combining the on-off time and the interval of the voltage applied to the vibrating element, and the frequency range may be set differently based on the level difference between the stimulation time and the stimulation time difference. Similarly, in the case of using a low-frequency stimulator, the pattern and frequency of the low-frequency stimulation are designed to be different from each other so as not to maintain the paralyzed state, which is a drowsy state. The reason is that, as described above, when the same stimulus is continued in the human body due to the threshold, it is no longer felt as a stimulus.

The message unit 340 may transmit the drowsy driving message to the acquaintance terminal 400 that is not connected to the call due to the outgoing call. At this time, when a call is sent from the acquaintance terminal 400 to the user terminal 100, which has received the message from the message unit 340, the message unit 340 sets the speaker of the vehicle to the maximum or the maximum value through the user terminal 100. You can set it below to allow the user to answer calls. And, even if the setting of the user terminal 100 is silent or vibration, the message unit 340 may ignore all the settings and force all output values to the maximum when a call comes from the acquaintance terminal 400 . In this case, even if it is not the acquaintance terminal 400 , it is of course possible to forcefully set the maximum for all calls received after sending a call or sending a message.

The accident processing unit 350 extracts the location and user information of the user terminal 100 when the value of the acceleration sensor received from the user terminal 100 exceeds a preset threshold value, and at least one public institution that has jurisdiction over the location. can be sent to the server. In this case, each threshold value may be as shown in Table 1 below, but is not limited thereto.

위험운전 유형Dangerous driving type		판단변수decision variable	임계값threshold	가중치weight
속도위반speed violation	직진구간과속speeding in a straight section	차속(GPS)Vehicle speed (GPS)	법규에 준함according to law	25%25%
	선회구간과속turning speed	횡가속도lateral acceleration	0.2G0.2G	10%10%
	선회구간과속turning speed	Yaw RateYaw Rate	8.6deg/sec8.6deg/sec	10%10%
가속Acceleration	급출발sudden departure	종가속도longitudinal acceleration	0.2G0.2G	20%20%
가속Acceleration	급가속rapid acceleration	종가속도longitudinal acceleration	0.2G0.2G	20%20%
감속deceleration	급정지sudden stop	종가속도longitudinal acceleration	-0.4G-0.4G	20%20%
감속deceleration	급감속rapid deceleration	종가속도longitudinal acceleration	-0.4G-0.4G	20%20%
회전rotation	급차선 변경change of lane	주기 및 주파수Period and frequency	4.0초4.0 seconds	15%15%
		횡가속도lateral acceleration	0.2G0.2G
		Yaw RateYaw Rate	5.0deg/sec5.0deg/sec
	연속적인 급차선 변경Consecutive lane change	주기 및 주파수Period and frequency	8.0초8.0 seconds	10%10%
		횡가속도lateral acceleration	0.2G0.2G
		Yaw RateYaw Rate	7.0deg/sec7.0deg/sec

When the values shown in Table 1 are received, the accident processing unit 350 may receive and analyze the monitoring for accident prediction in real time without delay. In other words, simply because overspeed does not cause an accident, when the value shown in Table 1 is received, the monitoring period is shortened, and the accident is handled in case of a collision by further considering the acceleration value caused by the collision. You can ask for help for Here, the 3-axis acceleration sensor is a sensor that measures the speed or impact applied when an object with mass moves along the XYZ axis. When the position of the acceleration sensor with respect to the three axes is changed or rotation occurs, the measured values of the three-axis acceleration are also changed differently. Accordingly, the accident processing unit 350 integrates the three-axis acceleration values so that the three-axis acceleration values can be measured and determined as a single value in order to output a measured value that is not affected by any change in the three-axis acceleration values. average. Here, when at least one application on the screen of the user terminal 100 is being driven in the foreground mode, the user terminal 100, on the application driven in the foreground mode, By overlaying a screen that detects a drowsy driving event by taking a picture of the user, it can be controlled to be driven at the same time. Of course, the area of the overlaid screen may be flexibly increased or decreased or moved so as not to block the screen displayed on the back side thereof. For example, if the screen that detects a drowsiness event is overlaid on the upper right corner of the screen where the navigation is running, you may have to turn right or go straight on the highway because the road is not visible when you leave the highway. have. Therefore, the user terminal 100 detects an event on the screen that is being output in the foreground mode, and prevents overlaying when the event is output, or avoids the area where the event is output, so that the size can be reduced or moved. have.

Hereinafter, an operation process according to the configuration of the safe driving service providing server of FIG. 2 will be described in detail with reference to FIG. 3 as an example. However, it will be apparent that the embodiment is only one of various embodiments of the present invention and is not limited thereto.

Referring to FIG. 3 , (a) the user terminal 100 stores the phone numbers of at least one acquaintance in order, and (b) the vehicle speed is detected based on GPS when driving in the vehicle. In this case, it may be automatically driven and overlaid in the user terminal 100 . In this case, if part A is, for example, navigation, the service of the present invention may be set in a format in which the screen on which the user is photographed is displayed in a preset area, for example, part B, in which the screen is divided or overlaid. In this case, the size of the screen division or the overlaid area B may be increased or decreased according to the user's convenience, or may be moved by touch and drag. Also, the screen may be inverted, that is, the area A is exchanged with the area B and the area B is exchanged with the area A. For example, if the user is drowsy, an alarm is sounded and a warning sound is issued to the user. If the screen is displayed as small as the B area, it may be dangerous because you have to aim the B area and touch it while driving. Also, even when the warning sound is released, it may be set so that it can be released by touching anywhere on the screen. Otherwise, there is a risk that could lead to an accident because you have to look ahead while aiming at the button.

And, (c) the user terminal 100, when drowsiness is detected by video or sound, sequentially makes calls to the phone numbers of previously registered acquaintances, and transmits a message indicating that the user is driving drowsy if the phone is not connected. can In addition, (d) when an accident shock is detected, the user terminal 100 may transmit the location information and the user information to the at least one public institution server 500 through the safe driving service providing server 300 .

The matters not described with respect to the method of providing the safe driving service of FIGS. 2 and 3 are the same as those described with respect to the method of providing the safe driving service through FIG. 1 or can be easily inferred from the described content. to be omitted.

4 is a diagram illustrating a process of transmitting and receiving data between each component included in the safe driving service providing system of FIG. 1 according to an embodiment of the present invention. Hereinafter, an example of a process in which data is transmitted and received between the respective components will be described with reference to FIG. 4 , but the present application is not limited to such an embodiment, and the example shown in FIG. 4 according to the various embodiments described above will be described. It is apparent to those skilled in the art that the data transmission/reception process may be changed.

4, the safe driving service providing server 300 receives the phone number of at least one acquaintance from the user terminal 100 (S4100), and monitors the coordinate movement of the GPS based on the moving distance per hour. The speed is calculated, and if the calculated speed is within the speed range of the vehicle, the safe driving service application is automatically driven in the user terminal 100 (S4200).

At this time, the safe driving service providing server 300 receives at least one detection data, GPS, and image from the user terminal 100 (S4300), and after analyzing whether or not driving drowsy (S4400), it is determined as drowsy driving If it is (S4500), the user terminal 100 sends an alarm and the acquaintance terminal 400 makes a call (S4600). At this time, the safe driving service providing server 300 transmits a voice guidance message to the acquaintance terminal 400 when a response (Ack) is received from the acquaintance terminal 400, and the type of response is a call connection (S4650), and the user terminal (100) is set to make a call, and if the call connection fails (S4630), a drowsy driving alarm message is transmitted to the acquaintance terminal 400 (S4670). And, the safe driving service providing server 300 continuously analyzes the information collected from the user terminal 100 (S4700), when an accident occurs (S4800), GPS and user information, for example, blood type, chronic disease By transmitting information such as , allergy, family history, and impact data measured by an acceleration sensor to the public institution server 500 , emergency rescuers can safely perform first aid. Then, the safe driving service providing server 300 transmits an accident notification to at least one acquaintance terminal 400 (S4920).

The order between the above-described steps (S4100 to S4920) is only an example, and is not limited thereto. That is, the order between the above-described steps S4100 to S4920 may be mutually changed, and some of these steps may be simultaneously executed or deleted.

The matters not described with respect to the method for providing the safe driving service of FIG. 4 are the same as those described for the method of providing the safe driving service with reference to FIGS. 1 to 3 or because it can be easily inferred from the described contents, the following description will be given below. to be omitted.

5 is an operation flowchart illustrating a method for providing a safe driving service according to an embodiment of the present invention. Referring to FIG. 5 , the safe driving service providing server receives at least one acquaintance terminal from the user terminal ( S5100 ).

In addition, the safe driving service providing server monitors the video streamed in real time from the user terminal (S5200), and when the user's drowsy driving event is detected by analyzing the video, a call is made to the user terminal by at least one registered acquaintance terminal. (Call) Make a call (S5300).

Matters not described with respect to the safe driving service providing method of FIG. 5 are the same as those described for the safe driving service providing method through FIGS. 1 to 4 or can be easily inferred from the described contents. to be omitted.

The safe driving service providing method according to the embodiment described with reference to FIG. 5 may also be implemented in the form of a recording medium including instructions executable by a computer, such as an application or program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer-readable media may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The safe driving service providing method according to an embodiment of the present invention described above may be executed by an application basically installed in a terminal (which may include a program included in a platform or an operating system, etc. basically installed in the terminal), It may be executed by an application (ie, a program) directly installed in the master terminal by a user through an application providing server such as an application store server, an application, or a web server related to the corresponding service. In this sense, the safe driving service providing method according to an embodiment of the present invention described above is implemented as an application (ie, a program) installed by default in a terminal or directly installed by a user, and a computer readable record such as a terminal may be recorded on the medium.

The above description of the present invention is for illustration, and those of ordinary skill in the art to which the present invention pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a dispersed form, and likewise components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

According to the present invention, based on the concept that the arousal effect is induced by interaction with the passenger, when it is determined that the driving is drowsy through the camera, a call is transmitted to a preset acquaintance terminal, and when the call is made, an instant lettering is used. By controlling so that the message about drowsy driving can be checked on the reception screen, the call is answered. If the call is not answered, the call is made to the next-priority acquaintance terminal, and the call is attempted until the call is connected, and the call is disconnected. When the transmission is finished, a message is sent so that a call can come from the terminal of the acquaintance, which is the terminal of the recipient, and the warning light is controlled while drowsy driving is detected to prevent damage to nearby vehicles, and when an accident is detected, the jurisdiction where the accident occurred By providing location and user information to the server of public institutions, the ambulance can arrive in a short time.

Claims

a user terminal for registering at least one acquaintance terminal and transmitting a drowsy driving message to the at least one acquaintance terminal when a drowsy driving event is detected; and

A registration unit for registering at least one acquaintance terminal from the user terminal, a monitoring unit monitoring an image streamed in real time from the user terminal, and analyzing the image to detect a drowsy driving event of the user, the registered at least one Safe driving service providing server including an acquaintance terminal for sending a call to the user terminal;

Safe driving service providing system, including.
The method of claim 1,

The safe driving service providing system, characterized in that when the call is made to the at least one acquaintance terminal, the sending unit transmits a drowsy driving message through call lettering to be displayed on the reception screen.
The method of claim 1,

The safe driving service providing server,

a message unit for transmitting a drowsy driving message to a terminal of an acquaintance who is not connected to the call due to the outgoing call;

Safe driving service providing system, characterized in that it further comprises.
The method of claim 1,

The safe driving service providing server,

an accident processing unit that extracts the location and user information of the user terminal and transmits the extracted location and user information to at least one public institution server having jurisdiction over the location when the value of the acceleration sensor received from the user terminal exceeds a preset threshold;

Safe driving service providing system, characterized in that it further comprises.
The method of claim 1,

When at least one application is running on the screen of the user terminal in the foreground mode, the user terminal detects a drowsy driving event by photographing the user on the application driven in the foreground mode. A system for providing safe driving service, characterized in that the screen is overlaid and controlled to be driven at the same time.
The method of claim 1,

The user terminal, when the drowsy driving event is detected, a safe driving service providing system, characterized in that outputting a warning sound.
The method of claim 1,

The user terminal is

A system for providing a safe driving service, characterized in that it is interlocked with at least one IoT node installed in a vehicle, and when the drowsy driving event is detected, a control signal previously mapped and stored in the at least one IoT node is transmitted.