KR20200046612A - System for generating a warning and operating method thereof - Google Patents

Abstract

The present invention relates to a warning generation system capable of generating a warning when sensing a careless driving state with a brainwave of a driver measured through a brainwave measurement ear set. According to an embodiment of the present invention, the warning generation system includes: a brainwave measurement ear set; and a warning output part installed in a vehicle and outputting a warning signal in response to a warning generation signal. The brainwave measurement ear set includes: an electrode part measuring a brainwave signal of a driver; a body part processing the brainwave signal of the driver measured by the electrode part; and a control part generating a warning signal by determining a careless driving state of the driver based on a result of comparing a preset reference brainwave signal with the brainwave signal of the driver received from the body part, and then, transmitting the generated warning signal to the warning output part.

Description

System for generating an alarm and its operation method {SYSTEM FOR GENERATING A WARNING AND OPERATING METHOD THEREOF}

The present invention relates to an alarm generating system and an operation method for generating an alarm when a driver's negligent state is detected by an EEG of a driver measured using an EEG measurement earset.

The biosignal is expressed through the body through a recognition process by receiving information through a sensory organ, and the expression of stress, emotion, etc. can be measured as a change in the biosignal. In recent years, human-friendly interface technology has been developed to apply a technology for analyzing bio signals in order to improve the quality of life and provide a more convenient interface to a user. In the case of an EEG, which is one of the representative biosignals, a neurofeedback training technology has been developed that is applied to the user's attention or cognitive function by measuring a specific EEG on the user's head.

The above-mentioned background art is technical information acquired by the inventor for the derivation of the present invention or acquired in the derivation process of the present invention, and is not necessarily a known technology disclosed to the general public prior to the filing of the present invention.

Domestic registered patent publication No. 10-1653910

The present invention has been devised to solve the above-described problems and / or limitations, and an object of the present invention according to an aspect is to generate an alarm when a driver's brainwaves are detected by an EEG of a driver measured using an earbud for measuring EEG. It is to ventilate the driver's attention.

An alarm generating system according to an embodiment of the present invention includes an ear set for measuring brain waves; And an alarm output unit provided in the vehicle and outputting an alarm signal in response to the alarm generation signal, wherein the earphone for measuring EEG comprises: an electrode unit for measuring the EEG signal of the driver; A body unit for processing the EEG signal of the driver measured by the electrode unit; And a control unit that determines the driver's negligent state as a result of comparing the driver's EEG signal received from the main body portion with a preset reference EEG signal, generates the alarm signal, and transmits the alarm signal to the alarm output unit. ; May include.

The electrode unit, a first electrode for measuring the EEG signal in contact with the driver around the temporal lobe temple; A second electrode providing a reference potential when measuring the EEG signal at the first electrode; And a third electrode serving as a ground when measuring the EEG signal at the first electrode.

The EEG measurement earset further includes an elastic support; the support extends in one direction from the main body and is located outside the driver's head, and the length and position can be adjusted according to the size of the driver's head. You can.

The main body portion, a filter portion for removing noise for the EEG signal of the driver obtained by the electrode portion; An analog-to-digital converter converting the noise-removed EEG signal into a digital EEG signal; And a communication unit that transmits and receives information to and from the vehicle and wirelessly transmits the alarm generation signal to the vehicle.

The EEG measurement ear set includes: a power switch; USB charging terminal for charging the built-in battery by using the power inside the car; And an LED indicating a state of charge of the battery and a communication state with the vehicle.

The EEG measurement earset may further include an alarm output unit configured to output a tactile alarm signal in response to the alarm generation signal.

The alarm output unit may output one or more of an audible alarm signal, a visual alarm signal, and a tactile alarm signal according to the alarm generation signal.

An operation method of an alarm generating system according to an exemplary embodiment of the present invention includes the steps of: a control unit receiving a wearing of a headset for measuring brain waves of a driver; Receiving, by the controller, an EEG signal of the driver as a result of signal processing of the EEG signal of the driver measured through the electrode unit in the main body; The control unit, as a result of comparing the EEG signal of the driver and a predetermined reference EEG signal, determining the driver's careless state and generating an alert signal to transmit to the vehicle; And outputting an alarm signal in response to the alarm generation signal, by an alarm output unit of the vehicle.

The method may further include the step of outputting at least one of an audible alert signal and a tactile alert signal by the EEG measurement earset in response to the alert generation signal.

The method may further include a step of outputting at least one of an audible alert signal, a visual alert signal, and a tactile alert signal according to the alert generating signal.

In addition to this, other methods for implementing the present invention, other systems, and computer programs for executing the methods may be further provided.

Other aspects, features, and advantages than those described above will become apparent from the following drawings, claims, and detailed description of the invention.

According to embodiments, an accident may be prevented in advance by generating an alarm to alert the driver's attention when an inadvertent driving condition is detected by the driver's brain waves measured using an EEG measurement earset.

The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a view schematically illustrating an alarm generating system according to an embodiment of the present invention.
FIG. 2 is a view for schematically explaining the detailed configuration of the ear set for measuring EEG among the alarm generating systems of FIG. 1.
FIG. 3 is a view illustrating a state in which the ear set for measuring EEG of FIG. 2 is worn.
4 is a flowchart illustrating an operation method of an alarm generating system according to an embodiment of the present invention.

Advantages and features of the present invention, and methods for achieving them will be clarified with reference to embodiments described in detail with reference to the accompanying drawings. However, the present invention is not limited to the embodiments presented below, but may be implemented in various different forms, and should be understood to include all transformations, equivalents, and substitutes included in the spirit and scope of the present invention. . The embodiments presented below are provided to make the disclosure of the present invention complete, and to fully inform the scope of the invention to those skilled in the art to which the present invention pertains. In the description of the present invention, when it is determined that a detailed description of known technologies related to the present invention may obscure the subject matter of the present invention, the detailed description will be omitted.

Terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "include" or "have" are intended to indicate the presence of features, numbers, steps, actions, components, parts or combinations thereof described herein, one or more other features. It should be understood that the existence or addition possibilities of fields or numbers, steps, operations, components, parts or combinations thereof are not excluded in advance. Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from other components.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings, and in describing with reference to the accompanying drawings, the same or corresponding components are assigned the same reference numbers, and redundant description thereof is omitted. I will do it.

1 is a view schematically illustrating an alarm generating system according to an embodiment of the present invention. Referring to FIG. 1, the alarm generation system 1 may include an ear set 100 for measuring brain waves and a vehicle 200.

The EEG measurement ear set 100 is a wireless ear set, and is mounted around the driver's ear to measure the EEG signal around the driver's left or right temporal lobe during driving. The EEG, also referred to as an EEG, may refer to a signal obtained by measuring ion flow due to action potentials generated in nerve cells of the brain in the form of a potential signal. Such EEG can be classified into, for example, an induced EEG generated by external stimulation (evoked potential, EP or event related potential, ERP), and a spontaneous EEG spontaneously generated without external stimulation. EEG is generally measured through electrodes attached to the scalp, but users who attach electrodes to the scalp may feel discomfort or discomfort. In particular, when looking at the aspect that the EEG is used in various ways in daily life as described above, the earset for measuring EEG 100 is more convenient than the method of attaching an electrode to the scalp to measure the EEG, and allows the user to feel troublesome. It minimizes the electrode so that it can not be felt, and the EEG can be accurately measured by attaching an electrode to the scalp or more, and by using a dry type sensor, it ensures signal reliability and minimizes physical and emotional restraint. EEG signals can be continuously measured without restricting behavior.

In this embodiment, the ear set 100 for measuring EEG may include an electrode unit 110, a body unit 120, and a control unit 130. In the present embodiment, the main body 120 may include a filter unit 121, an ADC conversion unit 122, and a wireless communication unit 123.

The electrode unit 110 includes a first electrode (111 of FIG. 2) to a third electrode (113 of FIG. 2), and may measure an EEG signal while driving and / or stopping a driver in a vehicle. The first electrode 111 is a conductive EEG electrode, and may measure the EEG signal of the left or right temporal lobe by contacting the driver's left or right temporal lobe temples (TTP7, TTP8). The second electrode 112 is a reference electrode and may provide a reference potential when measuring the EEG signal at the first electrode 111. In this embodiment, the first electrode 111 and the second electrode 112 may be provided with a plurality of protrusions. The third electrode 113 is a ground electrode, located on the rear wheel of the ear, and may serve as a ground when measuring the EEG signal at the first electrode 111. The second electrode 112 and the third electrode 113 may be disposed at a position where the first electrode 111 can be in contact with an ear ball, an ear wheel, or the like when the temple is in contact with the temple.

The body portion 120 may be formed of a plastic material and may be in a form surrounding the rear wheel of the ear so that it can be mounted on the driver's ear. The filter unit 121 included in the body unit 120 may remove noise of the EEG signal of the driver measured by the electrode unit 110. The ADC converter 122 may convert the EEG signal of the driver from which noise has been removed into a digital signal. The wireless communication unit 123 is a medium for transmitting and receiving information between the EEG 100 for measuring the EEG and the vehicle 200, and compares the EEG signal of the driver with the preset EEG signal from the EEG 100 for EEG measurement to be described later. According to the result, an alarm generation signal that determines the driver's careless condition may be transmitted to the vehicle 200 through wireless communication. In this embodiment, the wireless communication unit 140 is one of Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra-wideband (UWB), ZigBee, and wireless fidelity (Wi-Fi) technologies. The vehicle 200 may transmit and receive data through one or more communication.

In this embodiment, the control unit 130 may include a signal processing unit 131, a memory 132, a comparison unit 133, and a determination unit 134.

The signal processing unit 131 may calculate characteristics of one or more EEG signals among the EEG signals of the driver received from the main unit 120. The characteristics of the EEG calculated by the signal processing unit 131 are, for example, the magnitude of the EEG signal in the time domain, the magnitude of the EEG signal in the frequency domain and the signal-to-noise ratio (SNR), and the peak magnitude such as the P300 signal. It may be at least one of. Here, the P300 signal refers to an EEG associated with the trigger potential decision process, and the P300 signal has a characteristic that a peak occurs in the parietal lobe after about 300 milliseconds when an event occurs. Meanwhile, since each of the components included in the signal processing unit 131 itself is a known component, a description thereof will be omitted.

The memory 132 may store a reference EEG signal that can determine the driver's carelessness according to the characteristics of the EEG. Here, the driver's careless state may include a state in which he / she cannot concentrate on driving, including an abnormal state such as drowsiness, deterioration of concentration, and surprise. Also, the memory 132 may store the EEG signal of the driver received from the main body 120 for a predetermined period. The memory 132 may include internal memory and / or external memory, volatile memory such as DRAM, SRAM, or SDRAM, one time programmable ROM (OTPROM), PROM, EPROM, EEPROM, mask ROM, flash ROM, Non-volatile memory, SSD, such as NAND flash memory, or NOR flash memory. It may include a compact flash (CF) card, an SD card, a Micro-SD card, a Mini-SD card, an Xd card, a flash drive such as a memory stick, or a storage device such as an HDD.

The comparator 133 may generate an alarm generation signal by determining the driver's negligent state as a result of comparing the EEG signal of the driver received from the main body 120 with a preset reference EEG signal.

The determination unit 134 determines whether the driver wears the EEG measuring earbuds 100 before driving, and when the driver does not wear the EEG measuring earbuds 100, prompts the driver to wear the EEG measuring earbuds 100 A wear recommendation signal can be generated. The wearing recommendation signal may be periodically generated until the driver wears the EEG 100 for measuring EEG.

In addition, the determination unit 134, when the driver completes the driving, for example, if the transmission is located in the parking, if the driver does not remove the EEG measurement ear set 100, the driver to remove the EEG measurement ear set 100 A removal recommendation signal can be generated. The removal recommendation signal may be periodically generated until the driver removes the EEG 100 for measuring EEG.

The wearing recommendation signal and the removal recommendation signal generated by the determination unit 134 may be output to the alarm output unit 210 of the vehicle 200 and output as an alarm that can be recognized by the driver.

The vehicle 200 may include an alarm output unit 210 and an input / output unit 220, and the driver's carelessness may be caused by comparing the driver's EEG signal from the EEG measurement earset 100 with a preset reference EEG signal. It is possible to output an alarm by receiving an alarm generation signal that determines the status.

The alarm output unit 210 may output an alarm signal that arouses the driver's careless condition in response to an alarm generation signal from the EEG measurement earset 100. The alarm output unit 210 may output an alarm signal as an acoustic signal so that the driver can hear it, or output an alarm signal as a display signal for the driver to see, or apply vibration to the steering wheel (not shown) to drive the driver Can be printed so that you can feel it with a touch.

As an optional embodiment, although not shown, when the alarm generating signal is generated by providing an alarm output unit (not shown) including a vibration element that generates vibration in the EEG measuring earset 100, the EEG measuring earset 100 vibrates It is also possible to generate vibration in the device to awaken the driver's carelessness.

The input / output unit 220 includes a button (or key) for setting or canceling the driver's inadvertent state determination mode through the EEG measurement ear set 100, a display unit for outputting whether the current EEG measurement ear set 100 is worn or not. can do.

FIG. 2 is a view for schematically explaining the detailed configuration of the earbuds for the EEG measurement of the alarm generation system of FIG. 1, and FIG. 3 is a view showing the wearing state of the earbuds for the EEG measurement of FIG. 2. 2 and 3, FIG. 2A may show a front view of the EEG measurement ear set 100, and FIG. 2B may show a back view of the EEG measurement ear set 100.

Referring to FIGS. 2 and 3, the first electrode 111 may have one end formed in a protruding shape in a circular shape and coated with a conductive metal. The other end of the first electrode 111 may be connected to the main body 120 through the elastic first support 131.

The second electrode 112 may have one end formed in a protruding shape in a circle and coated with a conductive metal.

The body part 120 in contact with the rear wheel of the ear should be contacted without discomfort, and may be made of a conductive rubber material for use as the third electrode 113.

In this embodiment, the EEG 100 for measuring EEG may further include an elastic second support 132, the second support 132 extending in one direction from the main body 120 and outside the driver's head. It is configured in the form of a positioning band, and may be adjustable in length and position according to the size of the driver's head.

A lithium polymer type battery (not shown) is built in the EEG measurement earset 100, so it can be charged by receiving power from a vehicle or an external power source through the USB charging terminal 140.

The charging state of the battery is displayed through the LED / switch 150, and the power of the earbuds 100 for measuring EEG can be turned on / off through the LED / switch 150. Here, the LED and the switch may be provided integrally or separately. In addition, the LED / switch 150 may display a communication state with the vehicle 200 (or an external computer), or may indicate a wearing state and / or a detaching state of the EEG 100 for measuring the EEG.

4 is a flowchart illustrating an operation method of an alarm generating system according to an embodiment of the present invention. In the following description, parts overlapping with the description of FIGS. 1 to 3 will be omitted.

Referring to FIG. 4, in step S410, the controller 130 receives the ear set 100 for measuring the EEG of the driver. Here, the control unit 130 outputs an alarm signal corresponding to the recommendation signal to be worn until the driver wears the ear set 100 for brain wave measurement before the driver starts driving through periodic communication with the vehicle 200, so that the driver It is possible to induce wearing of the ear set 100 for measuring EEG. Further, when the driver completes driving, the controller 130 may output an alarm signal corresponding to the recommendation signal for removal until the earbuds 100 for the EEG measurement are removed, thereby inducing the driver's EEG measurement earphone 100 to be removed. have.

In step S420, the controller 130 receives the EEG signal of the driver from the ear set 100 for measuring EEG.

In step S430, the controller 130 determines the driver's careless state as a result of comparing the driver's EEG signal with a preset reference EEG signal, generates an alert signal, and transmits it to the vehicle.

In step S440, the alarm output unit 210 of the vehicle 200 outputs an alarm signal in response to the alarm generation signal to arouse the driver's careless condition. The alarm output unit 220 may output an alarm signal as an acoustic signal so that the driver can hear it, or output an alarm signal as a display signal for the driver to see, or apply vibration to the steering wheel (not shown) to drive the driver Can be printed so that you can feel it with a touch.

As an optional embodiment, although not shown, when the ear set for brain wave measurement 100 generates an alarm signal by providing a vibration element for generating vibration in the ear set for brain wave measurement 100, vibration is generated in the vibration element to cause the driver to be inattentive. You can also ventilate.

The embodiment according to the present invention described above may be implemented in the form of a computer program that can be executed through various components on a computer, and such a computer program can be recorded on a computer-readable medium. At this time, the medium is a hard disk, a magnetic medium such as a floppy disk and a magnetic tape, an optical recording medium such as a CD-ROM and DVD, a magneto-optical medium such as a floptical disk, and a ROM , Hardware devices specially configured to store and execute program instructions, such as RAM, flash memory, and the like.

Meanwhile, the computer program may be specially designed and configured for the present invention or may be known and available to those skilled in the computer software field. Examples of computer programs may include machine language codes such as those produced by a compiler, as well as high-level language codes that can be executed by a computer using an interpreter or the like.

In the specification (particularly in the claims) of the present invention, the use of the term " above " and similar indication terms may be in both singular and plural. In addition, in the case of describing a range in the present invention, as including the invention to which the individual values belonging to the range are applied (if there is no contrary description), each individual value constituting the range is described in the detailed description of the invention. Same as

Unless explicitly stated or contrary to the steps constituting the method according to the invention, the steps can be done in a suitable order. The present invention is not necessarily limited to the order of description of the above steps. The use of all examples or exemplary terms (eg, etc.) in the present invention is merely for describing the present invention in detail, and the scope of the present invention is limited due to the examples or exemplary terms, unless it is defined by the claims. It does not work. In addition, those skilled in the art can recognize that various modifications, combinations, and changes can be configured according to design conditions and factors within the scope of the appended claims or equivalents thereof.

Accordingly, the spirit of the present invention is not limited to the above-described embodiments, and should not be determined, and the scope of the spirit of the present invention as well as the claims to be described later, as well as all ranges that are equivalent to or equivalently changed from the claims Would belong to

1: Alarm system
100: EEG measurement ear set
200: vehicle

Claims (10)

Earset for EEG measurement; And
Included in the vehicle; and an alarm output unit for outputting an alarm signal in response to the alarm generation signal.
The earpiece for measuring the EEG,
An electrode unit measuring the EEG signal of the driver;
A body unit for processing the EEG signal of the driver measured by the electrode unit; And
A controller for determining the state of carelessness of the driver as a result of comparing the EEG signal of the driver received from the main body part with a preset reference EEG signal, generating the alert signal, and transmitting the alert signal to the alert output unit; Alarm generation system comprising a. According to claim 1, The electrode portion,
A first electrode for measuring an EEG signal in contact with the driver's temporal lobe temple;
A second electrode providing a reference potential when measuring the EEG signal at the first electrode; And
And a third electrode serving as a ground when measuring the EEG signal at the first electrode. According to claim 1, The earbuds for measuring the EEG,
Elastic support; further comprising,
The support extends in one direction from the main body and is located outside the head of the driver, and is capable of adjusting length and position according to the size of the head of the driver, an alarm generating system. According to claim 1, wherein the body portion,
A filter unit that removes noise related to the EEG signal of the driver obtained by the electrode unit;
An analog-to-digital converter converting the noise-removed EEG signal into a digital EEG signal; And
And a communication unit that transmits and receives information to and from the vehicle and wirelessly transmits the alarm generation signal to the vehicle. According to claim 1, The earbuds for measuring the EEG,
Power switch;
USB charging terminal for charging the built-in battery by using the power inside the car; And
And an LED for displaying a state of charge of the battery and a communication state with the vehicle. According to claim 1, The earbuds for measuring the EEG,
And an alarm output unit configured to output a tactile alarm signal in response to the alarm generation signal. According to claim 1, The alarm output unit,
An alarm generating system that outputs one or more of an audible alarm signal, a visual alarm signal, and a tactile alarm signal according to the alarm generating signal. The controller, the step of receiving the driver's EEG for measuring the brain waves;
Receiving, by the controller, an EEG signal of the driver as a result of signal processing of the EEG signal of the driver measured through the electrode unit in the main body;
The control unit, as a result of comparing the EEG signal of the driver and a predetermined reference EEG signal, determining the driver's careless state and generating an alert signal to transmit to the vehicle; And
And outputting an alarm signal in response to the alarm generation signal, the alarm output unit of the vehicle. The method of claim 8,
And outputting at least one of an audible alert signal and a tactile alert signal from the EEG measurement earset in response to the alert generation signal. The method of claim 8,
And outputting at least one of an audible alarm signal, a visual alarm signal, and a tactile alarm signal according to the alarm generation signal, by the alarm output unit.

Images