TWI744932B - Smart helmet system and operating method thereof - Google Patents

Abstract

A smart helmet system and operating method thereof is disclosed. By providing a brain wave sensor and a camera in a smart helmet device, so as to continuously detect a plurality of brain wave signals and to capture an eye video, and transmitting the brain wave signals and the eye video to a server for analyzing and interpreting to generate an emotional status as well as identifying the eye video to generate a dozing status. When the emotional status is poor and the dozing status is not, the server transmits a first driving signal to the smart helmet device, so that a music player within the smart helmet device plays at least one healing music. When the dozing status is yes, the server transmits a second driving signal to the smart helmet device, so that the music player plays a warning voice. The mechanism is help to improve the concentration of driver.

Description

Smart helmet system and its operating method

The invention relates to a smart helmet system and its operating method, in particular to a smart helmet system and its operating method.

In recent years, with the popularity and vigorous development of the Internet of Things, various Internet of Things devices have sprung up. Among them, smart helmets are one of the common applications.

Generally speaking, traditional smart helmets have the function of connecting to the Internet, and can receive navigation instructions, positioning information, and so on. However, whether it is to provide navigation instructions or positioning information, a large number of information can easily cause driving distraction, which will greatly affect the concentration or concentration of the driver. For driving, although the convenience is improved, the safety is sacrificed. Therefore, the traditional The smart helmet has the problem that it is difficult to improve the concentration of driving.

In view of this, some manufacturers have proposed technical means to connect with smart phones, which play the smart phone’s caller ID and automatically answer incoming calls through the speakers installed in the smart helmet, and allow drivers to use radio components to make calls to avoid driving. Distracted operation of the smartphone affects driving safety. However, even if this method can avoid distracted driving and operating a smartphone, it cannot avoid the situation that the content of the call affects the driving mood, resulting in a decrease in concentration or concentration, for example, a fight during a call Or fatigue and sleepiness caused by long talk time, and these conditions will greatly reduce the concentration or concentration of driving, so it is still unable to effectively solve the problem of difficulty in improving the concentration of driving.

In summary, it can be seen that there has been a problem in the prior art that it is difficult to improve driving concentration for a long time. Therefore, it is really necessary to propose improved technical means to solve this problem.

The invention discloses a smart helmet system and an operation method thereof.

First, the present invention discloses a smart helmet system, which includes: a smart helmet device and a server. Wherein, the smart helmet device includes: a sensing module, a transmission module, and a driving module. The sensing module is used to trigger the brain wave sensor provided in the smart helmet device to continuously sense the brain wave signal, and enable the camera element provided in the smart helmet device to continue Capture eye images; the transmission module is used to transmit brain wave signals and eye images through the wireless transmission element provided in the smart helmet device, and to receive the first driving signal and the second driving signal; and the driving module is used to receive When the first driving signal is reached, the music player installed in the smart helmet device is driven to play healing music, and when the second driving signal is received, the music player is driven to play a warning voice. Then, on the server side, it is used to continuously analyze and interpret the received brainwave signals to generate emotional states, and to continuously recognize received eye images to generate sleepy states, when the emotional state is not good and the sleepy state is no When the time, the first driving signal is transmitted to the smart helmet device, and when the doze state is yes, the second driving signal is transmitted to the smart helmet device.

In addition, the present invention also discloses a smart helmet operation method, the steps of which include: providing a smart helmet device having a brain wave sensor, a camera element, a wireless transmission element, and a music player, wherein the music player includes healing music and Warning voice; when the smart helmet device detects that a person is wearing it When the brain wave sensor is triggered, the brain wave signal is continuously sensed, and the imaging element is enabled to continuously capture eye images, and the brain wave signal and eye image are sent to the server through the wireless transmission element; the server continues to analyze and interpret The received brain wave signal is used to generate the emotional state, and the received eye image is continuously recognized to generate the sleepy state. When the emotional state is not good and the sleepy state is no, the first driving signal is transmitted to the smart helmet device. When the doze state is yes, transmitting the second driving signal to the smart helmet device; and when the smart helmet device receives the first driving signal, driving the music player provided in the smart helmet device to play the healing music, When the smart helmet device receives the second driving signal, it drives the music player provided in the smart helmet device to play a warning voice.

The system and method disclosed in the present invention are as above. The difference from the prior art is that the present invention uses brain wave sensors and imaging elements in a smart helmet device to continuously sense brain wave signals and capture eye images. And send it to the server to analyze and interpret brainwave signals to generate emotional state, and recognize eye images to generate a sleepy state. When the emotional state is not good and the sleepy state is no, the server transmits the first driving signal to the smart helmet The device enables the music player installed in the smart helmet device to play healing music. When the doze state is yes, the server sends a second driving signal to the smart helmet device to make the music player play a warning voice.

Through the above-mentioned technical means, the present invention can achieve the technical effect of improving driving concentration.

110: Smart helmet device

111: Sensing module

112: Transmission module

113: drive module

120: server

300: Smart helmet device

310: Brainwave Sensor

320: image sensor

330: wireless transmission components

340: Music player

Step 210: Provide a smart helmet device having a brainwave sensor, a camera element, a wireless transmission element, and a music player, wherein the music player includes at least one healing music and a warning voice

Step 220: When the smart helmet device detects that a person is wearing it, trigger the brain wave sensor to continuously sense a brain wave signal, and enable the imaging element to continuously capture an eye image, and transmit it through the wireless The component sends the brain wave signal and the eye image to a server

Step 230: The server continuously analyzes and interprets the received brain wave signal to generate an emotional state, and continuously recognizes the received eye image to generate a doze state, when the When the emotional state is not good and the doze state is no, send a first driving signal to the smart helmet device, and when the doze state is yes, send a second driving signal to the smart helmet device

Step 231: After the healing music continues to be played for a fixed period of time, when the emotional state is still not good, the server transmits the second driving signal to make the music player play the warning voice

Step 240: When the smart helmet device receives the first driving signal, it drives the music player provided in the smart helmet device to play the healing music, and the smart helmet device receives the second driving signal. When driving the signal, drive the music player installed in the smart helmet device to play the warning voice

Step 241: The smart helmet device generates a speed limit signal when receiving the second driving signal, and transmits it to a speed limit device of a motor vehicle through the wireless transmission element, so as to enable the speed limit device to Speed limit for motor vehicles

Figure 1 is a system block diagram of the smart helmet system of the present invention.

Figures 2A to 2C are flowcharts of the method for operating the smart helmet of the present invention.

Figure 3 is a schematic diagram of the application of the present invention to sense brain wave signals and capture eye images.

The following describes the implementation of the present invention in detail with the drawings and embodiments, so as to fully understand and implement the implementation process of how the present invention uses technical means to solve technical problems and achieve technical effects.

Before describing the smart helmet system and its operation method disclosed in the present invention, firstly, the self-defined terms of the present invention will be explained. The emotional state of the present invention is based on the brain wave signal received from the smart helmet device by the server. The analysis and interpretation are generated, which can record the negative emotions analyzed and interpreted as "bad" or directly record the corresponding emotions, such as happiness, depression, and so on. In addition, the doze state is to determine whether the driver is in a doze state based on the recognition result of the driver’s eye images. In actual implementation, the recording method of the doze state is not limited to recording as "Yes" or "No". Any recording method that can distinguish whether dozing or not does not depart from the scope of application of the present invention.

The following is a detailed description of the smart helmet system of the present invention and its operation method in conjunction with the drawings. Please refer to "Figure 1" first. "Figure 1" is a system block diagram of the smart helmet system of the present invention. This system includes: Smart The helmet device 110 and the server 120. First, in the part of the smart helmet device 110, it includes a sensing module 111, a transmission module 112, and a driving module 113. Among them, the sensing module 111 is used to trigger the brain wave sensor provided in the smart helmet device to continuously sense the brain wave signal when it is detected that a person is wearing it, and to enable the camera element provided in the smart helmet device Keep shooting eye images. In actual implementation, the detection of whether there is a person wearing it can be judged by the pressure sensor installed at the top of the smart helmet device 110. When the pressure is sensed, it is judged as being worn by the person, otherwise it is judged as being worn by the person. Wear. In addition, when the person wears the smart helmet device 110, the brain wave sensor is attached to the Around the scalp, it is used to collect the physiological current generated by the brain area, so as to provide the servo terminal to judge the emotional state through the change of the physiological current, such as depression, excitement, concentration, etc. In addition, the smart helmet device 110 may further include a Repetitive Transcranial Magnetic Stimulation (rTMS) device, which is used to induce electromagnetic pulses in specific areas of the cerebral cortex when the emotional state is depression. Electric current to increase or decrease the excitability of nerve cells in a specific area.

The transmission module 112 is used for transmitting the brain wave signal and the eye image through the wireless transmission element provided in the smart helmet device 110, and receiving the first driving signal and the second driving signal. In actual implementation, the transmission module 112 can be implemented by using WiFi, ZigBee, CoAP (Constrained Application Protocol), MQTT (Message Queuing Telemetry Transport) or similar wireless transmission components to receive and transmit data wirelessly . In addition, when the smart helmet device 110 receives the second driving signal, it can generate a speed limit signal, and transmit it to the speed limit device of the motor vehicle through the wireless transmission element, so as to enable the speed limit device to control the motor vehicle. Carry out speed limit, for example: limit the minimum speed to zero or below the speed limit.

The driving module 113 is used to drive the music player provided in the smart helmet device 110 to play healing music when receiving the first driving signal, and to drive the music player to play warning when receiving the second driving signal voice. In actual implementation, the healing music refers to music that can make people feel comfortable, happy, relaxing, etc., and can have a soothing effect on emotions, while the warning voice is pre-recorded to warn driving needs. Speech that enhances concentration or attention.

Then, in the part of the server 120, it is used to continuously analyze and interpret the received brain wave signals to generate an emotional state, and to continuously recognize the received eye images to generate a sleepy state. When the emotional state is "bad" and When the doze state is "No", the first driving signal is transmitted to the smart helmet device 110, and when the emotional state is "bad" and the doze state is "Yes", the second driving signal is transmitted to Smart helmet device 110. In actual implementation, assuming that the emotions analyzed and interpreted are negative, such as depression, anger, tension, etc., the emotional state is set to "poor". On the contrary, if the emotion is positive, such as comfort, pleasure, relaxation Wait, the emotional state is set to "good". In addition, when recognizing the eye image, you can first binarize the eye image, and then determine whether the eyes are open, squinted, closed, etc. according to the size and shape of the eye area, and continue to squint or close the eyes. If you keep your eyes open, set the doze state to “No”. In addition, assuming that after the healing music continues to play for a fixed period of time (for example: a specified time in minutes or seconds), when the emotional state is still not good, the server 120 may send a second driving signal To make the music player play a warning voice.

In particular, it should be noted that in actual implementation, the modules of the present invention can be implemented in various ways, including software, hardware, or any combination thereof. For example, in some embodiments, each module can be implemented by Software and hardware or one of them is implemented. In addition, the present invention can also be implemented partially or completely based on hardware. For example, one or more modules in the system can be implemented through integrated circuit chips, system Single chip (System on Chip, SoC), complex programmable logic device (Complex Programmable Logic Device, CPLD), field programmable logic gate array (Field Programmable Gate Array, FPGA), etc. to achieve. The invention can be a system, a method and/or a computer program. The computer program may include a computer-readable storage medium loaded with computer-readable program instructions for enabling a processor to implement various aspects of the present invention. The computer-readable storage medium may be a tangible that can hold and store instructions used by an instruction execution device. equipment. The computer-readable storage medium can be, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of computer-readable storage media include hard disks, random access memory, read-only memory, flash memory, optical disks, floppy disks, and any suitable combination of the foregoing. Used here Computer-readable storage media used are not interpreted as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (for example, optical signals through fiber optic cables), or transmitted through wires electric signal. In addition, the computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to various computing/processing devices, or downloaded via a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. To an external computer device or external storage device. The network may include copper transmission cables, optical fiber transmission, wireless transmission, routers, firewalls, switches, hubs and/or gateways. The network card or network interface in each computing/processing device receives computer-readable program instructions from the network, and forwards the computer-readable program instructions for storage in the computer-readable storage media in each computing/processing device middle. The computer program instructions that perform the operations of the present invention can be combined language instructions, instruction set architecture instructions, machine instructions, machine-related instructions, micro instructions, firmware instructions, or source code or object code written in any combination of one or more programming languages (Object Code), the programming language includes object-oriented programming languages, such as: Common Lisp, Python, C++, Objective-C, Smalltalk, Delphi, Java, Swift, C#, Perl, Ruby, PHP, etc., as well as conventional programs Procedural programming language, such as C language or similar programming language. The computer program instructions may be executed entirely on the computer, partly executed on the computer, executed as an independent software, partly executed on the client computer and partly executed on the remote computer, or entirely executed on the remote computer or server Executed on.

Please refer to "Figure 2A" to "Figure 2C". "Figure 2A" to "Figure 2C" are a flowchart of the method for operating a smart helmet of the present invention. The steps include: providing a brain wave sensor, A smart helmet device with a camera element, a wireless transmission element, and a music player, where the music player includes healing music and warning voice (step 210); when the smart helmet device detects that a person is wearing it, it triggers brainwave sensing The device continuously senses the brain wave signal, and enables the image sensor to continuously capture eye images, and The brain wave signals and eye images are sent to the server through the wireless transmission element (step 220); the server continues to analyze and interpret the received brain wave signals to generate emotional states, and continuously recognize the received eye images to generate drowsiness State, when the emotional state is not good and the doze state is no, send the first driving signal to the smart helmet device, and when the doze state is yes, send the second driving signal to the smart helmet device (step 230); When the helmet device receives the first driving signal, it drives the music player installed in the smart helmet device to play the healing music, and when the smart helmet device receives the second driving signal, it drives the music player installed in the smart helmet The music player of the device can play a warning voice (step 240). Through the above steps, brainwave sensors and imaging elements can be installed in the smart helmet device 110 to continuously sense brainwave signals and capture eye images, and send them to the server 120 for analysis and interpretation of brainwave signals To generate the emotional state and recognize the eye image to generate the sleepy state, when the emotional state is not good and the sleepy state is no, the server 120 transmits the first driving signal to the smart helmet device 110, so that it is installed in the smart helmet device The music player in 110 plays healing music. When the doze state is yes, the server 120 transmits a second driving signal to the smart helmet device 110 to make the music player play a warning voice.

In addition, after step 230, after the healing music continues to play for a fixed period of time, and the emotional state is still not good, the server 120 transmits a second driving signal to make the music player play a warning voice (step 231); And after step 240, the smart helmet device 110 can generate a speed limit signal when receiving the second driving signal, and transmit it to the speed limit device of the motor vehicle through the wireless transmission element, so as to enable the speed limit device to control the motor vehicle Perform speed limit (step 241).

The following description will be given in the form of an embodiment in conjunction with "Figure 3". Please refer to "Figure 3". "Figure 3" is a schematic diagram of applying the present invention to sensing brain wave signals and capturing eye images. First, when the driver wears the smart helmet device 300 applying the present invention, the brain wave sensor 310 will be triggered to continuously sense The brain wave signal of the driving is measured, and the imaging element 320 is enabled to continuously capture the eye image, and the brain wave signal and the eye image are transmitted to the server 120 through the wireless transmission element 330. Then, the server 120 will continue to analyze and interpret the received brainwave signals to generate an emotional state, and continue to recognize the received eye images to generate a sleepy state. When the emotional state is not good and the sleepy state is no, it sends the first A driving signal is sent to the smart helmet device 300, and when the doze state is yes, a second driving signal is transmitted to the smart helmet device 300. Assuming that the smart helmet device 300 receives the first driving signal, it will drive the music player 340 installed in the smart helmet device 300 to play healing music, which in turn affects the driving emotions and makes the emotions develop in the direction of comfort, pleasure, and relaxation . Assuming that the smart helmet device 300 is receiving the second driving signal, the music player 340 provided in the smart helmet device 300 is driven to play a warning voice to remind the driver to improve concentration or concentration.

In summary, it can be seen that the difference between the present invention and the prior art is that the brainwave sensor and imaging element are provided in the smart helmet device to continuously sense the brainwave signal and capture the eye image, and send it to The server analyzes and interprets brainwave signals to generate emotional states, and recognizes eye images to generate sleepy states. When the emotional state is not good and the sleepy state is no, the server transmits the first driving signal to the smart helmet device, so that The music player installed in the smart helmet device plays healing music. When the doze state is yes, the server sends a second drive signal to the smart helmet device to make the music player play a warning voice. This technical means It can solve the problems of the previous technology, and then achieve the technical effect of improving the concentration of driving.

Although the present invention is disclosed in the foregoing embodiments as above, it is not intended to limit the present invention. Anyone familiar with similar art can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the present invention The scope of patent protection shall be subject to the definition of the scope of patent application attached to this specification.

110: Smart helmet device

111: Sensing module

112: Transmission module

113: drive module

120: server

Claims (10)

A smart helmet system, the system includes: a smart helmet device, which includes: a sensing module for triggering a brain wave sensor set on the smart helmet device when it is detected that a person is wearing it The device continuously senses a brain wave signal, and enables a camera element provided in the smart helmet device to continuously capture an eye image; a transmission module for passing through a wireless transmission element provided in the smart helmet device Transmitting the brain wave signal and the eye image, and receiving a first driving signal and a second driving signal; and a driving module for driving the smart helmet when receiving the first driving signal A music player of the device to play at least one healing music, and upon receiving the second driving signal, drive the music player to play a warning voice; and a server to continuously analyze and interpret the received The brain wave signal is used to generate an emotional state, and the received eye image is continuously recognized to generate a sleepy state, and when the emotional state is not good and the sleepy state is no, the first driving signal is transmitted to the wisdom When the doze state is yes, the second driving signal is transmitted to the smart helmet device. For example, the smart helmet system of claim 1, wherein after the healing music continues to be played for a fixed period of time, when the emotional state is still not good, the server transmits the second driving signal to cause the music player to play the warning voice. For example, the smart helmet system of claim 1, wherein the smart helmet device generates a speed limit signal when receiving the second driving signal, and transmits it to a speed limit device of a motor vehicle through the wireless transmission element to cause The speed limit device can limit the speed of the motor vehicle. For example, the smart helmet system of claim 1, wherein the smart helmet device further includes a repetitive transcranial magnetic stimulation (rTMS) device for applying electromagnetic pulses to the brain when the emotional state is melancholy A specific area of the cortex generates induced current to increase or decrease the excitability of nerve cells in that specific area. For example, the smart helmet system of claim 1, wherein the server first binarizes the eye image, and then judges open, squinted and closed eyes according to the eye area in it, and when it is judged to be open, the doze state Set to No, and set the doze state to Yes when it is judged that the eyes are continuously squinted or closed. A smart helmet operation method, the steps include: providing a smart helmet device having a brain wave sensor, a camera element, a wireless transmission element and a music player, wherein the music player includes at least one healing device Music and a warning voice; when the smart helmet device detects that a person is wearing it, it triggers the brainwave sensor to continuously sense a brainwave signal, and enables the camera element to continuously capture an eye image, and pass The wireless transmission element transmits the brain wave signal and the eye image to a server; The server continuously analyzes and interprets the received brain wave signal to generate an emotional state, and continuously recognizes the received eye image to generate a sleepy state, when the emotional state is not good and the sleepy state is no , Transmitting a first driving signal to the smart helmet device, and when the doze state is yes, transmitting a second driving signal to the smart helmet device; and when the smart helmet device receives the first driving signal , Driving the music player installed in the smart helmet device to play the healing music, and when the smart helmet device receives the second driving signal, driving the music player installed in the smart helmet device To play the warning voice. For example, the smart helmet operation method of claim 6, wherein the method further includes that after the healing music continues to be played for a fixed period of time, when the emotional state is still not good, the server transmits the second driving signal to make the music The steps for the player to play the warning voice. For example, the smart helmet operation method of claim 6, wherein the method further includes the smart helmet device generating a speed limit signal when receiving the second driving signal, and transmitting the speed limit signal to a motor vehicle through the wireless transmission element The speed device is used to enable the speed limit device to perform speed limit steps on the motor vehicle. For example, the smart helmet operation method of claim 6, wherein the smart helmet device further includes a repetitive transcranial magnetic stimulation (rTMS, Repetitive Transcranial Magnetic Stimulation) device for using electromagnetic pulses when the emotional state is melancholy A specific area of the cerebral cortex generates induced current to increase or decrease the excitability of nerve cells in that specific area. For example, the smart helmet operation method of claim 6, wherein the server first binarizes the eye image, then judges open, squinted and closed eyes according to the eye area, and when it is judged to be open, the doze The state is set to No, and when it is judged that the eyes are continuously squinted or closed, the doze state is set to Yes.

Images