WO2018010270A1 - Reminding method, smart glasses and on-board system - Google Patents

Abstract

A reminding method for smart glasses (60), comprising: acquiring, on the basis of a sensor preset in the smart glasses (60), a user's eye movement data (S101), determining a degree of fatigue corresponding to the acquired eye movement data (S102), and when the determined degree of fatigue reaches a preset reminding threshold, sending the determined degree of fatigue to an on-board system that is interconnected with the smart glasses (60), to trigger the on-board system to start a reminding mode corresponding to the determined degree of fatigue (S103). The reminding method is used for reducing the complexity of an existing driver drowsiness detection system. Smart glasses (60) and an on-board system.

Description

Reminder method, smart glasses and vehicle system

The present application claims priority to Chinese Patent Application No. 201610559410.9, entitled "Reminder Method, Smart Eyewear, and Vehicle-mounted System", which is incorporated herein by reference. in.

Technical field

The present invention relates to the field of terminal application technologies, and in particular, to a reminding method, smart glasses, and an in-vehicle system.

Background technique

At present, a considerable part of traffic accidents are caused by the driver's fatigue driving. The existing system detection steps for detecting fatigue driving are complicated and difficult to implement; at the same time, a large amount of hardware resources are required, and the implementation cost is high.

Summary of the invention

In order to overcome the above drawbacks of the prior art, the technical problem to be solved by the present invention is to provide a reminding method, smart glasses and an in-vehicle system for reducing the implementation complexity of the existing fatigue driving detection system.

In order to solve the above technical problem, a reminding method in the present invention is applied to smart glasses, including:

Acquiring eye movement data of the user based on the sensor preset in the smart glasses;

Determining a degree of fatigue of the user corresponding to the acquired eye movement data;

When the determined degree of fatigue reaches the preset reminder threshold, the determined degree of fatigue is transmitted to the onboard system interconnected with the smart glasses to trigger the onboard system to initiate a reminder mode corresponding to the determined degree of fatigue.

As an improvement of the reminding method of the present invention, the eye movement data includes blink frequency data and/or eye rotation frequency data;

The step of acquiring the eye movement data of the user based on the sensor preset in the smart glasses includes:

Collecting an eye potential difference based on an eye potential sensor preset in the smart glasses;

Determining the blinking motion and/or the eyeball turning motion based on the collected potential difference, and determining the number of blinking actions and/or the number of eyeball turning motions in the preset time period;

The corresponding blink frequency data and/or eye rotation frequency data is determined based on the determined number of blinking actions and/or the number of eyeball turning motions.

As a further improvement of the reminding method of the present invention, the step of determining the degree of fatigue of the user corresponding to the acquired eye motion data by using a preset fatigue degree calculation algorithm includes:

According to the relationship between fatigue and severity, the fatigue degree is divided into several fatigue states; the corresponding blink frequency data range and/or the eyeball rotation frequency data range are set for each fatigue state, and stored in the state map; Finding, in the state mapping table, a degree of fatigue corresponding to the acquired eye motion data; or

The fatigue degree corresponding to the acquired eye motion data is determined by using a preset fatigue degree calculation algorithm.

As another improvement of the reminding method of the present invention, before the step of acquiring the eye movement data of the user based on the sensor preset in the smart glasses, the method further includes:

Acquiring speed data from the in-vehicle system;

The step of acquiring the eye movement data of the user based on the sensor preset in the smart glasses includes:

Obtaining eye movement data of the user based on the sensor preset in the smart glasses when the acquired speed data reaches a preset speed threshold;

After the step of determining that the fatigue level reaches the preset reminder threshold, the method further includes:

Triggering a vibrator disposed on a frame of the smart glasses to generate vibration; or

Sending the determined degree of fatigue to the mobile terminal interconnected with the smart glasses to trigger the mobile terminal to initiate a reminder mode corresponding to the determined degree of fatigue.

In order to solve the above technical problem, a reminding method in the present invention is applied to an in-vehicle system, including:

Obtaining a degree of fatigue determined by the smart glasses from smart glasses interconnected with the in-vehicle system;

Start a reminder mode that corresponds to the degree of fatigue acquired.

As an improvement of the reminding method of the present invention, the step of initiating a reminder mode corresponding to the degree of fatigue acquired includes:

And a reminder mode corresponding to the acquired fatigue degree is started from the preset mode table; and the corresponding relationship between each reminder mode and the fatigue degree is recorded in the mode table;

The reminder mode includes at least one of the following: a voice broadcast mode, a music broadcast mode, a rest place planning mode, and/or an emergency braking mode;

The rest place planning mode includes:

Get the positioning data of the current location;

Finding a rest place around the current location within the preset distance segment based on the positioning data;

Planning the route of each of the rest places and current locations found;

Show the planned route according to the distance and distance;

The emergency braking mode includes:

Turn on the emergency light and perform an emergency brake.

In order to solve the above technical problem, a smart glasses in the present invention includes:

a sensor module configured to acquire an eye movement data of the user based on a sensor preset in the smart glasses;

a fatigue degree calculation module, configured to determine a degree of fatigue of the user corresponding to the acquired eye motion data;

a wireless communication module, configured to send the determined fatigue level to an in-vehicle system interconnected with the smart glasses to trigger the on-board system startup and the determined fatigue when the determined fatigue level reaches a preset reminder threshold The corresponding reminder mode.

As an improvement of the smart glasses of the present invention, the eye movement data includes blink frequency data and/or eye rotation frequency data;

The sensor module is specifically configured to collect an eye potential difference based on an eye potential sensor preset in the smart glasses;

Determining the blinking motion and/or the eyeball turning motion based on the collected potential difference, and determining the number of blinking actions and/or the number of eyeball turning motions in the preset time period;

The corresponding blink frequency data and/or eye rotation frequency data is determined based on the determined number of blinking actions and/or the number of eyeball turning motions.

As a further improvement of the smart glasses of the present invention, the fatigue degree calculation module is specifically configured to divide the fatigue degree into a plurality of fatigue states according to the relationship of the degree of fatigue from light to heavy; and set a corresponding blink for each fatigue state. a frequency data range and/or an eye rotation frequency data range, and stored in the state mapping table; searching for the degree of fatigue corresponding to the acquired eye motion data from the state mapping table; or

The fatigue degree corresponding to the acquired eye motion data is determined by using a preset fatigue degree calculation algorithm.

As another improvement of the smart glasses of the present invention, the smart glasses further include a speed acquisition module configured to acquire speed data from the in-vehicle system;

The sensor module is configured to acquire the eye movement data of the user based on the sensor preset in the smart glasses when the acquired speed data reaches a preset speed threshold;

The wireless communication module is further configured to trigger a vibrator disposed on a frame of the smart glasses to generate vibration; or send the determined degree of fatigue to a mobile terminal interconnected with the smart glasses to trigger the mobile terminal A reminder mode corresponding to the determined degree of fatigue is initiated.

In order to solve the above technical problem, an in-vehicle system of the present invention includes:

a wireless communication unit configured to acquire a degree of fatigue determined by the smart glasses from smart glasses interconnected with the in-vehicle system;

The reminder unit is set to initiate a reminder mode corresponding to the degree of fatigue acquired.

As an improvement of the in-vehicle system of the present invention, the reminding unit is specifically configured to start a reminder mode corresponding to the acquired fatigue degree from the preset mode table; and record the corresponding relationship between each reminder mode and the degree of fatigue in the mode table The reminder mode includes at least one of the following: a voice announcement mode, a music broadcast mode, a rest place planning mode, and/or an emergency braking mode.

The beneficial effects of the present invention are as follows:

The reminding method, the smart glasses and the vehicle-mounted system effectively reduce the implementation complexity of the existing fatigue driving detection system; at the same time, the smart driving and the vehicle-mounted system interact to realize the fatigue driving reminder, thereby effectively reducing the hardware cost of implementing the invention.

DRAWINGS

1 is a flow chart of a reminding method for smart glasses in an embodiment of the present invention;

2 is a flow chart of interaction between smart glasses and an in-vehicle system in an embodiment of the present invention;

3 is a flow chart of a reminding method for an in-vehicle system in an embodiment of the present invention;

4 is a schematic structural view of a smart glasses according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of an in-vehicle system according to an embodiment of the present invention; FIG.

6 is a schematic structural diagram of another smart glasses according to an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of an in-vehicle device according to an embodiment of the present invention.

detailed description

In order to solve the problems of the prior art, the present invention provides a reminding method, a smart eyeglass, and an in-vehicle system. The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to be limiting.

Embodiment 1

As shown in FIG. 1 , a reminding method in the embodiment of the present invention is applied to smart glasses, including:

S101. Acquire an eye movement data of the user based on an inductor preset in the smart glasses.

S102. Determine a degree of fatigue of the user corresponding to the acquired eye motion data.

S103. When the determined degree of fatigue reaches a preset reminding threshold, send the determined degree of fatigue to an in-vehicle system interconnected with the smart glasses to trigger the in-vehicle system to initiate a reminder corresponding to the determined fatigue level. mode.

Specifically, the sensor module can collect the eye movement data of the user (driver) wearing the smart glasses, so that the degree of fatigue of the user can be further determined. If the determined degree of fatigue reaches a certain level (preset reminder threshold), That is, the vehicle system is triggered to activate the corresponding reminder mode.

Among them, the interconnection method can adopt wireless interconnection, including WIFI connection, infrared connection, Bluetooth connection and the like.

In the embodiment of the present invention, the sensor module is preset in the smart glasses, the eye movement data is acquired through the sensor module, and the fatigue degree corresponding to the acquired eye motion data is determined; the determined fatigue level reaches the preset reminder threshold. And transmitting the determined degree of fatigue to the in-vehicle system interconnected with the smart glasses to trigger the in-vehicle system to initiate a reminder mode corresponding to the determined degree of fatigue, the method effectively reducing the implementation complexity of the existing fatigue driving detection system; At the same time, the smart driving and the in-vehicle system interact to realize the fatigue driving reminder, which effectively reduces the hardware cost of implementing the invention.

In an embodiment of the present invention, the eye movement data includes blink frequency data and/or eye rotation frequency data;

The step of acquiring the eye movement data of the user based on the sensor preset in the smart glasses includes:

Collecting an eye potential difference based on an eye potential sensor preset in the smart glasses;

Determining the blinking motion and/or the eyeball turning motion based on the collected potential difference, and determining the number of blinking actions and/or the number of eyeball turning motions in the preset time period;

The corresponding blink frequency data and/or eye rotation frequency data is determined based on the determined number of blinking actions and/or the number of eyeball turning motions.

Among them, the eye potential sensor is specifically a three-point eye potential sensor.

That is to say, in the smart glasses, a three-point eye potential sensor is built in, and the eye direction difference generated by the eye movement data is used to monitor the movement of the eyes in eight directions in real time, based on the determined number of blinking actions and/or the rotation of the eyeball. The number of times, the blink frequency data and/or the eye rotation frequency data are determined.

In another embodiment of the present invention, the step of determining the degree of fatigue of the user corresponding to the acquired eye motion data by using a preset fatigue degree calculation algorithm includes:

According to the relationship between fatigue and lightness, the degree of fatigue is divided into several fatigue states.

Setting a corresponding blink frequency data range and/or an eye rotation frequency data range for each fatigue state, and storing in the state mapping table;

A degree of fatigue corresponding to the acquired eye movement data is searched from the state map.

The fatigue state includes a mental discomfort state, a mild fatigue state, a severe fatigue state, and/or a sleep state.

In another embodiment of the present invention, the step of determining the degree of fatigue corresponding to the obtained eye motion data by using a preset fatigue degree calculation algorithm includes:

The fatigue degree corresponding to the acquired eye motion data is determined by using a preset fatigue degree calculation algorithm.

Specifically, when the user's eyes reach the "fatigue" standard, the eyes may develop discomfort. The main symptoms may be dry eyes, foreign body sensation, blurred vision, and sore eyes. At this time, the human eye movements mainly manifested: irregular blinking, reduced number of eyeball rotations (becoming sluggish), and thinning of the eyes (the nature of sleeping is already closed).

For example, if the blink frequency is 1 time/second, it means that the user may already be in a severe fatigue state; if it is too long, it means that the blink frequency may be 0 or less, indicating that the user has gone to sleep. If the car the user is driving at this time is still driving, the probability of danger is very high.

Therefore, the method in the embodiment of the present invention can also cooperate with the vehicle system to complete a more effective reminder.

Specifically, the vehicle system side includes:

Obtaining a degree of fatigue determined by the smart glasses from smart glasses interconnected with the in-vehicle system;

A reminder mode corresponding to the acquired degree of fatigue is started from the preset mode table; the corresponding relationship between each reminder mode and the degree of fatigue is recorded in the mode table.

Further, the correspondence between each reminder mode and the degree of fatigue includes:

Correspondence between a mental distraction state, a mild fatigue state, a severe fatigue state, and/or a sleep state, respectively, with a voice broadcast mode, a music broadcast mode, a rest place planning mode, and/or an emergency braking mode.

The language broadcast mode includes broadcasting a preset warning reminder sound;

The music broadcast mode includes broadcasting preset preset passion music;

The rest place planning mode includes:

Get the positioning data of the current location;

Finding a rest place around the current location within the preset distance segment based on the positioning data;

Planning the route of each of the rest places and current locations found;

Show the planned route according to the distance and distance;

The emergency braking mode includes:

Turn on the emergency light and perform an emergency brake.

In still another embodiment of the present invention, the step of acquiring the eye movement data of the user based on the sensor preset in the smart glasses may further include:

Acquiring speed data from the in-vehicle system;

Obtaining eye movement data of the user based on the sensor preset in the smart glasses when the acquired speed data reaches a preset speed threshold;

That is to say, in the present mode, when the speed threshold is less than, the user is not driving the car, or the car where the user (driver) is located is not traveling.

Of course, after the step of determining that the fatigue level reaches the preset reminder threshold, the method may further include:

Triggering a vibrator disposed on a frame of the smart glasses to generate vibration, or

Sending the determined degree of fatigue to the mobile terminal interconnected with the smart glasses to trigger the mobile terminal to initiate a reminder mode corresponding to the determined degree of fatigue.

That is to say, by setting the vibrator in the smart glasses, the user can be directly reminded, which greatly improves the reminding effect;

By triggering the mobile terminal to activate the corresponding reminder mode, the reminding path is increased, thereby further improving the reminding effect.

The method of reminding in the embodiment of the present invention is specifically described.

As shown in FIG. 2, the smart glasses include a smart lens 1 and a smart lens 2, which are paired and used for real-time monitoring while data sharing.

Acquiring the eye movement data of the user based on the sensor preset in the smart glasses; monitoring the acquired fatigue degree corresponding to the eye motion data by using a preset fatigue degree calculation algorithm;

Determine whether fatigue (based on the preset reminder threshold), if not, continue monitoring;

If yes, touch the vehicle end to activate the corresponding reminder mode.

For example: 1. Start the car audio alert to warn the user that he is currently fatigued.

2, start the car to automatically play some passionate DJ music (speaking music), supplemented by refreshing.

3. Start the navigation search to plan the rest place near the road, and provide the user with the choice to go to rest.

4. When it is detected that the driver user is in a state of sleep (long-term closed eyes) during driving, it is recognized as dangerous driving, and the car automatically turns on the emergency light and performs emergency braking.

Embodiment 2

Based on the above-mentioned reminding method for smart glasses, as shown in FIG. 3, a reminding method in the embodiment of the present invention is applied to an in-vehicle system, including:

S301. Acquire a fatigue degree determined by the smart glasses from smart glasses interconnected with the in-vehicle system.

S302: Start a reminder mode corresponding to the acquired degree of fatigue.

Further, the step of initiating a reminder mode corresponding to the degree of fatigue acquired includes:

And a reminder mode corresponding to the acquired fatigue degree is started from the preset mode table; and the corresponding relationship between each reminder mode and the fatigue degree is recorded in the mode table;

The reminder mode includes at least one of the following: a voice broadcast mode, a music broadcast mode, a rest place planning mode, and/or an emergency braking mode;

The rest place planning mode includes:

Get the positioning data of the current location;

Finding a rest place around the current location within the preset distance segment based on the positioning data;

Planning the route of each of the rest places and current locations found;

Show the planned route according to the distance and distance;

The emergency braking mode includes:

Turn on the emergency light and perform an emergency brake.

The method of the embodiment of the invention effectively reduces the implementation complexity of the existing fatigue driving detection system; at the same time, the reminder of the fatigue driving is realized by the way that the smart glasses interact with the vehicle system, thereby effectively reducing the hardware cost of implementing the invention.

Embodiment 3

As shown in FIG. 4, an embodiment of the present invention provides a smart glasses, including:

The sensor module 40 is configured to acquire the eye movement data of the user based on the sensor preset in the smart glasses;

The fatigue degree calculation module 42 is configured to determine the degree of fatigue of the user corresponding to the acquired eye motion data;

The wireless communication module 44 is configured to send the determined fatigue level to the in-vehicle system interconnected with the smart glasses to trigger the onboard system startup and the determining when the determined fatigue level reaches a preset reminder threshold Reminder mode corresponding to the degree of fatigue.

Specifically, the eye movement data includes blink frequency data and/or eye rotation frequency data;

The sensor module 40 is specifically configured as an eye potential sensor preset in the smart glasses to collect an eye potential difference;

Determining the blinking motion and/or the eyeball turning motion based on the collected potential difference, and determining the number of blinking actions and/or the number of eyeball turning motions in the preset time period;

The corresponding blink frequency data and/or eye rotation frequency data is determined based on the determined number of blinking actions and/or the number of eyeball turning motions.

The fatigue degree calculation module 42 is specifically configured to divide the fatigue degree into a plurality of fatigue states according to the relationship between fatigue and severity, and set a corresponding blink frequency data range and/or eyeball for each fatigue state. Rotating the frequency data range and storing it in the state mapping table; searching for the degree of fatigue corresponding to the acquired eye motion data from the state mapping table; or

Specifically, the preset fatigue degree calculation algorithm is used to determine the degree of fatigue corresponding to the acquired eye motion data.

Further, the smart glasses further include a speed acquisition module configured to acquire speed data from the in-vehicle system;

The sensor module 40 is specifically configured to acquire the eye movement data of the user based on the sensor preset in the smart glasses when the acquired speed data reaches a preset speed threshold;

The wireless communication module 44 is further configured to trigger a vibrator disposed on a frame of the smart glasses to generate vibration; or send a determined degree of fatigue to a mobile terminal interconnected with the smart glasses to trigger the movement The terminal initiates a reminder mode corresponding to the determined degree of fatigue.

Embodiment 4

As shown in FIG. 5, an embodiment of the present invention provides an in-vehicle system, including:

The wireless communication unit 50 is configured to acquire the degree of fatigue determined by the smart glasses from the smart glasses interconnected with the in-vehicle system;

The reminding unit 52 is configured to activate a reminder mode corresponding to the acquired degree of fatigue.

The reminding unit 52 is specifically configured to start a reminder mode corresponding to the acquired fatigue degree from the preset mode table; and record the corresponding relationship between each reminder mode and the fatigue degree in the mode table;

The reminder mode includes at least one of the following: a voice broadcast mode, a music broadcast mode, a rest place planning mode, and/or an emergency braking mode.

Embodiments 3 and 4 are respectively the device embodiments corresponding to the first embodiment and the second embodiment. For the specific implementation, reference may be made to the first and second embodiments, which have the technical effects of the first embodiment and the second embodiment, and are not described herein again.

Embodiment 5

FIG. 6 is a schematic structural diagram of another smart glasses according to an embodiment of the present invention.

The smart glasses 60 in the embodiment of the present invention include at least one processor 62, such as a CPU, at least one receiver 63, at least one memory 65, at least one transmitter 61, and at least one communication bus 64. The communication bus 64 is used to implement connection communication between these components. The receiver 63 and the transmitter 61 may be wired transmission ports, or may be wireless devices, for example, including antenna devices for data communication with other devices. The memory 65 may be a high speed RAM memory or a non-volatile memory such as at least one disk memory.

The processor 62 can execute an operating system of the smart glasses 60 and various installed applications, program codes, and the like. For example, each module described above includes the sensor module 40, the fatigue level calculation module 42, The wireless communication module 44 and the like.

Program code is stored in the memory 65, and the processor 62 can invoke program code stored in the memory 65 via the communication bus 64 to perform related functions. For example, the various modules (eg, the sensor module 40, the fatigue level calculation module 42, the wireless communication module 44, etc.) described in FIG. 4 are program codes stored in the memory 65, and are The processor 62 executes to implement the functions of the various modules to effect processing of reminders for fatigue driving.

In one embodiment of the invention, the memory 65 stores a plurality of instructions that are executed by the processor 62 to effect a reminder process for fatigue driving. Specifically, based on the sensor preset in the smart glasses 60, the processor 62 acquires eye movement data of the user; the processor 62 determines the fatigue of the user corresponding to the acquired eye motion data. Degree; when the determined degree of fatigue reaches a preset reminder threshold, the processor 62 transmits the determined degree of fatigue to an in-vehicle system interconnected with the smart glasses 60 to trigger the onboard system startup and the determination The corresponding level of fatigue is the reminder mode.

In a further embodiment, the eye movement data includes blink frequency data and/or eye rotation frequency data; based on an eye potential sensor preset in the smart glasses, the processor 62 collects an eye potential difference; based on the acquisition The potential difference, determine the blinking action and/or the eyeball turning motion, and determine the number of blinking actions and/or the number of eyeball turning actions during the preset time period; based on the determined number of blinking actions and/or the number of eyeball turning actions The processor 62 determines corresponding blink frequency data and/or eye rotation frequency data.

In a further embodiment, the processor 62 divides the degree of fatigue into a plurality of fatigue states according to the degree of fatigue from light to heavy; sets a corresponding blink frequency data range and/or eye rotation for each fatigue state. The frequency data range is stored in the state mapping table; the processor 62 searches for the degree of fatigue corresponding to the acquired eye motion data from the state mapping table; or, adopts a preset fatigue degree calculation algorithm, The processor 62 determines the degree of fatigue corresponding to the acquired eye motion data.

In a further embodiment, the processor 62 obtains speed data from the in-vehicle system before the step of acquiring the eye movement data of the user based on the sensor preset in the smart glasses; and When the acquired speed data reaches a preset speed threshold, the processor 62 acquires eye movement data of the user based on the sensor preset in the smart glasses; when the determined fatigue level reaches a preset reminder threshold After the step, the processor 62 triggers a vibrator disposed on the frame of the smart glasses 60 to generate vibration; or the processor 62 transmits the determined degree of fatigue to the mobile terminal interconnected with the smart glasses 60 And triggering the mobile terminal to initiate a reminder mode corresponding to the determined degree of fatigue.

For details, refer to the description of the related steps in the corresponding embodiment of FIG. 1 for the specific implementation of the above-mentioned instructions by the processor 62, and details are not described herein.

Embodiment 6

FIG. 7 is a schematic structural diagram of an in-vehicle device according to an embodiment of the present invention.

The in-vehicle device 70 in the embodiment of the present invention may be different types of electronic devices, such as: smart phones, tablet computers, palmtop computers, and mobile Internet devices, personal digital assistants, media players, smart TVs, smart watches, smart bracelets, etc. . As shown in FIG. 7, the in-vehicle device 70 in the embodiment of the present invention includes at least one processor 72, such as a CPU, at least one receiver 73, at least one memory 75, at least one transmitter 71, and at least one communication bus 74. The communication bus 74 is used to implement connection communication between these components. The receiver 73 and the transmitter 71 may be wired transmission ports, or may be wireless devices, for example, including antenna devices for data communication with other devices. The memory 75 may be a high speed RAM memory or a non-volatile memory such as at least one disk memory.

The processor 72 can execute an operating system of the in-vehicle device 70 and various installed application programs, program codes, and the like. For example, each unit described above includes the wireless communication unit 50, the reminding unit 52, and the like.

Program code is stored in the memory 75, and the processor 72 can invoke program code stored in the memory 75 via the communication bus 74 to perform related functions. For example, the various units (e.g., the wireless communication unit 50, the reminder unit 52, etc.) described in FIG. 5 are program codes stored in the memory 75 and are executed by the processor 72, thereby The functions of the various modules are implemented to achieve processing of reminders for fatigue driving.

In one embodiment of the invention, the memory 75 stores a plurality of instructions that are executed by the processor 72 to effect a reminder process for fatigue driving. Specifically, the processor 72 acquires the degree of fatigue determined by the smart glasses from the smart glasses 60; and initiates a reminder mode corresponding to the acquired degree of fatigue.

In a further embodiment, the processor 72 starts a reminder mode corresponding to the acquired degree of fatigue from the preset mode table; the mode table records a correspondence between each reminder mode and the degree of fatigue; the reminder mode The at least one of the following includes: a voice broadcast mode, a music broadcast mode, a rest place planning mode, and/or an emergency braking mode; the rest place planning mode includes: the processor 72 acquires positioning data of a current location; Data, the processor 72 searches for a rest place around the current location within a preset distance segment; plans each of the found rest places and the current location route; displays the planned route according to the distance and distance; the emergency system The dynamic mode includes: turning on the emergency light and performing emergency braking.

For details, refer to the description of the related steps in the corresponding embodiment of FIG. 3, and the details are not described here.

The reminding method described in connection with the examples disclosed in the present application may be directly embodied as hardware, a software module executed by a processor, or a combination of both. For example, one or more combinations of one or more of the functional block diagrams and/or functional blocks in the functional blocks shown in FIG. 4 and FIG. 5 (eg, sensor module, wireless communication unit) may correspond to a computer Each software module of the program flow may also correspond to each hardware module. These software modules may correspond to the respective steps shown in FIGS. 1 and 3, respectively. These hardware modules can be implemented, for example, by curing these software modules using a Field Programmable Gate Array (FPGA).

The software module can reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable hard drive, CD-ROM, or any other form of storage medium known in the art. A storage medium can be coupled to the processor to enable the processor to read information from, and write information to, the storage medium; or the storage medium can be an integral part of the processor. The processor and the storage medium may be located in an application specific integrated circuit. The software module can be stored in the memory of the mobile terminal or in a memory card that can be inserted into the mobile terminal. For example, if the mobile terminal uses a larger capacity MEGA-SIM card or a large-capacity flash memory device, the software module can be stored in the MEGA-SIM card or a large-capacity flash memory device.

One or more of the functional block diagrams described with respect to Figures 4 and 5 and/or one or more combinations of functional block diagrams (e.g., fatigue level calculation module) may be implemented as general purpose processing for performing the functions described herein. , digital signal processor (DSP), application specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, or any suitable combination thereof. One or more of the functional blocks described with respect to Figures 4 and 5 and/or one or more combinations of functional blocks may also be implemented as a combination of computer devices, e.g., a combination of a DSP and a microprocessor, multiple micro A processor, one or more microprocessors in communication with the DSP, or any other such configuration.

While the present invention has been described with respect to the specific embodiments of the present invention, those skilled in the art can devise modifications of the present invention without departing from the inventive concept.

In addition, the method of the present invention can be performed not only in a mobile terminal but also in a multimedia device such as a PDA or a game machine.

Those skilled in the art can make various modifications to the method of the present invention without departing from the scope of the present invention, and still fall within the protection scope of the present invention.

Claims (12)

1. A reminding method, characterized in that it is applied to smart glasses, including:

   Acquiring eye movement data of the user based on the sensor preset in the smart glasses;

   Determining a degree of fatigue of the user corresponding to the acquired eye movement data;

   When the determined degree of fatigue reaches the preset reminder threshold, the determined degree of fatigue is transmitted to the onboard system interconnected with the smart glasses to trigger the onboard system to initiate a reminder mode corresponding to the determined degree of fatigue.
2. The method of claim 1 wherein said eye movement data comprises blink frequency data and/or eye rotation frequency data;

   The step of acquiring the eye movement data of the user based on the sensor preset in the smart glasses includes:

   Collecting an eye potential difference based on an eye potential sensor preset in the smart glasses;

   Determining the blinking motion and/or the eyeball turning motion based on the collected potential difference, and determining the number of blinking actions and/or the number of eyeball turning motions in the preset time period;

   The corresponding blink frequency data and/or eye rotation frequency data is determined based on the determined number of blinking actions and/or the number of eyeball turning motions.
3. The method according to claim 2, wherein the step of determining the degree of fatigue of the user corresponding to the obtained eye movement data comprises:

   According to the relationship between fatigue and lightness, the fatigue degree is divided into several fatigue states; the corresponding blink frequency data range and/or the eyeball rotation frequency data range are set for each fatigue state, and stored in the state map; Finding a degree of fatigue corresponding to the obtained eye movement data from the state mapping table; or

   The fatigue degree corresponding to the acquired eye motion data is determined by using a preset fatigue degree calculation algorithm.
4. The method according to any one of claims 1 to 3, wherein the step of acquiring the eye movement data of the user based on the sensor preset in the smart glasses further comprises:

   Acquiring speed data from the in-vehicle system;

   The step of acquiring the eye movement data of the user based on the sensor preset in the smart glasses includes:

   Obtaining eye movement data of the user based on the sensor preset in the smart glasses when the acquired speed data reaches a preset speed threshold;

   After the step of determining that the fatigue level reaches the preset reminder threshold, the method further includes:

   Triggering a vibrator disposed on a frame of the smart glasses to generate vibration; or

   Sending the determined degree of fatigue to the mobile terminal interconnected with the smart glasses to trigger the mobile terminal to initiate a reminder mode corresponding to the determined degree of fatigue.
5. A reminding method is characterized in that it is applied to an in-vehicle system, including:

   Obtaining a degree of fatigue determined by the smart glasses from smart glasses interconnected with the in-vehicle system;

   Start a reminder mode that corresponds to the degree of fatigue acquired.
6. The method of claim 5 wherein said step of initiating a reminder mode corresponding to the degree of fatigue acquired comprises:

   And a reminder mode corresponding to the acquired fatigue degree is started from the preset mode table; and the corresponding relationship between each reminder mode and the fatigue degree is recorded in the mode table;

   The reminder mode includes at least one of the following: a voice broadcast mode, a music broadcast mode, a rest place planning mode, and/or an emergency braking mode;

   The rest place planning mode includes:

   Get the positioning data of the current location;

   Finding a rest place around the current location within the preset distance segment based on the positioning data;

   Planning the route of each of the rest places and current locations found;

   Show the planned route according to the distance and distance;

   The emergency braking mode includes:

   Turn on the emergency light and perform an emergency brake.
7. A smart glasses, comprising:

   a sensor module configured to acquire an eye movement data of the user based on a sensor preset in the smart glasses;

   a fatigue degree calculation module, configured to determine a degree of fatigue of the user corresponding to the acquired eye motion data;

   a wireless communication module, configured to send the determined fatigue level to an in-vehicle system interconnected with the smart glasses to trigger the on-board system startup and the determined fatigue when the determined fatigue level reaches a preset reminder threshold The corresponding reminder mode.
8. The smart glasses according to claim 7, wherein the eye movement data comprises blink frequency data and/or eye rotation frequency data;

   The sensor module is specifically configured to collect an eye potential difference based on an eye potential sensor preset in the smart glasses;

   Determining the blinking motion and/or the eyeball turning motion based on the collected potential difference, and determining the number of blinking actions and/or the number of eyeball turning motions in the preset time period;

   The corresponding blink frequency data and/or eye rotation frequency data is determined based on the determined number of blinking actions and/or the number of eyeball turning motions.
9. The smart glasses according to claim 8, wherein the fatigue degree calculation module is specifically configured to divide the degree of fatigue into a plurality of fatigue states according to a relationship between fatigue and severity, and to each fatigue state. Setting a corresponding blink frequency data range and/or an eye rotation frequency data range, and storing the data in a state mapping table; and searching for the degree of fatigue corresponding to the acquired eye motion data from the state mapping table; or

   Specifically, the preset fatigue degree calculation algorithm is used to determine the degree of fatigue corresponding to the acquired eye motion data.
10. The smart glasses according to any one of claims 7-9, wherein the smart glasses further comprise a speed acquisition module configured to acquire speed data from the in-vehicle system;

    The sensor module is configured to acquire the eye movement data of the user based on the sensor preset in the smart glasses when the acquired speed data reaches a preset speed threshold;

    The wireless communication module is further configured to trigger a vibrator disposed on a frame of the smart glasses to generate vibration; or send the determined degree of fatigue to a mobile terminal interconnected with the smart glasses to trigger the mobile terminal A reminder mode corresponding to the determined degree of fatigue is initiated.
11. An in-vehicle system, comprising:

    a wireless communication unit configured to acquire a degree of fatigue determined by the smart glasses from smart glasses interconnected with the in-vehicle system;

    The reminder unit is set to initiate a reminder mode corresponding to the degree of fatigue acquired.
12. The in-vehicle system according to claim 11, wherein the reminding unit is specifically configured to start a reminder mode corresponding to the acquired fatigue degree from the preset mode table; and record each reminder mode in the mode table Correspondence of fatigue level;

    The reminder mode includes at least one of the following: a voice broadcast mode, a music broadcast mode, a rest place planning mode, and/or an emergency braking mode.

Images