CN108594993B - Electronic device, audio playing method and related product - Google Patents

Electronic device, audio playing method and related product Download PDF

Info

Publication number
CN108594993B
CN108594993B CN201810281877.0A CN201810281877A CN108594993B CN 108594993 B CN108594993 B CN 108594993B CN 201810281877 A CN201810281877 A CN 201810281877A CN 108594993 B CN108594993 B CN 108594993B
Authority
CN
China
Prior art keywords
user
sleep
electroencephalogram
brain wave
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201810281877.0A
Other languages
Chinese (zh)
Other versions
CN108594993A (en
Inventor
张海平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201810281877.0A priority Critical patent/CN108594993B/en
Publication of CN108594993A publication Critical patent/CN108594993A/en
Application granted granted Critical
Publication of CN108594993B publication Critical patent/CN108594993B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Abstract

The embodiment of the application relates to the technical field of mobile terminals, and discloses an electronic device, an audio playing method and a related product. The electronic device comprises a brain wave sensor, a processor and a loudspeaker, wherein the brain wave sensor is used for acquiring a first brain wave signal under the condition that a user is in a sleep state; a processor for determining whether the user will wake up from sleep based on the first brain wave signal; a speaker for playing a first audio with a preset volume in a case where a user is going to wake up from sleep; the first audio is used to extend the sleep time of the user. Therefore, by implementing the embodiment of the application, the brain wave signals can be analyzed to determine whether the user wakes up from sleep, and if the user wakes up from sleep, the first audio is played by using the loudspeaker, so that the sleep time of the user is prolonged, the occurrence of sleep troubles such as insomnia and easy waking is reduced, and the sleep quality of the user is improved.

Description

Electronic device, audio playing method and related product
Technical Field
The present application relates to the field of mobile terminal technologies, and in particular, to an electronic device, an audio playing method, and a related product.
Background
With the development of mobile terminal technology, mobile terminals have played an increasingly important role in people's lives. In life, it is increasingly convenient to use mobile terminals to perform activities such as payment and office work.
However, when a user interacts with the mobile terminal, the user often needs to input to the mobile terminal through operations such as gestures and actions, so that the user can interact with the mobile terminal. This limits the flexibility and freedom of operation of the mobile terminal by the user, and therefore how to improve the flexibility and freedom of operation of the mobile terminal by the user becomes a problem to be solved.
Disclosure of Invention
The embodiment of the application provides an electronic device, an audio playing method and a related product, which can improve the sleep quality of a user.
In a first aspect, embodiments of the present application disclose an electronic device, which includes a brain wave sensor, a processor, and a speaker, wherein,
the brain wave sensor is used for acquiring a first brain wave signal under the condition that a user is in a sleep state;
the processor is used for determining whether the user wakes up from sleep according to the first brain wave signal;
the loudspeaker is used for playing a first audio by using a preset volume under the condition that the user wakes up from sleep; the first audio is used to extend the sleep time of the user.
In a second aspect, an embodiment of the present application discloses an audio playing method applied to an electronic device including a brain wave sensor, a processor, and a speaker, the method including:
controlling the brain wave sensor to acquire a first brain wave signal when the user is in a sleep state;
determining whether the user will wake up from sleep according to the first brain wave signal;
controlling the speaker to play a first audio with a preset volume if the user is going to wake up from sleep; the first audio is used to extend the sleep time of the user.
In a third aspect, embodiments of the present application disclose an audio output apparatus applied to an electronic apparatus including a brain wave sensor, a processor, and a speaker, the audio output apparatus including an acquisition unit, a determination unit, and an output unit, wherein,
the acquisition unit is used for controlling the brain wave sensor to acquire a first brain wave signal when the user is in a sleep state;
the determination unit is used for determining whether the user wakes up from sleep according to the first brain wave signal;
the output unit is used for controlling the loudspeaker to play a first audio with a preset volume under the condition that the user wakes up from sleep; the first audio is used to extend the sleep time of the user.
In a fourth aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps of any of the methods in the second aspect of the embodiment of the present application.
In a fifth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform part or all of the steps described in any one of the methods in the second aspect of the present application.
In a sixth aspect, the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform some or all of the steps described in any one of the methods of the second aspect of the present application. The computer program product may be a software installation package.
In the embodiment of the application, the electronic device comprises a brain wave sensor, a processor and a loudspeaker, wherein the brain wave sensor is used for acquiring a first brain wave signal when a user is in a sleep state; a processor for determining whether the user will wake up from sleep based on the first brain wave signal; a speaker for playing a first audio with a preset volume in a case where a user is going to wake up from sleep; the first audio is used to extend the sleep time of the user. Therefore, by implementing the embodiment of the application, the brain wave signals can be analyzed to determine whether the user wakes up from sleep, and if the user wakes up from sleep, the first audio is played by using the loudspeaker, so that the sleep time of the user is prolonged, the occurrence of sleep troubles such as insomnia and easy waking is reduced, and the sleep quality of the user is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a schematic structural diagram of an electronic device disclosed in an embodiment of the present application;
fig. 2 is a schematic structural diagram of another electronic device disclosed in the embodiment of the present application;
fig. 3 is a schematic structural diagram of another electronic device disclosed in the embodiment of the present application;
fig. 4 is a schematic structural diagram of another electronic device disclosed in the embodiment of the present application;
FIG. 5 is a schematic illustration of an electroencephalogram disclosed in an embodiment of the present application;
fig. 6 is a schematic flowchart of an audio playing method disclosed in an embodiment of the present application;
fig. 7 is a functional block diagram of an audio output device according to an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of another electronic device disclosed in the embodiments of the present application;
fig. 9 is a schematic structural diagram of another electronic device disclosed in the embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the accompanying drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The electronic device according to the embodiment of the present application may include various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to a wireless modem, and various forms of User Equipment (UE), Mobile Stations (MS), terminal devices (terminal device), and the like. For convenience of description, the above-mentioned apparatuses are collectively referred to as electronic devices.
The embodiment of the application provides an electronic device, an audio playing method and a related product, which can analyze brain wave signals to determine whether a user wakes up from sleep, and if the user wakes up from sleep, a loudspeaker is used for playing a first audio, so that the sleep time of the user is prolonged, sleep troubles such as insomnia and easy waking are reduced, and the sleep quality of the user is improved. The following are detailed below.
Referring to fig. 1, fig. 1 is a schematic structural diagram of an electronic device 100 according to an embodiment of the present disclosure, as shown in fig. 1, the electronic device 100 includes a brain wave sensor 110, a processor 120 and a speaker 130, and the brain wave sensor 110, the processor 120 and the speaker 130 may be connected to each other so as to communicate with each other.
In the embodiment of the present application, the brain wave sensor 110 is configured to acquire the first brain wave signal when the user is in a sleep state.
A processor 120 for determining whether the user will wake up from sleep based on the first brain wave signal.
A speaker 130 for playing a first audio with a preset volume in case that a user is going to wake up from sleep; the first audio is used to extend the sleep time of the user.
In the human body, neuronal activity of the brain is conducted to the cerebral cortex by ions, thus producing weak voltage changes; therefore, in the embodiment of the present application, the brain wave sensor 110 has at least one conductive electrode that can be fixed on the scalp of the user so as to sense a weak voltage variation caused by the brain waves. In this embodiment, the conductive electrode may be a dry electrode, a wet electrode, or an invasive electrode, and specifically, which conductive electrode is adopted is not limited in this embodiment.
As an alternative embodiment, the brain wave sensor 110 further has a signal processing circuit, so that after the conductive electrodes acquire the original voltage signals, the signal processing circuit performs differential amplification on the original voltage signals, filters out interference noise introduced by the electromyographic signals, and performs analog-to-digital conversion to obtain digitized brain wave signals. The brain wave signals may be transmitted to the processor 120 for further signal processing and analysis to learn about the user's fatigue, concentration, mental state, whether it is in nightmare, whether it is going to wake from sleep, etc.
In the embodiment of the present Application, the Processor 120 may be a Central Processing Unit (CPU), a general purpose Processor, a Digital Signal Processor (DSP), an Application-Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a transistor logic device, a hardware component, or any combination thereof.
In the embodiment of the present application, the speaker 130 may be a sound box, an earphone, or other devices, so as to output audio information; the user can set the volume of playing the first audio in advance, so that the volume which is most suitable for the user can be obtained, and the situation that the volume of playing the first audio is too large and is awakened is avoided. On the other hand, the electronic device 100 may also monitor the sleep condition of the user when the first audio is played, so as to adaptively adjust the volume, so as to ensure that the first audio can better help the user to prolong the sleep time.
Wherein the first audio may be low frequency, periodically repeating, soothing music or natural timbre, thereby helping to increase drowsiness in the subconscious of the user, helping the user to stay in a sleeping state, and thus prolonging sleep time.
On the other hand, if the sleep health of the user is good, i.e., the daily sleep time is sufficient, there is no need to increase the sleep time by the above-described method. Thus, the processor 120 may also be configured to obtain the sleep condition of the user over a preset time period (e.g., within a week) and analyze the sleep condition of the user to determine the frequency of the user's insomnia; if the frequency of the user's insomnia is higher than the threshold, the first audio is played to prolong the user's sleep time when the user will wake up from sleep. By the mode, the insomnia condition of the user can be improved, and the sleep quality is improved.
Referring to fig. 2, fig. 2 is a schematic structural diagram of another electronic device 100 disclosed in the embodiment of the present application. As shown in fig. 2, as an alternative embodiment, the electronic device 100 further includes a data transmission module 140, and the data transmission module 140 may be connected to the processor 120, so that the processor 120 may transmit and receive data by using the data transmission module 140.
In this embodiment, the data transmission module 140 is configured to receive a whole-body image of the user acquired by the camera.
The processor 120 is further configured to determine whether the user is ready to fall asleep based on the whole-body image.
The brain wave sensor 110 is also used to acquire a second brain wave signal when the user is ready to fall asleep.
And the processor 120 is also used for determining the emotion type of the user according to the second brain wave signals.
The loudspeaker is also used for playing the second audio when the emotion type of the user is anxiety; the second audio is used to ease mood.
In this embodiment, the electronic device 100 may determine whether the user is lying down in preparation for falling asleep by analyzing the whole-body image of the user. Because a certain proportion of insomnia users cause insomnia as psychological factors, users can worry about not sleeping if they are awake when lying down and preparing to fall asleep, thereby causing psychological anxiety and aggravating insomnia symptoms. Therefore, in this embodiment, by analyzing the brain wave signals when the user is ready to fall asleep, it is determined whether the type of emotion of the user is anxiety, and if so, melody relaxing music is played to help the user relax the emotion, thereby making it easier to fall asleep.
Referring to fig. 3, fig. 3 is a schematic structural diagram of another electronic device 100 disclosed in the embodiment of the present application. As shown in fig. 3, the electronic device 100 may further include a display 150, and the display 150 may be connected to the processor 120, so that the processor 120 may control the display 150 to output image information.
In this embodiment, the processor 120 is further configured to query the user's work and rest schedule to determine whether the current time is the user's time to sleep.
The processor 120 is further configured to, if the display screen is in an on state when the current time is the time of falling asleep for the user, decrease the screen switching speed of the display screen.
In this embodiment, the user may preset a work and rest schedule in the electronic device 100, for example, set 11 pm to fall asleep and 7 am to get up. Therefore, the processor 120 may query the work and rest schedule of the user, and if the current time is the sleep time of the user and the user is still browsing a web page and watching a novel word by using the electronic device 100, the screen switching speed of the display screen is reduced, and the user needs to wait at each screen switching, so that the concentration of the user on the content displayed by the current display screen 150 can be reduced, thereby enhancing drowsiness and helping the user to sleep better.
Referring to fig. 4, fig. 4 is a schematic structural diagram of another electronic device 100 disclosed in the embodiment of the present application, as shown in fig. 4, the electronic device 100 may further include a memory 160, and the memory 160 may also be connected to the processor 120, so that the processor 120 may store data in the memory 160 or retrieve data from the memory 160.
A memory 160 for storing an electroencephalogram template library; wherein the electroencephalogram template library comprises more than one electroencephalogram template; more than one electroencephalogram template is an electroencephalogram obtained if the user is to wake up from sleep;
in determining whether the user will wake up from sleep based on the first brain wave signal, the processor 120 is specifically configured to:
generating an electroencephalogram of the user from the first brain wave signal; determining a waveform feature period in an electroencephalogram of a user; dividing the electroencephalogram of the user into a plurality of segmented electroencephalograms according to the waveform characteristic period; comparing each segmented electroencephalogram in the plurality of segmented electroencephalograms to an electroencephalogram template in an electroencephalogram template library to determine whether the segmented electroencephalogram matches any one of the electroencephalogram templates in the electroencephalogram template library; determining the proportion of the number of the segmented electroencephalograms matched with any one electroencephalogram template to the number of all the segmented electroencephalograms; in the event that the ratio is above a threshold, it is determined that the current user will wake up from sleep.
For example, please refer to fig. 5, fig. 5 is a schematic diagram of an electroencephalogram according to an embodiment of the present application; as shown in fig. 5, assuming that the currently acquired electroencephalogram of the electronic device includes 100 waveform feature periods, the current electroencephalogram can be split according to the waveform feature periods into at least 5 segmented electroencephalograms, namely, segmented electroencephalograms 1, 2, 3, 4, 5, wherein each segmented electroencephalogram occupies 20 feature periods, specifically, segmented electroencephalograms 1 correspond to waveform feature periods 1-20, segmented electroencephalograms 2 correspond to waveform feature periods 21-40, segmented electroencephalograms 3 correspond to waveform feature periods 41-60, segmented electroencephalograms 4 correspond to waveform feature periods 61-80, segmented electroencephalograms 5 correspond to waveform feature periods 81-100, each segmented electroencephalogram is compared with an electroencephalogram template library to determine whether each segmented electroencephalogram matches any one of the electroencephalogram templates in the electroencephalogram template library, specifically, the segmented electroencephalogram 1 is matched with an electroencephalogram template a, the segmented electroencephalogram 2 is matched with the electroencephalogram template a, the segmented electroencephalogram 3 does not have a matched electroencephalogram template, the segmented electroencephalogram 4 is matched with the electroencephalogram template a, and the segmented electroencephalogram 5 is matched with the electroencephalogram template b, so that the number of the segmented electroencephalograms matched with any one electroencephalogram template is 4, accounts for 80%, and exceeds a preset threshold value of 60%, and therefore it is determined that the current user will wake up from sleep.
As can be seen, in the present example, in consideration of the volatility of the human brain, the electronic device divides the electroencephalogram into a plurality of segmented electroencephalograms based on the waveform feature cycle of the current electroencephalogram of the user, performs template comparison for each segmented electroencephalogram, and determines whether the user wakes up from sleep according to the ratio of matching with the electroencephalogram template, so that the error tolerance can be provided for the partial electroencephalograms corresponding to the abnormal electroencephalogram signals generated due to the volatility of the human brain, the influence of the abnormally fluctuating partial electroencephalograms on the matching result is avoided, the matching accuracy of the electroencephalogram template is improved, and the detection accuracy is improved.
Referring to fig. 6, fig. 6 is a schematic flowchart illustrating an audio playing method according to an embodiment of the present application. As shown in fig. 6, the method may be applied to an electronic device including a brain wave sensor, a processor, and a speaker, and the audio playing method may include the steps of:
601. and controlling the brain wave sensor to acquire the first brain wave signal when the user is in a sleep state.
In the human body, neuronal activity of the brain is conducted to the cerebral cortex by ions, thus producing weak voltage changes; therefore, in the embodiment of the present application, the brain wave sensor has at least one conductive electrode that can be fixed on the scalp of the user so as to sense a weak voltage variation caused by the brain waves. In this embodiment, the conductive electrode may be a dry electrode, a wet electrode, or an invasive electrode, and specifically, which conductive electrode is adopted is not limited in this embodiment.
As an optional implementation manner, the brain wave sensor further has a signal processing circuit, so that after the conductive electrode acquires the original voltage signal, the signal processing circuit performs differential amplification on the original voltage signal, filters out interference noise introduced by the electromyographic signal, and performs analog-to-digital conversion on the interference noise to obtain a digitized brain wave signal. The brain wave signals can be transmitted to a processor for further signal processing and analysis, so that the fatigue degree, the concentration degree, the psychological state, whether the user is going to wake up from sleep and the like of the user can be known.
602. It is determined whether the user is to wake up from sleep based on the first brain wave signal.
On the other hand, if the sleep health of the user is good, i.e., the daily sleep time is sufficient, there is no need to increase the sleep time by this method. Thus, the electronic device may also be configured to obtain the sleep condition of the user over a preset time period (e.g., within a week) and analyze the sleep condition of the user to determine the frequency of the user's insomnia; if the frequency of the user's insomnia is higher than the threshold, the first audio is played to prolong the user's sleep time when the user will wake up from sleep. By the mode, the insomnia condition of the user can be improved, and the sleep quality is improved.
603. Controlling a loudspeaker to play a first audio with a preset volume under the condition that a user wakes up from sleep; the first audio is used to extend the sleep time of the user.
In the embodiment of the application, the loudspeaker can be a sound box, an earphone and other equipment, so that audio information is output; the user can set the volume of playing the first audio in advance, so that the volume which is most suitable for the user can be obtained, and the situation that the volume of playing the first audio is too large and is awakened is avoided. On the other hand, the electronic device can also monitor the sleep condition of the user when the first audio is played, so that the volume is adaptively adjusted, and the first audio can better help the user to prolong the sleep time.
Therefore, by using the method described in fig. 6, the brain wave signal can be analyzed to determine whether the user will wake up from sleep, and if the user will wake up from sleep, the first audio is played by using the speaker, so that the sleep time of the user is prolonged, the occurrence of sleep troubles such as insomnia and easy waking up is reduced, and the sleep quality of the user is improved.
Referring to fig. 7, fig. 7 is a functional block diagram of an audio output device, which can be applied to an electronic device having a brain wave sensor, a processor and a speaker, according to an embodiment of the present disclosure, and includes an obtaining unit 701, a determining unit 702 and an output unit 703, wherein,
an acquisition unit 701 for controlling the brain wave sensor to acquire the first brain wave signal in a case where the user is in a sleep state.
A determination unit 702 for determining whether the user is to wake up from sleep from the first brain wave signal.
An output unit 703 for controlling a speaker to play a first audio with a preset volume in a case where a user is going to wake up from sleep; the first audio is used to extend the sleep time of the user.
It is understood that the audio output device includes hardware structures and/or software modules for performing the respective functions in order to realize the above functions. Those of skill in the art would readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The embodiment of the present application may perform the division of the functional units on the audio output device according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
As an alternative embodiment, the obtaining Unit 701 and the determining Unit 702 may be a Central Processing Unit (CPU), a general-purpose Processor, a Digital Signal Processor (DSP), an Application-Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or other Programmable logic device, a transistor logic device, a hardware component, or any combination thereof. And the output unit 703 may be a speaker, a sound box, or the like.
Therefore, by using the audio output device described in fig. 7, the brain wave signal can be analyzed to determine whether the user wakes up from sleep, and if the user wakes up from sleep, the first audio is played by using the speaker, so that the sleep time of the user is prolonged, the occurrence of sleep troubles such as insomnia and easy waking is reduced, and the sleep quality of the user is improved.
Referring to fig. 8, fig. 8 is a schematic structural diagram of another electronic device 800 according to an embodiment of the disclosure. The electronic device 800 includes a processor 801, a memory 802, a communication interface 803, and one or more programs; the electronic device 800 further includes a brain wave sensor 804, a speaker 805, a data transmission module 806, and a display 807. Wherein the one or more programs are stored in the memory 802 and configured to be executed by the processor 801, the programs including instructions for performing the steps of:
controlling the brain wave sensor to acquire a first brain wave signal when the user is in a sleep state;
determining whether the user will wake up from sleep according to the first brain wave signal;
controlling the speaker to play a first audio with a preset volume if the user is going to wake up from sleep; the first audio is used to extend the sleep time of the user.
As an alternative implementation, the program further includes instructions for performing the steps of:
acquiring the sleep condition of the user in a preset time period, and determining the frequency of insomnia of the user according to the sleep condition;
in a case where the user is to wake up from sleep, controlling the speaker to play a first audio with a preset volume, the program comprising instructions for performing the steps of:
and under the condition that the frequency of the insomnia of the user is higher than a threshold value, if the user wakes up from sleep, the first audio is played by utilizing the preset volume.
As an alternative implementation, the program further includes instructions for performing the steps of:
controlling the data transmission module to receive the whole body image of the user acquired by the camera;
determining from the whole-body image whether the user is ready to fall asleep;
controlling the brain wave sensor to acquire a second brain wave signal in a case where the user is ready to fall asleep;
determining the emotion type of the user according to the second brain wave signal;
playing a second audio in case the mood type of the user is anxious; the second audio is for soothing mood.
As an alternative implementation, the program further includes instructions for performing the steps of:
inquiring the work and rest time table of the user to determine whether the current time is the time of falling asleep of the user;
and under the condition that the current time is the time of falling asleep of the user, if the display screen is in a lighting state, reducing the picture switching speed of the display screen.
As an alternative embodiment, in said determining whether the user will wake up from sleep from the first brain wave signal, the above procedure comprises instructions specifically for performing the following steps:
generating an electroencephalogram of the user from the first brain wave signal;
determining a waveform feature period in the user's electroencephalogram;
dividing the electroencephalogram of the user into a plurality of segmented electroencephalograms according to the waveform feature period;
comparing each of the plurality of segmented electroencephalograms to an electroencephalogram template in a library of electroencephalogram templates stored in the memory to determine whether the segmented electroencephalogram matches any one of the electroencephalogram templates in the library of electroencephalogram templates; wherein the electroencephalogram template library includes more than one electroencephalogram template; the more than one electroencephalogram template are each an electroencephalogram obtained if the user is to wake from sleep;
determining the proportion of the number of the segmented electroencephalograms matched with any one electroencephalogram template to the number of all the segmented electroencephalograms;
determining that the user is currently going to wake up from sleep if the ratio is above a threshold.
Therefore, with the electronic device described in fig. 8, the brain wave signal can be analyzed to determine whether the user will wake up from sleep, and if the user will wake up from sleep, the first audio is played by using the speaker, so as to prolong the sleep time of the user, reduce the occurrence of sleep troubles such as insomnia and easy waking, and improve the sleep quality of the user.
Referring to fig. 9, fig. 9 is a schematic structural diagram of another electronic device 900 disclosed in the present embodiment. As shown in fig. 9, for convenience of explanation, only the parts related to the embodiments of the present application are shown, and details of the technology are not disclosed, please refer to the method part of the embodiments of the present application. The electronic device may be any terminal equipment including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a POS (point of Sales), a vehicle-mounted computer, etc., taking the electronic device as the mobile phone as an example:
fig. 9 is a block diagram illustrating a partial structure of a mobile phone related to an electronic device provided in an embodiment of the present application. Referring to fig. 9, the handset includes: memory 902, input unit 903, display unit 904, sensor 905, and processor 908. Those skilled in the art will appreciate that the handset configuration shown in fig. 9 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The following describes each component of the mobile phone in detail with reference to fig. 9:
the memory 902 may be used to store software programs and modules, and the processor 908 executes various functional applications and data processing of the cellular phone by operating the software programs and modules stored in the memory 902. The memory 902 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 902 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. In the embodiment of the present application, the memory 902 may be used to store an electroencephalogram template library; wherein the electroencephalogram template library includes more than one electroencephalogram template.
The input unit 903 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone. Specifically, the input unit 903 may include a touch panel 9031. The touch panel 9031, also called a touch screen, may collect a touch operation performed by a user on or near the touch panel 9031 (e.g., an operation performed by the user on or near the touch panel 9031 by using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a preset program. Alternatively, the touch panel 9031 may include two parts, namely, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device and converts it to touch point coordinates, which are provided to the processor 908 and can receive commands from the processor assembly 908 and execute them. In addition, the touch panel 9031 may be implemented by using various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave.
The display unit 904 may be used to display information input by the user or information provided to the user and various menus of the cellular phone. The Display unit 904 may include a Display panel 9041, and optionally, the Display panel 9041 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch panel 9031 may cover the display panel 9041, and when the touch panel 9031 detects a touch operation thereon or nearby, the touch panel is transmitted to the processor assembly 908 to determine the type of the touch event, and then the processor assembly 908 provides a corresponding visual output on the display panel 9041 according to the type of the touch event. Although in fig. 9, the touch panel 9031 and the display panel 9041 are two independent components to implement the input and output functions of the mobile phone, in some embodiments, the touch panel 9031 and the display panel 9041 may be integrated to implement the input and output functions of the mobile phone.
The handset may also include at least one sensor 905, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 9041 according to the brightness of ambient light, and the proximity sensor may turn off the display panel 9041 and/or the backlight when the mobile phone moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here. In the embodiment of the present application, the sensor 905 includes a brain wave sensor 9051, and the brain wave sensor 9051 is configured to acquire a brain wave signal of the user.
The processor 908 is a control center of the mobile phone, and the processor 908 connects various parts of the entire mobile phone by using various interfaces and lines, and performs various functions of the mobile phone and processes data by operating or executing software programs and/or modules stored in the memory 902 and calling data stored in the memory 902, thereby performing overall monitoring of the mobile phone. Alternatively, processor 908 may include one or more processing units; preferably, the processor 908 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It is to be appreciated that the modem processor described above may not be integrated into processor 908. In the embodiment of the present application, the processor 908 may determine whether the user will wake up from sleep based on the brain wave signals.
Although not shown, the mobile phone may further include a radio frequency circuit, a Wireless Fidelity (WiFi) module, a bluetooth module, and the like, which are not described in detail herein.
In the embodiment shown in fig. 6, the method flow of each step may be implemented based on the structure of the mobile phone.
In the embodiment shown in fig. 7, the functions of the units can be implemented based on the structure of the mobile phone.
Therefore, with the electronic device described in fig. 8, the brain wave signal can be analyzed to determine whether the user will wake up from sleep, and if the user will wake up from sleep, the first audio is played by using the speaker, so as to prolong the sleep time of the user, reduce the occurrence of sleep troubles such as insomnia and easy waking, and improve the sleep quality of the user.
Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any one of the methods described in the above method embodiments, and the computer includes a mobile terminal.
Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as described in the above method embodiments. The computer program product may be a software installation package, the computer comprising a mobile terminal.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the above-described division of the units is only one type of division of logical functions, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit may be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the above-mentioned method of the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (9)

1. An electronic device, characterized in that the electronic device comprises a brain wave sensor, a processor, a memory, and a speaker, wherein,
the brain wave sensor is used for acquiring a first brain wave signal under the condition that a user is in a sleep state;
the processor is used for determining whether the user wakes up from sleep according to the first brain wave signal;
the loudspeaker is used for playing a first audio by using a preset volume under the condition that the user wakes up from sleep; the first audio is used for prolonging the sleeping time of the user;
the processor is further used for acquiring the sleep condition of the user within a preset time period and determining the frequency of insomnia of the user according to the sleep condition;
in a case where the user is to wake up from sleep, in playing a first audio with a preset volume, the speaker is specifically configured to: under the condition that the frequency of the insomnia of the user is higher than a threshold value, if the user wakes up from sleep, the first audio is played by utilizing the preset volume;
the memory is used for storing an electroencephalogram template library; wherein the electroencephalogram template library includes more than one electroencephalogram template; the more than one electroencephalogram template are each an electroencephalogram obtained if the user is to wake from sleep;
in the aspect of determining whether the user is going to wake up from sleep according to the first brain wave signal, the processor is specifically configured to:
generating an electroencephalogram of the user from the first brain wave signal;
determining a waveform feature period in the user's electroencephalogram;
dividing the electroencephalogram of the user into a plurality of segmented electroencephalograms according to the waveform feature period;
comparing each segmented electroencephalogram of the plurality of segmented electroencephalograms to an electroencephalogram template of the electroencephalogram template library to determine whether the segmented electroencephalogram matches any one of the electroencephalogram templates of the electroencephalogram template library;
determining the proportion of the number of the segmented electroencephalograms matched with any one electroencephalogram template to the number of all the segmented electroencephalograms;
determining that the user is currently going to wake up from sleep if the ratio is above a threshold.
2. The electronic device of claim 1, further comprising a data transmission module;
the data transmission module is used for receiving the whole body image of the user acquired by the camera;
the processor further configured to determine from the whole-body image whether the user is ready to fall asleep;
the brain wave sensor is also used for acquiring a second brain wave signal when the user is ready to fall asleep;
the processor is further used for determining the emotion type of the user according to the second brain wave signal;
the loudspeaker is further used for playing a second audio under the condition that the emotion type of the user is anxiety; the second audio is for soothing mood.
3. The electronic device of claim 1, further comprising a display screen;
the processor is further configured to query a work and rest schedule of the user to determine whether the current time is the time of the user falling asleep;
the processor is further configured to reduce a screen switching speed of the display screen if the display screen is in a lighting state under the condition that the current time is the sleep time of the user.
4. An audio playing method applied to an electronic device including a brain wave sensor, a processor, a memory, and a speaker, the method comprising:
controlling the brain wave sensor to acquire a first brain wave signal when the user is in a sleep state;
determining whether the user will wake up from sleep according to the first brain wave signal, including: generating an electroencephalogram of the user from the first electroencephalogram signal, determining a waveform feature period in the electroencephalogram of the user, dividing the electroencephalogram of the user into a plurality of segmented electroencephalograms according to the waveform feature period, comparing each segmented electroencephalogram of the plurality of segmented electroencephalograms with an electroencephalogram template in an electroencephalogram template library stored in the memory to determine whether the segmented electroencephalogram matches any one of the electroencephalogram templates in the electroencephalogram template library, wherein the electroencephalogram template library includes more than one electroencephalogram template, the more than one electroencephalogram template are each an electroencephalogram obtained in a case where the user is going to wake up from sleep, determining a ratio of the number of segmented electroencephalograms matching any one electroencephalogram template to the number of all segmented electroencephalograms, and in a case where the ratio is higher than a threshold, determining that the user is currently going to wake from sleep;
controlling the speaker to play a first audio with a preset volume if the user is going to wake up from sleep; the first audio is used for prolonging the sleeping time of the user;
the method further comprises the following steps:
acquiring the sleep condition of the user in a preset time period, and determining the frequency of insomnia of the user according to the sleep condition;
the controlling the speaker to play a first audio with a preset volume if the user is going to wake up from sleep comprises: and under the condition that the frequency of the insomnia of the user is higher than a threshold value, if the user wakes up from sleep, the first audio is played by utilizing the preset volume.
5. The method of claim 4, wherein the electronic device further comprises a data transmission module;
the method further comprises the following steps:
controlling the data transmission module to receive the whole body image of the user acquired by the camera;
determining from the whole-body image whether the user is ready to fall asleep;
controlling the brain wave sensor to acquire a second brain wave signal in a case where the user is ready to fall asleep;
determining the emotion type of the user according to the second brain wave signal;
playing a second audio in case the mood type of the user is anxious; the second audio is for soothing mood.
6. The method of claim 4, wherein the electronic device further comprises a display screen;
the method further comprises the following steps:
inquiring the work and rest time table of the user to determine whether the current time is the time of falling asleep of the user;
and under the condition that the current time is the time of falling asleep of the user, if the display screen is in a lighting state, reducing the picture switching speed of the display screen.
7. An audio output apparatus applied to an electronic apparatus including a brain wave sensor, a processor, a memory, and a speaker, the audio output apparatus including an acquisition unit, a determination unit, and an output unit, wherein,
the acquisition unit is used for controlling the brain wave sensor to acquire a first brain wave signal when the user is in a sleep state; the sleep state of the user in a preset time period is acquired;
the determination unit is used for determining whether the user wakes up from sleep according to the first brain wave signal; also used for determining the frequency of insomnia of the user according to the sleep condition;
the output unit is used for controlling the loudspeaker to play a first audio with a preset volume under the condition that the user wakes up from sleep; the first audio is used for prolonging the sleep time of the user and comprises the following steps: under the condition that the frequency of the insomnia of the user is higher than a threshold value, if the user wakes up from sleep, the first audio is played by utilizing the preset volume;
the determining unit is specifically configured to generate an electroencephalogram of the user according to the first electroencephalogram signal, and determine a waveform feature period in the electroencephalogram of the user; dividing the electroencephalogram of the user into a plurality of segmented electroencephalograms according to the waveform feature period; comparing each segmented electroencephalogram of the plurality of segmented electroencephalograms to an electroencephalogram template of a library of electroencephalogram templates stored in the memory to determine whether the segmented electroencephalogram matches any one of the library of electroencephalogram templates, wherein the library of electroencephalogram templates includes more than one electroencephalogram template, the more than one electroencephalogram template being an electroencephalogram obtained if the user is to wake up from sleep; determining the proportion of the number of the segmented electroencephalograms matched with any one electroencephalogram template to the number of all the segmented electroencephalograms; determining that the user is currently going to wake up from sleep if the ratio is above a threshold.
8. An electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 4-6.
9. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any of the claims 4-6.
CN201810281877.0A 2018-03-30 2018-03-30 Electronic device, audio playing method and related product Expired - Fee Related CN108594993B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810281877.0A CN108594993B (en) 2018-03-30 2018-03-30 Electronic device, audio playing method and related product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810281877.0A CN108594993B (en) 2018-03-30 2018-03-30 Electronic device, audio playing method and related product

Publications (2)

Publication Number Publication Date
CN108594993A CN108594993A (en) 2018-09-28
CN108594993B true CN108594993B (en) 2021-08-06

Family

ID=63624021

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810281877.0A Expired - Fee Related CN108594993B (en) 2018-03-30 2018-03-30 Electronic device, audio playing method and related product

Country Status (1)

Country Link
CN (1) CN108594993B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102526875A (en) * 2012-01-09 2012-07-04 中山大学附属第一医院 Digital insomnia therapy instrument and therapy method
CN104699248A (en) * 2015-03-24 2015-06-10 小米科技有限责任公司 Electronic equipment, device and method for control of audio play
CN105278666A (en) * 2014-12-16 2016-01-27 维沃移动通信有限公司 Method and device for obtaining work and rest time of users
CN105528067A (en) * 2014-10-20 2016-04-27 上海聚然智能科技有限公司 A wearable apparatus having an owner mood judging function
CN105749402A (en) * 2016-02-24 2016-07-13 陕西科技大学 Deep hypnosis system and method based on feedback mechanism
CN106295559A (en) * 2016-08-08 2017-01-04 京东方科技集团股份有限公司 Method, fingerprint identification device and the display device that a kind of data process
CN107122789A (en) * 2017-03-14 2017-09-01 华南理工大学 The study focus analysis method of multimodal information fusion based on depth camera

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101569569B (en) * 2009-06-12 2011-05-11 东北大学 Interface system of human brain and manipulator in micro-power wireless communication mode
CN105867641A (en) * 2016-05-12 2016-08-17 深圳市联谛信息无障碍有限责任公司 Screen reading application instruction input method and device based on brain waves
CN107132915B (en) * 2017-04-19 2021-01-29 西北工业大学 Brain-computer interface method based on dynamic brain function network connection
CN107456227B (en) * 2017-08-16 2021-03-30 北京蓬阳丰业医疗设备有限公司 Full-lead electrocardiogram clustering template system and method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102526875A (en) * 2012-01-09 2012-07-04 中山大学附属第一医院 Digital insomnia therapy instrument and therapy method
CN105528067A (en) * 2014-10-20 2016-04-27 上海聚然智能科技有限公司 A wearable apparatus having an owner mood judging function
CN105278666A (en) * 2014-12-16 2016-01-27 维沃移动通信有限公司 Method and device for obtaining work and rest time of users
CN104699248A (en) * 2015-03-24 2015-06-10 小米科技有限责任公司 Electronic equipment, device and method for control of audio play
CN105749402A (en) * 2016-02-24 2016-07-13 陕西科技大学 Deep hypnosis system and method based on feedback mechanism
CN106295559A (en) * 2016-08-08 2017-01-04 京东方科技集团股份有限公司 Method, fingerprint identification device and the display device that a kind of data process
CN107122789A (en) * 2017-03-14 2017-09-01 华南理工大学 The study focus analysis method of multimodal information fusion based on depth camera

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
脑电信号的特征提取与分析方法研究;戴冷湜;《中国优秀硕士学位论文全文数据库》;20110715(第7期);18-20 *

Also Published As

Publication number Publication date
CN108594993A (en) 2018-09-28

Similar Documents

Publication Publication Date Title
CN109464130B (en) Sleep assisting method, system and readable storage medium
US11393584B2 (en) System and method for adapting alarms in a wearable medical device
US10366778B2 (en) Method and device for processing content based on bio-signals
CN107360327B (en) Speech recognition method, apparatus and storage medium
US8781791B2 (en) Touchscreen with dynamically-defined areas having different scanning modes
US8768648B2 (en) Selection of display power mode based on sensor data
CN110377153B (en) Wearable device multi-mode system
US8751194B2 (en) Power consumption management of display in portable device based on prediction of user input
JP6365939B2 (en) Sleep assist system
US8519835B2 (en) Systems and methods for sensory feedback
KR102143499B1 (en) Method and apparatus for quality measurement of sleep using a portable terminal
US10123735B2 (en) Electronic device for determining sleep state and method of controlling same
CN106847307B (en) Signal detection method and device
CN108874130B (en) Play control method and related product
CN104102348A (en) Control system and method of electronic device
CN108388340A (en) Control method of electronic device and Related product
CN108837271B (en) Electronic device, output method of prompt message and related product
WO2022025678A1 (en) Electronic device for evaluating sleep quality and method for operation in the electronic device
CN109669546B (en) Music playing control method and device and computer readable storage medium
CN108304076B (en) Electronic device, video playing application management method and related product
CN108594993B (en) Electronic device, audio playing method and related product
CN108418959A (en) Electronic device, the method and Related product for exporting prompt message
CN108491074B (en) Electronic device, exercise assisting method and related product
CN112130664B (en) Intelligent noise reduction method, intelligent wake-up method and device using same
CN108600502B (en) Electronic device, dialing method and related product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210806

CF01 Termination of patent right due to non-payment of annual fee