CN116339509B - A control method and control device for intelligent terminal equipment - Google Patents
A control method and control device for intelligent terminal equipmentInfo
- Publication number
- CN116339509B CN116339509B CN202310210703.6A CN202310210703A CN116339509B CN 116339509 B CN116339509 B CN 116339509B CN 202310210703 A CN202310210703 A CN 202310210703A CN 116339509 B CN116339509 B CN 116339509B
- Authority
- CN
- China
- Prior art keywords
- information
- user
- processor
- functional module
- sleep state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/08—Measuring devices for evaluating the respiratory organs
- A61B5/0816—Measuring devices for examining respiratory frequency
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4806—Sleep evaluation
- A61B5/4809—Sleep detection, i.e. determining whether a subject is asleep or not
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4863—Measuring or inducing nystagmus
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Surgery (AREA)
- Public Health (AREA)
- Pathology (AREA)
- Veterinary Medicine (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Pulmonology (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Physiology (AREA)
- Anesthesiology (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
本发明涉及一种智能终端设备的控制方法及控制装置，装置包括处理器，处理器被配置为：接收由终端设备采集的声音信息，从声音信息中提取呼吸频率信息，在基于呼吸频率信息判断用户进入睡眠状态后，以限定音量差值第一次降低当前功能模块的播放音量，在播放音量调低后的第一限定时间内智能终端设备没有检测到任何输入的指令信息的情况下，以阶梯音量的方式逐步降低播放音量，在播放音量低至关闭阈值范围内时直接关闭功能模块；在用户对于功能模块的刺激信息产生的微变化没有反馈的情况下，按照预设的控制指令向功能模块发送控制信息，从而按照预设的方式控制功能模块。本发明仅通过采集呼吸信息判断用户进入睡眠状态，进而关闭指定的功能。
The present invention relates to a control method and control device for an intelligent terminal device, the device including a processor, the processor being configured to: receive sound information collected by the terminal device, extract respiratory rate information from the sound information, and after determining that a user has entered a sleep state based on the respiratory rate information, reduce the playback volume of the current functional module for the first time by a limited volume difference; if the intelligent terminal device does not detect any input instruction information within a first limited time after the playback volume is reduced, gradually reduce the playback volume in a stepped volume manner, and directly shut down the functional module when the playback volume falls below a shutdown threshold; if the user does not provide feedback on micro-changes in stimulation information generated by the functional module, send control information to the functional module according to a preset control instruction, thereby controlling the functional module in a preset manner. The present invention determines that a user has entered a sleep state by only collecting respiratory information, and then shuts down a specified function.
Description
The invention relates to a control system and a control method based on sleep perception, which are applied for patent application number 202110701370.8, applied for day 2021, month 06 and 25, and applied for patent application type.
Technical Field
The invention relates to the technical field of sleep perception, in particular to a control method and a control device of intelligent terminal equipment.
Background
Before sleeping, people listening to music, video and the like using mobile phones are increasing, but unknowingly sleeping situations are common, and at this time, the music and the video are still in a playing state. This causes the intelligent terminal to consume a lot of power and even wake up the user again. Therefore, it is necessary to automatically close applications such as music, video, etc. after the user enters a sleep state.
Currently, a timing closing mode is generally adopted to control closing of music, video and other modes. However, some users do not go to sleep at regular time, and some users go to sleep faster, but are again awake by audio and video which are not turned off after sleeping. How to personalize the application functions such as closing audio and video according to sleep perception is a technical problem which has not been solved yet.
In the prior art, even the sleep state of a user is detected by means of devices such as an intelligent sensing mattress and an intelligent watch, so that the terminal equipment indirectly acquires the sleep state of the user, but the intelligent sensing mattress, the intelligent watch and other matched devices are required to be configured by the user, so that the cost for the intelligent equipment to sense the sleep state of the user is increased, and the personalized closing of audio and video based on sleep sensing at any sleeping place of the user is also not facilitated.
For example, chinese patent CN111772583a discloses a sleep monitoring analysis method, device and electronic equipment of an intelligent sound box, which relate to the technical fields of artificial intelligence, computer vision and voice interaction. The method comprises the steps of obtaining multi-frame images and audio frequency acquired by an intelligent sound box when a user sleeps, generating an image curve of the user sleeping according to the multi-frame images, generating an audio curve of the user sleeping according to the audio frequency, obtaining sleep quality information of the user according to the image curve and the audio curve, and outputting the sleep information of the user, wherein the sleep information comprises at least one of the image curve, the audio curve, the sleep quality information of the user, the image of the user sleeping and the audio frequency of the user sleeping. The method and the device enable the user to know the detailed change process of the sleep condition and the external factors influencing the sleep, so that the user can be helped to better find a method for improving the sleep, the experience of the user is greatly improved, and the problem that the sleep quality of the user cannot be influenced when the audio and video are closed is not solved.
For example, chinese patent CN109920532B discloses a control method of a medical wearable device with sleep function, the invention wears VR device on the head of a user, the device camera corresponds to the eyes, the VR device camera identifies the series of eye movements and matches the feature data, the feature data matched in S2 is processed and converted into control signals to be sent to a processing center, the VR device is controlled to play corresponding video data according to different scene states in S3, after the sleep signal is matched in S2, the processing center controls the VR device to be turned off, the invention identifies the series of eye movements of the user by using the eye capturing system and matches the feature data in the feature library, and by identifying and matching the excited eye features, the calm eye features, the manic eye features, the heart hurt eye features and the sleep eye features, the different image quality are adjusted, the user is helped to get into sleep in time, and the invention has strong practicability. Although the device can correspondingly close the audio and video after detecting the sleep state of the user, the user must wear the VR equipment, which can certainly influence the sleep of the user, and the intelligent equipment which is not portable by the user is convenient and fast to automatically close the audio and video function based on the sleep state.
For example, chinese patent CN105407217a discloses a method for playing music on a mobile terminal, where the method includes starting a sound recording device when the mobile terminal is detected to play music, acquiring a respiratory rate of a user through the sound recording device, determining a work and rest state of the user according to the acquired respiratory rate of the user, where the work and rest state includes a sleep state and an awake state, and switching a music playing mode to a sleep playing mode if the work and rest state is the sleep state. The embodiment of the invention also discloses a mobile terminal for realizing the method. According to the embodiment of the invention, the music playing is managed according to different sleep states of the user, so that the mobile terminal is more intelligent and humanized, and the experience of the user on the music playing of the mobile terminal is greatly improved. However, in this technical solution, the acquisition of the respiratory information is achieved through the voice input device, and according to common knowledge, in a daily use environment, there is a lot of noise interference around an ordinary user (this is also one of the main reasons that some existing mobile terminals have a call noise reduction function), a lot of voice signals exist in the voice collected by the mobile terminal, and the voice input device cannot directly acquire the respiratory information related to sleeping from the lot of voice signals. Therefore, there is a significant error between the breathing frequency obtained from the sound signal collected by the mobile terminal and the actual breathing frequency of the user, and based on the existence of this error, the result of determining the obtained sleep state by means of the frequency threshold is also inaccurate.
For example, chinese patent CN107743289A discloses an intelligent sound box control method in an intelligent home scene, which comprises the steps of firstly judging whether the current time is sleep time based on biological clock information of a user, actively judging whether the user is in a sleep state only in the sleep time, and passively judging whether the user is in the sleep state outside the sleep time, so that the judgment times are reduced, the efficiency of voice prompt is improved, and the user experience is improved. Finally, in order to avoid the inconvenience of repeated setting and adjustment of the time length caused by setting the fixed cycle detection time length, the invention sets the random time length in the specific time range, thereby improving the cycle detection efficiency and further improving the user experience. However, the technical scheme firstly needs to limit the implementation within the time corresponding to the biological clock to execute the process of adjusting and closing the sound. In addition, the sound equipment is in a normal working condition, and feedback information of a user cannot influence the control process of the sound equipment. However, the biological Zhong Youchen physiological clock, which is an intangible "clock" within the living organism, is actually the intrinsic rhythmicity of the living organism's vital activity, and is determined by the temporal structural order within the living organism. Biological clocks typically have a certain regularity, usually belonging to a default fixed setting, without randomness like sound information. According to the technical scheme, the control process of adjusting and closing the intelligent sound is limited in a fixed time zone, and the sleep state of a user in the time zone is not determined in practice, so that normal people cannot always guarantee to accurately enter the sleep state at a specified time point.
Therefore, how to make the intelligent terminal device, such as a mobile phone, determine the sleep state directly through sensing the breathing sound of the human, and further close the functions of audio and video are still unresolved technical problems in the prior art.
Furthermore, since the inventors herein have studied numerous documents and patents, on the one hand, and have not set forth in detail all the details and content of the invention for the purpose of understanding the differences to those skilled in the art, on the other hand, the invention is by no means lacking in the features of the prior art, but rather the invention has all the features of the prior art, and the applicant retains the right of the prior art in the background of this invention.
Disclosure of Invention
In the prior art, the terminal intelligent device must determine the sleep state of the user by means of the collected blood pressure information, pulse information and breathing information, so that the intelligent terminal device such as a mobile phone which does not have the functions of collecting the pulse information, the sleep information and the like must be connected with the device with the corresponding function to monitor the sleep state and perform personalized control, and the user must carry a plurality of functional devices, otherwise, the sleep state cannot be monitored. For example, an existing smart watch needs to maintain continuous bluetooth signal connection with a smart phone to realize sleep state monitoring. Therefore, a user only provided with the smart phone cannot accurately judge the sleep state by collecting the breathing information and close the played audio and video functions according to the sleep state. Moreover, when the user plays audio or video by using the intelligent terminal equipment, a large amount of noise affecting the breathing information can be generated, and the difficulty of the breathing information identification and extraction is further improved.
Therefore, how to accurately judge whether the user enters a sleep state and close the played audio/video only through the breathing sound is a technical problem which is not solved at present. The current filtering of respiratory sounds to obtain accurate respiratory information is also an unresolved technical problem.
The control system provided by the invention can enable the intelligent terminal equipment to process the breathing information to obtain personalized breathing sound only by collecting the breathing information, so that the user is judged to enter a sleep state according to the breathing sound, and then the appointed function is closed. The invention can realize the technical effect of controlling closing by the intelligent terminal equipment with the sound collecting function, simplifies the use condition of user control, and ensures that the user realizes the control of audio and video in sleeping by the simple intelligent terminal equipment, such as intelligent terminal equipment with microphones, for example, intelligent mobile phones, desktops, notebook computers, tablet computers and the like.
In order to overcome the defects of the prior art, the invention provides a control system based on sleep perception, which comprises at least one processor, wherein the processor is connected with at least one terminal intelligent device and is configured to receive sound information collected by at least one audio collection module, extract at least one breathing frequency information from the sound information, identify a sleep state based on an extraction model and the breathing frequency information, and send preset instruction information to at least one associated functional module in a specified sleep state. The control system provided by the invention eliminates the defect that the sleep state is accurately judged after the object characteristic information is acquired through the third equipment or the control system, so that the intelligent terminal equipment can determine the sleep state only by acquiring the breathing sound, and can determine whether a user sleeps well or not through the perception of stimulus micro-variation in sleep, the error of inaccurate detection is reduced, and the control system can accurately judge the sleep state and close the functional module according to a preset instruction.
Preferably, the processor is further configured to send a stimulus information micro-change instruction to the running at least one functional module to test the sleep perception of the user in a manner that controls the stimulus information of the functional module to generate micro-changes, in case it is determined that the user enters a sleep state.
Preferably, the processor is further configured to send control information to the function module according to a preset control instruction in case that the user has no feedback on the micro-variation of the stimulus information of the function module, so as to control the function module in a preset manner.
Preferably, the processor is further configured to restore the micro-varied stimulation information of the controlled functional module in case there is feedback of the micro-variation generated by the stimulation information of the functional module by the user.
Preferably, the processor is further configured to control the functional module in accordance with a trend of decreasing the stimulus intensity of the stimulus information, thereby forming a sleep perception test that does not obstruct sleep.
Preferably, the processor is further configured to form and update the personalized frequency sample based on the current respiratory frequency information in the event that the user enters a sleep state and there is no feedback on the micro-variation of the stimulation information of the currently running functional module.
Preferably, the processor is further configured to, after the user enters the sleep state, generate feedback information after the stimulus information of the current operation module is changed slightly, wherein the feedback information at least comprises movement information, input instruction information and/or action information of the intelligent terminal device.
The invention also provides a control method based on sleep perception, which at least comprises the following steps:
receiving sound information acquired by at least one audio acquisition module;
at least one breathing frequency information is extracted from the sound information,
Identifying a sleep state based on the extraction model and the respiratory frequency information;
And sending preset instruction information to at least one associated functional module in the appointed sleep state.
Preferably, the method at least comprises the steps of sending a stimulation information micro-change instruction to at least one functional module to be operated under the condition that the user is determined to enter a sleep state, and testing the sleep perception of the user in a mode of controlling the stimulation information of the functional module to generate micro-change.
Preferably, the method at least comprises the step that the processor sends control information to the functional module according to a preset control instruction under the condition that the user does not have feedback on the micro-change generated by the stimulation information of the functional module, so that the functional module is controlled according to a preset mode.
Drawings
Fig. 1 is a logic diagram of a sleep awareness based control system of the present invention.
List of reference numerals
10 Parts of breath collection module, 20 parts of processor, 21 parts of database and 30 parts of function module.
Detailed Description
The following detailed description refers to the accompanying drawings.
The invention provides a control system and a control method based on sleep perception, and also provides a self-defined control system based on respiratory rate and portable intelligent terminal equipment. The sleep perception-based control system provided by the invention can remove one or more types of noise and vibration information while keeping the respiratory information, so that the accurate information of the respiratory frequency is extracted.
The intelligent terminal equipment in the invention is a using equipment which has wireless access to the Internet, can process partial data, display and execute corresponding data function. The smart terminal device is, for example, a smart product such as a smart phone, an Ipad, a player, a computer, etc. capable of operating based on data instructions. The intelligent terminal equipment can be provided with a sound collecting device by itself or can be connected with the sound collecting device to collect breathing sounds of a user. The sound collection device is for example a microphone.
Preferably, a microphone of the intelligent terminal device is coupled with a loudspeaker device, so that breathing information of a user can be further clearly acquired.
The processor of the present invention represents one or more general-purpose devices such as microprocessors, central Processing Units (CPUs), application specific integrated chips, and the like.
The breathing information of the present invention is breathing sound information such as breathing sounds, snoring sounds, etc. The respiratory rate information refers to the rate at which a user completes a breath, and the period refers to the time it takes for the user to complete a breath.
The control system based on sleep perception can be installed and operated in intelligent terminal equipment or establish data connection with the intelligent terminal equipment.
The breathing of a user differs from other noise in that the sound of breathing is periodic, regular, and the breathing frequency is in a specific range. For example, the breathing rate varies between 0.15 and 0.4 times per second.
The acquisition module comprises a sound acquisition module and an acceleration sensor. The acquisition module is a part of intelligent terminal equipment. The acquisition module is capable of acquiring corresponding information based on instructions of the processor.
Preferably, the control system of the present invention further comprises a database. The database is used to store acquired respiratory information as well as time, store instructions associated with the neural network, and extract process data of respiratory rate from the respiratory information. The processor reads data from the database, or the processor sends the data in the processing process to the database for storage.
The database is preferably a memory. Memory represents any type or form of volatile or non-volatile storage device or medium capable of storing data and/or other computer-readable instructions. The memory includes, but is not limited to, RAM, ROM, flash memory, or any other suitable storage device. The memory can be coupled to the processor or can be arranged in signal connection with the processor.
Preferably, the processor may further comprise a memory control module, an input/output (I/O) controller, and a communication interface, each of which may be interconnected via a communication infrastructure.
Examples of communication infrastructure include, but are not limited to, communication buses (e.g., industry Standard Architecture (ISA), peripheral Component Interconnect (PCI), PCI Express (PCIe), or similar buses) and networks.
I/O controllers represent any type or form of module capable of coordinating and/or controlling the input and output functions of a computing device. The I/O controller may control or facilitate the transfer of data between one or more elements of the processor.
A communication interface represents any type or form of communication device or adapter capable of facilitating communication between a processor and one or more additional devices.
Fig. 1 is a schematic diagram of an embodiment of a control system according to the present invention. As shown in fig. 1, the sleep perception based control system includes at least a processor 20. The processor 20 is connected to the acquisition modules 10, the database 21, and the functional module 30, respectively, to enable transmission of data information and instructions. The database 21 may drive and store data information by a storage drive such as a floppy disk drive, a magnetic tape drive, an optical disk drive, a flash memory drive, or the like.
Preferably, the intelligent terminal device is provided with a terminal display module. The terminal display module is connected with the processor in a wired or wireless mode, and the terminal display module is connected with the acquisition module in a data mode. And the terminal display module sends the control instruction to the functional module. The terminal display module can display the acquired information such as movement information, respiratory frequency information, sleep time, first time, second time, stimulation information micro-change mode, closing or pause time and the like. The terminal display module can display information in various modes such as charts or curves.
The functional module of the invention is a module which is arranged in the intelligent terminal equipment and can be used for adjusting and opening and closing various execution functions based on instructions of a processor. The functional modules are, for example, several modules such as an audio player, a video player, a power on/off module, a lamp adjusting and on/off module, and on/off and adjusting of each application module.
As shown in fig. 1, the sleep perception based control system of the present invention includes at least a processor configured to:
receiving sound information acquired by at least one audio acquisition module;
at least one breathing frequency information is extracted from the sound information,
Identifying a sleep state based on the extraction model and the respiratory frequency information;
And sending preset instruction information to at least one associated functional module in the appointed sleep state.
The respiratory frequency information extraction model can be simply called as an extraction model, is established based on a deep learning model and is used for extracting respiratory frequency information. The deep learning model is, for example, a convolutional neural network model.
Preferably, an analog filter is further arranged in the processor and is used for amplifying the received breathing information, so that the missing breathing sound with smaller sound is avoided.
Preferably, an acceleration sensor in the intelligent terminal device is connected to the processor and collects movement signals of the intelligent terminal device. The movement signal includes a movement speed of the audio-video in the three-dimensional space.
The processor extracts respiratory rate information from the amplified sound information. The processor eliminates noise and audio/video sounds without periodicity from the sound information to obtain respiration information with periodicity.
Preferably, the processor is further provided with an analog gain module, which is used for covering the breathing range by an analog gain of 10-100 times. Preferably, the processor is also capable of interfacing hardware that implements a gain, such as a filter, to limit the frequency response of the signal to a respiratory frequency range.
Preferably, the analog gain module sends the filtered breathing information to the extraction module.
The mode of the analog filter in the processor for linearly filtering the sound information is as follows:
The signal quality for linear filtering, y [ n ], is determined by the error sequence, e [ n ] = d [ n ] -y [ n ]. Where n represents the frequency of the mixed sound and m represents the sound exceeding the specified frequency range. Omega m denotes the weight and x denotes the acquired data value.
Preferably, the weights are selected to obtain a minimum mean square error in the following manner:
E{e2[n]}＝E{d[n]-y[n]2}
The way to calculate the selection weights for the linear filtering is:
according to the orthogonality principle, when the error e [ n ] and the data value are zero, the following is obtained:
E{x[n-k](d[n]-y[n])}=0,k=0,1,...,M-1
the effect of the linear filtering is optimal at this time.
Preferably, the weight module in the processor can also obtain the correct weight through training based on a training algorithm.
After the processor filters the acquired original sound information to eliminate noise caused by audio/video or other sounds, the respiratory information formed after the filtering is extracted in respiratory frequency. The respiratory information at this time is not completely noiseless and contains a small portion of noise, so the extraction module is required to perform further extraction based on a deep learning algorithm.
Preferably, the manner in which the processor extracts the respiratory rate information includes:
a respiratory frequency information extraction model is established,
Comparing the first respiration rate extracted by the respiration rate information extraction model with the verifiable respiration rate of the first test object to calculate an error;
Front-end parameters of one or more layers of the extraction model are reversely adjusted based on the calculation errors to improve prediction accuracy of the extraction model.
After acquiring the respiratory rate information, the processor determines whether the user enters a sleep state or not, and even determines which stage of the sleep stage the user enters, based on the respiratory rate information.
Preferably, the respiratory information signal has the following relation:
The respiratory information signal, after being brought in by the transmission delay information, is expressed as:
Finally, the relationship of the mixed acquired respiratory information received by the acquisition module is as follows:
Wherein the frequency f b is directly related to the distance between the object and the acquisition module and the distance b is related to the speed of the object. The frequency f b and the distance b are calculated by a fourier transform algorithm.
For the vital signs of the user, the frequency f b can be used to determine the distance interval of the user, and the distance b can reflect the displacement change of the user's sound source.
Preferably, the processor is capable of de-manizing the data of the respiratory information prior to extracting the respiratory rate. For example, normalization is performed by the equation f (x) = (x- μ)/σ, where μ represents the average value of the waveform and σ represents the standard deviation.
Other components in the sound information signal and unwanted frequencies can also be removed by de-noising the received respiratory information. For example, the breathing rate varies between 0.15 and 0.4 per second. Other frequencies not in the respiratory frequency range can be eliminated.
In the extraction model, the convolutional neural network model can be a two-layer convolutional model and can be expanded to more than two layers.
Each convolution layer includes a one-dimensional convolution layer and a pooling layer. The one-dimensional convolution layer effectively derives notable features from shorter segments of the entire dataset, and the locations of the features in the segments are not highly correlated. The one-dimensional convolution layer can export any type of signal data within a fixed length period, and thus can improve the efficiency of data screening and export. Thus, convolutional neural networks are trained using one-or two-dimensional convolutional layers at each layer. Pooling processing by the pooling layer after convolutional layer data processing can reduce the complexity of the output and prevent data overfitting.
Preferably, the size of the pooling layer is set to 3 to indicate that the size of the output matrix is only one third of the input matrix. The pooling layer is to reduce the input size by mapping the size of the defined window to a single result by taking the maximum of the elements in the window.
The processor is configured to:
And discretizing the waveform information of the input three-dimensional training extraction model, thereby improving the signal-to-noise ratio.
The data fitting of the respiration information can reduce the influence of small fluctuations in the data on the extraction model, and the small fluctuations are noise in general.
Preferably, the processor is further configured to:
the data output by the convolutional layer is directed to an average pooling layer. The average pooling layer is another pooling layer for avoiding overfitting. The averaging pooling layer transforms the matrix of convolutional network outputs into a single vector.
In the invention, the processor adjusts and controls the functional module according to the preset instruction after determining that the user enters the sleep state.
Preferably, the extraction model in the processor compares the extracted respiratory rate information with the respiratory rate samples, and on the basis that the respiratory rate samples are correspondingly associated with the sleep states, the processor obtains the corresponding sleep states according to the respiratory rate information.
The breath frequency samples in the present invention include an initial frequency sample and a personalized frequency sample. The initial frequency samples are set based on sample set data associated with sleep states for respiratory frequency characteristics of the population.
The personalized frequency sample is formed by personalized adjustment of the initial frequency sample based on the personalized breathing characteristics of the user, so that information related to the personalized frequency sample and the sleep state is formed.
Preferably, the initial frequency sample and sleep state related information in the extraction model are preset, and can be provided by a third-party data platform, or can be learned and obtained based on a deep learning model in advance according to sleep experiments of a plurality of sample groups.
The initial frequency samples are associated with sleep states as follows:
In the different sleep stages, there is a significant difference in the respiratory rate of the sleep state of the user, in the rapid eye movement sleep stage (REM), the brain wave changes rapidly, and the sleeper often has rapid eye jump phenomenon and dreams in the stage, so the respiratory rate of the sleeper is often unstable in the stage. During the light sleep stage (LIGHT SLEEP), the eye jump stops and the sleeper's breathing rate stabilizes. During the deep sleep stage (DEEP SLEEP), the sleeper's breathing rate is further slowed. Therefore, the magnitude of the breathing rate varies with the stage of sleep in which the sleeper is positioned.
The sound collection module collects breathing sound data according to the sampling frequency of 8KHz, and the breathing sound data is divided into N groups of data according to every 400 sample points. N represents the number of groups of sample points sampled, the sampling frequency being 8kHz. The time interval of 400 sample points is 0.05s.
After the voice of the audio and the video is filtered through linear filtering and respiratory information is formed, the respiratory frequency information is extracted according to the extraction model.
The invention does not need to monitor the sleep state of the user in the whole process, and can close the appointed functional module only by determining that the user enters the sleep state initial stage. However, how to accurately determine that the user enters the sleep state only through analysis of the breathing sounds, and to turn off the functional module that plays in a manner that does not affect the user's sleep feel, is important and difficult in the prior art.
When the user enters a sleep state and closes the function module, particularly when the audio and video which the user is watching or listening to are closed, if the user enters the sleep state only quickly if the user closes too early, the user can wake up due to environmental change due to the closing of the function module, and the reaction effect is achieved. If the switch-off is too late, the function of the sleep perception control function module is lost.
Based on this deficiency, the processor tests the user's perception level in a sleep state in a test mode. And controlling the functional module when the perception level of the user is reduced to a preset level. The invention tests the perception level of the user through the test mode so as to regulate and control the functional module in a mode of not influencing the sleeping feeling of the user, and even close the functional module.
The test mode in the invention tests the perception level of the user in a mode of micro-variation of the stimulus information. The stimulus in the invention refers to the stimulus of the modes of sound stimulus, visual stimulus, playing progress stimulus, playing content change and the like which are presented by the intelligent terminal equipment when the user uses the function module. Whereas the user of the present invention is in a sleep state or near sleep state, the micro-variation of the stimulus information in the present invention means a sensory stimulus that does not stimulate the user to be awake. The micro-change of the stimulus information is to finely adjust and change the stimulus applied by the functional module, and new stimulus is not added to avoid waking up the user.
Preferably, the implementation of the micro-variation of the stimulation information of the processor includes at least the following.
After judging that the user enters a sleep state based on the respiratory frequency information, the processor reduces the playing volume of the current functional module for the first time according to the limiting volume difference value, and under the condition that the intelligent terminal equipment does not detect any input instruction information within the first limiting time after the playing volume is reduced, the processor gradually reduces the playing volume in a step volume mode, and directly closes the functional module when the playing volume is reduced to be within a closing threshold range. The stepwise decrease of the playing volume will not bring new stimulation information to the user.
When the user does not enter the sleep state completely, the perception capability of the user is strong, the experience is necessarily deteriorated due to the reduction of the playing volume, and the user can move the intelligent terminal equipment or input related instructions or action signals to check. When the processor detects a moving signal acquired by an acceleration sensor in the intelligent terminal device, or an action signal of related input equipment, or an input instruction, the processor controls the functional module to resume playing volume.
After the user enters a sleep state, the perception capability of the user is weakened, the processor reduces the playing volume of the current functional module for the first time by limiting the volume difference, the intelligent terminal device cannot be moved under the condition that the user does not perceive, or an input device cannot be used for inputting an action signal to check the change of the functional module, and an instruction cannot be input, so that the processor cannot receive a moving signal acquired by an acceleration sensor, or an action signal of a related input device, or an input instruction, at the moment, the processor can reduce the playing volume for the second time, and the processor can close or pause the currently-appointed functional module under the condition that no interference information is still received within the second limiting time.
In the present invention, the operation signal of the input device is, for example, a touch screen operation signal, a mouse movement signal, a keyboard operation signal, or the like. Input instruction refers to any input instruction information.
After determining that the user enters a sleep state based on the respiratory rate information, the processor detects a perception of the user in a manner in which the functional module is suspended. For example, the playing contents of the audio module and the video module are temporarily played, and the processor sends a preset control instruction to at least one functional module when no input instruction information is detected within a third limited time. The control instructions comprise instructions preset by a user for closing a specified functional module, suspending, shutting down and the like.
And if the movement information of the intelligent terminal equipment, any input instruction information and the action signal of the input equipment are detected within the third limiting time, the processor sends an instruction for recovering operation to the regulated functional module.
Preferably, the processor detects the perception of the user by at least once pausing the function module. Preferably, the processor detects the perception of the user by means of a two or three-time pause of the functional module.
After detecting the perception and detecting the user feedback by once pausing the function module, the processor again judges whether the user enters a sleep state based on the current respiratory frequency information. And repeating the sensing detection after the user enters the sleep state.
Preferably, the processor is further capable of detecting a perception of the user by altering the way the content is played after determining that the user enters a sleep state based on the respiratory rate information. Preferably, the processor alters the play content in accordance with a trend that aids sleep. For example, changing the playing music content to light music without lyric content which is helpful for sleeping, changing the playing video content to atmosphere-relaxing video content which is helpful for sleeping, such as news video, access video, and the like, which is not easy to cause sensory stimulation.
After changing the playing content, the processor sends a preset control instruction to at least one functional module under the condition that any input instruction information or moving signal is not detected within the fourth limiting time. The control instructions comprise instructions preset by a user for closing a specified functional module, suspending, shutting down and the like.
And if the movement information of the intelligent terminal equipment, any input instruction information and the action signal of the input equipment are detected within the fourth limiting time, the processor sends an instruction for recovering operation to the regulated functional module.
Preferably, in the case where the processor controls the function module to be suspended, the processor can control the function module to display a still picture or a problem. For example, the text content of the display screen is that the play function is about to be turned off, or the display screen is covered by using a certain screen. And under the condition that the user does not feed back any signal in the fifth limiting time, the processor judges that the user perception is weak and enters a sleep state, so that a preset control instruction is executed.
The stimulation information micro-variation according to the present invention is not limited to the above-described modes, and can be implemented to achieve the same effect.
The test mode of the invention can also be used for adaptively adjusting the initial frequency sample of the breathing frequency to form a personalized frequency sample.
The processor can take the breathing frequency when the user feedback signal is not received as a personalized frequency sample of the user after the functional module is subjected to the control of the stimulation information micro-variation in the time period when the control system is used for the first time.
Along with the extension of the use time of the user and the increase of the detection times, the processor can extract and update the breathing frequency information which enters the sleep state when the user uses the functional modules of various types into personalized frequency samples, and store the personalized frequency samples at the same time, so that the personalized frequency samples in the database are more and more abundant. When the processor compares the extracted respiratory frequency information with the personalized frequency sample, the accuracy of judging whether to enter a sleep state is higher and higher, and forward circulation is formed.
After the control system is turned on, the processor sends instructions to the sound collection module to collect sound information and to the acceleration sensor to collect movement information. The processor receives the collected sound information and the mobile information of the intelligent terminal equipment.
The processor of the invention can also be a cloud server connected with the intelligent terminal equipment through a network. The control system is connected with the intelligent terminal equipment, the sound information and the movement information are collected by utilizing the components of the intelligent terminal equipment on the basis of not adding new hardware, and the perception of a user is detected based on the micro-change of the stimulus information of the functional module, so that the functional module can be controlled in a preset mode at proper time to save energy consumption and improve the sleeping quality of the user.
In the present invention, the breathing information includes an expiration sound, an inspiration sound and a snore sound. Snoring and breathing sounds share some common characteristics, and breathing sounds and snoring sounds share a similarity in waveform, both have periodicity, except that snoring sounds are larger than the average amplitude of the breathing sounds, since snoring sounds are generally larger than breathing sounds. The spectrograms show that the frequency distribution of the snore and the breathing sound are obviously different, the frequency distribution of the snore is concentrated in the low frequency range from 0Hz to 1000Hz, and the breathing sound is more distributed in the low frequency range and the high frequency range, so that whether the collected sound sample contains the snore or not can be judged according to the ratio of the low frequency range to the high frequency range.
Judging the existence of snore by utilizing the frequency range of the dominant position of the current respiratory sound, wherein f is used for representing a sound frame to be detected containing n sample points, s i is used for representing the ith data value after f is subjected to Fourier change, and then the ratio of a low frequency band to a high frequency band is expressed as follows:
when the user turns to snore from the normal breathing state, the sound frequency band gradually inclines to a low frequency, and the A (f) value gradually increases. By analyzing more than 100 different users' snoring data, it is defined that when the ratio of low frequency to high frequency becomes larger gradually and A (f) >1.5, the current user is in a snoring state, and otherwise, the current user is in a normal breathing state. I.e. when a (f) >1.5, it is determined that the user is snoring.
Preferably, since the processor of the present invention is able to distinguish snoring based on the above distinction. The processor of the present invention can also be configured to:
Under the condition that the processor determines that the user enters a sleep state and detects snore, the processor directly controls the functional module according to a preset instruction, and sleep perception detection is not carried out on the user. For example, some users will snore when they enter a sleep state, and at this time, sensory detection is not required for the users, and the processor can control the functional module to be directly turned off or paused, so as to avoid the functional module from continuously releasing the stimulation information to disturb the sleep of the users.
And under the condition that the processor determines that the user enters a sleep state and snore is not detected, the processor detects the micro change of the stimulus information of the user to detect the perception of the user, and under the condition that the perception of the user is weaker, the processor controls the functional module.
Preferably, the level of sleep perception of the present invention can be divided based on feedback of the user on the small changes in the stimulus information.
For example, the processor determines that the user is to enter a sleep state based on the respiratory frequency information. When the stimulus information is sound change, if the intensity of the sound is reduced by a first step range, the user does not have any feedback information or feedback action, and the sensory level of the user is first-order. When the user is detected to enter the sleep state for the second time, if the user does not have any feedback information or feedback action when the intensity of the sound is reduced by a second step range, the sensory level of the user is secondary, namely the sense is further weakened. The second step range is greater than the first step range. The first step range is 0-5 degrees, and the second step range is 5-10 degrees.
By the above way, the perception level of the user can be divided into a plurality of levels, and the specific division range and the level setting can be flexibly adjusted as required.
Preferably, the processor uses the mixed micro-variations of the stimulus information to determine the user's perception level. For example, for a video module that is played, the processor detects the perception of the user for the first time by masking the playing frame and not changing the sound. If the user does not have any feedback on the micro-variation of the first stimulus information, the sensory level is of the first order.
After the first stimulus micro-variation, the processor detects the perception level of the user a second time by controlling the sound of the video module, e.g. changing the intensity of the sound. If the user does not have any feedback on the micro-variation of the second stimulus information, the sensory level is of the second order.
After the second stimulus is slightly varied, the processor detects the perception level of the user for the third time by changing the sound content of the play content. Sound content such as volume video is replaced with song content. If the user does not have any feedback on the micro-change of the third stimulus information, the sensory level is three-level.
Obviously, in terms of sensory intensity, the primary sensory intensity corresponding to the primary sensory level is greater than the secondary sensory intensity, and the secondary sensory intensity is greater than the tertiary sensory intensity. When the sleep sensory level of the user enters the secondary or tertiary sensory intensity, the processor sends a pause or shut-off instruction to the video module.
As shown by way of example, the present invention is also capable of controlling the micro-variation of stimulus information from multiple aspects to form a detection of user perception. The invention aims to detect the perception of the micro-change of the stimulus information without disturbing the sleeping of a user.
Preferably, the processor determines at which level of sensory level to shut down or suspend operation of the functional module based on the sensory level of the user and corresponding feedback information.
For example, for a perception level, the user always has feedback on the detection of the primary sense during a first time period and no feedback on the detection of the secondary sense during a second time period. The processor adjusts based on the user's usage personalization. Starting timing after entering sleep state, and performing primary sensory detection when the first time is satisfied. And if the feedback is not performed in the preset feedback time, the processor performs secondary sensory detection when the second time is met. If the user has no feedback after the preset feedback time, the processor confirms that the sleep perception of the user is enough, and sends a closing or suspending instruction to the functional module. Wherein the second time period is longer than the first time period.
If the user has no feedback after the first time is met for a long time and the execution times exceed the preset times threshold, the processor can send a closing or suspending instruction to the functional module after the first-level sensory detection is completed and the feedback time is not preset.
If the user closes the functional module after the second time is met for a long time and the ratio of the execution times of the first-level sensory closing exceeds the preset ratio, the processor can skip the first-level sensory detection, directly perform the second-level sensory detection and control the functional module to be closed.
Therefore, the invention can reduce the influence on the sleep of the user under the condition of reducing the sensory stimulus, and simultaneously determines the perception attenuation degree of the user through the judgment of the respiratory frequency information and the sleep perception of the user, so that the pause or the closing of the functional module has no influence on the sleep of the user.
Preferably, when the respiratory rate information is completely strange respiratory rate information, the processor may store the new respiratory rate information and the determination result of the sleep state into the new account by establishing the new account, so as to facilitate the user to distinguish, and execute the control function of the preset function module.
It should be noted that the above-described embodiments are exemplary, and that a person skilled in the art, in light of the present disclosure, may devise various solutions that fall within the scope of the present disclosure and fall within the scope of the present disclosure. It should be understood by those skilled in the art that the present description and drawings are illustrative and not limiting to the claims. The scope of the invention is defined by the claims and their equivalents.
The present specification contains several inventive concepts, and applicant reserves the right to issue a divisional application according to each of the inventive concepts. The description of the invention encompasses multiple inventive concepts, such as "preferably," "according to a preferred embodiment," or "optionally," all means that the corresponding paragraph discloses a separate concept, and that the applicant reserves the right to filed a divisional application according to each inventive concept.
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310210703.6A CN116339509B (en) | 2021-06-25 | 2021-06-25 | A control method and control device for intelligent terminal equipment |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110701370.8A CN113448438B (en) | 2021-06-25 | 2021-06-25 | Control system and method based on sleep perception |
| CN202310210703.6A CN116339509B (en) | 2021-06-25 | 2021-06-25 | A control method and control device for intelligent terminal equipment |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110701370.8A Division CN113448438B (en) | 2021-06-25 | 2021-06-25 | Control system and method based on sleep perception |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116339509A CN116339509A (en) | 2023-06-27 |
| CN116339509B true CN116339509B (en) | 2025-10-24 |
Family
ID=77812386
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310210703.6A Active CN116339509B (en) | 2021-06-25 | 2021-06-25 | A control method and control device for intelligent terminal equipment |
| CN202110701370.8A Active CN113448438B (en) | 2021-06-25 | 2021-06-25 | Control system and method based on sleep perception |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110701370.8A Active CN113448438B (en) | 2021-06-25 | 2021-06-25 | Control system and method based on sleep perception |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN116339509B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113854983A (en) * | 2021-10-21 | 2021-12-31 | 南方医科大学南方医院 | A middle-aged and elderly sleep quality monitoring system and method |
| CN114732391B (en) | 2022-06-13 | 2022-08-23 | 亿慧云智能科技（深圳）股份有限公司 | Heart rate monitoring method, device and system in sleep state based on microwave radar |
| CN115120197B (en) * | 2022-06-17 | 2024-07-02 | 歌尔股份有限公司 | Method and device for monitoring breathing condition during sleep, electronic equipment and storage medium |
| CN115120837A (en) * | 2022-06-27 | 2022-09-30 | 慕思健康睡眠股份有限公司 | Sleep environment adjusting method, system, device and medium based on deep learning |
| CN121242492A (en) * | 2023-03-20 | 2026-01-02 | 首都医科大学宣武医院 | Household sleep monitoring and stimulating system and method |
| CN116570239A (en) * | 2023-04-14 | 2023-08-11 | 漳州松霖智能家居有限公司 | A snore detection method and device |
| TWI892383B (en) * | 2023-12-26 | 2025-08-01 | 瑞昱半導體股份有限公司 | Music automatic selection method and music automatic selection device |
| CN118873313B (en) * | 2024-09-23 | 2025-01-28 | 齐芯频顺半导体(杭州)有限公司 | An active loopback excitation and cancellation method |
| CN119048107B (en) * | 2024-10-29 | 2025-01-24 | 四川汉唐云分布式存储技术有限公司 | Online customer service distribution method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105407217A (en) * | 2015-10-26 | 2016-03-16 | 南京步步高通信科技有限公司 | Mobile terminal music playing method and mobile terminal |
| CN107517413A (en) * | 2017-10-24 | 2017-12-26 | 柴雪 | A kind of intelligent sound box and its control method |
| CN107743289A (en) * | 2017-10-25 | 2018-02-27 | 解君 | A kind of intelligent sound box control method in Intelligent household scene |
| CN110934566A (en) * | 2019-09-09 | 2020-03-31 | 精华隆智慧感知科技（深圳）股份有限公司 | Intelligent detection, automatic sleep-aiding and emergency alarm device |
| CN112998690A (en) * | 2021-03-29 | 2021-06-22 | 华南理工大学 | Pulse wave multi-feature fusion-based respiration rate extraction method |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9779751B2 (en) * | 2005-12-28 | 2017-10-03 | Breath Research, Inc. | Respiratory biofeedback devices, systems, and methods |
| US7862477B2 (en) * | 2006-07-28 | 2011-01-04 | Shala Cunningham | Method to evaluate a client by a physical therapist |
| US8740806B2 (en) * | 2012-11-07 | 2014-06-03 | Somnarus Inc. | Methods for detection of respiratory effort and sleep apnea monitoring devices |
| US9610030B2 (en) * | 2015-01-23 | 2017-04-04 | Hello Inc. | Room monitoring device and sleep analysis methods |
| CN105807674B (en) * | 2014-12-30 | 2021-05-04 | 北京奇虎科技有限公司 | An intelligent wearable device capable of controlling an audio terminal and a control method thereof |
| CN104994455A (en) * | 2015-07-03 | 2015-10-21 | 深圳市前海安测信息技术有限公司 | Headset volume adjusting method conducive to improving sleep quality and headset |
| CN107928250A (en) * | 2017-11-22 | 2018-04-20 | 宁波德葳智能科技有限公司 | A kind of contactless millimeter wave intelligence bassinet |
| CN108810300A (en) * | 2018-04-28 | 2018-11-13 | 平安科技（深圳）有限公司 | The method and its control method and device of adjustment intelligent terminal the tinkle of bells |
| CN109431470B (en) * | 2018-12-20 | 2021-05-07 | 西安交通大学医学院第二附属医院 | Sleep breathing monitoring method and device |
| CN117357070A (en) * | 2019-10-11 | 2024-01-09 | 京东方科技集团股份有限公司 | A sleep monitoring method, device, equipment and storage medium |
| CN212016413U (en) * | 2019-12-13 | 2020-11-27 | 深圳市三诺数字科技有限公司 | Hypnosis music control device and hypnosis sound box |
| CN111166294B (en) * | 2020-01-29 | 2021-09-14 | 北京交通大学 | Automatic sleep apnea detection method and device based on inter-heartbeat period |
| CN111904424B (en) * | 2020-08-06 | 2021-08-24 | 苏州国科医工科技发展(集团)有限公司 | Sleep monitoring and regulating system based on phased array microphone |
-
2021
- 2021-06-25 CN CN202310210703.6A patent/CN116339509B/en active Active
- 2021-06-25 CN CN202110701370.8A patent/CN113448438B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105407217A (en) * | 2015-10-26 | 2016-03-16 | 南京步步高通信科技有限公司 | Mobile terminal music playing method and mobile terminal |
| CN107517413A (en) * | 2017-10-24 | 2017-12-26 | 柴雪 | A kind of intelligent sound box and its control method |
| CN107743289A (en) * | 2017-10-25 | 2018-02-27 | 解君 | A kind of intelligent sound box control method in Intelligent household scene |
| CN110934566A (en) * | 2019-09-09 | 2020-03-31 | 精华隆智慧感知科技（深圳）股份有限公司 | Intelligent detection, automatic sleep-aiding and emergency alarm device |
| CN112998690A (en) * | 2021-03-29 | 2021-06-22 | 华南理工大学 | Pulse wave multi-feature fusion-based respiration rate extraction method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113448438A (en) | 2021-09-28 |
| CN113448438B (en) | 2023-02-03 |
| CN116339509A (en) | 2023-06-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116339509B (en) | A control method and control device for intelligent terminal equipment | |
| US9655559B2 (en) | Automated sleep staging using wearable sensors | |
| JP7763430B2 (en) | Method, computing device and computer program for analyzing a user's sleep state through acoustic information | |
| CN113677270B (en) | Information-enhanced deep sleep based on frontal lobe brain activity monitoring sensors | |
| CN110706816B (en) | Method and equipment for sleep environment regulation and control based on artificial intelligence | |
| CN108310587A (en) | A kind of sleep control device and method | |
| CN119770823B (en) | A smart companionship method and an emotion monitoring device | |
| CN116474239A (en) | High-efficient feedback regulation sleep brain wave music headrest | |
| CN119646600A (en) | Pet Soothing Methods | |
| Zhao et al. | Dysphagia diagnosis system with integrated speech analysis from throat vibration | |
| CN120581200A (en) | Dynamic health monitoring system and method integrating artificial intelligence and wearable devices | |
| Zhang et al. | An effective deep learning approach for unobtrusive sleep stage detection using microphone sensor | |
| CN116920232B (en) | Sleep stimulation method and system based on deep learning fusion of brain myoelectricity | |
| CN112162486A (en) | Mattress control system | |
| CN116115198A (en) | Low-power consumption snore automatic recording method and device based on physiological sign | |
| CN119896792B (en) | Physiological-musical following response intelligent emotion regulating system driven by generation type AI | |
| CN120143612A (en) | Intelligent sleep control system based on infrared and sound monitoring | |
| CN120010280A (en) | A smart home control method for collecting emotions through brain-computer interface | |
| JP2025526211A (en) | Method, apparatus and computer program for generating a sleep analysis model for predicting sleep states based on acoustic information | |
| KR20240065215A (en) | Method for providing a graphical user interface representing information or evaluation of a sleep of user | |
| Bi | Detection of Health-Related Behaviours Using Head-Mounted Devices | |
| US20250213172A1 (en) | System and methods for auditory stimulation to affect sleep | |
| Anwar et al. | Development of Smart Alarm Based on Sleep Cycle Analysis | |
| Hasan et al. | Pavlok-Nudge: A Feedback Mechanism for Atomic Behaviour Modification with Snoring Usecase | |
| Bhanumathi et al. | Automation Detection Of Stuttering Using MFCC In Conjunction With CSO |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |