WO2019037456A1

WO2019037456A1 - Snoring detection method and system, and terminal device

Info

Publication number: WO2019037456A1
Application number: PCT/CN2018/084103
Authority: WO
Inventors: 贺超; 宋雨
Original assignee: 深圳创达云睿智能科技有限公司
Priority date: 2017-08-24
Filing date: 2018-04-23
Publication date: 2019-02-28
Also published as: CN107456211B; CN107456211A

Abstract

Disclosed are a snoring detection method and system, and a terminal device. The method comprises: receiving feature information, sent by a detection apparatus, about first sound information within a pre-set range, and when a user is in a sleep state, acquiring current physical sign information about the user; and determining, according to the feature information and the physical sign information, whether the user produces a snoring sound. During the process, a detection apparatus acquires sound information and physical sign information about a user by means of different sensors, and sends same to an analysis apparatus, and the analysis apparatus determines, according to the above information, whether the user produces a snoring sound, thus improving the determination accuracy; in addition, the analysis apparatus can also acquire sound information in an environment where the user is located, thus eliminating the influence of noise in the environment, reducing inaccurate determination and missed determination, and improving the accuracy of a determination result about whether the user produces a snoring sound.

Description

Beep detection method, system and terminal device

Technical field

The present application belongs to the field of medical detection, and in particular relates to a method, system and terminal device for detecting a click.

Background technique

As people's life pressures continue to increase, more and more people have sleep disorders to varying degrees. Sleep-disordered breathing (snoring) is a major cause of sleep disorders. Sleep-disordered breathing refers to repeated episodes of apnea and/or hypopnea in sleep states caused by various causes, causing hypoxemia and hypercapnia. Therefore, the body has a series of clinical syndromes of pathophysiological changes. With the continuous development of electronic device technology, devices for snoring detection continue to enter people's daily lives. People can easily know whether they are snoring during sleep through these snoring detection devices, but the existing snoring detection devices are When people are detecting the snoring sound during sleep, they often cannot detect the humming sound accurately. For example, when there are other sounds mixed in the environment, the snoring detection device will detect the user’s snoring, and the user may not be accurate or missed. Test results.

technical problem

In view of this, the embodiment of the present application provides a method, a system, and a terminal device for detecting a click sound, so as to solve the problem that the false detection or missed judgment phenomenon is serious when the click sound detecting device detects the user's click sound in the prior art, and the accuracy of the detection result is low.

Technical solution

A first aspect of the embodiments of the present application provides a click detection method, where the click detection method includes:

Receiving, by the detecting device, feature information of the first sound information in a preset range sent by the detecting device, wherein the feature information is obtained by analyzing, by the detecting device, the first sound information;

Obtaining current physical information of the user when the user is in a sleep state;

Determining whether the user emits a click based on the feature information and the vital sign information.

A second aspect of the embodiments of the present application provides a click detection system, where the click detection system includes:

a receiving unit, configured to receive feature information of the first sound information in a preset range sent by the detecting device, wherein the feature information is obtained by analyzing, by the detecting device, the first sound information;

a physical information acquisition unit, configured to acquire current physical information of the user when the user is in a sleep state;

a determining unit, configured to determine, according to the feature information and the vital sign information, whether the user emits a beep.

A third aspect of the embodiments of the present application provides a terminal device including a memory, a processor, and a computer program stored in the memory and operable on the processor, when the processor executes the computer program The steps of the method of any of the above-described click detection methods are implemented.

A fourth aspect of the embodiments of the present application provides a computer readable storage medium storing a computer program, when the computer program is executed by a processor, implementing any one of the click detection methods The steps of the method.

Beneficial effect

In the embodiment provided by the application, after the analysis device receives the feature information of the first sound information, if the user is in a sleep state, the physical location information of the user is acquired, and then the feature information is matched with the physical information of the user, and finally Determine if the user is beeping. In this process, the detecting device acquires the sound information and the physical sign information of the user through different sensors, and sends the information to the analyzing device, and the analyzing device determines whether the user emits a click sound according to the above information, thereby improving the accuracy of the judgment, and at the same time, the analyzing device can also Acquiring the sound information in the environment where the user is located, eliminating the influence of noise in the environment, reducing false positives and missing judgments, and improving the accuracy of the user's judgment result.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only the present application. For some embodiments, other drawings may be obtained from those of ordinary skill in the art without departing from the drawings.

1 is a schematic flowchart of an implementation process of a click detection method according to Embodiment 1 of the present application;

2 is a structural block diagram of a click detection system according to Embodiment 2 of the present application;

FIG. 3 is a schematic diagram of a terminal device according to Embodiment 3 of the present application.

Embodiments of the invention

In the following description, for purposes of illustration and description However, it will be apparent to those skilled in the art that the present invention may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the application.

In order to explain the technical solutions described in the present application, the following description will be made by way of specific embodiments.

Example 1

FIG. 1 is a schematic diagram showing an implementation process of a click detection method provided in an embodiment of the present application, which is described in detail as follows:

Step S11: Receive feature information of the first sound information in a preset range sent by the detecting device, where the feature information is obtained by analyzing, by the detecting device, the first sound information;

In the embodiment provided by the present application, the analyzing device acquires feature information of the first sound from one end of the detecting device, wherein the detecting device collects first sound information in a preset range by using an audio sensor or the like, the first sound information including the The sound in the environment in which the preset range exists or the click of a user wearing the click detecting device or a click from another person existing within the preset range. Further, the detecting device acquires the first sound information in the preset range when the user is ready to fall asleep or is in a sleep state, and the detecting device may be worn by the user or may be set at a fixed position. For example, at a certain position on the user's bed; the preset range may be an area within a certain distance centered on the user.

The detecting device obtains the first sound information and analyzes the first sound information to determine its characteristic information. When performing the analysis, the feature information is first extracted, such as extracting the respiratory rhythm, the loudness and the loudness in the first sound information. a time series or the like for subsequently determining whether the first sound information contains a click sound based on the extracted feature information. The analyzing device acquires feature information of the first sound information from the detecting device.

Optionally, since the detecting device collects the first sound information within the preset range, a plurality of sounds may be collected, wherein the sounds of the plurality of users may also be included, when the detecting device is worn by the user In order to detect whether the wearer emits a click, analyze the type of the click included in the first sound information, and when the first sound information includes a plurality of feature information, uniquely identify different types of feature information to achieve A signature of the feature information is then sent to the analysis device along with each of the feature information along with its corresponding identification.

Step S12: Acquire current physical information of the user when the user is in a sleep state;

In the embodiment provided by the present application, if the user is in a sleep state, it is determined that the user may beep. At this time, the analyzing device acquires the current vital information of the user from the detecting device. Wherein, the vital sign information is obtained by the detecting device through a sensor. For example, the detecting device acquires physical sign information such as a respiratory rhythm of the user through a sensor (such as a motion sensor, a piezoelectric sensor, or the like).

Preferably, before the obtaining the current vital information of the user when the user is in a sleep state, the method includes:

Receiving, by the detecting device, a current state of the user, where the current state is obtained by the detecting device by detecting the brain electrical data of the user;

Determining, according to the current state, whether the user is in a sleep state;

Specifically, the analyzing device receives the current state of the user sent by the detecting device, and the current state includes a sleep state. Optionally, the detecting device acquires related information about the current state of the user by using a sensor (such as an EEG sensor, etc.), for example, the detecting device acquires the EEG data of the user through the EEG sensor, and determines the according to the characteristics of the EEG data. Whether the user is currently sleeping.

Step S13, determining, according to the feature information and the vital sign information, whether the user is beeping.

Preferably, the determining, according to the feature information and the vital sign information, whether the user emits a beep comprises:

Matching the feature information and the physical sign information to determine a matching degree between the two;

If the matching degree exceeds the preset matching value, it is determined that the user beeps.

In the embodiment provided by the present application, the detecting device compares the acquired feature information of the first sound information with the obtained physical location information of the user, if the matching degree between the feature information and the physical sign information exceeds a preset. Matching the value, determining that the first sound information includes click information, and the user emits a click; for example, matching the feature information with a respiratory rhythm in the vital information, if the feature information is If the matching degree of the user's breathing rhythm exceeds a preset value, it is determined that the user has made a click. Of course, other features in the feature information may also be matched with corresponding vital information to determine whether the user is beeping.

Optionally, if the user is not in a sleep state, it is determined that the user does not emit a click. At this time, if the first sound information includes a click sound, it is determined that the click sound is not issued by the user.

Optionally, since the clicks from different users also have certain common points, that is, the characteristics of the click sound, the feature information can also be matched with the characteristics of the preset click information when the judgment is made. If the matching degree exceeds a certain value, it is determined that the first sound information includes the click information, and the feature information is matched with the physical information of the user, and if the matching degree exceeds the preset value, determining that the A user emits a click, wherein the characteristics of the click information include frequency characteristics, intensity characteristics, and formants of the click.

Preferably, the matching the feature information and the physical information to determine the matching degree of the two includes:

Calling feature information of each sound when the first sound information includes a plurality of sounds;

The feature information of each of the sounds is matched with the vital sign information, and the degree of matching between each sound and the vital sign information is determined.

Specifically, the first sound information received by the analyzing device may include both a user-sounding sound and a sound existing in the environment, and may even include a click sound from other persons in the preset range. When a plurality of sound information is included in a sound information, feature information of each sound is called, and feature information of each sound is respectively matched with the physical information of the user, and if there is a sound, the feature information and the user's physical signs If the matching of the information exceeds the preset matching value, it is determined that the sound is the click of the user.

Preferably, the determining, according to the feature information and the vital sign information, whether the user is beeping, further comprising:

Acquiring the second sound information in the preset range when the matching degree exceeds the preset matching value;

If the loudness of the second sound information is less than the loudness of the first sound information, it is determined that the user is beeping.

Specifically, in order to avoid the interference of the sound in the environment, the accuracy of the determination result is increased. When the matching degree exceeds the preset matching value, the analyzing device acquires the second sound information of the preset range by using the own audio sensor; Determining the loudness of the first sound information, simultaneously acquiring the loudness of the second sound information, determining whether the loudness of the second sound is less than the loudness of the first sound, and if so, indicating that the preset range is removed from the environment itself The sound that exists, and a part of the sound, that is, the click sounded by the user, therefore, judges that the user has made a click.

Example 2

Corresponding to the click detection method described in the above embodiment, FIG. 2 is a structural block diagram of a click detection system provided by an embodiment of the present application. For the convenience of description, only parts related to the embodiment of the present application are shown.

Referring to FIG. 2, the click detection system includes: a receiving unit 21, a vital sign information acquiring unit 22, and a determining unit 23, wherein:

The receiving unit 21 is configured to receive feature information of the first sound information in the preset range sent by the detecting device, where the feature information is obtained by analyzing the first sound information by the detecting device;

The vital sign information acquiring unit 22 is configured to acquire the current vital sign information of the user when the user is in a sleep state;

Optionally, the click detection system further includes:

a sleep state determining unit, configured to receive a current state of the user sent by the detecting device, where the current state is obtained by the detecting device by detecting the brain electrical data of the user; and determining the user according to the current state Whether it is in sleep state.

The determining unit 23 is configured to determine, according to the feature information and the vital sign information, whether the user emits a beep.

Preferably, the determining unit 23 includes:

a matching degree determining module, configured to match the feature information and the physical sign information, and determine a matching degree between the two;

And a click determining module, configured to determine that the user beeps if the matching degree exceeds a preset matching value.

Preferably, the matching degree determining module includes:

a calling module, configured to invoke feature information of each sound when the first sound information includes multiple sounds;

And a matching module, configured to respectively match feature information of each of the sounds with the vital sign information, and determine a matching degree of each sound and the vital sign information.

Preferably, the determining unit 23 further includes:

a second sound information acquiring module, configured to acquire second sound information in the preset range when the matching degree exceeds a preset matching value;

The loudness judging module is configured to determine that the user emits a beep if the loudness of the second sound information is less than the loudness of the first sound information.

It should be understood that the size of the sequence of the steps in the above embodiments does not mean that the order of execution is performed. The order of execution of each process should be determined by its function and internal logic, and should not be construed as limiting the implementation process of the embodiments of the present application.

Example 3

FIG. 3 is a schematic diagram of a terminal device according to an embodiment of the present application. As shown in FIG. 3, the terminal device 3 of this embodiment includes a processor 30, a memory 31, and a computer program 32 stored in the memory 31 and operable on the processor 30. When the processor 30 executes the computer program 32, the steps in the embodiments of the above-described respective click detection methods are implemented, such as steps S11 to S13 shown in FIG. Alternatively, when the processor 30 executes the computer program 32, the functions of the modules/units in the above-described respective device embodiments, such as the functions of the units 21 to 23 shown in FIG. 2, are implemented.

Illustratively, the computer program 32 can be partitioned into one or more modules/units that are stored in the memory 31 and executed by the processor 30 to complete This application. The one or more modules/units may be a series of computer program instruction segments capable of performing a particular function, the instruction segments being used to describe the execution of the computer program 32 in the terminal device 3. For example, the computer program 32 can be divided into a receiving unit, a vital sign information acquiring unit, and a determining unit, and the specific functions of each unit are as follows:

Further, the determining unit includes:

Further, the matching degree determining module includes:

Further, the determining unit further includes:

Further, the click detection system further includes:

The terminal device 3 may be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server. The terminal device may include, but is not limited to, the processor 30 and the memory 31. It will be understood by those skilled in the art that FIG. 3 is only an example of the terminal device 3, does not constitute a limitation of the terminal device 3, may include more or less components than those illustrated, or combine some components, or different components. For example, the terminal device may further include an input/output device, a network access device, a bus, and the like.

The so-called processor 30 can be a central processing unit (Central Processing Unit, CPU), can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.

The memory 31 may be an internal storage unit of the terminal device 3, such as a hard disk or a memory of the terminal device 3. The memory 31 may also be an external storage device of the terminal device 3, for example, a plug-in hard disk equipped on the terminal device 3, a smart memory card (SMC), and a secure digital (SD). Card, flash card (Flash Card) and so on. Further, the memory 31 may also include both an internal storage unit of the terminal device 3 and an external storage device. The memory 31 is used to store the computer program and other programs and data required by the terminal device. The memory 31 can also be used to temporarily store data that has been output or is about to be output.

It will be clearly understood by those skilled in the art that, for convenience and brevity of description, only the division of each functional unit and module described above is exemplified. In practical applications, the above functions may be assigned to different functional units according to needs. The module is completed by dividing the internal structure of the device into different functional units or modules to perform all or part of the functions described above. Each functional unit and module in the embodiment may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit, and the integrated unit may be implemented by hardware. Formal implementation can also be implemented in the form of software functional units. In addition, the specific names of the respective functional units and modules are only for the purpose of facilitating mutual differentiation, and are not intended to limit the scope of protection of the present application. For the specific working process of the unit and the module in the foregoing system, reference may be made to the corresponding process in the foregoing method embodiment, and details are not described herein again.

In the above embodiments, the descriptions of the various embodiments are different, and the parts that are not detailed or described in the specific embodiments may be referred to the related descriptions of other embodiments.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods to implement the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present application.

In the embodiments provided by the present application, it should be understood that the disclosed device/terminal device and method may be implemented in other manners. For example, the device/terminal device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units. Or components may be combined or integrated into another system, or some features may be omitted or not performed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, the present application implements all or part of the processes in the foregoing embodiments, and may also be completed by a computer program to instruct related hardware. The computer program may be stored in a computer readable storage medium. The steps of the various method embodiments described above may be implemented when the program is executed by the processor. . Wherein, the computer program comprises computer program code, which may be in the form of source code, object code form, executable file or some intermediate form. The computer readable medium can include any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a removable hard drive, a magnetic disk, an optical disk, a computer memory, a read only memory (ROM, Read-Only) Memory), random access memory (RAM, Random) Access Memory), electrical carrier signals, telecommunications signals, and software distribution media. It should be noted that the content contained in the computer readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in a jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, computer readable media It does not include electrical carrier signals and telecommunication signals.

The above-mentioned embodiments are only used to explain the technical solutions of the present application, and are not limited thereto; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still implement the foregoing embodiments. The technical solutions described in the examples are modified or equivalently replaced with some of the technical features; and the modifications or substitutions do not deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in Within the scope of protection of this application.

Claims

A method for detecting a click sound, characterized in that the method for detecting a click sound comprises:

Receiving, by the detecting device, feature information of the first sound information in a preset range sent by the detecting device, wherein the feature information is obtained by analyzing, by the detecting device, the first sound information;

Obtaining current physical information of the user when the user is in a sleep state;

Determining whether the user emits a click based on the feature information and the vital sign information.
The method for detecting a click sound according to claim 1, wherein before the acquiring the current vital information of the user when the user is in a sleep state, the method includes:

Receiving, by the detecting device, a current state of the user, where the current state is obtained by the detecting device by detecting the brain electrical data of the user;

Determining whether the user is in a sleep state according to the current state.
The method for detecting a click sound according to claim 1, wherein the determining whether the user is humming based on the feature information and the vital sign information comprises:

Matching the feature information and the physical sign information to determine a matching degree between the two;

If the matching degree exceeds the preset matching value, it is determined that the user beeps.
The method for detecting a click sound according to claim 1, wherein the matching the feature information and the vital sign information to determine the matching degree of the two includes:

Calling feature information of each sound when the first sound information includes a plurality of sounds;

The feature information of each of the sounds is matched with the vital sign information, and the degree of matching between each sound and the vital sign information is determined.
The method for detecting a click sound according to claim 3, wherein the determining whether the user is humming based on the feature information and the vital sign information further includes:

Acquiring the second sound information in the preset range when the matching degree exceeds the preset matching value;

If the loudness of the second sound information is less than the loudness of the first sound information, it is determined that the user is beeping.
A click detection system, characterized in that the click detection system comprises:

a receiving unit, configured to receive feature information of the first sound information in a preset range sent by the detecting device, wherein the feature information is obtained by analyzing, by the detecting device, the first sound information;

a physical information acquisition unit, configured to acquire current physical information of the user when the user is in a sleep state;

a determining unit, configured to determine, according to the feature information and the vital sign information, whether the user emits a beep.
The click detection system according to claim 6, wherein the determining unit comprises:

a matching degree determining module, configured to match the feature information and the physical sign information, and determine a matching degree between the two;

And a click determining module, configured to determine that the user beeps if the matching degree exceeds a preset matching value.
The click detection system according to claim 7, wherein the determining unit further comprises:

a second sound information acquiring module, configured to acquire second sound information in the preset range when the matching degree exceeds a preset matching value;

The loudness judging module is configured to determine that the user emits a beep if the loudness of the second sound information is less than the loudness of the first sound information.
The click detection system according to claim 6, wherein the matching degree determination module comprises:

a calling module, configured to invoke feature information of each sound when the first sound information includes multiple sounds;

And a matching module, configured to respectively match feature information of each of the sounds with the vital sign information, and determine a matching degree of each sound and the vital sign information.
The click detection system of claim 6, wherein the click detection system further comprises:

a sleep state determining unit, configured to receive a current state of the user sent by the detecting device, where the current state is obtained by the detecting device by detecting the brain electrical data of the user; and determining the user according to the current state Whether it is in sleep state.
A terminal device comprising a memory, a processor, and a computer program stored in the memory and operable on the processor, wherein the processor executes the computer program as claimed in claim 1 5 The steps of any of the methods described.
A computer readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the steps of the method of any one of claims 1 to 5.