WO2024093829A1

WO2024093829A1 - Terminal device control method and apparatus, terminal device, and medium

Info

Publication number: WO2024093829A1
Application number: PCT/CN2023/127166
Authority: WO
Inventors: 郑金山; 李欢
Original assignee: 歌尔科技有限公司
Priority date: 2022-10-31
Filing date: 2023-10-27
Publication date: 2024-05-10
Also published as: CN115607180A

Abstract

Provided are a terminal device control method and apparatus, a terminal device, and a computer-readable storage medium. The method comprises: when a terminal device is in a wearing state, collecting an ambient sound of an environment where the terminal device is located (S10); when the volume of the ambient sound is less than a preset volume threshold, acquiring characteristic parameters of a user at a terminal device end (S20); and when the characteristic parameters satisfy a preset physiological sound data collection condition, performing physiological sound data collection on the user at the terminal device end (S30). By means of the control method, the quality of the collected physiological sound data can be improved.

Description

Terminal device control method, device, terminal device and medium

This application claims priority to the Chinese patent application filed with the China Patent Office on October 31, 2022, with application number 202211351540.5 and invention name “Terminal device control method, device, terminal device and medium”, the entire contents of which are incorporated by reference in this application.

Technical Field

The present invention relates to the field of artificial intelligence technology, and in particular to a terminal device control method, device, terminal device and computer-readable storage medium.

Background technique

As people pay more and more attention to their health, various wearable products that can realize the function of collecting physical health data are constantly emerging. Many related devices are also used in telemedicine, assisting doctors in diagnosis, etc. Among them, the stethoscope is a portable tool commonly used by medical staff in outpatient clinics and clinics to assist in testing the heart and lung sounds of patients. In addition to traditional stethoscopes, more and more digital stethoscopes are also used for user self-diagnosis.

However, since physiological sound signals such as heart sounds and lung sounds are very weak, ordinary people lack the necessary guidance when using these devices to collect physiological sounds and their operations are not standardized, resulting in the inability to measure accurate and effective physiological sound data.

Summary of the invention

The main purpose of the present invention is to provide a terminal device control method, device, terminal device and computer-readable storage medium, aiming to improve the quality of collected physiological sound data.

To achieve the above object, the present invention provides a terminal device control method, the method comprising the following steps:

When the terminal device is in a worn state, collecting ambient sound of the environment in which the terminal device is located;

When the volume of the ambient sound is less than a preset volume threshold, obtaining characteristic parameters of the user of the terminal device;

When the characteristic parameter meets the preset physiological sound data collection condition, physiological sound data is collected from the user of the terminal device.

Optionally, the characteristic parameters include: the motion state and physiological sound data collection posture of the user at the terminal device end, and correspondingly, the preset physiological sound data collection condition includes: the motion state is a static state and the physiological sound data collection posture is a preset standard collection posture. When the characteristic parameters meet the preset physiological sound data collection conditions, the step of collecting physiological sound data of the user at the terminal device end includes:

When the motion state of the user at the terminal device is the static state and the physiological sound data collection posture is the standard collection posture, the physiological sound signal of the user at the terminal device is collected by the physiological sound data collection module in the terminal device.

Optionally, after the step of acquiring characteristic parameters of the user at the terminal device, the method further includes:

Determining whether the motion state of the user at the terminal device is the static state;

If the motion state is a stationary state, determining whether the physiological sound data collection posture of the user at the terminal device is the standard collection posture, so as to perform the step of collecting physiological sound data of the user at the terminal device when the physiological sound data collection posture is the standard collection posture;

If the motion state is other than the static state, the display module and/or voice module and/or vibration module in the terminal device is used to remind the user of the terminal device to stop moving so that the terminal device can collect physiological sound data in a static state.

Optionally, after the step of determining whether the physiological sound data collection posture of the user at the terminal device is the standard collection posture, the method further includes:

If the physiological sound data collection posture of the user on the terminal device is other than the standard collection posture, the display module and/or voice module and/or vibration module of the terminal device will be used to remind the user on the terminal device to adjust the current physiological sound data collection posture until the physiological sound data collection posture becomes the standard collection posture.

Optionally, after the step of collecting the ambient sound of the environment in which the terminal device is located, the method further includes:

Determining whether the volume of the ambient sound in the environment where the terminal device is located is less than the preset volume threshold;

If the volume of the ambient sound is less than the preset volume threshold, the terminal device is acquired. Steps for characterizing parameters of end users;

If the volume of the ambient sound is greater than or equal to the preset volume threshold, the display module and/or voice module and/or vibration module in the terminal device will remind the user of the terminal device that the ambient sound is less than the preset volume threshold, so that the terminal device can collect physiological sound data in the environment.

Optionally, when the terminal device is in a worn state, before the step of collecting the ambient sound of the environment in which the terminal device is located, the step further includes:

Detecting whether the terminal device is in a physiological sound data collection state;

If the terminal device is in the physiological sound data collection state, the device wearing instruction is triggered through the display module and/or voice module and/or vibration module of the terminal device to remind the terminal device user to wear the terminal device based on the device wearing instruction.

Optionally, the step of obtaining characteristic parameters of the user at the terminal device includes:

The characteristic parameters of the user at the terminal device are obtained through the accelerometer and gyroscope in the terminal device.

To achieve the above object, the present invention further provides a terminal device control device, the terminal device control device comprising:

A first collection module, used for collecting ambient sound of the environment in which the terminal device is located when the terminal device is in a worn state;

An acquisition module, used for acquiring characteristic parameters of the user of the terminal device when the volume of the ambient sound is less than a preset volume threshold;

The second collection module is used to collect physiological sound data from the user of the terminal device when the characteristic parameter meets the preset physiological sound data collection condition.

To achieve the above-mentioned purpose, the present invention also provides a terminal device, which includes a memory, a processor and a terminal device control program stored in the memory and executable on the processor, and the terminal device control program implements the steps of the terminal device control method as described above when executed by the processor.

In addition, to achieve the above object, the present invention also provides a computer-readable storage medium, A terminal device control program is stored on the computer-readable storage medium, and when the terminal device control program is executed by the processor, the steps of the terminal device control method described above are implemented.

To achieve the above object, the present invention further provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the steps of the terminal device control method described above are implemented.

The present invention provides a terminal device control method, device, terminal device, computer-readable storage medium and computer program product, which collect the ambient sound of the environment in which the terminal device is located when the terminal device is in a worn state; obtain the characteristic parameters of the user of the terminal device when the volume of the ambient sound is less than a preset volume threshold; and collect physiological sound data of the user of the terminal device when the characteristic parameters meet the preset physiological sound data collection conditions.

Compared with the prior art in which the user cannot accurately operate the corresponding device to collect physiological sound data, in the present invention, when the ambient sound of the environment in which the terminal device is located is less than the preset volume threshold, the characteristic parameters of the user at the terminal device end can be further obtained, and only when the characteristic parameters meet the preset physiological sound data collection conditions can the physiological sound data of the user at the terminal device end be collected. Therefore, the present invention can guide the user to use the terminal device to collect physiological sound data, which greatly improves the user experience, and because physiological sound data can only be collected when the characteristic parameters of the user at the terminal device end meet the physiological sound data collection conditions, therefore, on the basis of ensuring the efficiency of physiological sound data collection, it also improves the quality of the collected physiological sound data, and provides reliable data for subsequent user health examinations.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of the structure of a hardware operating environment involved in an embodiment of the present invention;

FIG2 is a schematic diagram of a first flow chart of an embodiment of a terminal device control method of the present invention;

3 is a schematic diagram of a smart watch integrated module according to an embodiment of a terminal device control method of the present invention;

FIG4 is a schematic diagram of a second flow chart of an embodiment of a terminal device control method of the present invention;

FIG5 is a schematic diagram of a third flow chart of an embodiment of a terminal device control method according to the present invention;

FIG. 6 is a schematic diagram of functional modules of an embodiment of a terminal device control device of the present invention.

The purpose, features and advantages of the present invention will be further described in conjunction with the embodiments and with reference to the accompanying drawings. illustrate.

Detailed ways

It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

As shown in FIG. 1 , FIG. 1 is a schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present invention.

The terminal device of the embodiment of the present invention can be a wearable device such as a watch, a bracelet, a chest strap and a finger ring, or it can be a locator, a mobile phone, etc. The terminal device in this embodiment can be used to realize the user's physiological sound collection and further physiological sound data analysis and processing.

As shown in FIG1 , the terminal device may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. The communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

Those skilled in the art will appreciate that the device structure shown in FIG. 1 does not constitute a limitation on the physiological sound data acquisition device, and may include more or fewer components than shown in the figure, or a combination of certain components, or a different arrangement of components.

As shown in FIG1 , the memory 1005 as a computer storage medium may include an operation, a network communication module, a user interface module, and a terminal device control program. The operation is a program that manages and controls the hardware and software resources of the device, and supports the operation of the terminal device control program and other software or programs. In the device shown in FIG1 , the user interface 1003 is mainly used for data communication with the client; the network interface 1004 is mainly used for establishing a communication connection with the server; and the processor 1001 can be used to call the terminal device control program stored in the memory 1005 and perform the following operations:

When the terminal device is in a wearable state, the ambient sound of the environment in which the terminal device is located is collected;

When the volume of the ambient sound is less than a preset volume threshold, obtaining characteristic parameters of the user at the terminal device;

When the characteristic parameters meet the preset physiological sound data collection conditions, physiological sound data is collected from the user at the terminal device.

Further, the characteristic parameters include: the motion state and physiological sound data collection posture of the user at the terminal device end. Correspondingly, the preset physiological sound data collection conditions include: the motion state is a static state and the physiological sound data collection posture is a preset standard collection posture. The processor 1001 can be used to call the terminal device control program stored in the memory 1005 and perform the following operations:

When the motion state of the user at the terminal device is a stationary state and the physiological sound data collection posture is a standard collection posture, the physiological sound signal of the user at the terminal device is collected through the physiological sound data collection module in the terminal device.

Further, after the step of acquiring the characteristic parameters of the user at the terminal device, the processor 1001 may be used to call the terminal device control program stored in the memory 1005 and perform the following operations:

If the motion state is a static state, determining whether the physiological sound data collection posture of the user at the terminal device is a standard collection posture, and executing the step of collecting physiological sound data of the user at the terminal device when the physiological sound data collection posture is the standard collection posture;

Further, after the step of determining whether the physiological sound data collection posture of the user at the terminal device is a standard collection posture, the processor 1001 may be used to call the terminal device control program stored in the memory 1005 and perform the following operations:

If the physiological sound data collection posture of the user on the terminal device is other than the standard collection posture, the terminal device's display module and/or voice module and/or vibration module will be used to remind the user on the terminal device to adjust the current physiological sound data collection posture until the physiological sound data collection posture becomes the standard collection posture.

Further, after the step of collecting the ambient sound of the environment in which the terminal device is located, the processor 1001 can be used to call the terminal device control program stored in the memory 1005, and perform the following operations:

Determine whether the volume of the ambient sound in the environment where the terminal device is located is less than a preset volume threshold;

If the volume of the ambient sound is less than the preset volume threshold, the step of obtaining characteristic parameters of the user at the terminal device is performed;

If the volume of the ambient sound is greater than or equal to the preset volume threshold, the display module and/or voice module and/or vibration module in the terminal device will remind the user of the terminal device that the ambient sound is less than the preset volume threshold. The volume threshold environment is used for the terminal device to collect physiological sound data in the environment.

Further, when the terminal device is in a worn state, before the step of collecting the ambient sound of the environment in which the terminal device is located, the processor 1001 can be used to call the terminal device control program stored in the memory 1005 and perform the following operations:

Detect whether the terminal device is in the state of collecting physiological sound data;

Further, the processor 1001 may be used to call the terminal device control program stored in the memory 1005, and perform the following operations:

Refer to FIG. 2 , which is a flow chart of a first embodiment of a terminal device control method according to the present invention.

The embodiment of the present invention provides an embodiment of a terminal device control method. It should be noted that although a logical sequence is shown in the flow chart, in some cases, the steps shown or described may be executed in a different order than that shown here.

Since the human body's heart, lungs, intestines and other organs are constantly moving and continuously emitting various sound signals, these signals can be called physiological sounds. In this embodiment, physiological sounds include but are not limited to heart sounds and lung sounds.

Considering that when general users use terminal devices such as smart wearable devices to perform self-examination of physical health parameters such as heart and lung sounds, pulse and blood pressure, due to the lack of necessary guidance on device operation, users may perform health self-examinations in noisy environments, while in motion, or in irregular body postures such as twisting and tilting, resulting in very poor signal quality measured by the terminal device, or even no useful signal can be measured.

Therefore, in the present invention, a terminal device control method is provided, which can be applied to a portable and easy-to-operate terminal device, and the terminal can be specifically a physiological sound data acquisition device, which is convenient for ordinary users to operate the physiological sound data acquisition device in the present invention and collect high-quality physiological sound data. In addition, the acquisition method in the present invention is also applicable to the acquisition of sound signals of other organs such as lung sounds.

In one embodiment, when the terminal device is a smart watch, a physiological sound data collection module and other related functional modules can be integrated into the smart watch to use the smart watch to realize simple and convenient user physiological sound data collection and subsequent physiological sound data analysis. The watch integrates a main control chip and a functional module connected to the main control chip, wherein the main control chip is used to interact with the functional module for data to execute the terminal device control method of the present invention, and the functional module at least includes: a physiological sound data acquisition module, a physiological sound analysis module, a voice module (including a microphone and a speaker, etc.), a vibration module, a motion sensing module (including an accelerometer and a gyroscope), a communication module (including one or more combinations of wireless communications such as cellular communication, WiFi communication, and Bluetooth communication), a memory, a battery, a power management module, a screen display and touch module, and a key module. In addition, in this embodiment, at least one bone conduction sensor is integrated in the physiological sound data acquisition module.

Based on the hardware structure of the above-mentioned smart watch, a method for detecting the physiological sound collection position is proposed. The smart watch is used as an execution subject to execute the method. It can be understood that the terminal device control method in the present invention is suitable for the collection of heart sounds, lung sounds or other forms of physiological sound data, and is not specifically limited in this embodiment.

On this basis, the terminal device control method in this embodiment specifically includes the following steps:

Step S10, when the terminal device is in a worn state, collecting ambient sound of the environment in which the terminal device is located;

When the smart watch is worn, it will collect the ambient sound of the smart watch's environment through its built-in voice module (such as a microphone) to determine whether the smart watch is currently in a relatively quiet environment suitable for physiological sound detection.

It should be noted that in this embodiment, the method for detecting the wearing status of the smart watch is not specifically limited. For example, the built-in accelerometer and/or gyroscope of the smart watch can be used to detect whether the smart watch is in a wearing state, or the built-in infrared sensor of the smart watch can be used to detect its wearing state.

Step S20, when the volume of the ambient sound is less than a preset volume threshold, collecting characteristic parameters of the user of the terminal device;

After the smart watch collects the ambient sound of its environment, when the volume of the ambient sound is less than the preset volume threshold, it will further collect the characteristic parameters of the user on the smart watch side to determine whether physiological sound data can be collected for the user on the smart watch side based on the characteristic parameters.

Step S30, when the characteristic parameter meets the preset physiological sound data collection condition, physiological sound data is collected from the user of the terminal device.

After the smart watch obtains the characteristic parameters of the current smart watch user, it can collect physiological sound data for the smart watch user only if the characteristic parameters meet the preset physiological sound data collection conditions. set.

It should be noted that in this embodiment, the characteristic parameters of the user on the smart watch include but are not limited to the user's motion state (stationary, walking, running, etc.) and physiological sound data collection posture (such as standing posture, lying posture, etc.) on the smart watch side. On this basis, only when the above characteristic parameters meet the preset physiological sound data collection conditions, the smart watch will further collect the user's physiological sound. Therefore, this embodiment can guide the user on the smart watch side to use the smart watch to collect physiological sound data, so as to improve the quality and efficiency of physiological sound data collection, so as to subsequently use the collected physiological sound data to evaluate the user's physical health.

In this embodiment, when the smart watch is in the wearing state, the built-in voice module will be used to collect the ambient sound of the environment in which the smart watch is located. When the volume of the ambient sound is less than the preset volume threshold, the characteristic parameters of the user on the smart watch end will be further collected, and only when the characteristic parameters meet the preset physiological sound data collection conditions, the smart watch will further collect the user's physiological sound data.

Compared with the prior art in which users cannot accurately operate the corresponding equipment to collect physiological sound data, in the present invention, when the ambient sound of the environment in which the smart watch is located is less than the preset volume threshold, the characteristic parameters of the user on the smart watch side can be further obtained, and only when the characteristic parameters meet the preset physiological sound data collection conditions can the physiological sound data of the user on the smart watch side be collected. Therefore, the present invention can guide users to use terminal devices such as smart watches to collect physiological sound data, which greatly improves the user experience, and because physiological sound data can only be collected when the characteristic parameters of the user on the smart watch side meet the physiological sound data collection conditions, therefore, on the basis of ensuring the efficiency of physiological sound data collection, it also improves the quality of the collected physiological sound data, and provides reliable data for subsequent user health testing.

Furthermore, based on the first embodiment of the physiological sound data collection of the present invention, a second embodiment of the physiological sound data collection of the present invention is proposed.

In this embodiment, in the above step S30, "collecting physiological sound data from the user of the terminal device when the characteristic parameter meets the preset physiological sound data collection condition" may include:

Step S301, when the motion state of the user at the terminal device is the static state and the physiological sound data collection posture is the standard collection posture, the physiological sound signal of the user at the terminal device is collected by the physiological sound data collection module in the terminal device.

It should be noted that, in the present embodiment, the characteristic parameters of the user on the smart watch end include but are not limited to the movement state (stationary, walking, running, etc.) and physiological sound data collection posture (such as standing posture, lying posture, etc.) of the user on the smart watch end. Correspondingly, the preset physiological sound data collection conditions include: the movement state is a stationary state and the physiological sound data collection posture is a preset standard collection posture, wherein the standard collection posture in the present embodiment can be a standard sitting posture with both feet on the ground or an upright standing posture, etc.

On this basis, after obtaining characteristic parameters such as the movement state and physiological sound data collection posture of the smart watch user, the smart watch will collect physiological sounds of the smart watch user through the built-in physiological sound data collection module when the movement state of the smart watch user is static and the physiological sound data collection posture is the above-mentioned standard collection posture.

In one embodiment, at least one bone conduction sensor may be integrated into the physiological sound data acquisition module for physiological sound acquisition. In this embodiment, there is no specific limitation on the number and position of the bone conduction sensors. One or more bone conduction sensors may be used, and the installation position of the bone conduction sensor may be any position of the terminal device that can contact the user's body. Taking a smart watch as an example, a single bone conduction sensor may be installed on the upper shell, the bottom shell, the strap, etc., or three bone conduction sensors may be arranged in a "straight" manner and placed on the smart watch strap position close to the inside of the user's wrist, so that the user only needs to put the strap on the inside of the wrist close to the chest to measure the corresponding physiological sound signal. In addition, the physiological sound data acquisition module may also include a microphone. When in use, the corresponding physiological sound signal can be measured by putting the microphone close to the chest.

Further, as shown in FIG. 4 , after the above step S20, “obtaining characteristic parameters of the user at the terminal device”, the following may also be included:

Step S40, determining whether the motion state of the user at the terminal device is the static state;

Step S50, if the motion state is a static state, determining whether the physiological sound data collection posture of the user at the terminal device is the standard collection posture, so as to perform the step of collecting physiological sound data of the user at the terminal device when the physiological sound data collection posture is the standard collection posture;

Step S60, if the motion state is other than the static state, the display module and/or voice module and/or vibration module in the terminal device is used to remind the user of the terminal device to stop moving, so that the terminal device can collect physiological sound data in a static state.

In order to ensure that high-quality physiological sound data can be collected, taking smart watches as an example, the smart watches obtain the characteristic parameters of the user's motion state and physiological sound data collection posture on the smart watch end. After that, it will be further determined whether the motion state and the physiological sound data collection posture meet the corresponding preset physiological sound data collection conditions.

Specifically, for example, the smart watch first determines whether the current running state of the user on the smart watch end is a stationary state; if it is determined that the running state is indeed a stationary state, it will further determine whether the current physiological sound data collection posture of the user on the smart watch end is a standard collection posture, so as to collect physiological sound data when the physiological sound data collection posture is the standard collection posture; if it is determined that the current running state is other than the stationary state, such as the walking state, then the smart watch will prompt the user on the smart watch end to stop the current movement through its built-in display module (such as a display screen) and/or voice module (such as a speaker) and/or vibration module (such as a motor) to ensure that the smart watch can collect more accurate physiological sound data in a stationary state. It can be understood that at least one of the built-in display module, voice module, and vibration module of the smart watch can be used to give corresponding reminders to the user on the smart watch end.

Furthermore, after the above step S50 of "determining whether the physiological sound data collection posture of the user at the terminal device is the standard collection posture", the following may also be included:

Step S70, if the physiological sound data collection posture of the user on the terminal device is other than the standard collection posture, the display module and/or voice module and/or vibration module of the terminal device is used to remind the user on the terminal device to adjust the current physiological sound data collection posture until the physiological sound data collection posture is the standard collection posture.

When the smart watch determines that the running state of the user on the smart watch end is stationary, it continues to determine whether the current physiological sound data collection posture of the user on the smart watch end is the standard collection posture; if it is determined that the physiological sound data collection posture is other than the standard collection posture, the smart watch can remind the smart watch end user to adjust the current physiological sound data collection posture through its built-in display module (such as a display screen) and/or voice module (such as a speaker) and/or vibration module (such as a motor).

In one embodiment, if the user of the smart watch is still in a posture other than the standard collection posture within a preset time, the smart watch will send a physiological sound data collection failure reminder through the display or speaker and end the physiological sound data collection operation.

In addition, if it is determined that the current physiological sound data collection posture of the user on the smart watch is a standard collection posture, the physiological sound data collection operation can be performed through one or more bone conduction sensors, and the physiological sound data collected by the bone conduction sensors are integrated and sent to the main control chip, and the main control chip sends it to the physiological sound analysis module for analysis and processing. In this way, this embodiment improves the physiological sound data. The data quality can be improved and the collected physiological sound data can be more representative of the general situation of the user.

Further, as shown in FIG5 , after the above step S10 of “collecting the ambient sound of the environment where the terminal device is located”, the following may also be included:

Step S80, determining whether the ambient sound of the environment in which the terminal device is located is less than the preset volume threshold;

Step S90, if the ambient sound is less than the preset volume threshold, executing the step of collecting characteristic parameters of the user at the terminal device;

Step S100, if the ambient sound is greater than or equal to the preset volume threshold, the display module and/or voice module and/or vibration module in the terminal device is used to remind the user of the terminal device that the ambient sound is less than the preset volume threshold, so that the terminal device can collect physiological sound data in the environment.

Taking smart watches as an example, after the smart watch collects the ambient sound of its environment through its built-in voice module (such as a microphone), and before collecting the characteristic parameters of the smart watch user, it is also necessary to determine in advance whether the smart watch is in a relatively quiet environment in order to collect physiological sound data containing less noise.

Specifically, for example, after the smart watch collects the ambient sound of its environment, it will determine whether the volume of the ambient sound is greater than a preset volume threshold. In this embodiment, the preset volume threshold is not specifically limited and can be flexibly set according to the environment in which the smart watch is located. If it is determined that the volume of the ambient sound of its environment is less than the above-mentioned preset volume threshold, it means that the current environment of the smart watch is relatively quiet and does not affect the collection of physiological sound data. At this time, the smart watch can perform the physiological sound data collection operation; if it is determined that the volume of the ambient sound of its environment is greater than or equal to the above-mentioned preset volume threshold, it means that the current environment of the smart watch is relatively noisy. In order to improve the quality of the collected physiological sound data, at this time, the smart watch can use its built-in display module and/or voice module and/or vibration module to remind the user of the smart watch end that the ambient sound volume is less than the above-mentioned preset volume threshold to collect and detect physiological sounds.

Furthermore, before the above step S10, "collecting the ambient sound of the environment in which the terminal device is located when the terminal device is in a worn state", the following may also be included:

Step A, detecting whether the terminal device is in a physiological sound data collection state;

Step B, if the terminal device is in the physiological sound data collection state, triggering a device wearing instruction through the display module and/or voice module and/or vibration module of the terminal device, based on the physiological sound data collected. The device wearing instruction reminds the user of the terminal device to wear the terminal device.

Taking a smart watch as an example, it should be noted that, in this embodiment, the user can choose to set the function of the smart watch to the physiological sound data collection function through the functional components on the smart watch (such as physical buttons, or the display module of the smart watch, that is, the virtual buttons in the display screen). Correspondingly, the smart watch is in the physiological sound data collection state at this time.

When the smart watch detects that it is currently in the state of collecting physiological sound data, it will trigger the device wearing instruction through the display module and/or voice module and/or vibration module to remind the user to wear the smart watch based on the device wearing instruction, so that the smart watch can perform physiological sound detection operations when it is in the wearing state. In this way, the smart watch can collect higher quality physiological sound data.

Furthermore, in the above step S20, “obtaining characteristic parameters of the user at the terminal device” may include:

Step S201, obtaining characteristic parameters of the user of the terminal device through the accelerometer and gyroscope in the terminal device.

When the volume of the ambient sound in the environment where the smart watch is located is less than a preset volume threshold, the smart watch can obtain the characteristic parameters of the smart watch user including the motion state and physiological sound data collection posture through its internal integrated motion sensing module, namely, the accelerometer and gyroscope, so as to determine whether to collect physiological sound data of the smart watch user based on the characteristic parameters.

In this embodiment, after the smart watch obtains characteristic parameters including the motion state and physiological sound data collection posture of the user at the smart watch end, the smart watch will collect physiological sounds of the user at the smart watch end through the built-in physiological sound data collection module of the smart watch when the motion state of the user at the smart watch end is static and the physiological sound data collection posture is the above-mentioned standard collection posture. In order to ensure that high-quality physiological sound data can be collected, after the smart watch obtains the characteristic parameters including the motion state and the physiological sound data collection posture of the user at the smart watch end, it will further determine whether the motion state and the physiological sound data collection posture meet the corresponding preset physiological sound data collection conditions respectively. If not, the built-in display module and/or voice module and/or vibration module will be used to remind the user at the smart watch end to make timely adjustments. When the smart watch detects that it is currently in the physiological sound data collection state, it will trigger the device wearing instruction through the display module and/or voice module and/or vibration module to remind the user to wear the smart watch based on the device wearing instruction, so as to perform the physiological sound collection operation in the wearing state.

Therefore, in the present invention, the smart watch can detect the ambient sound of the environment in which the smart watch is located. The smart watch will only perform the user physiological sound data collection operation when the volume is less than the preset volume threshold, the movement state of the user on the smart watch end is in a stationary state, and the physiological sound data collection posture of the user on the smart watch end is in a standard collection posture. Therefore, the present invention reduces the collection of invalid physiological sound data, significantly improves the quality of the collected physiological sound data, and at the same time reduces the difficulty of physiological sound detection and improves the user experience.

In addition, an embodiment of the present invention further provides a terminal device control device. Referring to FIG. 6 , the terminal device control device includes:

The first acquisition module 10 is used to collect the ambient sound of the environment in which the terminal device is located when the terminal device is in a worn state;

An acquisition module 20, configured to acquire characteristic parameters of a user at the terminal device when the volume of the ambient sound is less than a preset volume threshold;

The second collection module 30 is used to collect physiological sound data from the user of the terminal device when the characteristic parameter meets the preset physiological sound data collection condition.

Further, the characteristic parameters include: the motion state and physiological sound data collection posture of the user of the terminal device, and correspondingly, the preset physiological sound data collection conditions include: the motion state is a static state and the physiological sound data collection posture is a preset standard collection posture, and the second collection module 30 includes:

The collecting unit is used to collect the physiological sound signal of the user at the terminal device through the physiological sound data collecting module in the terminal device when the movement state of the user at the terminal device is the static state and the physiological sound data collecting posture is the standard collecting posture.

Furthermore, the terminal device control device further includes:

A first judging module is used to judge whether the motion state of the user at the terminal device is the static state;

A second judgment module is used to judge whether the physiological sound data collection posture of the user at the terminal device is the standard collection posture, so as to execute the step of collecting physiological sound data of the user at the terminal device when the physiological sound data collection posture is the standard collection posture;

The first reminder module is used to remind the user of the terminal device to stop moving through the display module and/or voice module and/or vibration module in the terminal device, so that the terminal device can collect physiological sound data in a static state.

Furthermore, the terminal device control device further includes:

The second reminder module is used to remind the user of the terminal device to adjust the current physiological sound data collection posture through the display module and/or voice module and/or vibration module of the terminal device until the physiological sound data collection posture is the standard collection posture.

Furthermore, the terminal device control device further includes:

A third judgment module is used to judge whether the volume of the ambient sound in the environment where the terminal device is located is less than the preset volume threshold;

A characteristic parameter acquisition module, used to acquire characteristic parameters of the user at the terminal device;

The third reminder module is used to remind the user of the terminal device that the ambient sound is less than the preset volume threshold through the display module and/or voice module and/or vibration module in the terminal device, so that the terminal device can collect physiological sound data in the said environment.

Furthermore, the terminal device control device further includes:

A detection module, used to detect whether the terminal device is in a physiological sound data collection state;

An instruction triggering module is used to trigger a device wearing instruction through a display module and/or a voice module and/or a vibration module of the terminal device, so as to remind the terminal device user to wear the terminal device based on the device wearing instruction.

Furthermore, the acquisition module 20 includes:

The acquisition unit is used to acquire characteristic parameters of the user of the terminal device through the accelerometer and gyroscope in the terminal device.

The extended contents of the specific implementation manner of the terminal device control device of the present invention are basically the same as the embodiments of the above-mentioned terminal device control method, and will not be elaborated here.

In addition, an embodiment of the present invention further proposes a computer-readable storage medium, on which a terminal device control program is stored. When the terminal device control program is executed by a processor, the steps of the terminal device control method described below are implemented.

The various embodiments of the computer-readable storage medium of the present invention may refer to the various embodiments of the terminal device control method of the present invention, which will not be described in detail here.

It should be noted that, in this article, the terms "include", "comprise" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or The system includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article or system. In the absence of more restrictions, an element defined by the phrase "comprising a ..." does not exclude the existence of other identical elements in the process, method, article or system that includes the element.

The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), including a number of instructions for a terminal device (which can be a wearable device, a locator, a smart phone, a tablet computer, etc.) to execute the methods described in each embodiment of the present invention.

The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

A terminal device control method, characterized in that the terminal device control method comprises:

When the terminal device is in a worn state, collecting ambient sound of the environment in which the terminal device is located;

When the volume of the ambient sound is less than a preset volume threshold, obtaining characteristic parameters of a user at the terminal device;

When the characteristic parameter meets the preset physiological sound data collection condition, physiological sound data is collected from the user of the terminal device.
The terminal device control method according to claim 1 is characterized in that the characteristic parameters include: the motion state and physiological sound data collection posture of the terminal device end user, and correspondingly, the preset physiological sound data collection condition includes: the motion state is a static state and the physiological sound data collection posture is a preset standard collection posture, and when the characteristic parameters meet the preset physiological sound data collection conditions, the step of collecting physiological sound data for the terminal device end user includes:

When the motion state of the user at the terminal device is the static state and the physiological sound data collection posture is the standard collection posture, the physiological sound data of the user at the terminal device is collected by the physiological sound data collection module in the terminal device.
The terminal device control method according to claim 2, characterized in that after the step of obtaining the characteristic parameters of the terminal device end user, it also includes:

Determining whether the motion state of the user at the terminal device is the static state;

If the motion state is a stationary state, determining whether the physiological sound data collection posture of the user at the terminal device is the standard collection posture, so as to perform the step of collecting physiological sound data of the user at the terminal device when the physiological sound data collection posture is the standard collection posture;

If the motion state is other than the static state, the display module and/or voice module and/or vibration module in the terminal device is used to remind the user of the terminal device to stop moving so that the terminal device can collect physiological sound data in a static state.
The terminal device control method according to claim 3 is characterized in that in the step of determining whether the physiological sound data collection posture of the terminal device end user is the standard collection posture After that, it also includes:

If the physiological sound data collection posture of the user on the terminal device is other than the standard collection posture, the display module and/or voice module and/or vibration module of the terminal device will be used to remind the user on the terminal device to adjust the current physiological sound data collection posture until the physiological sound data collection posture becomes the standard collection posture.
The terminal device control method according to claim 1, characterized in that after the step of collecting the ambient sound of the environment in which the terminal device is located, it also includes:

Determining whether the volume of the ambient sound in the environment where the terminal device is located is less than the preset volume threshold;

If the volume of the ambient sound is less than the preset volume threshold, executing the step of obtaining characteristic parameters of the user at the terminal device;

If the volume of the ambient sound is greater than or equal to the preset volume threshold, the display module and/or voice module and/or vibration module in the terminal device will remind the user of the terminal device that the ambient sound is less than the preset volume threshold, so that the terminal device can collect physiological sound data in the environment.
The terminal device control method according to claim 1, characterized in that, before the step of collecting the ambient sound of the environment in which the terminal device is located when the terminal device is in a worn state, it also includes:

Detecting whether the terminal device is in a physiological sound data collection state;

If the terminal device is in the physiological sound data collection state, the device wearing instruction is triggered through the display module and/or voice module and/or vibration module of the terminal device to remind the terminal device user to wear the terminal device based on the device wearing instruction.
The terminal device control method according to any one of claims 1 to 6, characterized in that the step of obtaining characteristic parameters of the terminal device user comprises:

The characteristic parameters of the user at the terminal device are obtained through the accelerometer and gyroscope in the terminal device.
A terminal device control device, characterized in that the terminal device control device comprises:

A first collection module, used for collecting ambient sound of the environment in which the terminal device is located when the terminal device is in a worn state;

An acquisition module, used for acquiring characteristic parameters of the user of the terminal device when the volume of the ambient sound is less than a preset volume threshold;

The second collection module is used to collect physiological sound data from the user of the terminal device when the characteristic parameter meets the preset physiological sound data collection condition.
A terminal device, characterized in that the terminal device includes a memory, a processor, and a terminal device control program stored in the memory and executable on the processor, wherein the terminal device control program, when executed by the processor, implements the steps of the terminal device control method as described in any one of claims 1 to 7.
A computer-readable storage medium, characterized in that a terminal device control program is stored on the computer-readable storage medium, and when the terminal device control program is executed by a processor, the steps of the terminal device control method according to any one of claims 1 to 7 are implemented.