WO2022135071A1

WO2022135071A1 - Earphone playback control method and apparatus, and electronic device and storage medium

Info

Publication number: WO2022135071A1
Application number: PCT/CN2021/134003
Authority: WO
Inventors: 汶晨光
Original assignee: 中兴通讯股份有限公司
Priority date: 2020-12-21
Filing date: 2021-11-29
Publication date: 2022-06-30
Also published as: CN114647397A

Abstract

An earphone playback control method and apparatus, and an electronic device and a storage medium. The earphone playback control method comprises: detecting a real-time scene parameter of a scene where earphones are currently located (S102); matching the real-time scene parameter with scene parameters to be controlled in a parameter library (S104), wherein at least one scene parameter to be controlled in the parameter library is a scene parameter of the scene where the earphones are located learned under the condition that a first anti-noise reduction operation is performed on the earphones; and after the real-time scene parameter is successfully matched with any one of the scene parameters to be controlled in the parameter library, performing a second anti-noise reduction operation (S106).

Description

Headphone playback control method, device, electronic device and storage medium

technical field

The present application relates to the field of computers, for example, to a headphone playback control method, apparatus, electronic device, and storage medium.

Background technique

With the development of computer technology, people can use terminal devices such as laptops, tablet computers, mobile phones and even wearable devices for entertainment anytime, anywhere. For example, in their spare time, end users can listen to music and watch videos through terminal devices to relax. Spirit. In order to obtain a better hearing experience and avoid affecting other people in the same space, users will choose to wear headphones. Headphones can effectively isolate the noise in the external environment, thereby providing users with better audio playback services, especially when the headphones are noise-cancelling headphones with noise reduction function, they can reduce ambient noise in real time and maximize their own audio output. , showing the best listening effect.

However, earphones, especially noise-cancelling earphones, not only isolate the ambient noise, but also isolate the sounds that are more important to the user in the environment, which can easily make the user miss important sound information in the environment. The existence of the noise earphone may make the user unable to hear the announcement of the public transport station, which will bring great inconvenience to the user in some scenarios.

SUMMARY OF THE INVENTION

The headphone playback control method, device, electronic device and storage medium provided by the present application mainly solve the technical problem that the external environmental sound isolated by the headphone in a specific scene cannot be known.

The present application provides a headphone playback control method, including:

Detect the real-time scene parameters of the scene where the headset is currently located; match the real-time scene parameters with the to-be-controlled scene parameters in the parameter library, wherein at least one to-be-controlled scene parameter in the parameter library is executed in the headset The scene parameters of the scene where the headset is located, learned in the case of the first anti-noise reduction operation; after the real-time scene parameters are successfully matched with the parameters of a scene to be controlled in the parameter library, the second anti-noise reduction operation is performed .

The present application also provides a headphone playback control device, including:

The detection unit is set to detect the real-time scene parameters of the scene where the headset is currently located; the matching unit is set to match the real-time scene parameters with the to-be-controlled scene parameters in the parameter library, wherein at least one of the to-be-controlled scene parameters in the parameter library The control scene parameter is the scene parameter of the scene where the headset is learned when the headset is executed the first anti-noise reduction operation; the anti-noise reduction unit is set to be between the real-time scene parameters and the parameter library After the parameters of the first to-be-controlled scene are successfully matched, the second anti-noise reduction operation is performed.

The present application also provides an electronic device, the electronic device includes a processor, a memory and a communication bus;

The communication bus is configured to realize the connection and communication between the processor and the memory; the processor is configured to execute one or more computer programs stored in the memory, so as to realize the above-mentioned headphone playback control method.

The present application also provides a storage medium, where one or more computer programs are stored in the storage medium, and the one or more computer programs can be executed by one or more processors, so as to implement the above-mentioned headphone playback control method.

Description of drawings

FIG. 1 is a flowchart of a method for controlling playback of headphones according to an embodiment of the present application;

2 is a flowchart of identifying a scene to be controlled and storing parameters of the scene to be controlled provided by an embodiment of the present application;

FIG. 3 is a flow chart of verifying whether an associated scene parameter is suitable as a to-be-controlled scene parameter according to an embodiment of the present application;

FIG. 4 is a control flow diagram after the second anti-noise reduction operation is realized by automatically reducing the output sound energy of the earphone according to an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a headphone playback control device according to an embodiment of the present application;

6 is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application;

FIG. 7 is a schematic diagram of a hardware structure of an earphone according to an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a terminal according to an embodiment of the present application;

FIG. 9 is a schematic structural diagram of a headphone playback control system according to an embodiment of the present application.

Detailed ways

The embodiments of the present application will be described below through specific implementations in conjunction with the accompanying drawings. The specific embodiments described herein are merely used to explain the present application.

Example 1:

In order to prevent users from missing important sounds in the external environment when wearing headphones to listen to audio, the main practice in the related art is to pre-set some sounds before the headphones leave the factory, and store the audio data of these sounds in the memory of the headphones. ; During the process of the user using the headset, the audio acquisition unit collects the ambient sound signal, and matches the collected ambient sound signal with the preset audio data. If the matching is successful, the collected ambient sound signal is played to the user through the headset , so that the user can hear the ambient sound. However, in this solution, whether the user can hear the important ambient sound depends on whether the headset manufacturer can store the audio data of the sound that is more important to the user in the headset, but for different users, the same The important sounds in the environment are different, and for a user, the important sounds in different environments are also different, so it is difficult for headset manufacturers to take into account every user and every scene. For all the important sounds to the user, it is still easy for the user to encounter an embarrassing situation by missing the important sound in the environment.

In this regard, this embodiment provides a headphone playback control method. The headphone playback control method can be implemented by one electronic device, or by the cooperation of two or even more than two electronic devices. Please refer to the headphone shown in FIG. 1 . Flow chart of playback control method:

S102: Detect real-time scene parameters of the scene where the headset is currently located.

The so-called real-time scene parameters refer to the scene parameters of the current scene. In this embodiment, the real-time scene parameters of the headset can represent the scene where the headset is currently located. The sound in the environment is different in different scenarios. For example, when the user is working in the office, there will be keyboard tapping sounds; when the user is on public transportation, there will be site announcement sounds in the environment; when the user is walking on the roadside , there will basically be the sound of the car engine and the whistle. Therefore, in some examples, the scene in which the headset is located can be represented by detecting ambient sound signals.

In other examples of this embodiment, the scene in which the headset is located may be reflected by its state information, for example, whether the headset is in a wearing state or not, whether it is in a motion state or a static state, etc. If the headset is in a wearing state, And at the same time in a state of motion, the user should be moving while wearing the headset. In some other examples of this embodiment, the state information of the headset may include other state information, such as temperature state information, humidity state information, and the like, in addition to at least one of wearing state information and motion state information. Furthermore, even the motion state information can be refined into multiple levels according to the size of the motion speed.

The ambient sound signal can be collected by an audio collection unit, the audio collection unit can be set on the earphone or on the terminal communicatively connected to the earphone, or the audio collection unit can exist independently of the earphone and the terminal. Usually, the audio collection unit can be located on the terminal or earphone, and considering that the ambient sound signal collected by the terminal, especially the mobile terminal, such as mobile phone, wearable device, etc. in some scenarios, does not match the actual ambient sound signal of the user For example, when the mobile phone is placed in the pocket of the user's clothes, it will produce friction sound with the clothes pocket. This friction sound will be collected by the audio collection sheet of the mobile phone, and because the pocket blocks the external sound, the friction sound will become a The main ambient sound collected by the mobile phone audio collection unit. But in fact, the user cannot hear the friction sound even if he does not wear headphones. Therefore, in this case, the ambient sound of the environment where the user is located is quite different from the ambient sound of the environment where the mobile phone is located. The ambient sound signal collected by the audio collection unit on the mobile phone cannot be used as the sound signal of the environment where the user is located. But in general, when the user wears the earphone, the ambient sound of the environment where the earphone is located is consistent with the ambient sound of the environment where the user is located. Therefore, in this embodiment, the electronic device can use the audio collection unit on the earphone to perform the environmental sound. Collection of sound signals.

The earphone state information can be collected by sensors, such as at least one of a pressure sensor, a temperature sensor, an infrared sensor, a gravity sensor (gyroscope), and the like. The sensor set to detect the wearing state information of the headset is set on the headset. In this embodiment, the sensor set to detect the motion state information of the headset may be located on the headset. In other examples, considering that the headset will move with the user's movement While moving, the mobile terminal is usually carried by the user. Therefore, the sensor deployed on the mobile terminal can also be used to detect the motion state information of the earphone. In some other examples, sensors configured to collect motion state information of the headset are deployed on both the headset and the terminal, and the electronic device can collect the state information of the headset through the sensors on the headset and the sensor on the terminal jointly.

In some examples, the real-time scene parameters of the headset may only include ambient sound signals, and in other examples, the real-time scene parameters of the headset may only include status information of the headset. However, in this embodiment, the real-time scene parameter of the earphone may include both the ambient sound signal and the state information of the earphone.

S104: Match the real-time scene parameters with the to-be-controlled scene parameters in the parameter library.

In this embodiment, after acquiring the real-time scene parameters of the headset, the electronic device can match the real-time scene parameters with the to-be-controlled scene parameters pre-stored in the parameter library to determine whether the real-time scene parameters match any to-be-controlled scene parameters in the parameter library match. Among them, the scene to be controlled refers to a scene that needs to improve the probability of the ambient sound being received. Therefore, the scene parameter to be controlled is actually the real-time scene parameter corresponding to the scene to be controlled by the headset.

One or more scene parameters to be controlled can be stored in the parameter library, and each scene parameter to be controlled corresponds to a scene to be controlled. In this embodiment, at least one scene to be controlled is automatically identified by the electronic device, and correspondingly, the parameter of at least one scene to be controlled in the parameter library is also automatically determined by the electronic device, and does not require manual settings by programmers or users: parameter library The at least one scene parameter to be controlled pre-stored in is the scene parameter of the scene where the headset is learned when it is detected that the headset is subjected to the first anti-noise reduction operation. The "noise reduction operation" is an operation that reduces the probability that the user hears the ambient sound, then the "anti-noise reduction operation" is the operation that can increase the probability that the user hears the ambient sound. In order to improve the probability that the ambient sound is heard by the user's ears, at least two approaches can be adopted: first, the operation of reducing the sound energy output by the earphone to the user's ear; second, collecting the ambient sound signal and passing the ambient sound signal through the Headphone output. In this embodiment, the "first anti-noise reduction operation" refers to an operation of manually increasing the probability of ambient sound being received. Corresponding to the first anti-noise reduction operation, there is also a second anti-noise reduction operation, and the second anti-noise reduction operation refers to an anti-noise reduction operation performed automatically without a manual operation by the user.

In this embodiment, the first anti-noise reduction operation may include a manual sound energy limiting operation and an operation of manually controlling the earphone to output an ambient sound signal.

The manual sound energy limiting operation is a user operation, which is an operation performed by the user in order to reduce the sound energy of the earphones received by his ears. For example, the manual sound energy limiting operation can be an operation that the user manually reduces the output volume of the earphone, or can also be manually controlled by the user. The operation of stopping the audio playback, and in some other examples, the manual sound energy limiting operation may be an operation of the user taking off the earphone in the wearing state during the earphone playing. In some examples, the manual sound energy limiting operation may be a combination of the above three operations: for example, when the user manually reduces the output volume of the earphone, he removes the earphone that was originally in the wearing state, which is also regarded as a manual sound. It can limit the operation; in other examples, the user manually controls the audio playback to stop and then immediately takes off the headphones that were originally in the wearing state. This operation can also be regarded as a manual sound energy limiting operation.

The operation of manually controlling the earphone to output the ambient sound signal may include the user issuing an instruction to instruct the electronic device to collect the ambient sound signal, and then play the ambient sound signal through the earphone. For example, in an example of this embodiment, an ambient sound collection control button is set on the earphone. If the user wants to hear the ambient sound, he can press the button. After the earphone receives the user's instruction, it can detect the ambient sound. The signal is collected, and the collected sound signal is output to the user. Of course, in some other examples of this embodiment, the ambient sound signal may also be collected by the terminal communicatively connected to the earphone according to the user's instruction.

The following describes the process of identifying the scene to be controlled by the electronic device and storing the parameters of the scene to be controlled in conjunction with the process shown in FIG. 2 :

S202: Detect real-time scene parameters of the scene where the headset is currently located, and monitor the first anti-noise reduction operation for the headset.

In this embodiment, after detecting that the terminal has established a communication connection with the earphone, the electronic device may detect scene parameters of the scene where the earphone is located in real time, and monitor the first anti-noise reduction operation for the earphone. Both the process of detecting the real-time scene parameter and the process of detecting the first anti-noise reduction operation may be performed periodically, but the detection periods of the two detection processes may be the same or different.

S204: Determine whether the first anti-noise reduction operation is monitored.

If the detection result is yes, execute S206, and if the detection result is negative, continue to execute S202.

S206: Determine a scene parameter corresponding to the first anti-noise reduction operation in time as the associated scene parameter of the first anti-noise reduction operation.

If the first anti-noise reduction operation is detected, the electronic device needs to determine the real-time scene parameters corresponding to the first anti-noise reduction operation, and, usually, the user is because the environment has appeared more important to him. Only sound will perform the first anti-noise reduction operation. Therefore, when the electronic device determines the real-time scene parameters corresponding to the detected first anti-noise reduction operation, it is actually backtracking to the earphone before and when the first anti-noise reduction operation occurs. scene parameters. Therefore, after detecting the first anti-noise reduction operation, the electronic device can associate the scene parameter corresponding to the first anti-noise reduction operation in time with the first anti-noise reduction operation as the first anti-noise reduction operation the associated scene parameters.

S208: Store the associated scene parameters in the parameter library as the scene parameters to be controlled.

After determining the relevant scene parameters of the first anti-noise reduction operation, the electronic device can directly store the relevant scene parameters as the to-be-controlled scene parameters, because the user has recently been in the scene corresponding to the relevant scene parameters, and has the ability to limit the sound energy of the headphones. Therefore, the user is very likely to have the need to limit the sound energy of headphones in the corresponding scene in the future. Therefore, the scene corresponding to the associated scene parameter can be used as the scene to be controlled. On this basis, the associated scene parameter is the Control scene parameters.

Considering that some of the user's first anti-noise reduction operations are occasional and have no regularity, for example, at a moment, a stranger stopped the user walking on the sidewalk to ask for directions, in order to hear the other party's question, also out of courtesy , the user takes off the headset. In this case, the electronic device can detect the first anti-noise reduction operation, and can also determine the associated scene parameter corresponding to the first anti-noise reduction operation based on the detection of the real-time scene parameter. But in fact, the associated scene parameter is not suitable as the scene parameter to be controlled, because the user will not be stopped to ask for directions every time in the usual scene, so if the electronic device regards the associated scene parameter as the scene parameter to be controlled After storage, there will be no ambient sound that is important to the user in subsequent scenes. However, because the real-time scene parameters of the headset match the stored parameters of the scene to be controlled, the corresponding scene will also be identified as the scene to be controlled. control the scene. In order to avoid the occurrence of this problem, this embodiment provides a process of learning the scene parameters of the scene where the headset is located, and obtaining the scene parameters to be controlled, as shown in Figure 3:

S302: When the first anti-noise reduction operation is detected, determine a scene parameter corresponding to the first anti-noise reduction operation in time as the associated scene parameter of the first anti-noise reduction operation.

In the process of learning the scene parameters of the scene where the headset is located as the scene parameters to be controlled, if the first anti-noise reduction operation is detected, the electronic device determines the real-time scene parameters corresponding to the first anti-noise reduction operation, and the determined real-time scene parameter The scene parameter is the associated scene parameter corresponding to the first anti-noise reduction operation.

S304: Continue to detect real-time scene parameters of the scene where the headset is located, and match the detected real-time scene parameters with associated scene parameters.

Since the first anti-noise reduction operation performed by the user in the scene corresponding to the associated scene parameter is occasional, in order to avoid using the scene parameter corresponding to the occasional first anti-noise reduction operation as the scene parameter to be controlled, in this embodiment After the electronic device obtains the associated scene parameters, it will continue to detect the real-time scene parameters of the scene where the headset is located, so as to verify the associated scene parameters. The verification of the associated scene parameter by the electronic device is actually to determine whether the user will perform the first anti-noise reduction operation again when the scene corresponding to the associated scene parameter appears again. If the user performs the first anti-noise reduction operation again, it means that the user's first anti-noise reduction operation in this scenario is not accidental, and the user does have a high probability of reducing the sound energy of the earphones in this scenario. Therefore, , the corresponding associated scene parameters can be used as the scene parameters to be controlled. Conversely, if the user does not perform the first anti-noise reduction operation again, it means that the user's previous first anti-noise reduction operation is accidental, and the corresponding associated scene parameters should not be stored as the scene parameters to be controlled.

Therefore, after determining the associated scene parameters, the electronic device obtains the real-time scene parameters of the headset, matches the real-time scene parameters with the associated scene parameters, and also determines whether the scene corresponding to the associated scene parameters is reproduced. Optionally, after the electronic device detects the first anti-noise reduction operation and determines the associated scene parameter corresponding to the first anti-noise reduction operation, it is uncertain when the associated scene parameter will be detected again. After an associated scene parameter is determined, the associated scene parameter may be stored first, but the associated scene parameter needs to be stored separately from the to-be-controlled scene parameter in the electronic device.

S306: When the real-time scene parameter and the associated scene parameter are successfully matched, monitor the first anti-noise reduction operation for the earphone within the first preset time period.

If the real-time scene parameter detected by the electronic device subsequently matches the associated scene parameter successfully, the electronic device monitors the first anti-noise reduction operation for the earphone within the first preset time period. The electronic device monitors the first anti-noise reduction operation for the earphone, in fact, it monitors whether the user will manually reduce the sound energy output by the earphone to the ear again or manually control the earphone to output the ambient sound signal in the reproduced associated scene. The first preset duration may be calculated after the electronic device determines that the real-time scene parameter and the associated scene parameter are successfully matched. The first preset duration can be set by the programmer, or can be defined by the user.

S308: After the first anti-noise reduction operation is detected within the first preset time period, store the associated scene parameters in the parameter library as the scene parameters to be controlled.

If the electronic device detects the user's first anti-noise reduction operation within the first preset time period, it means that the user performs the first anti-noise reduction operation in the same associated scene is not accidental. Therefore, the associated scene should be If the scene is identified as the scene to be controlled, the associated scene parameter corresponding to the associated scene should be used as the scene parameter to be controlled. Therefore, in this case, the electronic device will store the associated scene parameters as the scene parameters to be controlled. The first anti-noise reduction operation performed by the user in the associated scene for the first time may be different from the first anti-noise reduction operation performed in the reproduced associated scene. For example, the user takes off the wearing headphones in the associated scene for the first time The first anti-noise reduction operation is implemented, but in the associated scene of reproduction, the user can complete the first anti-noise reduction operation by controlling the audio playback to stop.

If the electronic device fails to detect the user's first anti-noise reduction operation within the first preset time period, it means that the user previously performed the first anti-noise reduction operation in the associated scene by accident. Therefore, the associated scene should not If it is identified as a scene to be controlled, the electronic device can discard the corresponding associated scene parameters.

S106: After the real-time scene parameters are successfully matched with any to-be-controlled scene parameters in the parameter library, perform a second anti-noise reduction operation.

If the real-time scene parameters obtained by the electronic device are successfully matched with the pre-stored parameters of a to-be-controlled scene, it means that the corresponding to-be-controlled scene is reproduced, and there is a sound that is important to the user in the external environment. In order to prevent the user from missing the sound, The electronic device may automatically perform the second anti-noise reduction operation.

In some examples of this embodiment, the second anti-noise reduction operation may reduce the output sound energy of the earphone, for example, reduce the output volume of the earphone, or pause audio playback. Because the output sound energy of the earphone itself is reduced, the output sound energy of the earphone received by the user's ear is reduced. In this case, the user's ear can hear more other sounds, including sounds in the external environment.

In other examples of this embodiment, the second anti-noise reduction operation may be implemented by the electronic device collecting the ambient sound signal, and then outputting the collected ambient sound signal to the user's ear through the earphone. In this case, the output sound energy of the earphone itself does not need to be reduced, but because the content played by the earphone itself contains the ambient sound, the probability of the user hearing the ambient sound is greatly improved. In some examples of this embodiment, when the headset plays the ambient sound signal to the user, the audio that is originally playing can be paused, or the two can be played together. In an example, when the earphone superimposes and plays the audio originally being played together with the ambient sound signal, the volume of the original audio can be appropriately reduced.

The headset playback control method provided by the embodiment of the present application can automatically learn and determine the scene that requires the user to pay attention to the ambient sound based on the user's historical operations without relying on artificially setting the scene or audio, and based on the real-time scene of the headset. The scene data identifies these scenes, and then automatically limits the sound energy of the headphones in these scenes, preventing users from missing important sounds in the environment and improving the user experience. By pre-detecting the first anti-noise reduction operation, and obtaining the scene parameters corresponding to the headset when the first anti-noise reduction operation is detected, it can identify the scene where the user needs to improve the probability of the ambient sound being received and heard. In which scenarios you need to listen to the ambient sound, take these scenarios as the scenarios to be controlled, and store the scene parameters corresponding to these scenarios in the parameter library as the parameters of the scenarios to be controlled. In the subsequent process, the real-time scene parameters of the scene where the headset is currently located are detected, and the real-time scene parameters are matched with the parameters of the scene to be controlled pre-stored in the parameter library, so as to determine whether the current scene is a scene that needs to improve the received ambient sound. That is, whether it is the scene to be controlled that needs to perform the second anti-noise reduction operation on the earphone. If the real-time scene parameters are successfully matched with the parameters of a to-be-controlled scene in the parameter library, the second anti-noise reduction operation is automatically performed, and the probability of the user hearing the ambient sound is increased through the second anti-noise reduction operation. The scenarios where the user performs the first anti-noise reduction operation on the headphones are usually scenarios where the user needs to listen to the ambient sound. Therefore, the electronic device can automatically learn and summarize the user needs to listen to the ambient sound based on the user's manual operation combined with the real-time scene parameters of the headphones. Scenarios to be controlled, so as to automatically and accurately identify the to-be-controlled scenarios with sound energy limitations in the subsequent process, and automatically perform the second anti-noise reduction operation on the headphones in these to-be-controlled scenarios to prevent users from missing important sounds in the environment . The induction of the scene to be controlled is based on the user's historical operations, which is in line with the user's habits, which is equivalent to "personalized scene customization" for the user, thus improving the intelligence of the playback control of the headset, making the external environment isolated by the headset in a specific scene. The voice was heard.

Embodiment 2:

The user's habits will keep changing. When the scene parameters of a scene are stored by the electronic device as the scene parameters to be controlled, it does not mean that any real-time scene parameters matching the scene parameters to be controlled will be detected at any time in the future. Represents an important voice in the environment that must have user attention. For example, during the period of t1-t2, there is a sound of the user's attention in a scene, so as long as the electronic device recognizes the scene parameters that characterize the scene reproduction, it can be determined that the sound of the user's attention exists in the environment; but after the period of t2, the user If you don't pay attention to the sound in this scene, then the second anti-noise reduction operation automatically performed by the electronic device in this scene is not what the user expects. , the influence of the second anti-noise reduction operation may be manually eliminated. For example, if the second anti-noise reduction operation performed by the electronic device is an operation to limit the output sound energy of the headphones, the user may perform the first sound energy boosting operation. , which controls the headset to boost the sound energy it outputs to the user's ears. This situation indicates that the user's habits may have changed, and the corresponding scene parameters to be controlled may have become invalid. Therefore, the electronic device needs to determine whether the user's habits have changed based on the detection, and whether the pre-stored scene parameters to be controlled need to be adjusted.

The following describes the control process after the electronic device realizes the second anti-noise reduction operation by reducing the output sound energy of the earphone in conjunction with the process shown in FIG. 4 :

S402: Monitor the first sound energy boosting operation for the earphone within a second preset time period.

The "first sound energy boosting operation" is an operation detected by a sensor or an input unit to boost the sound energy output from the earphone to the ear, and it is an operation for the user to manually boost the sound energy output from the earphone to the ear. As can be seen from the introduction of the ability to limit the operation, the first sound energy boosting operation may include: putting on the earphone that was originally taken off during the earphone playing, manually increasing the output volume of the earphone, and manually controlling the start of audio playback.

Here, the second preset duration may be calculated from the time when the electronic device automatically performs the second anti-noise reduction operation. The second preset duration can be set by the programmer, or can be defined by the user.

S404: Determine whether the first sound energy boosting operation is detected within the second preset time period.

If the judgment result is yes, execute S406, and if the judgment result is no, execute S412.

S406: Record the cumulative number of times the first sound energy boosting operation is performed for the target scene parameter to be controlled.

The "target scene parameters to be controlled" referred to here refer to the scene parameters to be controlled that are previously matched from the pre-stored scene parameters to be controlled. The scene parameter c to be controlled, the real-time scene parameter of the headset obtained by the electronic device at one moment is successfully matched with the scene parameter a to be controlled, then the scene parameter a to be controlled is the target scene parameter to be controlled, and the electronic device automatically executes the second step according to the matching result. After the anti-noise reduction operation, it will determine whether the first sound energy boosting operation is detected within the second preset time period. If the judgment result is yes, the electronic device will perform the accumulation of the first sound energy boosting operation for the scene parameter a to be controlled. The number of times is incremented by "1".

S408: Determine whether the accumulated number of times corresponding to the target to-be-controlled scene parameter has been preset.

If the judgment result is yes, execute S410, and if the judgment result is no, execute S412.

In this embodiment, the preset number of times can be set by the programmer, or can be set by the user. The size of the preset number of times reflects the difficulty of the electronic device in determining a parameter of a scene to be controlled as invalid: the higher the value of the preset number of times If the value of the preset times is larger, it is more difficult for the parameter of the scene to be controlled to be determined to be invalid.

S410: Delete the target scene parameter to be controlled.

If it is determined that the number of times the user has manually boosted sound energy after the electronic device performs the second anti-noise reduction operation has exceeded the preset number of times under the parameters of the target scene to be controlled, it means that the parameters of the target scene to be controlled have become invalid, and the electronic device can Delete the target scene parameter to be controlled.

S412: Determine whether the real-time scene parameters of the headset match the target scene parameters to be controlled.

If the judgment result is yes, continue to execute S412, and if the judgment result is no, execute S414.

S414: Perform a second sound energy boosting operation to boost the output sound energy of the earphone.

Since the real-time scene parameters of the headset do not match the parameters of the target scene to be controlled, it means that the scene where the headset is located has changed, and it is no longer in the scene to be controlled corresponding to the parameters of the target scene to be controlled. Therefore, the user may no longer exist in the environment. Therefore, the electronic device can automatically perform the sound energy boosting operation, that is, perform the second sound energy boosting operation, so as to convert the output sound energy of the earphone. For example, in some examples of this embodiment, the electronic device performs the second sound energy boosting operation. When the boost operation is enabled, the headphone output sound energy can be restored to the level before the second anti-noise reduction operation was performed.

For example, it is assumed that at time t1, the user is wearing headphones, and the original output volume of the headphones is k1. In this case, the electronic device determines that the scene parameters corresponding to the headphones are successfully matched with the scene parameter b to be controlled, and the electronic device will reduce the volume of the headphones. For example, the output volume is reduced to k2; after the electronic device determines that the scene parameter corresponding to the headset and the scene parameter b to be controlled no longer match, the electronic device can control the headset again to play audio according to the output volume of k1. For another example, if the electronic device determines that the scene parameter corresponding to the headset successfully matches the scene parameter b to be controlled, it controls the audio playback to stop, then after determining that the scene parameter corresponding to the headset and the scene parameter b to be controlled no longer match, the electronic device can Control the headset to continue audio playback at the previous output volume k1.

If the electronic device detects that the user is speaking, it is very likely that there are important sounds that the user is concerned about in the external environment. Therefore, in some examples of this embodiment, the electronic device may also pre-store the user's voice feature information, and then collect the environment sound signal, and based on pre-stored sound feature information to identify whether the ambient sound signal contains the user's voice. If the user's voice is recognized, the electronic device may automatically perform the second anti-noise reduction operation.

The electronic device in this embodiment may be the headset itself, a terminal connected to the headset, or even other devices independent of the headset and the terminal. For example, in one example, the headset is connected to the mobile phone for communication, while the electronic device The device is a wearable device that is connected to a headset and a mobile phone, respectively. The functions of the aforementioned electronic devices can also be jointly implemented by two or even more physical devices. For example, part of the process of the aforementioned headset playback control method can be implemented by the headset, and another part of the process can be implemented by a terminal communicatively connected to the headset. For example, in some examples of this embodiment, the headset may detect real-time scene parameters of the scene where the headset is currently located. Then, the collected real-time scene parameters are transmitted to the terminal. After receiving the real-time scene parameters, the terminal matches the real-time scene parameters with the pre-stored parameters of the scene to be controlled. The second anti-noise operation increases the probability of users hearing ambient sounds.

In this embodiment, the electronic device can monitor the validity of the pre-stored scene parameters to be controlled based on user operations, and promptly clear the parameters of the scene to be controlled that have expired, so as to avoid erroneously restricting the sound energy of the headset based on the scene parameters to be controlled, and improve the The accuracy of scene recognition to be controlled is conducive to enhancing user experience.

Embodiment three:

This embodiment first provides a headphone playback control apparatus, please refer to FIG. 5 : the headphone playback control apparatus 50 includes a detection unit 502, a matching unit 504 and an anti-noise reduction unit 506, wherein the detection unit 502 is configured to detect the current scene where the headphones are located the real-time scene parameters; the matching unit 504 is set to match the real-time scene parameters with the to-be-controlled scene parameters in the parameter library, and at least one to-be-controlled scene parameter in the parameter library is the first reverse scene parameter when the headset is executed The scene parameters of the scene where the headset is learned during the noise reduction operation; the anti-noise reduction unit 506 is configured to execute a second anti-noise after the real-time scene parameters are successfully matched with any to-be-controlled scene parameters in the parameter library. In the noise reduction operation, the first anti-noise reduction operation and the second anti-noise reduction operation are both used to increase the probability of ambient sound being received.

The headphone playback control device 50 can implement the flow of the foregoing headphone playback control method, and the details of executing the headphone playback control method may refer to the introduction of the foregoing embodiments, which will not be repeated here. The headset playback control device 50 may be deployed on the headset, or may be deployed on a terminal that is communicatively connected to the headset as an audio source for the headset. Even in some other examples, the headset playback control apparatus 50 may also be deployed on a device independent of the headset and the terminal, and the device may be communicatively connected with the headset and the terminal.

The present embodiments provide a storage medium including volatile or non-volatile implemented in any method or technology arranged to store information, such as computer readable instructions, data structures, computer program modules or other data volatile, removable or non-removable media. Storage media include but are not limited to random access memory (Random Access Memory, RAM), read-only memory (Read-Only Memory, ROM), electrically erasable programmable read-only memory (Electrically Erasable Programmable read only memory, EEPROM), flash memory or other memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Video Disc (DVD) or other optical disk storage, magnetic cartridge, tape, magnetic disk storage or other magnetic storage device , or any other medium that can be configured to store the desired information and that can be accessed by a computer.

The storage medium may store one or more computer programs that can be read, compiled and executed by one or more processors, and in this embodiment, the storage medium may store a headphone playback control program. The headphone playback control program can be used by one or more processors to execute any flow of headphone playback control described in the foregoing embodiments.

This embodiment also provides a computer program product, including a computer-readable device, where the computer program as shown above is stored on the computer-readable device. In this embodiment, the computer-readable device may include the computer-readable storage medium as described above. For example, the computer program product includes an electronic device. For example, this embodiment provides an electronic device, as shown in FIG. 6 : the electronic device 6 includes a processor 61 , a memory 62 , and a communication device configured to connect the processor 61 and the memory 62 The bus 63, wherein the memory 62 may be the aforementioned storage medium storing the earphone playback control program. In some examples, the processor 61 may read the headphone playback control program, compile and execute the process of implementing the headphone playback control method described in the foregoing embodiments.

This embodiment also provides an earphone and a terminal. In an optional case, the earphone and the terminal cooperate with each other to implement the earphone playback control method provided by this embodiment:

Referring to FIG. 7 , the headset 70 shown in FIG. 7 includes a detection unit 71 , an audio output unit 72 , a first communication unit 73 and a controller 74 , wherein the detection unit 71 , the audio output unit 72 and the first communication unit 73 are all connected with The controller 74 is communicatively connected. In addition, the earphone 70 is communicatively connected to the terminal through the first communication unit 73 . The communication connection between the earphone 70 and the terminal may be a wired connection or a wireless connection.

The audio output unit 72 is configured to, under the control of the controller 74, output the audio data received by the first communication unit 73 from the terminal, such as the sound of playing a song or a video.

The detection unit 71 is configured to detect real-time scene parameters of the scene where the headset 70 is currently located under the control of the controller 74 . In some examples of this embodiment, the detection unit 71 may include at least one of a sound detection unit and a state detection unit, and in some examples, the detection unit 71 may include both a sound detection unit and a state detection unit, wherein the sound detection unit The unit is configured to collect ambient sound signals of the environment where the earphone 70 is located. For example, the sound detection unit may be a microphone deployed on the earphone 70 . The state detection unit may include multiple types of sensors deployed on the headset, including at least one of pressure sensors, temperature sensors, humidity sensors, infrared sensors, gravity sensors, acceleration sensors, and the like.

In addition to being configured to receive audio data from the terminal side, the first communication unit 73 can also transmit the real-time scene parameters collected by the detection unit 71 to the terminal, so that the terminal can match the real-time scene parameters with the pre-stored scene parameters to be controlled.

Please refer to FIG. 8 : the terminal 80 includes a second communication unit 81 , a processor 82 , and a memory 83 , the processor 82 is communicatively connected to the second communication unit 81 and the memory 83 , and the terminal 80 is communicatively connected to the headset through the second communication unit 81 .

The second communication unit 81 is configured to transmit audio data to the earphone under the control of the processor 82, and realize audio playback through the earphone; in addition, the second communication unit 81 is also configured to receive the real-time scene parameter transmitted by the earphone and representing the scene where the earphone is currently located. .

The processor 82 is set to match the real-time scene parameters with the to-be-controlled scene parameters pre-stored in the memory 83. The to-be-controlled scene parameters are the scene parameters corresponding to the earphones when the first anti-noise reduction operation was previously detected, and the first anti-noise reduction operation was passed. The operation of manually reducing the sound energy output by the earphone to the user's ears; if the real-time scene parameters are successfully matched with a to-be-controlled scene parameter, the processor 82 automatically executes the second anti-noise reduction operation, which can improve the user's Probability of hearing ambient sounds.

In some examples, the real-time scene parameters acquired by the processor 82 may be partly from the headset and partly from the acquisition unit of the terminal 80 itself. For example, the terminal 80 is also provided with an audio acquisition unit, such as a microphone, with multiple types of sensors. The processor 82 can combine the real-time scene parameters collected by the acquisition unit on the terminal 80 and the real-time scene parameters received from the headset to obtain comprehensive scene parameters, which are obtained by combining two kinds of real-time scene parameters from different sources. More accurately determine the scene the headset is currently in.

In some examples of this embodiment, the processor 82 may monitor the first anti-noise reduction operation for the headset. When the first anti-noise reduction operation is detected, the processor 82 determines the scene parameter corresponding to the first anti-noise reduction operation in time as the relevant scene parameter of the first anti-noise reduction operation, and then uses the relevant scene parameter as the scene to be controlled The parameters are stored in the memory 83 .

Optionally, after the processor 82 determines the scene parameters corresponding to the first anti-noise reduction operation in time as the associated scene parameters of the first anti-noise reduction operation, the processor 82 may also match the real-time scene parameters with the associated scene parameters. If the real-time scene parameters and the associated scene parameters are successfully matched, the processor 82 monitors the first anti-noise reduction operation for the earphone within the first preset time period; if the first anti-noise reduction operation is detected within the first preset time period, Then, the processor 82 stores the associated scene parameters in the memory 83 as the scene parameters to be controlled.

In some examples of this embodiment, the memory 83 also stores the voice feature information of the user, and the processor 82 can collect the ambient sound signal through the microphone of the terminal 80 or the microphone on the earphone, and then according to the sound signal stored in the memory 83 The sound feature information identifies the user's voice in the collected ambient sound signal. After recognizing the user's voice, the processor 82 automatically performs the second anti-noise reduction operation.

In some examples of this embodiment, when the processor 82 automatically performs the second anti-noise reduction operation, it may transmit a control instruction to the earphone through the second communication unit 81, instructing the earphone to reduce its output sound energy. For example instructing the headset to lower its output volume. Alternatively, the processor 82 may directly control the audio to stop playing, so that the second communication unit 81 temporarily stops transmitting audio data to the earphone. In some other examples, the processor 82 may collect the ambient sound signal through the microphone of the terminal 80 itself or the microphone on the earphone, and control the second communication unit 81 to transmit the collected ambient sound signal to the earphone, so that the earphone outputs the collected ambient sound signal. to the ambient sound signal.

In some examples, assuming that the to-be-controlled scene parameter that successfully matches the real-time scene parameter is the target to-be-controlled scene parameter, after the processor 82 automatically reduces the output sound energy of the earphone, the manual sound energy can be monitored for a second preset time period The lifting operation, the manual sound energy lifting operation is an operation of manually increasing the sound energy output by the earphone to the user's ear. If the processor 82 detects the manual sound energy boosting operation within the second preset time period, it records the cumulative number of times the manual sound energy boosting operation is performed for the target scene parameter to be controlled; if the accumulated number of times corresponding to the target scene parameter to be controlled exceeds the preset number If the number of times is set, the processor 82 deletes the target scene parameter to be controlled from the memory 83 .

If the manual sound energy boosting operation is not detected within the second preset time period, and it is determined that the real-time scene parameters of the earphones do not match the target scene parameters to be controlled, the processor 82 automatically restores the output sound energy of the earphones to the second preset time period. The level before the denoising operation.

It can be seen that the aforementioned headset 70 and the terminal 80 can cooperate with each other to implement the headset playback control method in the aforementioned embodiment. As for the details of the headset playback control method implemented by the headset 70 and the terminal 80, please refer to the introduction of the aforementioned embodiment, which will not be repeated here.

This embodiment also provides an earphone playback control system, as shown in FIG. 9 , the earphone playback control system 9 includes an earphone 70 and a terminal 80 communicatively connected to the earphone 70 , wherein the earphone 70 is the corresponding earphone in FIG. 7 . , the terminal 80 is the corresponding terminal in FIG. 8 .

FIG. 9 is only used to illustrate the connection between the earphone 70 and the terminal 80 . The earphone 70 is not limited to the wired earphone shown in FIG. Optionally, the earphone 70 may be a wireless earphone, such as a Bluetooth earphone.

The headphone playback control system, headphone, terminal, electronic device, and storage medium provided in this embodiment can automatically summarize the to-be-controlled scene in which the user needs to listen to the ambient sound based on the user's manual operation combined with the real-time scene parameters of the headphone, for use in the subsequent process. Automatically and accurately identify to-be-controlled scenes with sound energy limitations, and automatically limit the sound energy of headphones in these to-be-controlled scenes to prevent users from missing important sounds in the environment. The induction of the scenes to be controlled is based on the user's historical operations, which is in line with the user's habits, which is equivalent to "personalized customization of the scenes to be controlled" for the user, thereby improving the intelligence of the headset playback control and enhancing the user experience.

It can be seen that those skilled in the art should understand that all or some of the steps in the methods disclosed above, the functional modules/units in the system, and the device can be implemented as software (which can be implemented by computer program codes executable by a computing device) , firmware, hardware, and their appropriate combination. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical components Components execute cooperatively. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit.

In addition, communication media typically embodies computer readable instructions, data structures, computer program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and can include any information delivery, as is well known to those of ordinary skill in the art medium. Therefore, the present application is not limited to any particular combination of hardware and software.

Claims

A headphone playback control method, comprising:

Detect the real-time scene parameters of the scene where the headset is currently located;

Matching the real-time scene parameters with the to-be-controlled scene parameters in the parameter library, wherein at least one to-be-controlled scene parameter in the parameter library is learned when the headset is subjected to the first anti-noise reduction operation The scene parameters of the scene where the headset is located;

After the real-time scene parameters are successfully matched with a to-be-controlled scene parameter in the parameter library, a second anti-noise reduction operation is performed.
The headset playback control method according to claim 1, wherein the process of learning the scene parameters of the scene where the headset is located to obtain the scene parameters to be controlled comprises:

In the case of detecting the first anti-noise reduction operation, determining a scene parameter corresponding to the first anti-noise reduction operation in time as the associated scene parameter of the first anti-noise reduction operation;

Continue to detect the real-time scene parameters of the scene where the headset is located, and match the detected real-time scene parameters with the associated scene parameters;

In the case that the real-time scene parameter and the associated scene parameter are successfully matched, monitor the first anti-noise reduction operation for the earphone within a first preset time period;

After the first anti-noise reduction operation is detected within the first preset time period, the associated scene parameter is stored in the parameter library as the to-be-controlled scene parameter.
The headset playback control method according to claim 2, wherein the first anti-noise reduction operation includes at least one of the following: an operation of controlling the headset to change from a wearing state to a non-wearing state, reducing the The operation of outputting the volume, and the operation of controlling the audio playback stop.
The headset playback control method according to claim 1, wherein the detection of real-time scene parameters of the scene where the headset is currently located includes at least one of the following:

collecting the ambient sound signal of the environment where the earphone is located;

The state information in which the earphone is located is detected, wherein the state information includes at least one of wearing state information and motion state information.
The headphone playback control method according to claim 4, wherein after collecting the ambient sound signal of the environment where the headphone is located, the method further comprises:

Identify user characteristic sounds in the collected ambient sound signals;

After recognizing the characteristic sound of the user, the second anti-noise reduction operation is performed.
The headphone playback control method according to any one of claims 1-5, wherein the performing the second anti-noise reduction operation comprises at least one of the following:

reducing the output sound energy of the earphone, wherein the method of reducing the output sound energy of the earphone includes at least one of reducing the output volume of the earphone and controlling audio playback to stop;

A real-time ambient sound signal is collected, and the collected ambient sound signal is output through the earphone.
The headphone playback control method according to claim 6, wherein the to-be-controlled scene parameter that is successfully matched with the real-time scene parameter is the target to-be-controlled scene parameter, and after reducing the output sound energy of the headphone, the method further comprises:

monitoring a first sound energy boosting operation within a second preset time period, wherein the first sound energy boosting operation is an operation detected by a sensor or an input unit to increase the sound energy output from the earphone to the user's ear;

In the case where the first sound energy boosting operation is detected within the second preset time period, record the cumulative number of times the first sound energy boosting operation is performed for the target to-be-controlled scene parameter, and after determining the target After the accumulated number of times corresponding to the parameter of the scene to be controlled exceeds the preset number of times, the parameter of the target scene to be controlled is deleted;

In the case where the first sound energy boosting operation is not detected within the second preset time period, and it is determined that the real-time scene parameters of the headset do not match the target scene parameters to be controlled, execute the second sound energy A lifting operation is performed to boost the output sound energy of the earphone.
A headphone playback control device, comprising:

a detection unit, configured to detect real-time scene parameters of the scene where the headset is currently located;

a matching unit, configured to match the real-time scene parameters with the to-be-controlled scene parameters in the parameter library, wherein at least one to-be-controlled scene parameter in the parameter library is the first anti-noise reduction operation performed on the earphone The scene parameters of the scene where the headset is learned in the case of ;

The anti-noise reduction unit is configured to perform a second anti-noise reduction operation after the real-time scene parameters are successfully matched with the parameters of a scene to be controlled in the parameter library.
An electronic device, including a processor, a memory and a communication bus;

The communication bus is configured to implement connection communication between the processor and the memory;

The processor is configured to execute at least one computer program stored in the memory to implement the headphone playback control method according to any one of claims 1 to 7.
A storage medium storing at least one computer program, the at least one computer program being executable by at least one processor to implement the headphone playback control method according to any one of claims 1 to 7.