WO2019033986A1

WO2019033986A1 - Sound playback device detection method, apparatus, storage medium, and terminal

Info

Publication number: WO2019033986A1
Application number: PCT/CN2018/099660
Authority: WO
Inventors: 许钊铵; 严锋贵; 甘高亭; 郑志勇; 杨海
Original assignee: Oppo广东移动通信有限公司
Priority date: 2017-08-18
Filing date: 2018-08-09
Publication date: 2019-02-21
Also published as: CN107509153A; CN107509153B

Abstract

Provided are a sound playback device detection method, apparatus, storage medium, and terminal. The method comprises: if it is detected that a detection event of a sound playback device has been triggered, playing a preset audio file at a preset volume level by means of the sound playback device and controlling a microphone to acquire a sample audio signal; comparing the sample audio signal to a preset audio signal, said preset audio signal being an audio signal of a preset audio file which is played at a preset volume level when no foreign objects are present at the sound position of the sound playback device and which is acquired by means of the microphone; if the result of comparison satisfies a preset condition, then determining that a foreign object is present at the sound position of the sound playback device.

Description

Method, device, storage medium and terminal for detecting sound playing device

The present application claims the priority of the Chinese Patent Application Serial No. PCT Application No.

Technical field

The present disclosure relates to the field of terminal technologies, for example, to a method, an apparatus, a storage medium, and a terminal for detecting a sound playing device.

Background technique

In order to meet the audio and video needs of users in life and work, such as voice calls, video calls, music listening and watching videos, most terminals have audio playback functions, such as mobile phones, tablets, music players and voice recorders.

The terminal can play sound by using a sound playing device such as a speaker or an earpiece, wherein the earpiece is used for a call. The sounding principle of the speaker and the earpiece is basically the same, which is the process of converting electrical energy into mechanical energy and converting mechanical energy into sound energy by using the principle of electromagnetic induction. Taking the speaker as an example, when the coil in the speaker is energized, the coil generates a magnetic field. Under the interaction with the magnetic field of the magnet, the coil vibrates, thereby driving the vibration of the diaphragm, and the diaphragm discharges the air to realize the sound.

Summary of the invention

The present disclosure provides a method, device, storage medium and terminal for detecting a sound playing device, which can automatically detect a sound playing device.

A method for detecting a sound playing device, comprising: detecting that a detection event of a sound playing device is triggered, playing a preset audio file through a sound playing device at a preset volume level, and controlling a microphone to collect a sample audio signal; The signal is compared with a preset audio signal, wherein the preset audio signal is played at the preset volume level in the absence of foreign matter at the sounding position of the sound playing device and passes through the preset audio file. Depicting an audio signal collected by the microphone; and determining that there is a foreign object in the sounding position of the sound playing device when the comparison result satisfies the preset condition.

A detecting device for a sound playing device, comprising: a playing control module configured to play a preset audio file through a sound playing device at a preset volume level when a detection event of the sound playing device is detected is triggered.

The audio collection control module is configured to control the microphone to collect the sample audio signal while playing the preset audio file through the sound playback device at a preset volume level.

a signal comparison module configured to compare the sample audio signal with a preset audio signal, wherein the preset audio signal is at the preset volume without a foreign object in a sounding position of the sound playing device Level playing the preset audio file and the audio signal collected by the microphone.

The foreign matter determination module is configured to determine that there is a foreign object in the sounding position of the sound playing device when the comparison result satisfies the preset condition.

A computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements a method of detecting a sound playback device as described in the present disclosure.

A mobile terminal comprising a microphone, a sound playing device, a memory, a processor, and a computer program stored on the memory and operable on the processor, the processor executing the computer program to implement sound playback as described in the present disclosure Device detection method.

DRAWINGS

1 is a schematic flow chart of a method for detecting a sound playing device according to an embodiment;

FIG. 2 is a schematic structural diagram of an audio processing hardware system of a smart phone according to an embodiment; FIG.

3 is a block diagram of an audio system architecture provided by an embodiment;

4 is a schematic flow chart of a method for detecting a speaker according to an embodiment;

FIG. 5 is a schematic flowchart of a method for detecting an earpiece according to an embodiment; FIG.

FIG. 6 is a structural block diagram of a detecting apparatus of a sound playing device according to an embodiment; FIG.

FIG. 7 is a schematic structural diagram of a terminal according to an embodiment.

Detailed ways

The present disclosure is described below in conjunction with the drawings and by way of specific embodiments. Some example embodiments are described as a process or method depicted as a flowchart. Although the flowcharts describe the various steps as a sequential process, many of the steps can be implemented in parallel, concurrently, or concurrently. In addition, the order of the steps can be rearranged. The process may be terminated when its operation is completed, but may also have additional steps not included in the figures. The processing may correspond to methods, functions, procedures, subroutines, subroutines, and the like.

FIG. 1 is a schematic flowchart diagram of a method for detecting a sound playing device according to an embodiment of the present invention. The method may be performed by a control device of a screen display, wherein the device may be implemented by software and/or hardware, and may be integrated into a terminal. As shown in Figure 1, the method includes the following steps.

In step 101, when it is detected that the detection event of the sound playing device is triggered, the preset audio file is played by the sound playing device at a preset volume level and the microphone is controlled to collect the sample audio signal.

Exemplarily, the terminal in this embodiment may include a device configured with a microphone and a sound playing device, such as a mobile phone, a tablet computer, a music player, and a voice recorder. The microphone can be either built-in or external.

A microphone (referred to as a microphone, also known as a microphone or a microphone) is an energy conversion device that converts a sound signal into an electrical signal. When the vibration of the sound is transmitted to the diaphragm of the microphone, the magnet inside changes a current signal. The current signal is processed by the sound processing circuit and transmitted to the opposite end of the call or stored, thereby implementing a call or recording. In this embodiment, the type, the number, and the location of the microphone are not limited. For example, for a mobile phone, it may be one or more electret microphones disposed on the lower side of the mobile phone.

The sound playing device in this embodiment may include a speaker or an earpiece or the like. The sounding principle of the speaker and the earpiece is basically the same, which is the process of converting electrical energy into mechanical energy and converting mechanical energy into sound energy by using the principle of electromagnetic induction. Taking the speaker as an example, when the coil in the speaker is energized, the coil generates a magnetic field. Under the interaction with the magnetic field of the magnet, the coil vibrates, thereby driving the vibration of the diaphragm, and the diaphragm discharges the air to realize the sound. It can be known from the above sounding principle that the speaker or the earpiece needs to discharge air to realize the sound, and when there is a foreign object in the sounding position of the speaker or the earpiece, the sound playback is affected, and the playback volume is generally reduced. In this embodiment, the automatic detection function added by the terminal can be automatically detected by the terminal when there is a foreign object in the sounding position of the sound playing device.

Exemplarily, the detection event of the sound playing device can be automatically triggered by the system, for example, the condition of the sound playing device detecting event is preset in the system, and the condition may be that the terminal is detected when the device is powered on, or may be detected at a preset time interval, or may be When a sound playback request is received, etc.; it may also be triggered according to a user operation, such as an option to trigger a sound playback device detection event in the system setting menu of the terminal, and when the user selects the option, the detection event of the sound playback device is triggered. For different sound playback devices, such as speakers and earpieces, the trigger conditions for the corresponding speaker detection event and handset detection event may be different.

The following takes the smart phone as an example to introduce the audio processing hardware system and system architecture.

FIG. 2 is a schematic structural diagram of an audio processing hardware system of a smart phone according to an embodiment of the present invention. The audio processing circuit is usually in the main control board. The location of the audio processing circuit may be different due to the different designs of different mobile phones. The audio processing circuit of the smartphone includes an audio signal processing circuit, a baseband signal processing circuit, an audio power amplifier, a headphone signal amplifier, an earpiece, a speaker, a microphone, and a headphone interface. Among them, the audio signal processing circuit is the core of the entire audio processing circuit. The audio processing circuit is composed of a receiving audio circuit, a sending circuit, a headphone talking circuit, and the like, including analog/digital (A/D) conversion, digital/analog (A/D) conversion, digital voice signal processing, and analog audio amplification of analog audio. Circuits, etc.

During the call, the local microphone is first called to convert the sound acoustic signal of the sound into an analog audio signal, amplified by an analog audio amplifier circuit, and subjected to A/D conversion by an internal multimode converter to obtain a digital audio signal; The digital audio signal is sent to the baseband processor for speech encoding, channel encoding, etc.; a series of processing such as encryption and interleaving is performed again; finally, the digital narrowband modulation module sent to the baseband processor is modulated to generate the transmitted baseband signal and sent to the radio frequency. The circuit is modulated into a transmitting intermediate frequency and sent to the other party. When answering the telephone, the baseband information is first demodulated from the radio frequency circuit, sent to the baseband processor for digital narrowband demodulation, and the control signal and the voice signal are separated; secondly, the voice signal is decrypted, deinterleaved, recombined, etc. Processing, then performing channel decoding and speech decoding; finally obtaining a pure digital speech signal, which is sent to a multi-mode converter in the speech signal processor for D/A conversion; after being restored to an analog audio signal, after the audio power is amplified, the handset is sounded . If the speakerphone is selected, the baseband processor turns off the handset receiver amplifier, activates the hands-free receiver amplifier (ringing amplifier), and amplifies the audio signal power to push the speaker to sound.

When recording, similar to the above process, the mechanical sound wave signal of the sound is first converted into an analog audio signal by a microphone, amplified by an analog audio amplifying circuit, and digital audio signal is obtained after A/D conversion, according to a preset audio format. Coding and storage. When playing a recording or other audio file, the audio file is decoded to obtain a digital audio signal, which is converted into an analog audio signal after D/A conversion, and the audio signal power is amplified to drive the speaker to sound.

In this embodiment, a preset audio file may be stored in the terminal in advance, and the preset audio file is played. The pre-stored audio file and the preset volume level can be selected by the designer according to the actual situation, and the preset audio file and/or the preset volume level corresponding to different sound playing devices can be different. The audio signal collected by the microphone may be the above-mentioned analog audio signal converted from the mechanical sound wave signal, or may be an amplified analog audio signal, or may be an A/D converted digital audio signal, etc., according to the signal. The different forms are respectively set corresponding to the preset conditions below. In order to facilitate the interaction between the terminal and the user, the terminal generally provides a volume adjustment function to the user, and the user can adjust the volume level of the sound played by the terminal by adjusting the volume adjustment button or the volume adjustment progress bar, and the terminal adjusts according to the user. The volume level of the audio signal to be played is correspondingly amplified, such as power amplification, to meet the user's listening needs. The division strategy for the volume level may be different in different terminals, that is, the total number of volume levels and the volume level corresponding to each volume level may be different.

As shown in FIG. 3, the audio system architecture provided in this embodiment includes a user space, a kernel space, and a hardware system. The user space includes an application layer, an application framework layer, and a hardware abstraction layer (HAL). The kernel space includes a driver layer, and the hardware system includes a speaker. The application layer is the top layer of the audio system. You can write an application to perform corresponding logical operations, such as detecting an application that triggers a recording event, presetting standard audio conditions, and issuing audio playback commands. The application framework layer includes an audio control interface and a standardized plug-in module to provide an audio playback form control interface, as well as a speaker volume control interface. The application framework layer provides two classes, AudioTrack and AudioRecorder, as well as the AudioManager, AudioService, and AudioSystem classes. A system runtime layer (Libraries) is also included between the application framework layer and the hardware abstraction layer. Many of the classes in the Framework layer are actually just "mediations" for applications that use Android library files. Because upper-level applications are generally written in Java, they require the most direct support of the Java interface, which is one of the meanings of the framework layer. As an "intermediary", the framework layer does not really implement specific functions, or only implement some of the functions, but focus on the library to complete. For example, the above AudioTrack, AudioRecorder, MediaPlayer and MediaRecorder can find the corresponding class in the library. This part of the code is placed in the frameworks/av/media/libmedia of the project, mostly written in C++. The hardware abstraction layer of audio is divided into two parts, namely AudioFlinger and AudioPolicyService. In fact, the latter is not a real device, just a virtual device to allow manufacturers to easily customize their own strategies. Depending on the product, audio devices vary widely. In the audio architecture of Android, these problems are solved by the audio.primary of the HAL layer, etc., without the need to modify the upper layer implementation on a large scale. The hardware abstraction layer is the transition from the application framework layer to the driver layer to achieve compatibility with the underlying hardware. The driver layer controls the audio codec according to the characteristics of the audio codec to ensure that the audio codec can work normally, and the audio data obtained by the audio codec is provided to the system layer. In the embodiment, when the preset audio signal is played and the subsequent sound is played, the designed class is the above-mentioned AudioTrack class; when the audio signal is collected, the class involved is the above-mentioned AudioRecorder class.

In step 102, the sample audio signal is compared to a preset audio signal.

The preset audio signal is an audio signal that is played by the preset audio file at the preset volume level and is collected by the microphone in the absence of a foreign object in the sounding position of the sound playing device. Exemplarily, the preset audio signal can be recorded and stored by the terminal before leaving the factory, or can be recorded and stored by the user without confirming the occurrence of the sound playing device. In some embodiments, the preset audio signal may be an analog audio signal converted from a mechanical sound wave signal as described above, or may be an amplified analog audio signal, or may be an A/D converted digital audio. Signals, etc. Generally, the sample audio signal corresponds to a preset audio signal, that is, when the preset audio signal is an analog audio signal converted from a mechanical sound wave signal, the sample audio signal is also an analog audio signal converted from a mechanical sound wave signal; When the preset audio signal is an amplified analog audio signal, the sample audio signal is also an amplified analog audio signal, and the amplification processing is the same, and the magnification is the same. Comparing the amplified analog audio signals makes it easier to compare the differences between the two.

As can be seen from the above, the speaker or the earpiece needs to be ventilated to achieve sound, and when there is a foreign object in the sounding position of the speaker or the earpiece, the corresponding playback volume is generally reduced. If there is a foreign object in the sounding position of the speaker, the playback volume will be smaller when the preset audio signal is played through the speaker, and the sound volume corresponding to the sample audio signal collected by the microphone is smaller than that of the foreign object. The situation will also be smaller. Similarly, if there is a foreign object in the sounding position of the earpiece, the playing volume when playing the preset audio signal through the earpiece will become smaller than that in the case where no foreign matter exists, so the sound volume corresponding to the sample audio signal collected by the microphone is compared with The situation of foreign matter will also become smaller. Therefore, the sample audio signal can be compared with the preset audio signal to determine whether or not foreign matter is present based on the comparison result.

The three properties of the sound are volume, pitch, and tone. Among them, the volume is also called loudness or sound intensity, which refers to the subjective feeling of the human ear on the strength of the sound heard. The objective evaluation scale is the amplitude of the sound. Amplitude refers to the maximum distance from the original position during the vibration of the object. The loudness of the sound heard by the human ear is related to the amplitude of the sound source. Generally, the louder the louder the stronger the amplitude.

In step 103, when the comparison result satisfies the preset condition, it is determined that there is a foreign object in the sounding position of the sound playing device.

Illustratively, the preset conditions can be determined experimentally or by simulation. Due to the difference in the playing environment, the sample audio signal may not be exactly the same as the preset audio signal, and when the difference between the two is within a certain preset range, it may be considered that there is no foreign object currently, and the difference between the two exceeds the preset range. At the time, it is considered that there is a foreign matter in the sounding position of the sound playing device.

The detecting method of the sound playing device provided in this embodiment detects that when the detecting event of the sound playing device is triggered, playing the preset audio file through the sound playing device at a preset volume level and controlling the microphone to collect the sample audio signal, the sample audio is The signal is compared with the preset audio signal, and when the comparison result satisfies the preset condition, it is determined that there is a foreign object in the sounding position of the sound playing device. By adopting the above technical solution, the terminal can automatically detect that the sound playing device such as the speaker or the earpiece is blocked by foreign matter, enriching the function of the terminal.

In some embodiments, before the comparing the sample audio signal with the preset audio signal, the detecting method of the sound playing device further comprises: performing denoising processing on the sample audio signal to filter out the playing environment. The interference of the noise on the sample audio signal. In this embodiment, the sounds that are not related to the sound in the preset audio file are considered to be the noise of the playing environment. For example, when playing the preset audio file, someone next to them speaks loudly, or there is a car whistle, etc. Since the comparison result causes a large interference, the above-described operation of denoising the sample audio signal can improve the accuracy of determining whether or not foreign matter is present, and preventing a misjudgment.

In some embodiments, the first sound level of the sample audio signal corresponding to the same preset time period may be compared with the second sound level of the preset audio signal to obtain a sound level comparison result. The first acoustic sound level includes an amplitude average value of the sample audio signal in the preset time period, and the second sound sound level includes an amplitude average value of a preset audio signal in the preset time period. Since the playing of the preset audio file and the audio signal acquisition of the microphone are performed simultaneously, the sound content corresponding to the preset audio signal is substantially the same, and the sound level of the two audio signals corresponding to the same preset time period is Can be used to measure the presence of foreign objects in the sounding position of the sound playback device. The start time, duration, and number of preset time periods can be set according to the characteristics of the preset audio file. For example, it may be that the 5th to 15th seconds of the start of recording is the preset time period, or may be the 5th second of the start of recording, and then the time period of each time of 1 second is a preset time period.

In some embodiments, determining that the sounding position of the sound playing device has a foreign object when the comparison result satisfies the preset condition, including: when the sound sound level comparison result includes the first sound level is less than the first When the product of the two-tone sound level and the preset ratio value is determined, it is determined that there is a foreign object in the sounding position of the sound playing device. Exemplarily, the preset ratio value may be set according to actual needs, and may generally be less than 1, such as 0.9, and may of course be equal to 1.

In some embodiments, when the first sound level is greater than or equal to a product of the second sound level and a preset ratio value, determining that the sounding position of the sound playing device is not There is a foreign object.

In some embodiments, after the determining that there is a foreign object in the sounding position of the sound playing device, the detecting method of the sound playing device further comprises: adjusting the current playing mode to improve the playing when the sound playing event is monitored volume. When there is a foreign object, the played sound will become smaller, affecting the user's listening, so the current play mode can be adjusted to increase the playback volume. Illustratively, there may be many implementations for adjusting the current play mode, and several ways are given below as illustrative illustrations. The first one is to adjust the gain of the analog audio signal to be played by adjusting the hardware gain to increase the magnification, thereby increasing the playback volume. Secondly, processing the audio data to be played, such as multiplying the audio data by a preset. a coefficient, such as 1.2, thereby increasing the amplitude of the analog audio signal corresponding to the digital audio signal, thereby increasing the playback volume; and a third, playing the sound through the sound playback device at the target volume level, wherein the target volume level is high The setting value of the current volume level, for example, the setting value of the current volume level is 5, and the sound can be played at the target volume level 7. Among them, the third way to adjust the current play mode, the adjustment method is simple and fast, the response speed is fast, and the impact on the audio itself to be played is small, and the distortion is avoided.

In some embodiments, after the determining that there is a foreign object in the sounding position of the sound playing device, the detecting method of the sound playing device further comprises: determining a corresponding sound level according to the product and the first sound level Adjusting a value; the sound playing by the sound playing device at a target volume level, comprising: determining a target volume level according to a set value of a current volume level and the volume level adjustment value; and passing the sound at the target volume level Play the device for sound playback. For example, the corresponding volume level adjustment value may be determined according to the difference between the product and the first sound level, and the terminal may pre-store the correspondence between different difference values and the volume level adjustment value; or according to the product and The quotient of the first sound level determines the corresponding volume level adjustment value, and the terminal can pre-store the correspondence between different quotient and volume level adjustment values.

In some embodiments, after the determining that there is a foreign object in the sounding position of the sound playing device, the detecting method of the sound playing device further comprises: controlling the sound playing device to generate the ultrasonic wave. Such a setting can automatically clear the foreign matter present at the sounding position. Optionally, after the ultrasonic wave is generated, the preset audio file may be played again, and the related operations described above are performed to determine whether the foreign object has been cleared.

FIG. 4 is a schematic flowchart diagram of a method for detecting a speaker according to an embodiment of the present invention, where the method includes the following steps.

In step 401, when it is detected that the speaker detection event is triggered, the preset audio file is played through the speaker at a preset volume level a and the microphone is controlled to acquire the sample audio signal.

The speaker can also be replaced by a sound playback device such as an earpiece.

In step 402, the first sound level A of the sample audio signal corresponding to the same preset time period is compared with the second sound level B of the preset audio signal to obtain a sound level comparison result.

In step 403, it is determined whether A is smaller than k×B. If A is smaller than k×B, step 404 is performed; if A is greater than or equal to k×B, the flow is ended. Where k is the preset scale value and "x" is the multiplication operation.

In step 404, it is determined that there is a foreign object in the sounding position of the speaker.

In step 405, a corresponding volume level adjustment value b is determined based on the value of (k x B-A), and "-" is a subtraction operation. For example, the terminal may pre-store the correspondence between different difference values and volume level adjustment values, and determine the volume level adjustment value b according to the value of (k×B-A) and the correspondence between the previously stored different difference values and the volume level adjustment values.

In step 406, the target volume level is determined to be d=c+b according to the set value c of the current volume level and the volume level adjustment value b, and "+" is an addition operation.

In step 407, sound playback is performed through the speaker at the target volume level d.

The method for detecting the speaker provided in this embodiment can automatically detect whether there is a foreign object in the sounding position of the speaker, and when there is a foreign object, raise the volume level to ensure that the played sound is not affected by the presence of foreign matter.

FIG. 5 is a schematic flowchart of a method for detecting an earpiece according to an embodiment of the present invention, where the method includes the following steps.

In step 501, when it is detected that the earpiece detection event is triggered, the preset audio file is played through the speaker at a preset volume level e and the microphone is controlled to acquire the sample audio signal.

The earpiece can also be replaced by a sound playback device such as a speaker.

In step 502, the sample audio signal is denoised to filter out interference of the noise in the playback environment to the sample audio signal.

In step 503, the first sound level C of the sample audio signal corresponding to the same preset time period is compared with the second sound level D of the preset audio signal to obtain a sound level comparison result.

In step 504, it is determined whether C is less than y×D. If C is less than y×D, step 505 is performed; if C is greater than or equal to y×D, the flow is ended. Where y is the preset scale value and "x" is the multiplication operation.

In step 505, it is determined that there is a foreign object in the sounding position of the earpiece.

In step 506, a corresponding volume level adjustment value f is determined based on the value of (y x D ÷ C), and "÷" is a division operation. For example, the terminal may pre-store the correspondence between different quotient and volume level adjustment values, and determine the volume level adjustment value f according to the value of (y×D÷C) and the correspondence between the different quotient and volume level adjustment values stored in advance. .

In step 507, the target volume level h = [g x f] is determined based on the set value g of the current volume level and the volume level adjustment value f, and [] is a rounding operation.

In step 508, the sound is played through the earpiece at the target volume level h.

The method for detecting the earpiece provided by the embodiment can automatically detect whether there is a foreign object in the sounding position of the earpiece, and when there is a foreign object, raise the volume level to ensure that the user hears the voice of the opposite end when using the terminal to talk with another person. The size is not affected by the presence of foreign objects.

FIG. 6 is a structural block diagram of a detecting apparatus of a sound playing device according to an embodiment of the present invention. The device may be implemented by software and/or hardware, and is generally integrated in a terminal, and the sound playing device may be implemented by executing a detecting method of the sound playing device. The foreign matter at the utterance position is detected. As shown in Figure 6, the device includes the following modules.

The play control module 601 is configured to play the preset audio file through the sound playing device at a preset volume level when the detection event that the sound playing device is detected is triggered.

The audio collection control module 602 is configured to control the microphone to acquire the sample audio signal while playing the preset audio file through the sound playing device at a preset volume level.

The signal comparison module 603 is configured to compare the sample audio signal with a preset audio signal, wherein the preset audio signal is the preset in the case where no foreign object exists in the sounding position of the sound playing device. The volume level plays the preset audio file and the audio signal collected by the microphone.

The foreign object determination module 604 is configured to determine that there is a foreign object in the sounding position of the sound playing device when the comparison result satisfies the preset condition.

The detecting device of the sound playing device provided by the embodiment detects that the detecting event of the sound playing device is triggered, plays the preset audio file through the sound playing device at a preset volume level, and controls the microphone to collect the sample audio signal, and the sample audio signal is Comparing with the preset audio signal, when the comparison result satisfies the preset condition, it is determined that there is a foreign object in the sounding position of the sound playing device. By adopting the above technical solution, the terminal can automatically detect that the sound playing device such as the speaker or the earpiece is blocked by foreign matter, enriching the function of the terminal.

In an embodiment, the apparatus may further include a denoising module configured to perform denoising processing on the sample audio signal to compare the sample audio signal with the preset audio signal to filter out the playing environment. The interference of the noise on the sample audio signal.

In an embodiment, the signal comparison module is further configured to: compare a first sound level of the sample audio signal corresponding to the same preset time period with a second sound level of the preset audio signal to obtain an acoustic sound level Comparing results.

In an embodiment, the foreign object determination module is further configured to: when the sound intensity comparison result includes the product of the first sound level being less than the product of the second sound level and a preset ratio value, determining the There is a foreign object in the sounding position of the sound playback device.

In an embodiment, the device may further include a play adjustment module, configured to adjust the current play mode to improve the play after the sound play event is detected after the determining that the sound play position of the sound playing device exists. volume.

In an embodiment, the play adjustment module is further configured to: perform sound play by the sound playback device at a target volume level, wherein the target volume level is higher than a set value of the current volume level.

In an embodiment, the apparatus may further include an adjustment value determining module configured to determine a corresponding volume according to the product and the first acoustic sound level after the determining that there is a foreign object in the sounding position of the sound playing device The level adjustment value is further set to: determine a target volume level according to the set value of the current volume level and the volume level adjustment value; and perform sound playback by the sound playing device at the target volume level.

The present embodiment also provides a storage medium containing computer executable instructions for performing a prompting method when executed by a computer processor, the method comprising the following steps.

When it is detected that the detection event of the sound playing device is triggered, the preset audio file is played by the sound playing device at a preset volume level and the microphone is controlled to collect the sample audio signal.

Comparing the sample audio signal with a preset audio signal, wherein the preset audio signal is played at the preset volume level in the absence of foreign matter at a sounding position of the sound playing device An audio file and an audio signal collected by the microphone. as well as

When the comparison result satisfies the preset condition, it is determined that there is a foreign object at the sounding position of the sound playing device.

Storage Media - Any of various types of memory devices or storage devices, including non-transitory storage media. The term "storage medium" is intended to include: a mounting medium such as a CD-ROM, a floppy disk or a tape device; a computer system memory or a random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc. Non-volatile memory, such as flash memory, magnetic media (such as hard disk or optical storage); registers or other similar types of memory elements, and the like. The storage medium may also include other types of memory or a combination thereof. Additionally, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system, the second computer system being coupled to the first computer system via a network, such as the Internet. The second computer system can provide program instructions to the first computer for execution. The term "storage medium" can include two or more storage media that can reside in different locations (eg, in different computer systems connected through a network). A storage medium may store program instructions (eg, implemented as a computer program) executable by one or more processors.

A storage medium containing computer executable instructions, the computer executable instructions being configured to perform the detecting operation of the sound playing device as described above, and the sound playing device provided by any embodiment of the present disclosure may also be provided. Related operations in the detection method.

The embodiment provides a terminal in which the detecting device of the sound playing device provided in this embodiment can be integrated. FIG. 7 is a schematic structural diagram of a terminal according to an embodiment of the present disclosure. The terminal may be, for example, a mobile terminal. As shown in FIG. 7, the terminal may include a casing (not shown), a memory 701, and a central processing unit (CPU) 702 (also referred to as a processor, below). Referred to as CPU), a circuit board (not shown), a power supply circuit (not shown), a microphone 713, and a sound playback device (such as speaker 711 in the figure). The circuit board is disposed inside a space enclosed by the casing; the CPU 702 and the memory 701 are disposed on the circuit board; and the power circuit is configured to supply power to a plurality of circuits or devices of the terminal The memory 701 is configured to store executable program code; the CPU 702 runs a computer program corresponding to the executable program code by reading executable program code stored in the memory 701 to implement the following steps.

The terminal further includes: a peripheral interface 703, an RF (Radio Frequency) circuit 705, an audio circuit 706, a speaker 711, a power management chip 708, an input/output (I/O) subsystem 709, a touch screen 712, and other inputs. / Control device 710 and external port 704, these components communicate via one or more communication buses or signal lines 707.

The illustrated terminal 700 is merely one example of a terminal, and the terminal 700 may have more or fewer components than those shown in the figures, two or more components may be combined, or may have different component configurations. The various components shown in the figures can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The following describes the terminal for prompting the user provided in this embodiment, and the terminal takes a mobile phone as an example.

The memory 701 can be accessed by the CPU 702, the peripheral interface 703, etc., and the memory 701 can include a high speed random access memory, and can also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices. Or other volatile solid-state storage devices.

Peripheral interface 703, which can connect the input and output peripherals of the device to CPU 702 and memory 701.

I/O subsystem 709, which can connect input and output peripherals on the device, such as touch screen 712 and other input/control devices 710, to peripheral interface 703. The I/O subsystem 709 can include a display controller 7091 and one or more input controllers 7092 for controlling other input/control devices 710. Wherein, one or more input controllers 7092 receive electrical signals from other input/control devices 710 or transmit electrical signals to other input/control devices 710, and other input/control devices 710 may include physical buttons (press buttons, rocker buttons, etc.) ), dial, slide switch, joystick, click wheel. The input controller 7092 can be connected to any of the following: a keyboard, an infrared port, a USB interface, and a pointing device such as a mouse.

The touch screen 712 is an input interface and an output interface between the user mobile terminal and the user, and displays the visual output to the user. The visual output may include graphics, text, icons, videos, and the like.

Display controller 7091 in I/O subsystem 709 receives an electrical signal from touch screen 712 or an electrical signal to touch screen 712. Touch screen 712 detects contact on the touch screen, display controller 7091 converts the detected contact into interaction with a user interface object displayed on touch screen 712, ie, implements human-computer interaction, and the user interface object displayed on touch screen 712 can be operational The icon of the game, the icon of the network to the corresponding network, and the like. Wherein, the device may further comprise a light mouse, which is a touch sensitive surface that does not display a visual output, or an extension of a touch sensitive surface formed by the touch screen.

The RF circuit 705 is configured to establish communication between the mobile phone and the wireless network (ie, the network side) to implement data reception and transmission between the mobile phone and the wireless network. For example, sending and receiving short messages, emails, and the like. The RF circuit 705 receives and transmits an RF signal, also referred to as an electromagnetic signal, which converts the electrical signal into an electromagnetic signal or converts the electromagnetic signal into an electrical signal and communicates with the communication network and other devices through the electromagnetic signal. The RF circuit 705 may include known circuitry for performing these functions, including an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec (COder) -DECoder, CODEC) Chipset, Subscriber Identity Module (SIM), etc.

The audio circuit 706 is arranged to receive audio data from the peripheral interface 703, convert the audio data into an electrical signal, and transmit the electrical signal to the speaker 711.

The speaker 711 is arranged to restore the voice signal received by the mobile phone from the wireless network through the RF circuit 705 to sound and play the sound to the user.

The power management chip 708 is configured to provide power and power management for the hardware connected to the CPU 702, the I/O subsystem, and the peripheral interface.

The terminal provided in this embodiment can automatically detect that the sound playing device such as the speaker or the earpiece is blocked by foreign matter, thereby enriching the function of the terminal.

The detecting device and the terminal of the sound playing device provided in the above embodiments may perform the detecting method of the sound playing device provided by any embodiment of the present disclosure, and have a corresponding functional module for performing the method. For details of the techniques not described in the above embodiments, reference may be made to the method of detecting a sound playing device provided by any of the embodiments of the present disclosure.

Claims

A method for detecting a sound playing device, comprising:

When it is detected that the detection event of the sound playing device is triggered, playing the preset audio file through the sound playing device at a preset volume level and controlling the microphone to collect the sample audio signal;

Comparing the sample audio signal with a preset audio signal, wherein the preset audio signal is played at the preset volume level in the absence of foreign matter at a sounding position of the sound playing device An audio file and an audio signal collected by the microphone;

When the comparison result satisfies the preset condition, it is determined that there is a foreign object in the sounding position of the sound playing device.
The method of claim 1, wherein before comparing the sample audio signal with a preset audio signal, the method further comprises: performing a denoising process on the sample audio signal to filter out a playback environment The interference of the noise on the sample audio signal.
The method according to claim 1 or 2, wherein said comparing said sample audio signal with a preset audio signal comprises: first sounding the first sound level of said sample audio signal corresponding to the same preset time period The second acoustic level of the preset audio signal is compared to obtain a sound acoustic comparison result.
The method according to claim 3, wherein the determining that there is a foreign object in the sounding position of the sound playing device when the comparison result satisfies the preset condition comprises: including the first sound sound in the sound sound level comparison result When the degree is less than the product of the second acoustic sound level and the preset proportional value, it is determined that there is a foreign object in the sounding position of the sound playing device.
The method according to claim 4, wherein after the determining that there is a foreign object in the sounding position of the sound playing device, the method further comprises: adjusting the current playing mode to improve the playing when the sound playing event is monitored volume.
The method according to claim 5, wherein the adjusting the current play mode comprises: performing sound play by the sound playback device at a target volume level, wherein the target volume level is higher than a current volume level setting value.
The method according to claim 6, wherein after the determining that there is a foreign object in the sounding position of the sound playing device, the method further comprises:

Determining a corresponding volume level adjustment value according to the product and the first acoustic sound level;

Performing sound playback by the sound playing device at a target volume level, including:

Determining a target volume level according to the set value of the current volume level and the volume level adjustment value;

Sound playback is performed by the sound playback device at the target volume level.
A detecting device for a sound playing device, comprising:

a play control module configured to play the preset audio file through the sound playing device at a preset volume level when the detection event of the sound playing device is detected is triggered;

The audio collection control module is configured to control the microphone to collect the sample audio signal while playing the preset audio file through the sound playing device at a preset volume level;

a signal comparison module configured to compare the sample audio signal with a preset audio signal, wherein the preset audio signal is at the preset volume without a foreign object in a sounding position of the sound playing device Level playing the preset audio file and the audio signal collected by the microphone;

The foreign matter determination module is configured to determine that there is a foreign object in the sounding position of the sound playing device when the comparison result satisfies the preset condition.
The apparatus of claim 8, further comprising a denoising module configured to perform denoising processing on the sample audio signal prior to comparing the sample audio signal with a preset audio signal to filter out a playback environment The interference of the noise on the sample audio signal.
The apparatus according to claim 8 or 9, wherein the signal comparison module is further configured to: the first sound level of the sample audio signal corresponding to the same preset time period and the second sound level of the preset audio signal Compare to get the sound and sound comparison results.
The apparatus according to claim 10, wherein the foreign object determination module is further configured to: when the first sound level is less than the product of the second sound level and the preset ratio value, It is determined that there is a foreign matter in the sounding position of the sound playing device.
The apparatus according to claim 11, further comprising a play adjustment module configured to adjust a current play mode to improve playback after detecting a sound play event after determining that a foreign object exists in a sounding position of the sound playing device volume.
The apparatus according to claim 12, wherein the play adjustment module is further configured to: perform sound playback by the sound playback device at a target volume level, wherein the target volume level is higher than a set value of the current volume level.
The apparatus according to claim 13, further comprising an adjustment value determining module configured to determine a corresponding volume according to the product and the first acoustic sound level after the determining that there is a foreign object in the sounding position of the sound playing device Level adjustment value;

The play adjustment module is further configured to: determine a target volume level according to the set value of the current volume level and the volume level adjustment value; and perform sound playback by the sound playing device at the target volume level.
A computer readable storage medium having stored thereon a computer program, the program being executed by a processor to implement the method of detecting a sound playing device according to any one of claims 1-7.
A terminal comprising a microphone, a sound playing device, a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor executes the computer program as claimed in any of claims 1-7 A method of detecting a sound playback device as described.
The terminal of claim 16, further comprising: a peripheral interface, a radio frequency circuit, an audio circuit, and a speaker, wherein the peripheral interface, the radio frequency circuit, the audio circuit, and the speaker communicate via one or more communication buses or signal lines .
The terminal of claim 17, wherein the radio frequency circuit is configured to establish communication between the terminal and a wireless network to implement data reception and transmission by the terminal and the wireless network.
The terminal of claim 18, said audio circuit being arranged to receive audio data from said peripheral interface, convert said audio data into an electrical signal, and transmit said electrical signal to said speaker.
The terminal of claim 19, said speaker being arranged to restore said electrical signal to sound and play said sound.