WO2020057656A1 - Method, device and mobile terminal for collecting external sound wave based on sound output element - Google Patents

Method, device and mobile terminal for collecting external sound wave based on sound output element Download PDF

Info

Publication number
WO2020057656A1
WO2020057656A1 PCT/CN2019/107101 CN2019107101W WO2020057656A1 WO 2020057656 A1 WO2020057656 A1 WO 2020057656A1 CN 2019107101 W CN2019107101 W CN 2019107101W WO 2020057656 A1 WO2020057656 A1 WO 2020057656A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound output
output element
sound
audio signal
mobile terminal
Prior art date
Application number
PCT/CN2019/107101
Other languages
French (fr)
Chinese (zh)
Inventor
蒋勇高
王步青
Original Assignee
深圳市万普拉斯科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市万普拉斯科技有限公司 filed Critical 深圳市万普拉斯科技有限公司
Publication of WO2020057656A1 publication Critical patent/WO2020057656A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/03Constructional features of telephone transmitters or receivers, e.g. telephone hand-sets

Definitions

  • Step S100 controlling the sound output element and the sound input element to form a loop.
  • the mobile terminal may include a smart phone, a tablet computer, and the like.
  • the mobile terminal is preferably a smart phone or a tablet computer.
  • the mobile terminal may include a processor, a memory, a sound input element, and a sound output element.
  • the mobile terminal is provided with a sound output path and an environment acquisition path of the sound output element.
  • the memory may be used to store computer-readable instructions, and the processor runs the computer-readable instructions to cause the mobile terminal to execute the method for collecting external sound waves based on the sound output element or the device for collecting external sound waves based on the sound output element. The function of each module.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Telephone Function (AREA)

Abstract

Disclosed by the present application are a method, device, mobile terminal and non-volatile computer readable storage medium for collecting external sound waves on the basis of a sound output element. The method is applied to the mobile terminal. The mobile terminal comprises a sound output element and a sound input element and is provided with a sound output channel and an environment acquisition channel of the sound output element. The method comprises: controlling the sound output element and the sound input element to form a loop; when the sound output element is not in a sound output state, controlling the sound output element to switch to the environment acquisition channel; controlling the sound output element to collect an external environment acoustic signal; obtaining an audio signal received from the sound input element and pre-processing the audio signal and the environment acoustic signal. According to the technical solution of the present application, the sound output element may have multiple functions, the cost of the device may be reduced, and noise elimination and other functions can be achieved by using the sound input element, thus solving the problem of the hardware space layout for additional components.

Description

基于声音输出元件采集外界声波的方法、装置和移动终端Method, device and mobile terminal for collecting external sound waves based on sound output element
本申请以2018年9月21日提交的申请号为201811107396.4,名称为“基于声音输出元件采集外界声波的方法、装置和移动终端”的中国发明专利申请为基础,并要求其优先权。This application is based on a Chinese invention patent application filed on September 21, 2018 with application number 201811107396.4, entitled "Method, Device and Mobile Terminal for Acquiring External Sound Waves Based on Sound Output Elements", and claims its priority.
技术领域Technical field
本申请涉及通信领域,具体而言,涉及一种基于声音输出元件采集外界声波的方法、装置和移动终端。The present application relates to the field of communications, and in particular, to a method, a device, and a mobile terminal for collecting external sound waves based on a sound output element.
背景技术Background technique
随着人们对通话质量需求的不断提高,移动终端中存在的mic(microphone,麦克风)的个数一般为两个以上,一个主mic用于录制通话音频,另一个或多个副mic则利用双麦降噪原理实现在通话过程中的语音消噪,从而使得在嘈杂环境下也可以保证较好的通话质量。然而,这使得移动终端往往需要在主mic的基础上额外增加副mic以实现双麦降噪,不仅增加了器件成本,而且需要额外的空间来放置该增加的副mic,不利于硬件布局等。With the continuous improvement of people's demand for call quality, the number of mics (microphones) existing in mobile terminals is generally more than two. One main mic is used to record call audio, and the other one or more secondary mics use dual The principle of Mai noise reduction achieves voice denoising during a call, so that better call quality can be guaranteed even in a noisy environment. However, this makes the mobile terminal often need to add an additional secondary mic on the basis of the main mic to achieve dual microphone noise reduction, which not only increases the device cost, but also requires additional space to place the additional secondary mic, which is not conducive to hardware layout and the like.
发明内容Summary of the Invention
鉴于上述问题,本申请提供了一种基于声音输出元件采集外界声波的 方法,通过利用已有的声音输出元件来采集外界声音信号及进行相应处理,可解决现有技术中需要额外增加声音输入元件来实现双麦降噪等问题。In view of the above problems, this application provides a method for collecting external sound waves based on a sound output element. By using an existing sound output element to collect external sound signals and performing corresponding processing, the need to add an additional sound input element in the prior art can be solved. To achieve double wheat noise reduction and other issues.
本申请的一个实施方式提供一种基于声音输出元件采集外界声波的方法,所述基于声音输出元件采集外界声波的方法应用于移动终端,所述移动终端包括声音输出元件和声音输入元件,所述移动终端设有所述声音输出元件的声音输出通路和环境采集通路,所述方法包括:An embodiment of the present application provides a method for collecting external sound waves based on a sound output element. The method for collecting external sound waves based on a sound output element is applied to a mobile terminal. The mobile terminal includes a sound output element and a sound input element. The mobile terminal is provided with a sound output path and an environment acquisition path of the sound output element, and the method includes:
控制所述声音输出元件与所述声音输入元件形成一回路;Controlling the sound output element to form a loop with the sound input element;
当所述声音输出元件未处于声音输出状态时,控制所述声音输出元件切换到所述环境采集通路;When the sound output element is not in a sound output state, controlling the sound output element to switch to the environment acquisition path;
控制所述声音输出元件采集外界环境声波信号;Controlling the sound output element to collect external environment sound wave signals;
获取来自所述声音输入元件接收的音频信号,并将所述音频信号和所述环境声波信号进行预设处理。Acquiring an audio signal received from the sound input element, and performing preset processing on the audio signal and the ambient sound wave signal.
本申请的另一个实施方式提供一种基于声音输出元件采集外界声波的装置,所述基于声音输出元件采集外界声波的装置应用于移动终端,所述移动终端包括声音输出元件和声音输入元件,所述移动终端设有所述声音输出元件的声音输出通路和环境采集通路,所述装置包括:Another embodiment of the present application provides a device for collecting external sound waves based on a sound output element. The device for collecting external sound waves based on a sound output element is applied to a mobile terminal. The mobile terminal includes a sound output element and a sound input element. The mobile terminal is provided with a sound output path and an environment acquisition path of the sound output element, and the device includes:
回路控制模块,用于控制所述声音输出元件与所述声音输入元件形成一回路;A loop control module, configured to control the sound output element and the sound input element to form a loop;
通路切换模块,用于当所述声音输出元件未处于声音输出状态时,使所述声音输出元件切换到所述环境采集通路;A path switching module, configured to switch the sound output element to the environment collection path when the sound output element is not in a sound output state;
采集控制模块,用于当切换到所述环境采集通路时,使所述声音输出元件采集外界环境声波信号;An acquisition control module, configured to cause the sound output element to acquire an external environmental sound wave signal when switching to the environmental acquisition path;
信号处理模块,用于获取来自所述声音输入元件接收的音频信号并将所述音频信号和所述环境声波信号进行预设处理。The signal processing module is configured to obtain an audio signal received from the sound input element and perform preset processing on the audio signal and the ambient sound wave signal.
本申请的又一个实施方式提供一种移动终端,所述移动终端包括控制器、存储器、声音输入元件和声音输出元件,所述移动终端设有所述声音输出元件的声音输出通路和环境采集通路,Another embodiment of the present application provides a mobile terminal including a controller, a memory, a sound input element, and a sound output element. The mobile terminal is provided with a sound output path and an environment acquisition path of the sound output element. ,
所述存储器用于存储计算机可读指令,所述控制器用于执行所述计算机可读指令时实施上述的基于声音输出元件采集外界声波的方法。The memory is configured to store computer-readable instructions, and the controller is configured to implement the above-mentioned method for collecting external sound waves based on a sound output element when executing the computer-readable instructions.
本申请的再一个实施方式提供一种计算机非易失性可读存储介质,其存储计算机可读指令,在所述计算机可读指令被执行时,实施根据上述的基于声音输出元件采集外界声波的方法。Another embodiment of the present application provides a computer non-volatile readable storage medium, which stores computer readable instructions, and when the computer readable instructions are executed, the implementation of collecting external sound waves based on the sound output element described above is implemented. method.
本申请的技术方案通过建立声音输出元件的环境采集通路,以实现利用声音输出元件来采集外界的声波信号,实现了声音输出元件的复用,达到节约器件成本的目的;还通过与声音输入元件形成一回路,可用于通话消噪及语音交互时提高抗干扰等功能,还可解决因增加额外的声音输入元件来实现消噪所带来的空间布局等难题。The technical solution of the present application establishes an environment acquisition channel of a sound output element, so as to use the sound output element to collect external sound wave signals, realizes the reuse of the sound output element, and achieves the purpose of saving the cost of the device. Form a loop, which can be used to reduce noise during calls and improve anti-interference during voice interaction. It can also solve problems such as spatial layout caused by adding additional sound input components to achieve noise cancellation.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更清楚地说明本申请的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,应当理解,以下附图仅示出了本申请的某些实施例,因此不应被看作是对本申请保护范围的限定。In order to explain the technical solution of the present application more clearly, the drawings used in the embodiments are briefly introduced below. It should be understood that the following drawings only show some embodiments of the present application, and therefore should not be used. Seen as a limitation on the scope of protection of this application.
图1为本申请实施例提供的移动终端的结构示意图;FIG. 1 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application;
图2为本申请实施例1的基于声音输出元件采集外界声波的方法的硬件结构示意图;2 is a schematic diagram of a hardware structure of a method for collecting external sound waves based on a sound output element according to Embodiment 1 of the present application;
图3为本申请实施例1的基于声音输出元件采集外界声波的方法的流程示意图;3 is a schematic flowchart of a method for collecting external sound waves based on a sound output element according to Embodiment 1 of the present application;
图4为本申请实施例1的基于声音输出元件采集外界声波的方法的消噪应用示意图;4 is a schematic diagram of an application of noise cancellation based on a method for collecting external sound waves based on a sound output element according to Embodiment 1 of the present application;
图5为本申请实施例2的基于声音输出元件采集外界声波的装置的结构示意图。FIG. 5 is a schematic structural diagram of a device for collecting external sound waves based on a sound output element according to Embodiment 2 of the present application.
主要元件符号说明:Explanation of main component symbols:
100-手机;110-射频电路;120-存储器;130-输入单元;140-显示单元;150-拍摄单元;160-音频电路;170-无线保真模块;180-处理器;190-电源;A-声音输出通路;B-环境采集通路;20-基于声音输出元件采集外界声波的装置;200-回路控制模块;210-通路切换模块;220-采集控制模块;230-信号处理模块。100-mobile phone; 110-RF circuit; 120-memory; 130-input unit; 140-display unit; 150-shooting unit; 160-audio circuit; 170-wireless fidelity module; 180-processor; 190-power supply; A -Sound output path; B-environment acquisition path; 20- device for collecting external sound waves based on sound output elements; 200-loop control module; 210-path switching module; 220- acquisition control module; 230- signal processing module.
具体实施方式detailed description
下面将结合本申请实施例中附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。In the following, the technical solutions in the embodiments of the present application will be clearly and completely described with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all of the embodiments.
在此处附图中描述和示出的本申请实施例的组件可以以各种不同的配置来布置和设计。因此,以下对在附图中提供的本申请的实施例的详细描述并非旨在限制要求保护的本申请的范围,而是仅仅表示本申请的选定实施例。基于本申请的实施例,本领域技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例,都属于本申请保护的范围。The components of the embodiments of the present application described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work fall into the protection scope of the present application.
下述各实施例均可应用于如图1所示的移动终端,如手机,图1示出 了该手机的结构框图,该手机100包括:射频(Radio Frequency,RF)电路110、存储器120、输入单元130、显示单元140、拍摄单元150、音频电路160、无线保真(wireless fidelity,WiFi)模块170、处理器180、以及电源190等部件。其中,射频电路110可用于接收和发送无线信号等;存储器120可用于存储该手机100运行所需的应用程序及用户的相关文件信息等。输入单元130可包括按键、触摸面板,也可以包括其他输入设备等,以用于接收来自用户输入的信息等;显示单元140可以包括显示面板,主要用于显示图像、文字等信息;拍摄单元150主要包括前后置摄像头等,主要用于拍摄图片、视频等;音频电路160连接听筒、扬声器等声音输出设备以及麦克风等声音输入设备,可用于录入或播放语音等;无线保真模块170可用于收发wifi信号以实现信息传输等。处理器180作为手机100的控制中心,主要用于使其他各单元或模块执行相应功能等;而电源190主要包括电池设备,用于为手机100中的各模块或单元提供所需的工作电压等。Each of the following embodiments can be applied to a mobile terminal as shown in FIG. 1, such as a mobile phone. FIG. 1 shows a structural block diagram of the mobile phone. The mobile phone 100 includes: a radio frequency (RF) circuit 110, a memory 120, The input unit 130, the display unit 140, the photographing unit 150, the audio circuit 160, a wireless fidelity (WiFi) module 170, a processor 180, and a power supply 190 and other components. The radio frequency circuit 110 may be used to receive and send wireless signals, and the like, and the memory 120 may be used to store application programs required by the mobile phone 100 and related file information of the user. The input unit 130 may include keys, a touch panel, or other input devices to receive information from a user. The display unit 140 may include a display panel, which is mainly used to display information such as images and text. The shooting unit 150 It mainly includes front and rear cameras, which are mainly used for taking pictures, videos, etc. The audio circuit 160 is connected to sound output devices such as earpieces and speakers, and sound input devices such as microphones, which can be used to record or play voice. wifi signal to realize information transmission and so on. The processor 180, as the control center of the mobile phone 100, is mainly used to make other units or modules perform corresponding functions, etc., while the power supply 190 mainly includes battery equipment, which is used to provide the required working voltage for each module or unit in the mobile phone 100, etc. .
本领域技术人员可以理解,图1中示出的手机100结构并不构成对手机的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。下面以手机为例说明本申请的技术方案,当然,本申请并不限于应用于手机,也可以应用于平板电脑等。Those skilled in the art can understand that the structure of the mobile phone 100 shown in FIG. 1 does not constitute a limitation on the mobile phone, and may include more or fewer parts than those shown in the figure, or combine certain parts, or arrange different parts. The following uses a mobile phone as an example to describe the technical solution of this application. Of course, this application is not limited to being applied to a mobile phone, but can also be applied to a tablet computer or the like.
在移动终端中,声音输出元件主要由振膜、线圈和磁体等结构组成,其工作原理主要包括:当移动终端内部输出的音频电信号经过声音输出元件中的线圈时,使得线圈产生的磁场发生变化,进而带动振膜的振动以激发周围空气的震动,从而发出声波。而对于声音输入元件,其结构同样包括振膜、线圈和磁体等结构,其工作原理主要包括:当外界声波导致声音输入元件中的振膜震动时,此时振膜的机械振动将带动内部线圈的振动, 线圈的振动将使磁场发送变化,进而产生电流信号并送入内部进行数字化等处理,从而实现外界声音的采集。In a mobile terminal, the sound output element is mainly composed of a diaphragm, a coil, and a magnet. Its working principle mainly includes: When the audio electrical signal output by the mobile terminal passes through the coil in the sound output element, the magnetic field generated by the coil occurs. The change, in turn, drives the vibration of the diaphragm to excite the vibration of the surrounding air, thereby emitting sound waves. As for the sound input element, its structure also includes structures such as diaphragm, coil, and magnet. Its working principle mainly includes: When the external sound wave causes the diaphragm of the sound input element to vibrate, the mechanical vibration of the diaphragm will drive the internal coil at this time. The vibration of the coil and the vibration of the coil will change the transmission of the magnetic field, and then generate a current signal and send it to the inside for digitization and other processing, so as to achieve the collection of external sound.
考虑到声音输出元件的结构与声音输入元件的结构相似,而其工作原理相反,本申请提出一种基于声音输出元件采集外界声波的方法。下面以具体的实施例介绍本申请,当然,本申请并不限于这些具体的实施例。Considering that the structure of the sound output element is similar to the structure of the sound input element, and its working principle is opposite, this application proposes a method for collecting external sound waves based on the sound output element. The following describes the present application with specific embodiments. Of course, the present application is not limited to these specific embodiments.
实施例1Example 1
本实施例提出一种基于声音输出元件采集外界声波的方法,该基于声音输出元件采集外界声波的方法可应用于移动终端,如手机、平板电脑等,其中,所述移动终端通常包括声音输出元件和声音输入元件。This embodiment proposes a method for collecting external sound waves based on a sound output element. The method for collecting external sound waves based on a sound output element can be applied to a mobile terminal, such as a mobile phone, a tablet computer, etc., where the mobile terminal usually includes a sound output element And sound input components.
一般地,所述移动终端通常设有所述声音输出元件的声音输出通路,该声音输出通路可用于将内部的音频信号送至所述声音输出元件并向外输出声音。在本申请中,为使声音输出元件能用于采集外界声波,还可在所述移动终端内设有声音输出元件的环境采集通路,通过该环境采集通路可将采集到的外界声波信号送入移动终端内部并进行相应的处理。Generally, the mobile terminal is generally provided with a sound output path of the sound output element, which can be used to send an internal audio signal to the sound output element and output sound externally. In the present application, in order to enable the sound output element to be used to collect external sound waves, an environmental acquisition path for the sound output element may also be provided in the mobile terminal, and the collected external sound wave signals may be sent through the environmental acquisition path. The mobile terminal internally performs corresponding processing.
请参照图2,所述移动终端包括处理器180及音频电路160,而音频电路160包括ADC转换单元和DAC转换单元,由于声音输出元件通常仅与DAC转换单元连接,即形成图2所示的声音输出通路A。所述DAC转换单元可用于将内部的数字音频信号转换成模拟信号并通过该声音输出通路A送至声音输出元件以进行输出。示范性地,所述音频电路160可为声卡等设备。Please refer to FIG. 2, the mobile terminal includes a processor 180 and an audio circuit 160, and the audio circuit 160 includes an ADC conversion unit and a DAC conversion unit. Since a sound output element is usually only connected to the DAC conversion unit, the system shown in FIG. 2 is formed. Sound output path A. The DAC conversion unit may be used to convert an internal digital audio signal into an analog signal and send it to a sound output element through the sound output path A for output. Exemplarily, the audio circuit 160 may be a device such as a sound card.
而本实施例中,如图2所示,声音输出元件还同时电性连接到所述ADC转换单元,以及在ADC转换单元与处理器180之间配置相应的控制通路以形成所述环境采集通路B。示范性地,所述控制通路主要用于对ADC 转换单元的控制逻辑进行选择。于是,当需要利用声音输出元件进行外界声波信号采集时,处理器180控制打开所述环境采集通路B而关闭声音输出通路A,从而通过环境采集通路B读取由声音输出元件采集到的外界声波信号。应当理解,声音输出通路A与环境采集通路B不能同时处于选择状态,即当声音输出通路A在输出声音时,处理器180控制环境采集通路B处于关闭状态;而当声音输出通路A没有输出声音时,处理器180控制环境采集通路B处于开启状态,从而采集外界的环境声音。In this embodiment, as shown in FIG. 2, the sound output element is also electrically connected to the ADC conversion unit at the same time, and a corresponding control path is configured between the ADC conversion unit and the processor 180 to form the environment acquisition path. B. Exemplarily, the control path is mainly used to select the control logic of the ADC conversion unit. Therefore, when it is necessary to use the sound output element for external sound wave signal collection, the processor 180 controls to open the environment acquisition path B and close the sound output path A, so as to read the external sound wave collected by the sound output element through the environment acquisition path B signal. It should be understood that the sound output path A and the environment acquisition path B cannot be in the selected state at the same time, that is, when the sound output path A is outputting sound, the processor 180 controls the environment acquisition path B to be closed; and when the sound output path A is not outputting sound, At this time, the processor 180 controls the environment acquisition path B to be in an open state, thereby collecting external environment sounds.
考虑到移动终端的上层应用对所述声音输出元件采集外界声波信号的调用,可通过对所述ADC转换单元的控制逻辑进行接口封装,并通过上层应用程序对所述接口进行调用,从而可以实现所述环境采集通路B的选择。同时,还可创建一PCM capture设备并分配一设备ID以用于唯一识别该所述声音输出元件采集到的声波信号的应用场景,所述PCM capture设备为该声音输出元件创建的一个虚拟的设备文件,可用于存储该声音输出元件采集到的声波信号转换后得到的PCM数据等。其中,当需要对该PCM数据进行处理时,相应地可通过PCM read操作从该PCM capture设备中获取该PCM数据或通过PCM write操作将转换后得到的新的PCM数据写入该PCM capture设备中等等。Considering that the upper-layer application of the mobile terminal calls the sound output element to collect external sound wave signals, the control logic of the ADC conversion unit can be interface-encapsulated, and the interface can be called by the upper-layer application program, so as to achieve The selection of the environment acquisition path B. At the same time, it is also possible to create a PCM capture device and assign a device ID to uniquely identify the application scenario of the sound wave signal collected by the sound output element. The PCM capture device creates a virtual device for the sound output element. The file can be used to store the PCM data obtained by converting the acoustic signal collected by the sound output element. Among them, when the PCM data needs to be processed, the PCM data can be obtained from the PCM capture device through the PCM read operation or the new PCM data obtained by the conversion can be written into the PCM capture device through the PCM write operation. Wait.
示范性地,以移动终端中常用的ALSA音频架构为例,ALSA架构中包含了大量的音频设备的开源驱动及相应的ALSA标准接口,当对所述ADC转换单元的控制逻辑进行了ALSA标准接口的封装后,可通过调用该封装后的接口即可实现对底层的ADC转换单元及声音输出元件的访问。当然,还可以通过音频总线为ADC转换单元及声音输出元件配置一条数据通路以用于将采集并转换后的声波数据送到上层应用程序进行存储或调用等处理。本实施例中,所述音频总线可包括但不限于为I 2S总线、Slimbus 总线等。 Exemplarily, taking the ALSA audio architecture commonly used in mobile terminals as an example, the ALSA architecture contains a large number of open source drivers for audio equipment and corresponding ALSA standard interfaces. When the control logic of the ADC conversion unit is ALSA standard interface After encapsulation, access to the underlying ADC conversion unit and sound output components can be achieved by calling the encapsulated interface. Of course, it is also possible to configure a data path for the ADC conversion unit and the sound output component through the audio bus to send the collected and converted sound wave data to an upper-layer application for storage or invocation. In this embodiment, the audio bus may include, but is not limited to, an I 2 S bus, a Slimbus bus, and the like.
优选地,考虑到声音输出元件采集到的模拟电信号可能比较微弱,可对该声音输出元件采集到的模拟信号经过放大调理后再送入ADC转换单元进行转换。具体地,可在ADC转换单元与所述声音输出元件之间设置相应的放大调理电路,用于对进行放大处理后再送入ADC转换单元进行数字转换。通过将采集到的模拟信号进行放大、滤波等调理,可确保该模拟信号能够被ADC转换单元成功识别及处理,从而提高采集的准确性与可靠性。Preferably, considering that the analog electrical signal collected by the sound output element may be relatively weak, the analog signal collected by the sound output element may be amplified and conditioned and then sent to the ADC conversion unit for conversion. Specifically, a corresponding amplification and conditioning circuit may be provided between the ADC conversion unit and the sound output element, and is configured to perform digital conversion on the amplified processing and then send it to the ADC conversion unit. By amplifying, filtering, and other conditioning of the collected analog signal, it can be ensured that the analog signal can be successfully identified and processed by the ADC conversion unit, thereby improving the accuracy and reliability of the acquisition.
请参照图3,基于上述的声音输出元件的声音输出通路A和环境采集通路B,下面对基于声音输出元件的外界声波的采集方法进行详细描述。Referring to FIG. 3, the sound output path A and the environment acquisition path B based on the above-mentioned sound output element are described in detail below.
步骤S100:控制声音输出元件与声音输入元件形成一回路。Step S100: controlling the sound output element and the sound input element to form a loop.
当需要利用声音输出元件采集外界声音信号时,处理器180可控制声音输出元件与声音输入元件形成一回路,于是在形成回路后,声音输入元件主要用于接收外界的音频信号,而声音输出元件主要用于向外传送音频信号。例如,所述回路可以是通话过程中建立的通话回路,即在通话时,如麦克风等声音输入元件,可用于接收通话时的音频信号;而声音输出元件,如送话器或扬声器等,可用于通过声音输出通路A输出接收到的通话对方的音频信号。可以理解,所述回路应当不限于为上述的通话回话,也可以是如语音互动时形成的对话回话等等。When it is necessary to use the sound output element to collect external sound signals, the processor 180 may control the sound output element and the sound input element to form a loop, so after the loop is formed, the sound input element is mainly used to receive the external audio signal, and the sound output element It is mainly used for transmitting audio signals. For example, the loop may be a call loop established during a call, that is, during a call, a sound input element such as a microphone may be used to receive an audio signal during a call; and a sound output element such as a microphone or a speaker may be used The audio signal of the receiving call party is output through the sound output path A. It can be understood that the loop should not be limited to the above-mentioned call answer, but may also be, for example, a conversation answer formed during voice interaction.
步骤S110:当所述声音输出元件未处于声音输出状态时,控制所述声音输出元件切换到所述环境采集通路。Step S110: When the sound output element is not in a sound output state, control the sound output element to switch to the environment acquisition path.
当声音输出元件正在输出声音时,则其环境采集通路B将处于关闭状态,而当该声音输出元件未处于声音输出状态时,处理器180将控制声音 输出元件由声音输出通路A切换到所述环境采集通路B以用于开始采集外界声波信号。仍以上述的通话回路为例,当声音输出元件正在传送通话对方的声音时,则该声音输出元件将处于声音输出通路A;而将声音输出元件没有发出声音时,此时将切换到环境采集通路B。When the sound output element is outputting sound, its environment collection path B will be closed, and when the sound output element is not in the sound output state, the processor 180 will switch the control sound output element from the sound output path A to the The environmental acquisition path B is used to start acquiring external acoustic signals. Still using the above-mentioned call loop as an example, when the sound output element is transmitting the voice of the opposite party, the sound output element will be in the sound output path A; and when the sound output element does not emit a sound, it will switch to the environment collection at this time Path B.
步骤S120:控制所述声音输出元件采集外界环境声波信号。Step S120: controlling the sound output element to collect external environment sound wave signals.
在切换到环境采集通路B后,处理器180将控制声音输出元件开始采集外界的声波信号。具体地,处理器180将通过选择所述环境采集通路的控制通路来选择所述ADC转换单元的控制逻辑从而控制ADC转换单元接收并转换该声音输出元件采集的环境声波信号。After switching to the environment collection path B, the processor 180 will control the sound output element to start collecting sound wave signals from the outside. Specifically, the processor 180 will select the control logic of the ADC conversion unit by selecting the control path of the environment acquisition path, so as to control the ADC conversion unit to receive and convert the environmental sound wave signal collected by the sound output element.
步骤S130:获取来自所述声音输入元件接收的音频信号,并将所述音频信号和所述环境声波信号进行预设处理。Step S130: Obtain an audio signal received from the sound input element, and perform preset processing on the audio signal and the ambient sound wave signal.
声音输入元件在回路形成后将持续地接收到外界的音频信号,于是当声音输出元件采集到外界声波信号后,处理器180将会把声音输入元件采集到的音频信号与声音输出元件采集到声波信号一并进行相应的处理。The sound input element will continuously receive the external audio signal after the loop is formed. Therefore, after the sound output element collects the external sound wave signal, the processor 180 will collect the audio signal collected by the sound input element and the sound output element into the sound wave. The signals are processed accordingly.
以上述的通话应用为例,所述预设处理可以是通话消噪处理。当外界环境噪音较大时,声音输入元件采集到的音频信号主要包括通话语音信号,但通常包括有环境噪音信号,故通话质量往往容易受到较大影响,为此,有必要在通话过程中进行语音消噪处理以保证当外界环境嘈杂时仍然有较好的通话质量。具体地,声音输入元件将采集到的音频信号,而声音输出元件在切换到环境采集通路B后将采集到外界的声波信号。于是处理器180将所述音频信号与所述外界声波信号一并送入消噪处理单元进行消噪处理。Taking the above-mentioned call application as an example, the preset process may be a call noise reduction process. When the external environment is noisy, the audio signals collected by the sound input element mainly include the voice signal of the call, but usually include the environmental noise signal, so the quality of the call is often easily affected. Therefore, it is necessary to perform the call during the call. Voice denoising processing to ensure better call quality when the external environment is noisy. Specifically, the sound input element will collect the audio signal, and the sound output element will collect the external sound wave signal after switching to the environmental collection path B. The processor 180 then sends the audio signal and the external sound wave signal to a noise canceling processing unit for noise canceling processing.
优选地,在利用所述声音输出元件与声音输入元件实现语音消噪时, 所述声音输出元件应当与声音输入元件隔离或者具有一定的距离,可防止声音输入元件采集到的音频信号与声音输出元件采集到的声波信号基本相同,这样会使得信号叠加时把正常的通话语音信号也被部分抵消。Preferably, when the sound output element and the sound input element are used to implement voice denoising, the sound output element should be isolated from the sound input element or have a certain distance to prevent the audio signal and sound output collected by the sound input element The acoustic signals collected by the components are basically the same, so that the normal call voice signal will be partially cancelled when the signals are superimposed.
本实施例中,可根据双麦消噪的原理将所述通话音频信号与所述环境声波信号进行信号相减及放大,将输出一修正音频信号,通过将所述修正音频信号进行放大滤波处理后,可得到最终消噪后的音频信号,于是将所述消噪后的音频信号进行输出以达到消噪效果。In this embodiment, the call audio signal and the ambient sound wave signal can be subtracted and amplified according to the principle of double microphone denoising, a modified audio signal will be output, and the modified audio signal will be amplified and filtered. Then, the final denoised audio signal can be obtained, and then the denoised audio signal is output to achieve a denoising effect.
示范性地,如图4所示,声音输入元件采集的所述音频信号与声音输出元件采集的所述环境声波信号中均包括有两种信号,分别是通话语音信号和环境噪音信号。考虑到在通话过程中,用户主要靠近声音输入元件进行通话,故声音输入元件采集到的通话语音信号往往远大于声音输出元件采集到通话语音信号。Exemplarily, as shown in FIG. 4, both the audio signal collected by the sound input element and the ambient sound wave signal collected by the sound output element include two types of signals, which are a call voice signal and an environmental noise signal, respectively. Considering that during the call, the user is mainly close to the voice input element to make a call, the call voice signal collected by the voice input element is often much larger than the voice signal collected by the voice output element.
于是,当所述通话音频信号和所述环境声波信号被同时送入处理器180中的消噪处理模块中的差分放大器的同相端与反相端时,对于采集到的相同的背景噪音信号部分,通过两路信号的信号叠加所述背景噪音信号将被抵消,而保留的差异信号则为较清晰的修正音频信号。随后对所述修正音频信号进行放大等处理,并输出最终得到的消噪后的音频信号。其中,所述双麦消噪原理来自于“声波叠加互抵”原理,由于声音的传播是通过介质的振动来实现的,若波与波之间的波形呈反相,那么将会进行抵消。Therefore, when the call audio signal and the ambient sound wave signal are simultaneously sent to the non-inverting and anti-inverting ends of the differential amplifier in the noise canceling processing module in the processor 180, for the same background noise signal portion that is collected The signal of the two signals superimposed on the background noise signal will be cancelled, while the remaining difference signal is a clearer modified audio signal. Then, the modified audio signal is subjected to processing such as amplification, and the finally obtained denoised audio signal is output. Among them, the principle of double wheat denoising comes from the principle of “acoustic wave superposition and mutual cancellation”. Since the propagation of sound is achieved through the vibration of the medium, if the waveform between the waves is in the opposite phase, it will be cancelled.
可选地,若当同时具有声音输出通路A和环境采集通路B的所述声音输出元件为多个时,可在一个声音输出元件被占用时,调用其他声音输出元件而不用再来回切换被占用的声音输出元件的通路。本实施例中,声音输入元件则可为用于接收声音的麦克风,而所述声音输出元件可为送话器 和/或扬声器。例如,当移动终端中的送话器和扬声器均已建立有所述环境采集通路B时,若送话器与声音输入元件形成一回路时,可利用扬声器进行外界的声波信号采集。同理,若扬声器被占用,则可利用送话器进行外界声波信号的采集。Optionally, if there are multiple sound output elements having both a sound output path A and an environment collection path B, when one sound output element is occupied, other sound output elements can be called without switching back and forth between occupied ones. The path of the sound output element. In this embodiment, the sound input element may be a microphone for receiving sound, and the sound output element may be a microphone and / or a speaker. For example, when the microphone and the speaker in the mobile terminal have already established the environment collection path B, if the microphone and the sound input element form a loop, the speaker may be used for external sound signal collection. Similarly, if the speaker is occupied, the microphone can be used to collect external sound signals.
通过本实施提出的基于声音输出元件采集外界声波的方法,可实现对声音输出元件的功能复用并降低器件成本。同时,还与声音输入元件形成回路并在所述回路的基础上,进一步实现如通话消噪等应用,不仅可用已有的声音输出元件来代替额外增加的声音输入元件进行环境噪音信号的采集,还可以最大程度上解决因额外增加新的声音输入元件所带来的空间布局等问题。当然,基于所述声音输出元件的环境采集通路以及与声音输入元件的回路,还可以但不限用于如语音交互游戏等来提高抗干扰能力等其他应用。Through the method for collecting external sound waves based on the sound output element proposed in this implementation, the function of the sound output element can be reused and the cost of the device can be reduced. At the same time, it also forms a loop with the sound input element and further implements applications such as call denoising on the basis of the loop. Not only can the existing sound output element be used instead of the additional sound input element to collect environmental noise signals, It can also solve the spatial layout and other problems caused by the addition of new sound input components to the greatest extent. Of course, the environment acquisition path based on the sound output element and the circuit with the sound input element can also, but not limited to, be used in other applications such as voice interactive games to improve anti-interference ability.
实施例2Example 2
请参照图5,基于上述实施例1,本实施例提供一种基于声音输出元件采集外界声波的装置20,所述基于声音输出元件采集外界声波的装置20应用于移动终端,所述移动终端包括声音输出元件和声音输入元件,所述移动终端设有所述声音输出元件的声音输出通路,所述移动终端还设有所述环境采集通路,所述装置包括:Please refer to FIG. 5. Based on the foregoing Embodiment 1, this embodiment provides a device 20 for collecting external sound waves based on a sound output element. The device 20 for collecting external sound waves based on a sound output element is applied to a mobile terminal. The mobile terminal includes A sound output element and a sound input element, the mobile terminal is provided with a sound output path of the sound output element, the mobile terminal is further provided with the environment acquisition path, and the device includes:
回路控制模块200,用于控制所述声音输出元件与所述声音输入元件形成一回路;The loop control module 200 is configured to control the sound output element and the sound input element to form a loop;
通路切换模块210,用于当所述声音输出元件未处于声音输出状态时,使所述声音输出元件切换到所述环境采集通路;A path switching module 210, configured to switch the sound output element to the environment collection path when the sound output element is not in a sound output state;
采集控制模块220,用于当切换到所述环境采集通路时,使所述声音输出元件采集外界环境声波信号;An acquisition control module 220, configured to cause the sound output element to acquire an external environmental sound wave signal when switching to the environmental acquisition path;
信号处理模块230,用于获取来自所述声音输入元件接收的音频信号并将所述音频信号和所述环境声波信号进行预设处理。The signal processing module 230 is configured to obtain an audio signal received from the sound input element and perform preset processing on the audio signal and the ambient sound wave signal.
上述的基于声音输出元件采集外界声波的装置20对应于实施例1的基于声音输出元件采集外界声波的方法。实施例1中的任何可选项也适用于本实施例,这里不再详述。The device 20 for collecting external sound waves based on the sound output element corresponds to the method for collecting external sound waves based on the sound output element in Embodiment 1. Any option in Embodiment 1 is also applicable to this embodiment, which is not described in detail here.
本申请还提供了一种移动终端,该移动终端可以包括智能电话、平板电脑等,移动终端优选为智能电话、平板电脑。该移动终端可包括处理器、存储器、声音输入元件和声音输出元件,该移动终端设有声音输出元件的声音输出通路和环境采集通路。其中,存储器可用于存储计算机可读指令,处理器通过运行所述计算机可读指令,从而使移动终端执行上述基于声音输出元件采集外界声波的方法或者上述基于声音输出元件采集外界声波的装置中的各个模块的功能。This application also provides a mobile terminal. The mobile terminal may include a smart phone, a tablet computer, and the like. The mobile terminal is preferably a smart phone or a tablet computer. The mobile terminal may include a processor, a memory, a sound input element, and a sound output element. The mobile terminal is provided with a sound output path and an environment acquisition path of the sound output element. The memory may be used to store computer-readable instructions, and the processor runs the computer-readable instructions to cause the mobile terminal to execute the method for collecting external sound waves based on the sound output element or the device for collecting external sound waves based on the sound output element. The function of each module.
进一步地,该移动终端还包括:ADC转换单元,声音输出元件、ADC转换单元和处理器依次电性连接以建立所述环境采集通路,并在ADC转换单元与处理器之间配置所述环境采集通路的一控制通路。Further, the mobile terminal further includes: an ADC conversion unit, a sound output element, the ADC conversion unit, and a processor are electrically connected in order to establish the environment acquisition path, and the environment acquisition is configured between the ADC conversion unit and the processor. A control path for a path.
进一步地,该移动终端还包括:放大调理电路,该放大调理电路设于ADC转换单元与声音输出元件之间,用于对声音输出元件采集的环境声波信号进行放大后送入ADC转换单元。Further, the mobile terminal further includes: an amplification conditioning circuit, which is disposed between the ADC conversion unit and the sound output element, and is used to amplify the ambient sound wave signals collected by the sound output element and send the amplified sound signal to the ADC conversion unit.
其中,存储器可包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序;存储数据区可存储根据移动终端的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory may include a storage program area and a storage data area. The storage program area may store an operating system and an application program required for at least one function. The storage data area may store data (such as audio data) created according to the use of the mobile terminal. , Phone book, etc.). In addition, the memory may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage device.
本申请还提供了一种计算机非易失性可读存储介质,用于储存上述移动终端中使用的所述计算机可读指令。The present application further provides a computer non-volatile readable storage medium for storing the computer-readable instructions used in the mobile terminal.
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,也可以通过其它的方式实现。以上所描述的装置实施例仅仅是示意性的,例如,附图中的流程图和结构图显示了根据本申请的多个实施例的装置、方法和计算机可读指令产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或代码的一部分,所述模块、程序段或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowchart and structure diagrams in the accompanying drawings show a possible implementation architecture of the device, method, and computer-readable instruction product according to various embodiments of the present application. , Functions and operations. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, which contains one or more components for implementing a specified logical function Executable instructions.
也应当注意,在作为替换的实现方式中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个连续的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,结构图和/或流程图中的每个方框、以及结构图和/或流程图中的方框的组合,可以用执行规定的功能或动作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。It should also be noted that in alternative implementations, the functions labeled in the blocks may also occur in a different order than those labeled in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, can be a dedicated hardware-based system that performs a specified function or action. To achieve, or can be implemented by a combination of dedicated hardware and computer instructions.
另外,在本申请各个实施例中的各功能模块或单元可以集成在一起形成一个独立的部分,也可以是各个模块单独存在,也可以两个或更多个模块集成形成一个独立的部分。In addition, the functional modules or units in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
所述功能如果以软件功能模块的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是智能手机、个人 计算机、服务器、或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application is essentially a part that contributes to the existing technology or a part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a smart phone, a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiments of the present application. The foregoing storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes .
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。The above is only a specific implementation of this application, but the scope of protection of this application is not limited to this. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in this application. It should be covered by the protection scope of this application.

Claims (20)

  1. 一种基于声音输出元件采集外界声波的方法,其特征在于,所述方法应用于移动终端,所述移动终端包括声音输出元件和声音输入元件,所述移动终端设有所述声音输出元件的声音输出通路和环境采集通路,所述方法包括:A method for collecting external sound waves based on a sound output element, characterized in that the method is applied to a mobile terminal, the mobile terminal includes a sound output element and a sound input element, and the mobile terminal is provided with a sound of the sound output element An output path and an environmental acquisition path, the method includes:
    控制所述声音输出元件与所述声音输入元件形成一回路;Controlling the sound output element to form a loop with the sound input element;
    当所述声音输出元件未处于声音输出状态时,控制所述声音输出元件切换到所述环境采集通路;When the sound output element is not in a sound output state, controlling the sound output element to switch to the environment acquisition path;
    控制所述声音输出元件采集外界环境声波信号;Controlling the sound output element to collect external environment sound wave signals;
    获取来自所述声音输入元件接收的音频信号,并将所述音频信号和所述环境声波信号进行预设处理。Acquiring an audio signal received from the sound input element, and performing preset processing on the audio signal and the ambient sound wave signal.
  2. 根据权利要求1所述的基于声音输出元件采集外界声波的方法,其特征在于,所述移动终端包括处理器和ADC转换单元,The method for collecting external sound waves based on a sound output element according to claim 1, wherein the mobile terminal comprises a processor and an ADC conversion unit,
    所述声音输出元件、所述ADC转换单元和所述处理器依次电性连接以建立所述环境采集通路,并在所述ADC转换单元与所述处理器之间配置所述环境采集通路的一控制通路。The sound output element, the ADC conversion unit, and the processor are electrically connected in order to establish the environment acquisition path, and one of the environment acquisition paths is configured between the ADC conversion unit and the processor. Control pathway.
  3. 根据权利要求2所述的基于声音输出元件采集外界声波的方法,其特征在于,还包括:The method for collecting external sound waves based on a sound output element according to claim 2, further comprising:
    对所述声音输出元件采集到的所述环境声波信号进行放大调理后送入所述ADC转换单元。Amplify and adjust the ambient sound wave signal collected by the sound output element and send it to the ADC conversion unit.
  4. 根据权利要求1所述的基于声音输出元件采集外界声波的方法,其特征在于,所述预设处理包括:The method for collecting external sound waves based on a sound output element according to claim 1, wherein the preset processing comprises:
    对所述音频信号与所述环境声波信号进行消噪处理以得到一消噪后的 音频信号。Denoise processing is performed on the audio signal and the ambient sound wave signal to obtain a denoised audio signal.
  5. 根据权利要求4所述的基于声音输出元件采集外界声波的方法,其特征在于,所述消噪处理包括,The method for collecting external sound waves based on a sound output element according to claim 4, wherein the noise reduction processing comprises:
    将所述环境声波信号与所述音频信号同时送入差分放大器进行信号叠加以得到一修正音频信号,并将所述修正音频信号进行放大滤波处理,以得到所述消噪后的音频信号。The ambient sound wave signal and the audio signal are simultaneously sent to a differential amplifier for signal superposition to obtain a modified audio signal, and the modified audio signal is amplified and filtered to obtain the denoised audio signal.
  6. 一种基于声音输出元件采集外界声波的装置,其特征在于,所述基于声音输出元件采集外界声波的装置应用于移动终端,所述移动终端包括声音输出元件和声音输入元件,所述移动终端设有所述声音输出元件的声音输出通路和环境采集通路,所述装置包括:A device for collecting external sound waves based on a sound output element is characterized in that the device for collecting external sound waves based on a sound output element is applied to a mobile terminal, and the mobile terminal includes a sound output element and a sound input element. There is a sound output path and an environment collection path of the sound output element, and the device includes:
    回路控制模块,用于控制所述声音输出元件与所述声音输入元件形成一回路;A loop control module, configured to control the sound output element and the sound input element to form a loop;
    通路切换模块,用于当所述声音输出元件未处于声音输出状态时,使所述声音输出元件切换到所述环境采集通路;A path switching module, configured to switch the sound output element to the environment collection path when the sound output element is not in a sound output state;
    采集控制模块,用于当切换到所述环境采集通路时,使所述声音输出元件采集外界环境声波信号;An acquisition control module, configured to cause the sound output element to acquire an external environmental sound wave signal when switching to the environmental acquisition path;
    信号处理模块,用于获取来自所述声音输入元件接收的音频信号并将所述音频信号和所述环境声波信号进行预设处理。The signal processing module is configured to obtain an audio signal received from the sound input element and perform preset processing on the audio signal and the ambient sound wave signal.
  7. 根据权利要求6所述的基于声音输出元件采集外界声波的装置,其特征在于,所述移动终端包括处理器和ADC转换单元,The device for collecting external sound waves based on a sound output element according to claim 6, wherein the mobile terminal comprises a processor and an ADC conversion unit,
    所述声音输出元件、所述ADC转换单元和所述处理器依次电性连接以建立所述环境采集通路,并在所述ADC转换单元与所述处理器之间配置所述环境采集通路的一控制通路。The sound output element, the ADC conversion unit, and the processor are electrically connected in order to establish the environment acquisition path, and one of the environment acquisition paths is configured between the ADC conversion unit and the processor. Control pathway.
  8. 根据权利要求7所述的基于声音输出元件采集外界声波的装置,其 特征在于,所述装置还包括:放大调理电路,The device for collecting external sound waves based on a sound output element according to claim 7, wherein the device further comprises: an amplification conditioning circuit,
    所述放大调理电路设于所述ADC转换单元与所述声音输出元件之间,用于对所述声音输出元件采集的所述环境声波信号进行放大后送入所述ADC转换单元。The amplification conditioning circuit is provided between the ADC conversion unit and the sound output element, and is used to amplify the ambient sound wave signal collected by the sound output element and send the amplified signal to the ADC conversion unit.
  9. 根据权利要求6所述的基于声音输出元件采集外界声波的装置,其特征在于,所述信号处理模块具体用于:The device for collecting external sound waves based on a sound output element according to claim 6, wherein the signal processing module is specifically configured to:
    对所述音频信号与所述环境声波信号进行消噪处理以得到一消噪后的音频信号。Denoise processing is performed on the audio signal and the ambient sound wave signal to obtain a denoised audio signal.
  10. 根据权利要求9所述的基于声音输出元件采集外界声波的装置,其特征在于,所述信号处理模块具体用于:The device for collecting external sound waves based on a sound output element according to claim 9, wherein the signal processing module is specifically configured to:
    将所述环境声波信号与所述音频信号同时送入差分放大器进行信号叠加以得到一修正音频信号,并将所述修正音频信号进行放大滤波处理,以得到所述消噪后的音频信号。The ambient sound wave signal and the audio signal are simultaneously sent to a differential amplifier for signal superposition to obtain a modified audio signal, and the modified audio signal is amplified and filtered to obtain the denoised audio signal.
  11. 一种移动终端,其特征在于,所述移动终端包括处理器、存储器、声音输入元件和声音输出元件,所述移动终端设有所述声音输出元件的声音输出通路和环境采集通路,A mobile terminal, characterized in that the mobile terminal includes a processor, a memory, a sound input element, and a sound output element, and the mobile terminal is provided with a sound output path and an environment acquisition path of the sound output element,
    所述存储器用于存储计算机可读指令,所述处理器用于执行所述计算机可读指令时实现如下步骤:The memory is configured to store computer-readable instructions, and the processor is configured to implement the following steps when executing the computer-readable instructions:
    控制所述声音输出元件与所述声音输入元件形成一回路;Controlling the sound output element to form a loop with the sound input element;
    当所述声音输出元件未处于声音输出状态时,控制所述声音输出元件切换到所述环境采集通路;When the sound output element is not in a sound output state, controlling the sound output element to switch to the environment acquisition path;
    控制所述声音输出元件采集外界环境声波信号;Controlling the sound output element to collect external environment sound wave signals;
    获取来自所述声音输入元件接收的音频信号,并将所述音频信号和所述环境声波信号进行预设处理。Acquiring an audio signal received from the sound input element, and performing preset processing on the audio signal and the ambient sound wave signal.
  12. 根据权利要求11所述的移动终端,其特征在于,还包括:ADC转换单元,The mobile terminal according to claim 11, further comprising: an ADC conversion unit,
    所述声音输出元件、所述ADC转换单元和所述处理器依次电性连接以建立所述环境采集通路,并在所述ADC转换单元与所述处理器之间配置所述环境采集通路的一控制通路。The sound output element, the ADC conversion unit, and the processor are electrically connected in order to establish the environment acquisition path, and one of the environment acquisition paths is configured between the ADC conversion unit and the processor. Control pathway.
  13. 根据权利要求12所述的移动终端,其特征在于,还包括:放大调理电路,The mobile terminal according to claim 12, further comprising: an amplification conditioning circuit,
    所述放大调理电路设于所述ADC转换单元与所述声音输出元件之间,用于对所述声音输出元件采集的所述环境声波信号进行放大后送入所述ADC转换单元。The amplification conditioning circuit is provided between the ADC conversion unit and the sound output element, and is used to amplify the ambient sound wave signal collected by the sound output element and send the amplified signal to the ADC conversion unit.
  14. 根据权利要求11所述的移动终端,其特征在于,所述处理器执行所述计算机可读指令实现所述预设处理时,包括如下步骤:The mobile terminal according to claim 11, wherein when the processor executes the computer-readable instructions to implement the preset processing, the processor comprises the following steps:
    对所述音频信号与所述环境声波信号进行消噪处理以得到一消噪后的音频信号。Denoise processing is performed on the audio signal and the ambient sound wave signal to obtain a denoised audio signal.
  15. 根据权利要求14所述的移动终端,其特征在于,所述处理器执行所述计算机可读指令实现所述消噪处理时,包括如下步骤:The mobile terminal according to claim 14, wherein when the processor executes the computer-readable instructions to implement the noise cancellation processing, the processor comprises the following steps:
    将所述环境声波信号与所述音频信号同时送入差分放大器进行信号叠加以得到一修正音频信号,并将所述修正音频信号进行放大滤波处理,以得到所述消噪后的音频信号。The ambient sound wave signal and the audio signal are simultaneously sent to a differential amplifier for signal superposition to obtain a modified audio signal, and the modified audio signal is amplified and filtered to obtain the denoised audio signal.
  16. 一种计算机非易失性可读存储介质,其特征在于,其存储计算机可读指令,在所述计算机可读指令被执行时,实现如下步骤:A computer non-volatile readable storage medium is characterized in that it stores computer readable instructions, and when the computer readable instructions are executed, the following steps are implemented:
    控制所述声音输出元件与所述声音输入元件形成一回路;Controlling the sound output element to form a loop with the sound input element;
    当所述声音输出元件未处于声音输出状态时,控制所述声音输出元件切换到所述环境采集通路;When the sound output element is not in a sound output state, controlling the sound output element to switch to the environment acquisition path;
    控制所述声音输出元件采集外界环境声波信号;Controlling the sound output element to collect external environment sound wave signals;
    获取来自所述声音输入元件接收的音频信号,并将所述音频信号和所述环境声波信号进行预设处理。Acquiring an audio signal received from the sound input element, and performing preset processing on the audio signal and the ambient sound wave signal.
  17. 根据权利要求16所述的计算机非易失性可读存储介质,其特征在于,还包括:ADC转换单元,The computer non-volatile readable storage medium according to claim 16, further comprising: an ADC conversion unit,
    所述声音输出元件、所述ADC转换单元和所述处理器依次电性连接以建立所述环境采集通路,并在所述ADC转换单元与所述处理器之间配置所述环境采集通路的一控制通路。The sound output element, the ADC conversion unit, and the processor are electrically connected in order to establish the environment acquisition path, and one of the environment acquisition paths is configured between the ADC conversion unit and the processor. Control pathway.
  18. 根据权利要求17所述的计算机非易失性可读存储介质,其特征在于,还包括:放大调理电路,The computer non-volatile readable storage medium according to claim 17, further comprising: an amplification conditioning circuit,
    所述放大调理电路设于所述ADC转换单元与所述声音输出元件之间,用于对所述声音输出元件采集的所述环境声波信号进行放大后送入所述ADC转换单元。The amplification conditioning circuit is provided between the ADC conversion unit and the sound output element, and is used to amplify the ambient sound wave signal collected by the sound output element and send the amplified signal to the ADC conversion unit.
  19. 根据权利要求16所述的计算机非易失性可读存储介质,其特征在于,所述计算机可读指令被一个或多个处理器执行实现所述预设处理时,包括如下步骤:The computer non-volatile readable storage medium according to claim 16, wherein when the computer-readable instructions are executed by one or more processors to implement the preset processing, the method comprises the following steps:
    对所述音频信号与所述环境声波信号进行消噪处理以得到一消噪后的音频信号。Denoise processing is performed on the audio signal and the ambient sound wave signal to obtain a denoised audio signal.
  20. 根据权利要求19所述的计算机非易失性可读存储介质,其特征在于,所述计算机可读指令被一个或多个处理器执行实现所述消噪处理时,包括如下步骤:The computer non-volatile readable storage medium according to claim 19, wherein when the computer-readable instructions are executed by one or more processors to implement the noise cancellation processing, the method includes the following steps:
    将所述环境声波信号与所述音频信号同时送入差分放大器进行信号叠加以得到一修正音频信号,并将所述修正音频信号进行放大滤波处理,以得到所述消噪后的音频信号。The ambient sound wave signal and the audio signal are simultaneously sent to a differential amplifier for signal superposition to obtain a modified audio signal, and the modified audio signal is amplified and filtered to obtain the denoised audio signal.
PCT/CN2019/107101 2018-09-21 2019-09-20 Method, device and mobile terminal for collecting external sound wave based on sound output element WO2020057656A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811107396.4A CN109040378A (en) 2018-09-21 2018-09-21 Method, apparatus and mobile terminal based on sound output element acquisition external sound wave
CN201811107396.4 2018-09-21

Publications (1)

Publication Number Publication Date
WO2020057656A1 true WO2020057656A1 (en) 2020-03-26

Family

ID=64617539

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/107101 WO2020057656A1 (en) 2018-09-21 2019-09-20 Method, device and mobile terminal for collecting external sound wave based on sound output element

Country Status (2)

Country Link
CN (1) CN109040378A (en)
WO (1) WO2020057656A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109040378A (en) * 2018-09-21 2018-12-18 深圳市万普拉斯科技有限公司 Method, apparatus and mobile terminal based on sound output element acquisition external sound wave
CN112202956A (en) * 2020-10-12 2021-01-08 展讯通信(上海)有限公司 Terminal equipment and audio acquisition method thereof

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140037100A1 (en) * 2012-08-03 2014-02-06 Qsound Labs, Inc. Multi-microphone noise reduction using enhanced reference noise signal
CN103841491A (en) * 2012-11-08 2014-06-04 Dsp集团有限公司 Adaptive system for managing a plurality of microphones and speakers
CN104380698A (en) * 2014-04-10 2015-02-25 华为终端有限公司 Verbal system, and switching method and device which are applied to verbal system
CN105635378A (en) * 2015-12-28 2016-06-01 小米科技有限责任公司 Call quality adjusting method, device and mobile terminal
CN108521621A (en) * 2018-03-30 2018-09-11 广东欧珀移动通信有限公司 Signal processing method, device, terminal, earphone and readable storage medium storing program for executing
CN109040378A (en) * 2018-09-21 2018-12-18 深圳市万普拉斯科技有限公司 Method, apparatus and mobile terminal based on sound output element acquisition external sound wave

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7974422B1 (en) * 2005-08-25 2011-07-05 Tp Lab, Inc. System and method of adjusting the sound of multiple audio objects directed toward an audio output device
CN105049606B (en) * 2015-06-17 2019-02-26 惠州Tcl移动通信有限公司 A kind of mobile terminal microphone switching method and switching system
CN106937190A (en) * 2015-12-29 2017-07-07 华为终端(东莞)有限公司 Terminal, noise cancelling headphone and earphone noise-reduction method
CN106488045A (en) * 2016-12-28 2017-03-08 广东欧珀移动通信有限公司 Control method and control device
CN107071127A (en) * 2017-04-28 2017-08-18 维沃移动通信有限公司 A kind of way of recording and mobile terminal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140037100A1 (en) * 2012-08-03 2014-02-06 Qsound Labs, Inc. Multi-microphone noise reduction using enhanced reference noise signal
CN103841491A (en) * 2012-11-08 2014-06-04 Dsp集团有限公司 Adaptive system for managing a plurality of microphones and speakers
CN104380698A (en) * 2014-04-10 2015-02-25 华为终端有限公司 Verbal system, and switching method and device which are applied to verbal system
CN105635378A (en) * 2015-12-28 2016-06-01 小米科技有限责任公司 Call quality adjusting method, device and mobile terminal
CN108521621A (en) * 2018-03-30 2018-09-11 广东欧珀移动通信有限公司 Signal processing method, device, terminal, earphone and readable storage medium storing program for executing
CN109040378A (en) * 2018-09-21 2018-12-18 深圳市万普拉斯科技有限公司 Method, apparatus and mobile terminal based on sound output element acquisition external sound wave

Also Published As

Publication number Publication date
CN109040378A (en) 2018-12-18

Similar Documents

Publication Publication Date Title
US8233637B2 (en) Multi-membrane microphone for high-amplitude audio capture
US9380384B2 (en) Systems and methods for providing a wideband frequency response
US10149052B2 (en) Electronic device and vibration information generation device
CN109218882B (en) Earphone and ambient sound monitoring method thereof
CN104243732A (en) Use of vibration sensor in acoustic echo cancellation
US20080025523A1 (en) System and method for noise canceling in a mobile phone headset accessory
KR20160099640A (en) Systems and methods for feedback detection
US20170084287A1 (en) Electronic device and method of audio processing thereof
WO2020057656A1 (en) Method, device and mobile terminal for collecting external sound wave based on sound output element
KR20190097473A (en) Method and an electronic device for acquiring a noise-refined voice signal
CN112202956A (en) Terminal equipment and audio acquisition method thereof
WO2023060793A1 (en) Noise reduction method, chip, chip module, and device
WO2020237954A1 (en) Sound signal processing method, apparatus and device
KR102391525B1 (en) Method for processing audio signal and electronic device for supporting the same
US10291759B2 (en) Data return type voice input/output device for smart phone
WO2024037183A1 (en) Audio output method, electronic device and computer-readable storage medium
CN108495235A (en) A kind of separation method of supper bass, device, computer equipment and storage medium
WO2014192235A1 (en) Controller, control method, and program
KR101648042B1 (en) Earphone system for mobile phone with Active Noise Cancellation function
CN102196338A (en) Loudspeaking system and control method thereof
KR20230039715A (en) Echo canceling method by filtering means, electronic device and computer readable storage medium
WO2024021712A1 (en) Audio playback method and electronic device
US20140003612A1 (en) Information terminal and computer program product
CN114449425B (en) Micro-electromechanical microphone earphone system with noise reduction function and operation method thereof
TW202416731A (en) Computer system and processing method thereof of sound signal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19861886

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 24/06/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19861886

Country of ref document: EP

Kind code of ref document: A1